2024-09-13T18:29:52.290 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:29:52.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:29:52.407 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998 branch: wip-rishabh-testing-20240910.100730-reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} email: null first_in_suite: false job_id: '7903998' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - but it is still running - objects unfound and apparently lost - MDS_SLOW_METADATA_IO - MDS_TRIM sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - thrashosds: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:29:52.407 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:29:52.408 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:29:52.408 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:29:52.409 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:29:52.430 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:29:52.430 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:29:52.430 INFO:teuthology.packaging:ref: None 2024-09-13T18:29:52.430 INFO:teuthology.packaging:tag: None 2024-09-13T18:29:52.430 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:29:52.430 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:29:52.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:29:52.586 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:29:52.587 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:29:52.594 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:29:52.594 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:29:52.618 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:29:52.635 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:29:52.642 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:29:52.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:24:03.918904', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T18:29:52.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:24:03.917089', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T18:29:52.707 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:29:52.713 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-13T18:29:52.713 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-13T18:29:52.714 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:29:52.827 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f22f2ab3be0>, signals=[15]) 2024-09-13T18:29:52.827 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:29:52.834 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:29:52.834 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:29:52.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:29:52.935 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:29:52.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:29:53.031 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:29:53.038 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-09-13T18:29:53.045 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-09-13T18:29:53.045 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-09-13T18:29:53.093 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-09-13T18:29:53.093 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="20.04" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=focal 2024-09-13T18:29:53.094 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=focal 2024-09-13T18:29:53.095 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-09-13T18:29:53.127 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-13T18:29:53.134 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-13T18:29:53.134 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="20.04" 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:29:53.181 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:29:53.182 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:29:53.182 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=focal 2024-09-13T18:29:53.182 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=focal 2024-09-13T18:29:53.182 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-13T18:29:53.211 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:29:53.222 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:29:53.228 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:29:53.228 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:29:53.231 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:29:53.236 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:29:53.243 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:29:53.243 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:29:53.277 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:29:53.292 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:29:53.441 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:29:53.515 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:29:53.515 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T18:29:53.515 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T18:29:53.515 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:29:53.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:29:53.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T18:29:53.710 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:29:53.710 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:29:53.710 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-13T18:29:53.717 INFO:teuthology.orchestra.run.smithi032.stdout:5.4.0-124-generic 2024-09-13T18:29:53.717 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:29:53.717 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:29:53.718 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-13T18:29:53.718 DEBUG:teuthology.orchestra.run.smithi032:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T18:29:53.778 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T18:29:53.888 INFO:teuthology.orchestra.run.smithi032.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T18:29:53.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T18:29:53.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T18:29:53.945 DEBUG:teuthology.orchestra.run.smithi032:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T18:30:17.699 INFO:teuthology.orchestra.run.smithi032.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T18:30:17.700 INFO:teuthology.orchestra.run.smithi032.stderr: * [new branch] main -> origin/main 2024-09-13T18:30:17.767 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T18:30:17.768 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T18:30:17.770 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T18:30:17.771 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T18:30:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T18:30:17.776 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T18:30:17.777 INFO:teuthology.orchestra.run.smithi032.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T18:30:22.557 INFO:teuthology.orchestra.run.smithi032.stderr:Updating files: 29% (1035/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2063/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2895/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T18:30:22.558 INFO:teuthology.orchestra.run.smithi032.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T18:30:22.577 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:30:22.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:30:22.732 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:30:22.733 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T18:30:22.735 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-09-13T18:30:23.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13 18:30:24 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T18:30:23.721 INFO:teuthology.orchestra.run.smithi032.stderr:FINISHED --2024-09-13 18:30:24-- 2024-09-13T18:30:23.721 INFO:teuthology.orchestra.run.smithi032.stderr:Total wall clock time: 1.0s 2024-09-13T18:30:23.721 INFO:teuthology.orchestra.run.smithi032.stderr:Downloaded: 1 files, 43M in 0.8s (51.8 MB/s) 2024-09-13T18:30:23.725 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:30:23.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T18:30:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T18:30:25.854 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T18:30:25.859 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T18:30:26.053 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T18:30:29.875 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T18:30:30.013 INFO:teuthology.orchestra.run.smithi032.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:30:59.010 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:30:59.021 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:30:59.044 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-09-13T18:30:59.380 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:30:59.409 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:30:59.822 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:30:59.834 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:31:02.579 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-09-13T18:31:02.812 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T18:31:02.822 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T18:31:02.822 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T18:31:02.822 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:02.846 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:02.846 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:02.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T18:31:02.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T18:31:02.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T18:31:02.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T18:31:02.871 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:31:02.872 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:31:02.873 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:31:02.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:31:02.874 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:31:02.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:31:02.875 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:31:02.875 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T18:31:02.876 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:31:02.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:31:02.877 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:31:02.895 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:31:02.896 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T18:31:02.897 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:31:02.898 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:31:02.899 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:31:02.900 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:31:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:31:02.902 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:31:02.903 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:31:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:31:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:31:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:31:02.907 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:31:02.908 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T18:31:02.909 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:31:02.957 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:31:02.958 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T18:31:02.959 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T18:31:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T18:31:02.961 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T18:31:02.962 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T18:31:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:31:02.964 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:31:02.965 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:31:02.966 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:31:02.967 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T18:31:02.968 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:31:02.969 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:31:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:31:02.971 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:31:02.972 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:31:02.973 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:31:02.974 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:31:02.975 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T18:31:02.976 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:31:02.977 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:31:02.978 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:31:02.979 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:31:02.980 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T18:31:02.981 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T18:31:02.982 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T18:31:02.983 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T18:31:02.984 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:31:02.985 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:31:02.986 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T18:31:02.987 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T18:31:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:31:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T18:31:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T18:31:02.991 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:31:02.992 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:31:02.993 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:31:02.994 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:31:02.995 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T18:31:02.996 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T18:31:02.997 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T18:31:02.998 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T18:31:02.999 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:31:03.000 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:31:03.001 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:31:03.002 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:31:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:31:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T18:31:03.005 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:31:03.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:31:03.034 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T18:31:03.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:31:03.034 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:31:03.035 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:31:03.036 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:31:03.037 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T18:31:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T18:31:03.039 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T18:31:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T18:31:03.041 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T18:31:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T18:31:03.043 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:31:03.044 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T18:31:03.045 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:31:03.046 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:31:03.047 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T18:31:03.048 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:31:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:31:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T18:31:03.051 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T18:31:03.052 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T18:31:03.053 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:31:03.054 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:31:03.055 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T18:31:03.056 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T18:31:03.057 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:31:03.058 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T18:31:03.059 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:31:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T18:31:03.061 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:31:03.062 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:31:03.063 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T18:31:03.064 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T18:31:03.065 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:31:03.066 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:31:03.067 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:31:03.068 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T18:31:03.098 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:31:03.099 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:31:03.100 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T18:31:03.101 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:31:03.102 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:31:03.103 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T18:31:03.104 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T18:31:03.106 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T18:31:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T18:31:03.110 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:31:03.111 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T18:31:03.112 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:31:03.113 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T18:31:03.114 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:31:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:31:03.116 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:31:03.117 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:31:03.118 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:31:03.119 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:31:03.120 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T18:31:03.121 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T18:31:03.122 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:31:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T18:31:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:31:03.125 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:31:03.126 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:31:03.127 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T18:31:03.128 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:31:03.129 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T18:31:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T18:31:03.131 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T18:31:03.138 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T18:31:03.139 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:31:03.140 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:31:03.141 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:31:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:31:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:31:03.144 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:31:03.145 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T18:31:03.146 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T18:31:03.147 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:31:03.148 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T18:31:03.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:31:03.148 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T18:31:03.149 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:31:03.153 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T18:31:03.153 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:31:03.154 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:31:03.155 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T18:31:03.156 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T18:31:03.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T18:31:03.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T18:31:03.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:31:03.158 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:31:03.159 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:31:03.160 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:31:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:31:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T18:31:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:31:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T18:31:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:31:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:31:03.163 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T18:31:03.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:31:03.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:31:03.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:31:03.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:31:03.163 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:31:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T18:31:03.165 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:31:03.166 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T18:31:03.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:31:03.166 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T18:31:03.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:31:03.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:31:03.166 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T18:31:03.167 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T18:31:03.175 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T18:31:03.175 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:31:03.176 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:31:03.177 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:31:03.178 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:31:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:31:03.180 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:31:03.181 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:31:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T18:31:03.183 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:31:03.184 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T18:31:03.185 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:31:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:31:03.201 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:31:03.202 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:31:03.203 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:31:03.204 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:31:03.205 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:31:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:31:03.207 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:31:03.208 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:31:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:31:03.211 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:31:03.211 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:31:03.211 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:31:03.212 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:31:03.213 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:31:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:31:03.215 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:31:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:31:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:31:03.218 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:31:03.219 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:31:03.220 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T18:31:03.220 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:31:03.220 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T18:31:03.220 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:31:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:31:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T18:31:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:31:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T18:31:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:31:03.223 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:31:03.224 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T18:31:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T18:31:03.226 INFO:teuthology.orchestra.run.smithi032.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:31:03.226 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T18:31:03.226 INFO:teuthology.orchestra.run.smithi032.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T18:31:03.232 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:03.232 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:03.232 DEBUG:teuthology.orchestra.run.smithi032:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T18:31:03.276 INFO:teuthology.orchestra.run.smithi032.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:31:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:31:03.276 INFO:teuthology.orchestra.run.smithi032.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:31:03.276 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T18:31:03.277 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:03.277 DEBUG:teuthology.orchestra.run.smithi032:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T18:31:03.279 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:31:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:31:04.352 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-09-13T18:31:04.653 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:04.666 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:31:05.023 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:31:05.035 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:31:06.719 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-09-13T18:31:37.835 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T18:31:37.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:31:37.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:32:12.353 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-13T18:32:21.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:32:21.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:32:24.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-13T18:32:36.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:32:36.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:32:39.521 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-13T18:32:54.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:32:54.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:32:54.778 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-13T18:32:55.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:32:55.537 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:32:55.537 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-13T18:32:55.597 INFO:teuthology.orchestra.run.smithi032.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:32:55.597 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:32:55.597 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:32:55.598 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:32:56.599 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:56.599 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:32:56.606 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:32:56.606 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:32:56.612 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:32:56.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:32:56.639 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:32:56.659 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:32:56.659 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:32:56.669 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:32:56.698 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:32:56.734 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:32:56.734 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:32:56.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:56.740 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:32:56.745 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:32:56.810 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:32:56.827 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:32:56.856 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:32:56.904 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:32:56.907 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:32:56.914 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:32:56.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:32:56.919 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:32:56.952 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:32:56.973 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:32:56.973 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:32:57.005 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:32:57.017 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:32:57.078 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:32:57.141 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:32:57.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:32:57.228 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:32:57.235 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:32:57.243 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:32:57.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:32:57.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-09-13T18:32:57.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-13T18:32:57.400 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:32:57.408 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:32:57.408 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:32:57.776 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:32:57.845 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-09-13T18:32:57.845 DEBUG:teuthology.task.selinux:Excluding smithi086: OS 'ubuntu' does not support SELinux 2024-09-13T18:32:57.845 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:32:57.846 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T18:32:57.846 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:32:57.846 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:32:57.933 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:32:57.945 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:32:57.946 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:40:16.323 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2024-09-13T18:40:16.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:40:16.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:40:16.444 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-13T18:40:16.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-13T18:40:16.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T18:40:16.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:40:16.793 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-13T18:40:16.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-13T18:40:16.915 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:40:16.926 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:40:16.926 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:40:16.926 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:40:16.932 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:40:16.932 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:40:16.963 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:40:16.964 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Command line: ntpd -gq 2024-09-13T18:40:16.965 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: proto: precision = 0.251 usec (-22) 2024-09-13T18:40:16.965 INFO:teuthology.orchestra.run.smithi086.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:40:16.966 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:40:16.966 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:40:16.966 INFO:teuthology.orchestra.run.smithi086.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:40:16.967 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:40:16.967 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:40:16.967 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:40:16.967 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listen normally on 3 enp3s0f1 172.21.15.86:123 2024-09-13T18:40:16.968 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listen normally on 4 lo [::1]:123 2024-09-13T18:40:16.968 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d809%5]:123 2024-09-13T18:40:16.968 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:16 ntpd[14015]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:40:17.002 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:40:17.002 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Command line: ntpd -gq 2024-09-13T18:40:17.003 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: proto: precision = 0.047 usec (-24) 2024-09-13T18:40:17.003 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:40:17.004 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:40:17.004 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listen normally on 4 lo [::1]:123 2024-09-13T18:40:17.005 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2024-09-13T18:40:17.006 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:16 ntpd[13517]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:40:17.964 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:17 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:17.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:17 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:17.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:17 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:17.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:17 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:17.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:17 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:17.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:17 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:18.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:18.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:18.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:18.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:18.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:18.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:18.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:18.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:18.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:18.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:18.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:18.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:17 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:18 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:18 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:18 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:18 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:18 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:18.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:18 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:19.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:19.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:19.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:19.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:19.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:19.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:19.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:19.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:18 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:19.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:19 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:19.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:19 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:19.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:19 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:19.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:19 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:19.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:19 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:19.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:19 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:20.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:19 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:20.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:20 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:20.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:20 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:20.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:20 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:20.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:20 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:20.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:20 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:20.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:20 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:20 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:20 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:20 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:20 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:20 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:21.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:20 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:21.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:21.967 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:21.967 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:21.967 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:21.967 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:21 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:22.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:21 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:22.964 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:22 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:22.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:22 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:22.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:22 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:22.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:22 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:22.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:22 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:22.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:22 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:23.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:22 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:23.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:22 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:23.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:22 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:23.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:22 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:23.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:22 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:23.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:22 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:23.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:23.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:23.965 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:23.966 INFO:teuthology.orchestra.run.smithi086.stdout:13 Sep 18:40:23 ntpd[14015]: ntpd: time slew -0.004014 s 2024-09-13T18:40:23.967 INFO:teuthology.orchestra.run.smithi086.stdout:ntpd: time slew -0.004014s 2024-09-13T18:40:23.967 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:40:23.967 INFO:teuthology.orchestra.run.smithi086.stderr:13 Sep 18:40:23 ntpd[14015]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:40:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:24.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:40:24.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:40:24.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:40:24.004 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:40:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:13 Sep 18:40:23 ntpd[13517]: ntpd: time slew +0.000686 s 2024-09-13T18:40:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew +0.000686s 2024-09-13T18:40:24.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:40:24.005 INFO:teuthology.orchestra.run.smithi032.stderr:13 Sep 18:40:23 ntpd[13517]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:40:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:40:24.022 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-13T18:40:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.159 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:40:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-13T18:40:24.159 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.159 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.159 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.159 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:40:24.161 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:40:24.170 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:40:24.170 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:40:24.170 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:40:24.170 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:40:24.175 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:40:24.175 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:40:24.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-09-13T18:40:24.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-key list | grep Ceph 2024-09-13T18:40:24.282 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:40:24.341 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:40:24.341 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:40:24.342 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:40:24.342 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:40:24.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:40:24.406 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:40:24.507 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:40:24.507 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:40:24.548 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:40:24.548 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:40:24.549 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:40:24.549 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:40:24.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:40:24.627 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:40:24.627 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:40:24.644 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-13T18:40:24.708 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:40:24.708 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:40:24.789 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:40:24.796 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:40:24.813 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:40:24.825 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:40:24.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:40:24.830 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:40:24.846 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:40:24.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-13T18:40:24.868 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:40:24.891 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:40:24.913 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:40:24.951 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:40:25.137 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:40:25.137 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:40:25.137 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:40:25.149 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:40:25.185 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:40:25.208 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:40:25.232 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:40:25.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:40:25.299 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:40:25.462 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 28.7 kB in 1s (44.7 kB/s) 2024-09-13T18:40:26.537 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 28.7 kB in 1s (21.7 kB/s) 2024-09-13T18:40:26.603 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-13T18:40:26.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:40:26.701 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-13T18:40:26.915 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-13T18:40:26.915 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-13T18:40:27.107 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:40:27.108 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:40:27.108 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:40:27.109 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-13T18:40:27.109 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:40:27.109 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:40:27.109 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:40:27.109 INFO:teuthology.orchestra.run.smithi086.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:40:27.109 INFO:teuthology.orchestra.run.smithi086.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:40:27.111 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:40:27.111 INFO:teuthology.orchestra.run.smithi086.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:40:27.111 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:40:27.111 INFO:teuthology.orchestra.run.smithi086.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:40:27.112 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:40:27.113 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:40:27.113 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:40:27.113 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:40:27.113 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:40:27.114 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-09-13T18:40:27.115 INFO:teuthology.orchestra.run.smithi086.stdout: btrfs-tools 2024-09-13T18:40:27.235 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:40:27.236 INFO:teuthology.orchestra.run.smithi086.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:40:27.238 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-09-13T18:40:27.239 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 librbd1 2024-09-13T18:40:27.388 INFO:teuthology.orchestra.run.smithi086.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T18:40:27.389 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 200 MB of archives. 2024-09-13T18:40:27.389 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:40:27.389 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:40:27.432 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:40:27.516 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:40:27.550 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:40:27.567 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:40:27.625 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:40:27.637 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:40:27.642 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:40:27.643 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:40:27.647 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:40:27.648 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:40:27.654 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:40:27.675 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:40:27.764 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:40:27.765 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:40:27.772 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:40:27.805 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:40:27.821 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:40:27.881 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-13T18:40:27.881 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:40:27.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:40:28.057 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-13T18:40:28.077 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:40:28.086 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:40:28.112 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:40:28.120 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:40:28.121 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:40:28.126 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:40:28.127 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:40:28.141 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:40:28.142 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:40:28.159 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:40:28.229 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:40:28.246 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:40:28.247 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:40:28.274 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-13T18:40:28.274 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-13T18:40:28.306 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:40:28.306 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:40:28.306 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:40:28.307 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:40:28.310 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:40:28.310 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:40:28.312 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:40:28.322 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:40:28.397 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:40:28.406 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:40:28.407 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:40:28.408 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:40:28.409 INFO:teuthology.orchestra.run.smithi086.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:40:28.411 INFO:teuthology.orchestra.run.smithi086.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:40:28.413 INFO:teuthology.orchestra.run.smithi086.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:40:28.413 INFO:teuthology.orchestra.run.smithi086.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:40:28.415 INFO:teuthology.orchestra.run.smithi086.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:40:28.457 INFO:teuthology.orchestra.run.smithi086.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:40:28.459 INFO:teuthology.orchestra.run.smithi086.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:40:28.461 INFO:teuthology.orchestra.run.smithi086.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:40:28.476 INFO:teuthology.orchestra.run.smithi086.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:40:28.477 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:40:28.479 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:40:28.479 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:40:28.479 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-13T18:40:28.479 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:40:28.479 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:40:28.480 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:40:28.480 INFO:teuthology.orchestra.run.smithi032.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:40:28.480 INFO:teuthology.orchestra.run.smithi032.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:40:28.481 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:40:28.482 INFO:teuthology.orchestra.run.smithi032.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:40:28.483 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-13T18:40:28.483 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:40:28.483 INFO:teuthology.orchestra.run.smithi032.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:40:28.483 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:40:28.483 INFO:teuthology.orchestra.run.smithi032.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:40:28.483 INFO:teuthology.orchestra.run.smithi032.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:40:28.484 INFO:teuthology.orchestra.run.smithi032.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:40:28.484 INFO:teuthology.orchestra.run.smithi032.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:40:28.484 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:40:28.484 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:40:28.484 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-13T18:40:28.484 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-09-13T18:40:28.485 INFO:teuthology.orchestra.run.smithi086.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:40:28.539 INFO:teuthology.orchestra.run.smithi086.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:40:28.542 INFO:teuthology.orchestra.run.smithi086.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:40:28.543 INFO:teuthology.orchestra.run.smithi086.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:40:28.544 INFO:teuthology.orchestra.run.smithi086.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:40:28.545 INFO:teuthology.orchestra.run.smithi086.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:40:28.547 INFO:teuthology.orchestra.run.smithi086.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:40:28.547 INFO:teuthology.orchestra.run.smithi086.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:40:28.549 INFO:teuthology.orchestra.run.smithi086.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:40:28.557 INFO:teuthology.orchestra.run.smithi086.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:40:28.568 INFO:teuthology.orchestra.run.smithi086.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:40:28.648 INFO:teuthology.orchestra.run.smithi086.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:40:28.651 INFO:teuthology.orchestra.run.smithi086.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:40:28.653 INFO:teuthology.orchestra.run.smithi086.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:40:28.655 INFO:teuthology.orchestra.run.smithi086.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:40:28.656 INFO:teuthology.orchestra.run.smithi086.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:40:28.657 INFO:teuthology.orchestra.run.smithi086.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:40:28.709 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:40:28.710 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:40:28.710 INFO:teuthology.orchestra.run.smithi032.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:40:28.710 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:40:28.710 INFO:teuthology.orchestra.run.smithi032.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:40:28.710 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:40:28.711 INFO:teuthology.orchestra.run.smithi032.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:40:28.712 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-09-13T18:40:28.712 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 librbd1 2024-09-13T18:40:28.804 INFO:teuthology.orchestra.run.smithi032.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T18:40:28.804 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 200 MB of archives. 2024-09-13T18:40:28.804 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:40:28.804 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:40:28.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:40:28.831 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:40:28.857 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:40:28.886 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:40:28.890 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:40:28.903 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:40:28.946 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:40:28.949 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:40:28.957 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:40:28.960 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:40:28.960 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:40:28.961 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:40:28.962 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:40:28.965 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:40:28.966 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:40:28.968 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:40:28.981 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:40:28.982 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:40:28.983 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:40:28.986 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:40:28.987 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:40:28.989 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:40:28.992 INFO:teuthology.orchestra.run.smithi086.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:40:28.999 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:40:28.999 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:40:29.004 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:40:29.007 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:40:29.015 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:40:29.018 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:40:29.019 INFO:teuthology.orchestra.run.smithi086.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:40:29.019 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:40:29.019 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:40:29.020 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:40:29.020 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:40:29.021 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:40:29.032 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:40:29.033 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:40:29.037 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:40:29.041 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:40:29.050 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:40:29.053 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:40:29.054 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:40:29.056 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:40:29.058 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:40:29.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:40:29.068 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:40:29.069 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:40:29.072 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:40:29.073 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:40:29.085 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:40:29.086 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:40:29.088 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:40:29.089 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:40:29.090 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:40:29.091 INFO:teuthology.orchestra.run.smithi086.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:40:29.092 INFO:teuthology.orchestra.run.smithi086.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:40:29.093 INFO:teuthology.orchestra.run.smithi086.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:40:29.106 INFO:teuthology.orchestra.run.smithi086.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:40:29.109 INFO:teuthology.orchestra.run.smithi086.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:40:29.109 INFO:teuthology.orchestra.run.smithi086.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:40:29.110 INFO:teuthology.orchestra.run.smithi086.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:40:29.110 INFO:teuthology.orchestra.run.smithi086.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:40:29.166 INFO:teuthology.orchestra.run.smithi086.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:40:29.166 INFO:teuthology.orchestra.run.smithi086.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:40:29.166 INFO:teuthology.orchestra.run.smithi086.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:40:29.167 INFO:teuthology.orchestra.run.smithi086.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:40:29.169 INFO:teuthology.orchestra.run.smithi086.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:40:29.169 INFO:teuthology.orchestra.run.smithi086.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:40:29.171 INFO:teuthology.orchestra.run.smithi086.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:40:29.179 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:40:29.198 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:40:29.199 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:40:29.213 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:40:29.214 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:40:29.214 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:40:29.215 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:40:29.215 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:40:29.216 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:40:29.217 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:40:29.218 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:40:29.232 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:40:29.233 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:40:29.237 INFO:teuthology.orchestra.run.smithi086.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:40:29.238 INFO:teuthology.orchestra.run.smithi086.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:40:29.240 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:40:29.242 INFO:teuthology.orchestra.run.smithi086.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:40:29.244 INFO:teuthology.orchestra.run.smithi086.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:40:29.249 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:40:29.249 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:40:29.250 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:40:29.250 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:40:29.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:40:29.257 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:40:29.258 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:40:29.277 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:40:29.280 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:40:29.283 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:40:29.290 INFO:teuthology.orchestra.run.smithi086.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:40:29.318 INFO:teuthology.orchestra.run.smithi086.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:40:29.320 INFO:teuthology.orchestra.run.smithi086.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:40:29.325 INFO:teuthology.orchestra.run.smithi086.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:40:29.328 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:40:29.329 INFO:teuthology.orchestra.run.smithi086.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:40:29.329 INFO:teuthology.orchestra.run.smithi086.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:40:29.330 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:40:29.331 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:40:29.331 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:40:29.344 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:40:29.345 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:40:29.346 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:40:29.346 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:40:29.347 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:40:29.402 INFO:teuthology.orchestra.run.smithi086.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:40:29.406 INFO:teuthology.orchestra.run.smithi086.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:40:29.410 INFO:teuthology.orchestra.run.smithi086.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:40:29.468 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:40:29.473 INFO:teuthology.orchestra.run.smithi086.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:40:29.473 INFO:teuthology.orchestra.run.smithi086.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:40:29.474 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:40:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:40:29.489 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:40:29.493 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:40:29.494 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:40:29.516 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:40:29.575 INFO:teuthology.orchestra.run.smithi086.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:40:29.576 INFO:teuthology.orchestra.run.smithi086.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:40:29.576 INFO:teuthology.orchestra.run.smithi086.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:40:29.578 INFO:teuthology.orchestra.run.smithi086.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:40:29.590 INFO:teuthology.orchestra.run.smithi086.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:40:29.591 INFO:teuthology.orchestra.run.smithi086.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:40:29.592 INFO:teuthology.orchestra.run.smithi086.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:40:29.592 INFO:teuthology.orchestra.run.smithi086.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:40:29.593 INFO:teuthology.orchestra.run.smithi086.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:40:29.881 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:40:29.883 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:40:29.889 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:40:30.771 INFO:teuthology.orchestra.run.smithi086.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:40:30.773 INFO:teuthology.orchestra.run.smithi086.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:40:30.778 INFO:teuthology.orchestra.run.smithi086.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:40:30.841 INFO:teuthology.orchestra.run.smithi086.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:40:30.842 INFO:teuthology.orchestra.run.smithi086.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:40:30.843 INFO:teuthology.orchestra.run.smithi086.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:40:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:40:31.105 INFO:teuthology.orchestra.run.smithi086.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:40:31.181 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:40:31.184 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:40:31.186 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:40:31.209 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:40:31.321 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:40:31.730 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:40:31.731 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:40:31.739 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:40:31.773 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:40:31.776 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:40:31.778 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:40:31.843 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 200 MB in 4s (50.5 MB/s) 2024-09-13T18:40:31.896 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:40:32.022 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:40:32.026 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:40:32.026 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:40:32.068 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 105330 files and directories currently installed.) 2024-09-13T18:40:32.071 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:40:32.121 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:40:32.440 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:40:32.455 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:40:32.498 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:40:32.767 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:40:32.781 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:40:32.813 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:40:32.814 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:40:32.817 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:40:32.817 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:40:32.818 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:40:32.818 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:40:32.842 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:40:33.030 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:40:33.153 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:40:33.167 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:40:33.279 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:40:33.615 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:40:33.630 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:40:33.707 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:40:33.997 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 200 MB in 4s (46.3 MB/s) 2024-09-13T18:40:34.043 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:40:34.056 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:40:34.110 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:40:34.205 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:40:34.275 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T18:40:34.278 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:40:34.317 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:40:34.628 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:40:34.647 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:40:34.703 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:40:34.813 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:40:34.827 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:40:34.882 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:40:35.006 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:40:35.026 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:40:35.064 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:40:35.385 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:40:35.396 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:40:35.417 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:40:35.439 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:40:35.458 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:40:35.525 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:40:35.794 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:40:35.808 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:40:35.861 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:40:35.921 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:40:35.939 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:40:35.979 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:40:36.281 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:40:36.293 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:40:36.330 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:40:36.332 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:40:36.350 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:40:36.390 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:40:36.730 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:36.868 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:40:36.975 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:40:36.976 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:40:36.998 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:40:37.519 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:37.522 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:40:37.540 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:40:37.580 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:40:37.646 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:40:37.975 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:40:37.995 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:40:38.033 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:40:38.409 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:40:38.425 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:38.467 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:38.496 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:40:38.515 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:40:38.561 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:40:38.819 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:40:38.833 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:38.877 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:38.942 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:39.098 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:40:39.260 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:40:39.273 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:40:39.309 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:39.562 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:40:39.578 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:39.645 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:39.820 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:39.943 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:40:39.948 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:40:39.961 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:40:39.990 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:40.310 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:40:40.324 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:40:40.368 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:40:40.637 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:40:40.653 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:40.695 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:40.748 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:40:40.767 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:40.805 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:41.073 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:40:41.085 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:40:41.122 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:40:41.158 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:40:41.177 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:41.224 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:41.484 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:40:41.497 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:40:41.525 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:40:41.610 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:40:41.624 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:40:41.668 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:41.870 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:40:41.884 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:40:41.929 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:40:41.988 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:40:42.010 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:42.054 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:42.290 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:40:42.304 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:42.348 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:42.441 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:40:42.459 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:40:42.499 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:42.885 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:40:42.904 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:40:42.943 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:40:43.221 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:40:43.238 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:43.246 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:40:43.262 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:43.304 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:43.657 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:40:43.670 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:40:43.692 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:40:43.706 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:40:43.711 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:40:43.768 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:40:44.025 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:40:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:44.083 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:44.480 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:40:44.498 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:40:44.547 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:40:44.562 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:40:44.605 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:44.914 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:40:44.934 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:40:44.964 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:40:45.400 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:40:45.419 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:45.458 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:40:46.413 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:46.452 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:46.847 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:40:46.867 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:40:46.905 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:40:47.068 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:40:47.084 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:47.137 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:47.191 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:40:47.211 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:47.241 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:47.719 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:40:47.738 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:47.777 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:48.457 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:40:48.473 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:40:48.507 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:40:48.877 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:40:48.890 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:40:48.927 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:40:49.246 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:40:49.262 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:40:49.305 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:40:49.641 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:40:49.691 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:40:50.019 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:40:50.033 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:40:50.077 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:40:50.366 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:50.430 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:40:50.444 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:40:50.445 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:50.488 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:40:50.808 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:40:50.821 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:40:50.857 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:40:51.185 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:40:51.200 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:40:51.243 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:40:51.597 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:40:51.609 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:40:51.646 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:40:51.800 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:40:51.818 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:40:51.858 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:40:51.949 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:40:51.964 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:40:52.033 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:40:52.236 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:40:52.255 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:40:52.294 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:40:52.407 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:40:52.423 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:40:52.472 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:40:52.639 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:40:52.697 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:40:52.774 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:40:52.790 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:40:52.848 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:40:53.075 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:40:53.097 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:40:53.135 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:40:53.141 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:40:53.150 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:40:53.193 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:40:53.511 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:40:53.521 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:40:53.531 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:40:53.535 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:40:53.569 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:40:53.579 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:40:53.924 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:40:53.936 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:40:53.956 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:40:53.973 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:40:53.975 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:40:54.014 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:40:54.327 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:40:54.340 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:40:54.385 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:40:54.392 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:40:54.412 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:40:54.450 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:40:54.721 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:40:54.736 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:40:54.771 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:40:54.779 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:40:54.789 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:40:54.829 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:40:55.192 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:40:55.209 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:40:55.234 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:40:55.247 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:40:55.250 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:40:55.292 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:40:55.604 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:40:55.619 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:40:55.653 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:40:55.662 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:55.672 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:40:55.711 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:40:56.059 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:40:56.074 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:56.117 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:56.130 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:40:56.148 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:40:56.195 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:40:56.478 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:40:56.492 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:40:56.536 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:40:56.583 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:40:56.602 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:40:56.649 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:40:56.856 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:40:56.869 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:40:56.905 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:40:56.994 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:40:57.011 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:40:57.052 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:40:57.301 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:40:57.316 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:40:57.359 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:40:57.422 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:40:57.480 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:40:57.704 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:40:57.719 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:57.762 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:57.850 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:40:57.867 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:40:57.908 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:40:58.270 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:40:58.274 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:40:58.288 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:40:58.288 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:58.327 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:40:58.355 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:40:58.655 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:40:58.738 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:40:59.152 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:40:59.170 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:40:59.209 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:40:59.392 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:40:59.435 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:00.405 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:41:00.423 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:00.462 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:00.926 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:41:00.939 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:00.984 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:01.337 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:41:01.355 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:41:01.394 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:41:01.756 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:41:01.774 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:41:01.806 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph. 2024-09-13T18:41:01.813 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:41:01.822 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:01.897 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:02.151 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:41:02.166 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:02.200 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:02.260 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:41:02.279 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:41:02.317 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:41:02.645 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:41:02.660 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:02.721 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:41:02.737 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:02.740 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:02.779 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:03.282 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:41:03.296 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:03.333 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:41:03.340 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:03.352 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:03.391 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:03.663 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:41:03.679 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:41:03.721 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:41:04.091 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:41:04.104 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:41:04.149 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:41:04.361 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:41:04.379 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:04.419 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:04.502 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:04.560 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:04.955 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:41:04.969 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:41:05.013 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:41:05.350 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:41:05.364 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:41:05.408 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:41:05.778 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:41:05.792 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:41:05.836 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:41:06.234 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:41:06.250 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:41:06.589 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:41:06.597 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-09-13T18:41:06.614 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:06.655 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:41:06.960 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:41:07.004 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:41:07.041 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:41:07.063 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:07.107 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:07.341 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:41:07.354 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:41:07.391 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:41:07.569 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:41:07.588 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:07.627 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:07.728 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:41:07.743 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:41:07.786 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:41:08.157 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:41:08.173 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:41:08.205 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:41:08.223 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:08.224 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:41:08.262 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:08.485 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:41:08.501 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:41:08.542 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:41:08.647 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:41:08.670 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:41:08.715 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:41:08.837 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:41:08.853 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:41:08.896 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:41:09.094 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:41:09.112 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:41:09.151 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:41:09.256 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:41:09.271 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:41:09.314 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:41:09.471 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:41:09.493 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:09.537 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:09.654 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:41:09.668 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:09.775 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:09.941 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:41:09.959 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:41:09.999 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:41:10.377 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:41:10.390 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:41:10.435 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:41:10.854 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:41:10.878 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:41:10.920 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:41:11.214 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:41:11.228 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:41:11.272 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:41:11.273 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:41:11.292 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:41:11.331 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:41:11.600 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:41:11.615 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:41:11.658 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:41:11.702 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:41:11.720 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:41:11.759 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:41:12.002 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:41:12.016 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:41:12.060 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:41:12.130 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:41:12.148 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:41:12.196 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:41:12.557 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:41:12.576 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:41:12.615 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:41:13.027 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:41:13.047 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:41:13.088 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:41:13.365 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:41:13.371 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:41:13.380 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:41:13.394 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:41:13.414 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:41:13.437 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:41:13.774 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:41:13.794 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:41:13.832 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:41:13.935 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:41:13.950 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:41:13.984 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:41:14.209 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:41:14.228 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:41:14.267 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:41:14.408 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:41:14.421 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:41:14.466 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:41:14.662 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:41:14.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:14.720 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:15.233 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:41:15.249 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:15.292 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:16.371 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:41:16.394 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:41:16.436 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:41:16.521 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:41:16.538 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:41:16.579 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:41:16.798 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:41:16.816 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:41:16.864 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:41:17.001 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:41:17.014 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:41:17.051 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:41:17.225 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:41:17.244 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:41:17.291 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:41:17.396 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:41:17.412 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:41:17.454 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:41:17.791 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:41:17.807 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:41:17.849 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:41:18.136 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:41:18.149 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:41:18.211 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:41:18.489 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:41:18.506 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:41:18.539 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:41:18.734 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:41:18.752 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:41:18.792 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:41:18.859 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:41:18.875 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:41:18.917 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:41:19.262 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:41:19.276 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:41:19.320 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:41:19.412 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:41:19.428 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:41:19.465 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:41:19.665 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:41:19.680 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:41:19.723 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:41:19.877 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:41:19.896 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:41:19.934 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:41:20.051 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:41:20.067 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:41:20.109 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:41:20.656 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:41:20.669 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:20.722 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:20.755 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:41:20.775 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:20.813 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:21.033 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:41:21.050 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:41:21.083 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:41:21.470 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:41:21.484 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:41:21.527 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:41:21.830 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package jq. 2024-09-13T18:41:21.845 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:41:21.888 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:41:22.158 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package socat. 2024-09-13T18:41:22.174 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:41:22.216 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:41:22.250 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:41:22.270 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:41:22.307 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:41:22.519 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:41:22.535 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:41:22.569 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:41:22.763 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:41:22.782 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:41:22.820 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:41:22.951 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:41:22.967 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:23.008 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:23.216 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:41:23.236 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:41:23.282 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:41:23.678 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:41:23.696 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:41:23.735 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:41:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:41:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:41:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:41:24.525 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:41:24.543 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:41:24.591 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:41:24.954 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:41:24.975 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:41:25.019 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:41:25.425 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:41:25.444 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:41:25.484 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:41:25.854 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:41:25.872 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:41:25.911 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:41:26.323 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:41:26.337 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:41:26.381 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:41:27.047 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:41:27.061 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:27.105 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:27.146 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:41:27.162 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:27.204 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:27.466 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:41:27.480 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:41:27.533 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:41:27.633 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:41:27.648 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:27.724 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:27.963 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:41:27.983 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:41:28.143 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:41:28.316 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-09-13T18:41:28.337 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:41:28.382 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:41:28.405 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:41:28.418 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:28.693 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-09-13T18:41:28.707 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:41:28.751 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:41:28.756 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:41:28.771 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:28.814 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:29.084 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:41:29.097 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:41:29.130 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:41:29.134 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:29.148 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:41:29.187 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:41:29.631 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:41:29.642 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:41:29.645 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:29.660 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:29.689 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:29.699 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:30.118 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:41:30.132 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:41:30.193 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:41:30.538 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:41:30.552 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:41:30.596 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:41:30.991 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:41:31.007 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:41:31.049 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:32.901 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:41:32.918 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:41:32.959 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:41:33.287 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:41:33.301 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:41:33.337 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:41:33.615 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:41:33.629 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:41:33.664 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:41:33.746 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:41:33.764 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:33.803 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:34.001 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:41:34.014 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:41:34.258 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:41:34.276 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:34.315 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:34.537 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:41:34.553 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:41:34.595 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:41:34.702 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:41:34.723 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:41:34.768 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:41:34.949 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:41:34.962 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:41:35.015 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:41:35.088 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:41:35.109 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:35.170 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:35.385 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:41:35.402 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:41:35.442 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:41:35.465 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:41:35.486 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:41:35.531 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:35.787 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:41:35.801 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:41:35.845 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:41:35.859 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:41:35.882 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:41:35.925 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:36.148 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:41:36.162 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:41:36.206 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:41:36.546 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:41:36.563 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:36.603 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:36.910 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:41:36.925 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:37.010 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:37.090 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:41:37.109 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:41:37.181 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:41:37.586 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:41:37.607 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:41:37.652 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:41:38.105 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:41:38.128 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:41:38.171 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:38.446 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:41:38.463 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:38.504 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:38.831 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:41:39.117 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:41:39.235 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:41:39.361 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:41:39.587 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:40.155 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user cephadm....done 2024-09-13T18:41:40.343 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:40.361 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:41:40.384 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:41:40.426 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:41:40.469 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:41:40.788 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:41:40.809 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:41:40.820 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:41:40.879 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:41:41.113 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:41.256 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:41:41.257 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:41:41.279 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:41:41.323 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:41:41.356 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:41:41.658 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:41:41.677 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:41:41.699 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:41:41.743 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:41:42.084 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:41:42.255 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:41:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:41:42.345 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:41:42.369 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:41:42.662 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:41:42.708 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:41:42.729 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:41:42.774 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:41:42.955 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:41:43.160 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:41:43.175 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:41:43.217 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:41:43.239 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:41:43.532 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:43.596 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:41:43.615 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:41:43.653 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:41:43.816 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:41:43.934 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:41:43.973 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:41:43.992 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:41:44.031 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:41:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:41:44.743 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:41:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:44.809 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:44.820 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:41:44.946 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:41:45.339 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:41:45.958 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:41:46.221 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:41:46.239 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:41:46.278 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:46.326 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:41:46.619 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:41:46.636 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:41:46.970 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:41:47.025 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:41:47.159 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:41:47.271 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:41:47.318 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:41:47.545 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:47.563 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:41:47.689 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:41:47.815 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:41:48.100 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:41:48.216 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-09-13T18:41:48.442 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:48.493 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:41:48.568 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:41:48.819 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:41:49.003 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:41:49.196 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:41:49.404 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:41:49.581 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:41:49.665 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:41:49.740 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:50.074 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:41:50.091 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:41:50.226 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:41:50.576 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:41:50.585 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:41:50.711 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:41:50.837 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:41:50.928 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:41:51.155 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:41:51.465 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:41:51.591 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:41:51.629 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:41:51.742 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:41:52.005 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:41:52.060 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:41:52.356 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:41:52.378 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:41:52.654 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:41:52.741 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:41:52.780 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:41:53.073 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:41:53.100 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:41:53.251 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:41:53.365 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:41:53.593 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:41:53.683 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:41:53.952 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:41:54.069 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:41:54.337 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:41:54.356 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:41:54.463 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:41:54.479 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:41:54.805 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:41:54.931 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:41:55.156 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:41:55.282 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:41:55.299 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:41:55.408 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:41:55.683 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:41:55.776 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:41:56.060 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:41:56.101 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:41:56.435 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:41:56.878 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:41:57.245 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:41:57.507 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:41:57.622 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:41:57.666 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:41:57.748 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:41:57.874 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:41:58.076 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:41:58.250 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:41:58.386 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:41:58.712 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:41:58.751 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:41:58.838 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:41:59.119 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:41:59.206 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:41:59.566 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:41:59.603 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:41:59.959 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:42:00.055 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:42:00.181 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:00.285 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:42:00.640 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:00.783 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:42:01.243 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:42:01.315 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:42:01.402 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:42:01.475 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:42:01.528 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:42:01.601 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:42:01.727 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:42:01.896 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:42:02.036 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:42:02.162 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:42:02.307 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:02.433 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:42:02.505 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:42:02.593 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:42:02.806 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:42:03.011 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:42:03.182 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:42:03.387 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:42:03.570 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:03.738 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:42:03.787 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:42:03.864 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:42:03.913 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:04.072 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:04.198 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:04.215 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:42:04.324 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:42:04.583 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:42:04.659 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:04.787 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:42:04.984 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:42:05.114 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:05.240 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:05.356 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:42:05.390 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:05.616 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:42:05.617 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:42:05.703 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:42:05.854 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:42:06.109 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:06.240 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:42:06.243 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:06.369 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:06.495 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:42:06.690 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:42:06.816 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:42:06.976 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:42:07.427 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:42:07.448 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:07.574 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:07.700 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:07.778 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:42:07.826 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:07.977 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:08.103 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:08.681 INFO:teuthology.orchestra.run.smithi086.stdout:Adding group ceph....done 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user ceph....done 2024-09-13T18:42:09.250 INFO:teuthology.orchestra.run.smithi086.stdout:Setting system user ceph properties....done 2024-09-13T18:42:09.273 INFO:teuthology.orchestra.run.smithi086.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:42:09.431 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:42:09.634 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:42:09.753 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:42:09.759 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:42:10.213 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:10.236 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:42:10.429 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:42:10.429 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:42:10.662 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:42:10.872 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:10.998 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:11.055 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:11.172 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:42:11.466 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:42:11.466 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:42:11.640 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:42:11.908 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:12.050 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:42:12.337 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:42:12.518 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:42:12.802 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:12.936 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:42:13.037 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:42:13.037 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:42:13.484 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:13.693 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:42:13.693 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:42:14.147 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:14.217 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:42:14.342 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:42:14.468 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:42:14.619 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:42:14.675 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:42:14.675 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:42:14.996 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:42:15.115 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:15.163 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:42:15.241 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:15.384 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:15.531 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:42:15.645 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:42:15.645 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:42:15.932 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:42:16.110 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:16.253 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:16.342 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:42:16.412 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:16.555 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:16.933 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:42:17.084 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:42:17.174 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:17.419 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:42:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:42:17.553 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:17.679 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:17.830 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:17.947 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:42:18.307 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:18.450 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:42:18.818 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:18.961 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:19.089 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:19.355 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:42:19.356 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:42:20.161 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:20.481 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:42:20.482 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:20.482 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:20.558 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:42:20.983 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:42:20.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:42:21.057 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-13T18:42:21.276 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-13T18:42:21.277 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-13T18:42:21.494 INFO:teuthology.orchestra.run.smithi086.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:42:21.495 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:42:21.496 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-13T18:42:21.496 INFO:teuthology.orchestra.run.smithi086.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:42:21.496 INFO:teuthology.orchestra.run.smithi086.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:42:21.497 INFO:teuthology.orchestra.run.smithi086.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:42:21.497 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:42:21.497 INFO:teuthology.orchestra.run.smithi086.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:42:21.498 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-13T18:42:21.498 INFO:teuthology.orchestra.run.smithi086.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:42:21.498 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:42:21.498 INFO:teuthology.orchestra.run.smithi086.stdout: libengine-pkcs11-openssl 2024-09-13T18:42:21.557 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-13T18:42:21.558 INFO:teuthology.orchestra.run.smithi086.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:42:21.558 INFO:teuthology.orchestra.run.smithi086.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:42:21.559 INFO:teuthology.orchestra.run.smithi086.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:42:21.559 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:42:21.559 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:42:21.559 INFO:teuthology.orchestra.run.smithi086.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:42:21.559 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-09-13T18:42:21.560 INFO:teuthology.orchestra.run.smithi086.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:42:21.737 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:21.744 INFO:teuthology.orchestra.run.smithi086.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T18:42:21.744 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:42:21.744 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:42:21.744 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:42:21.863 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:21.997 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:22.123 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:22.282 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:22.359 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:42:22.365 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:42:22.365 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:42:22.375 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:42:22.377 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:42:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:22.474 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:42:22.477 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:42:22.484 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:42:22.488 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:42:22.489 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:42:22.522 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:42:22.523 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:42:22.527 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:42:22.528 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:42:22.603 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:42:22.604 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:42:22.613 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:42:22.616 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:42:22.632 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:42:22.633 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:42:22.685 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:42:22.685 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:42:22.707 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:42:22.737 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:42:22.795 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:42:22.803 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:42:22.803 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:42:22.804 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:42:22.805 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:42:22.831 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:42:22.849 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:42:23.006 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-09-13T18:42:23.272 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:42:23.272 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:42:23.272 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:42:23.272 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:42:23.273 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:42:23.472 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-09-13T18:42:23.679 INFO:teuthology.orchestra.run.smithi086.stdout:Preconfiguring packages ... 2024-09-13T18:42:23.684 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-09-13T18:42:23.720 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:42:23.852 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 25.4 MB in 2s (14.9 MB/s) 2024-09-13T18:42:23.939 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:42:24.130 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 116709 files and directories currently installed.) 2024-09-13T18:42:24.799 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:42:24.800 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:42:24.800 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:42:25.376 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:25.447 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:42:25.666 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:42:25.666 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:42:26.527 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:26.653 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:26.855 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 116709 files and directories currently installed.) 2024-09-13T18:42:26.858 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:42:27.012 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:42:27.400 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:42:27.400 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:42:27.418 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:42:27.593 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:42:27.956 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:42:28.288 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:28.408 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 116709 files and directories currently installed.) 2024-09-13T18:42:28.411 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:42:28.542 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:42:28.821 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:42:29.246 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:42:29.373 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:42:29.682 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:42:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:42:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:42:30.052 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:42:30.565 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:42:30.578 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:42:30.623 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:42:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:31.001 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package dump. 2024-09-13T18:42:31.014 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:42:31.146 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:42:31.146 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:42:31.388 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package indent. 2024-09-13T18:42:31.402 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:42:31.446 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:42:31.782 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:42:31.799 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:42:31.840 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:42:32.001 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:32.218 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:42:32.233 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:42:32.276 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:42:32.579 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:42:32.593 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:42:32.637 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:42:32.824 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:42:32.825 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:42:33.016 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:42:33.029 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:33.073 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:42:33.376 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:42:33.390 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:33.434 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:42:33.686 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:33.779 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:42:33.795 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:33.812 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:33.837 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:42:34.197 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:34.341 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:42:34.357 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:42:34.399 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:42:34.470 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:42:34.470 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:42:34.744 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:42:34.760 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:42:34.802 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:42:35.222 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:42:35.237 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:42:35.280 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:35.298 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:35.449 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:35.575 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:35.674 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:42:35.689 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:35.726 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:35.732 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:42:36.085 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:42:36.102 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:36.143 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:42:36.229 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:42:36.415 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:42:36.489 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:42:36.501 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:42:36.546 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:42:36.907 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:42:37.074 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:42:37.089 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:42:37.132 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:42:37.544 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:42:37.558 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:37.637 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:42:38.283 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:42:38.297 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:42:38.341 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:42:38.954 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:42:38.969 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:42:39.035 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:42:39.945 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ppp. 2024-09-13T18:42:39.962 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:42:40.235 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:42:40.600 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:42:40.614 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:42:40.658 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:42:41.036 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:42:41.052 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:42:41.112 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:42:41.473 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:42:41.490 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:42:41.539 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:42:41.877 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:42:41.892 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:42:41.934 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:42.043 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:42:42.589 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:42:42.603 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:42:42.671 INFO:teuthology.orchestra.run.smithi086.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:42:42.699 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:42:42.843 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:42:42.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:42:42.986 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-13T18:42:43.204 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-13T18:42:43.290 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:43.451 INFO:teuthology.orchestra.run.smithi032.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:42:43.451 INFO:teuthology.orchestra.run.smithi032.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:42:43.451 INFO:teuthology.orchestra.run.smithi032.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:42:43.451 INFO:teuthology.orchestra.run.smithi032.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:42:43.451 INFO:teuthology.orchestra.run.smithi032.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:42:43.451 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:42:43.452 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:42:43.452 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:42:43.452 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-13T18:42:43.452 INFO:teuthology.orchestra.run.smithi032.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:42:43.452 INFO:teuthology.orchestra.run.smithi032.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:42:43.453 INFO:teuthology.orchestra.run.smithi032.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:42:43.453 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:42:43.453 INFO:teuthology.orchestra.run.smithi032.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:42:43.454 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-13T18:42:43.454 INFO:teuthology.orchestra.run.smithi032.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:42:43.454 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:42:43.454 INFO:teuthology.orchestra.run.smithi032.stdout: libengine-pkcs11-openssl 2024-09-13T18:42:43.565 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-13T18:42:43.566 INFO:teuthology.orchestra.run.smithi032.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:42:43.566 INFO:teuthology.orchestra.run.smithi032.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:42:43.566 INFO:teuthology.orchestra.run.smithi032.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:42:43.566 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:42:43.567 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:42:43.567 INFO:teuthology.orchestra.run.smithi032.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:42:43.567 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-09-13T18:42:43.568 INFO:teuthology.orchestra.run.smithi032.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:42:43.638 INFO:teuthology.orchestra.run.smithi032.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T18:42:43.638 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:42:43.638 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:42:43.638 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:42:43.770 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:42:43.772 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:42:43.773 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:42:43.782 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:42:43.784 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:42:43.801 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:42:43.801 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:42:43.804 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:42:43.807 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:42:43.807 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:42:43.807 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:42:43.808 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:42:43.810 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:42:43.810 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:42:43.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:42:43.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:42:43.835 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:42:43.842 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:42:43.849 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:42:43.849 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:42:43.867 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:42:43.867 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:42:43.877 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:42:43.889 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:42:43.908 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:42:43.911 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:42:43.912 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:42:43.912 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:42:43.913 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:42:43.924 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:42:43.926 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:42:44.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:42:44.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:42:44.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:42:44.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:42:44.060 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:42:44.634 INFO:teuthology.orchestra.run.smithi032.stdout:Preconfiguring packages ... 2024-09-13T18:42:44.879 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 25.4 MB in 0s (52.7 MB/s) 2024-09-13T18:42:45.213 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:42:45.216 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:42:45.398 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:42:45.491 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:42:45.508 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:42:45.556 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:42:45.799 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:42:45.814 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:42:45.859 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:42:46.131 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:42:46.141 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:42:46.185 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:42:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:42:46.484 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:42:46.528 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:42:46.949 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:42:46.964 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:42:47.017 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:42:47.070 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:42:47.332 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:42:47.537 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:42:47.880 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:48.039 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:42:48.165 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:42:48.291 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:42:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:42:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:42:49.161 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:49.308 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:42:49.312 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:42:49.559 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:42:49.988 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:42:50.060 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:42:50.190 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:42:50.274 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:42:50.401 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:42:50.551 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:42:50.559 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:42:51.047 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:42:51.050 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:42:51.231 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:42:51.612 INFO:teuthology.orchestra.run.smithi086.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:42:51.753 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:42:51.886 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:42:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:51.895 INFO:teuthology.orchestra.run.smithi086.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:42:52.156 INFO:teuthology.orchestra.run.smithi086.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:42:52.156 INFO:teuthology.orchestra.run.smithi086.stdout:Removing obsolete dictionary files: 2024-09-13T18:42:52.421 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:42:52.494 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:42:52.797 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:42:53.286 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:42:53.422 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:42:53.431 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:42:53.441 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:42:53.480 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:42:53.572 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:42:53.698 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:42:53.850 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package dump. 2024-09-13T18:42:53.869 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:42:53.933 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:42:54.245 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package indent. 2024-09-13T18:42:54.268 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:42:54.311 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:42:54.690 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:42:54.709 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:42:54.723 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:42:54.748 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:42:54.961 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:42:55.059 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:42:55.160 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:42:55.165 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:42:55.180 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:42:55.218 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:42:55.512 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:42:55.535 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:42:55.603 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:42:55.717 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:42:55.843 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:42:55.965 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:42:55.968 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:42:55.985 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:56.023 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:42:56.170 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:42:56.297 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:56.351 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:42:56.374 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:56.417 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi086.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:42:56.699 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:This user must also own the server process. 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:The default text search configuration will be set to "english". 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:Data page checksums are disabled. 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:56.755 INFO:teuthology.orchestra.run.smithi086.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:42:56.756 INFO:teuthology.orchestra.run.smithi086.stdout:creating subdirectories ... ok 2024-09-13T18:42:56.756 INFO:teuthology.orchestra.run.smithi086.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:42:56.773 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default max_connections ... 100 2024-09-13T18:42:56.791 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:42:56.804 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:42:56.806 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:42:56.807 INFO:teuthology.orchestra.run.smithi086.stdout:creating configuration files ... ok 2024-09-13T18:42:56.824 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:56.862 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:42:56.914 INFO:teuthology.orchestra.run.smithi086.stdout:running bootstrap script ... ok 2024-09-13T18:42:57.274 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:42:57.293 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:42:57.332 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:42:57.416 INFO:teuthology.orchestra.run.smithi086.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:42:57.701 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:42:57.721 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:42:57.784 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:42:58.187 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi086.stdout:syncing data to disk ... ok 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:58.204 INFO:teuthology.orchestra.run.smithi086.stdout:Success. You can now start the database server using: 2024-09-13T18:42:58.204 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:58.204 INFO:teuthology.orchestra.run.smithi086.stdout: pg_ctlcluster 12 main start 2024-09-13T18:42:58.204 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:42:58.254 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:42:58.534 INFO:teuthology.orchestra.run.smithi086.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:42:58.534 INFO:teuthology.orchestra.run.smithi086.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:42:58.610 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:42:58.691 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:42:58.709 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:58.748 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:42:59.093 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:42:59.117 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:42:59.159 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:42:59.445 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:42:59.468 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:42:59.511 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:43:00.058 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:43:00.079 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:43:00.123 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:43:00.585 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:43:00.605 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:43:00.666 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:43:01.350 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:43:01.373 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:43:01.416 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:43:01.587 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:43:01.713 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:43:01.838 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:43:02.012 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:43:02.032 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:43:02.048 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:43:02.149 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:43:02.174 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:43:02.300 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:43:02.970 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ppp. 2024-09-13T18:43:02.989 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:43:03.064 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:03.064 INFO:teuthology.orchestra.run.smithi086.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:43:03.064 INFO:teuthology.orchestra.run.smithi086.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:43:03.064 INFO:teuthology.orchestra.run.smithi086.stdout:- enp3s0f1 2024-09-13T18:43:03.064 INFO:teuthology.orchestra.run.smithi086.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:43:03.065 INFO:teuthology.orchestra.run.smithi086.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:43:03.065 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:03.212 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:43:03.470 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:43:03.535 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:43:03.892 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:43:03.913 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:43:03.958 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:43:04.077 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:43:04.361 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:43:04.381 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:43:04.453 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:43:04.587 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:43:04.722 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:43:04.848 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:43:04.865 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:43:04.869 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:43:04.914 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:43:05.016 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:43:05.142 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:43:05.244 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:43:05.264 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:43:05.267 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:43:05.302 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:43:05.553 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:43:05.836 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:43:05.836 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:43:05.998 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:43:06.021 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:43:06.090 INFO:teuthology.orchestra.run.smithi032.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:43:06.118 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:43:06.347 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:43:06.457 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:43:06.585 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:43:06.631 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:43:06.652 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:43:06.695 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:43:06.760 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:43:07.078 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:43:08.335 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:43:08.357 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:43:08.402 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:43:08.662 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:43:08.685 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:43:08.753 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:43:09.040 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:43:09.064 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:43:09.105 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:43:09.416 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:43:09.440 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:43:09.483 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:43:09.937 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:43:09.957 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:43:10.015 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:43:10.368 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:43:10.592 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:43:11.027 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:43:11.153 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:43:11.279 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:43:11.405 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:43:11.866 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:43:11.867 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:43:12.784 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:43:14.190 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:43:14.332 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:43:14.827 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:43:14.939 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:43:15.065 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:43:15.210 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:43:15.216 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:16.515 INFO:teuthology.orchestra.run.smithi032.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:43:16.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:16.882 INFO:teuthology.orchestra.run.smithi032.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:43:17.354 INFO:teuthology.orchestra.run.smithi032.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:43:17.355 INFO:teuthology.orchestra.run.smithi032.stdout:Removing obsolete dictionary files: 2024-09-13T18:43:17.926 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:43:19.302 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:43:19.428 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:43:19.554 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:43:19.714 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:43:20.975 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:43:21.420 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:43:21.538 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:43:21.605 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:43:21.731 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:43:21.882 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:43:22.008 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:43:22.201 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:43:22.327 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:43:22.866 INFO:teuthology.orchestra.run.smithi032.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:43:22.906 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:43:22.993 INFO:teuthology.orchestra.run.smithi032.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:43:22.993 INFO:teuthology.orchestra.run.smithi032.stdout:This user must also own the server process. 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout:The default text search configuration will be set to "english". 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout:Data page checksums are disabled. 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:22.994 INFO:teuthology.orchestra.run.smithi032.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:43:22.997 INFO:teuthology.orchestra.run.smithi032.stdout:creating subdirectories ... ok 2024-09-13T18:43:22.997 INFO:teuthology.orchestra.run.smithi032.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:43:23.042 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default max_connections ... 100 2024-09-13T18:43:23.089 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:43:23.112 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:43:23.113 INFO:teuthology.orchestra.run.smithi032.stdout:creating configuration files ... ok 2024-09-13T18:43:23.293 INFO:teuthology.orchestra.run.smithi032.stdout:running bootstrap script ... ok 2024-09-13T18:43:23.937 INFO:teuthology.orchestra.run.smithi032.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:43:24.474 INFO:teuthology.orchestra.run.smithi032.stdout:syncing data to disk ... ok 2024-09-13T18:43:24.474 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:24.475 INFO:teuthology.orchestra.run.smithi032.stdout:Success. You can now start the database server using: 2024-09-13T18:43:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: pg_ctlcluster 12 main start 2024-09-13T18:43:24.475 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:25.102 INFO:teuthology.orchestra.run.smithi032.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:43:25.103 INFO:teuthology.orchestra.run.smithi032.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:43:25.306 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:43:28.969 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:43:29.120 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:43:29.246 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:43:29.414 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:43:29.565 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:43:29.691 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:43:30.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:43:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:43:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:- ens1f0 2024-09-13T18:43:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:43:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:43:30.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:31.098 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:43:31.717 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:43:32.661 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:43:33.694 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:43:33.837 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:43:34.030 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:43:34.156 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:43:34.274 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:43:34.462 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:43:34.594 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:43:34.719 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:43:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:43:35.047 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:43:35.988 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:43:36.114 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:43:36.253 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:43:36.409 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:43:36.894 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:43:50.115 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:43:50.256 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:43:51.441 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:43:51.449 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:51.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:43:51.603 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:43:51.642 INFO:teuthology.orchestra.run.smithi032.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:43:51.643 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:43:51.643 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:43:51.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:43:51.804 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:43:51.828 INFO:teuthology.orchestra.run.smithi086.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:43:51.828 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:43:51.829 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:43:51.831 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:43:51.831 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:51.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:43:51.865 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:51.865 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:43:51.886 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:43:51.887 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:51.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:43:51.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:43:52.030 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:52.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:43:52.046 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:43:52.057 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:43:52.057 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:52.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:43:52.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:43:52.183 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:52.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:43:52.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:43:52.215 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:43:52.215 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:52.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:43:52.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:43:52.344 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:52.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:43:52.359 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:43:52.375 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:43:52.449 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:43:52.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-09-13T18:43:52.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-09-13T18:43:52.488 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:43:52.489 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:43:52.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:43:52.560 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:43:52.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:43:52.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:43:52.642 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:43:52.642 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:43:52.642 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:43:52.642 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:52.642 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:43:52.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:43:52.829 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:52.829 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:43:52.836 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:43:52.923 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:43:52.923 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:43:52.923 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}', 'email': None, 'first_in_suite': False, 'job_id': '7903998', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'thrashosds': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:43:52.924 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:43:52.931 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:43:52.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:43:52.994 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:43:53.022 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:53.022 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:43:53.087 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:43:53.087 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-09-13T18:43:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:43:53.151 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:53.151 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 499 Links: 1 2024-09-13T18:43:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-13 18:38:29.422169978 +0000 2024-09-13T18:43:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-13 18:38:29.102177354 +0000 2024-09-13T18:43:53.152 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-13 18:38:29.102177354 +0000 2024-09-13T18:43:53.152 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-13T18:43:53.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:43:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-13T18:43:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-13T18:43:53.227 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000591177 s, 866 kB/s 2024-09-13T18:43:53.229 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:43:53.299 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 503 Links: 1 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-13 18:38:30.046155595 +0000 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-13 18:38:29.722163063 +0000 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-13 18:38:29.722163063 +0000 2024-09-13T18:43:53.358 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-13T18:43:53.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:43:53.432 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-13T18:43:53.432 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-13T18:43:53.432 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000579148 s, 884 kB/s 2024-09-13T18:43:53.435 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:43:53.500 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 512 Links: 1 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-13 18:38:30.374148035 +0000 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-13 18:38:30.370148128 +0000 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-13 18:38:30.370148128 +0000 2024-09-13T18:43:53.558 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-13T18:43:53.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:43:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-13T18:43:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-13T18:43:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000576347 s, 888 kB/s 2024-09-13T18:43:53.633 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:43:53.700 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 516 Links: 1 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-13 18:38:30.994133744 +0000 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-13 18:38:30.990133837 +0000 2024-09-13T18:43:53.758 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-13 18:38:30.990133837 +0000 2024-09-13T18:43:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-13T18:43:53.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:43:53.832 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-13T18:43:53.833 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-13T18:43:53.833 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000449098 s, 1.1 MB/s 2024-09-13T18:43:53.833 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:43:53.895 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:43:53.895 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:53.896 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:43:53.902 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:43:53.902 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 18:37:13.870217346 +0000 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 18:37:13.650214722 +0000 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 18:37:13.650214722 +0000 2024-09-13T18:43:53.910 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-13T18:43:53.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:43:53.963 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T18:43:53.963 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T18:43:53.963 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000389705 s, 1.3 MB/s 2024-09-13T18:43:53.964 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:43:53.972 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 18:37:14.310222291 +0000 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 18:37:14.114220147 +0000 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 18:37:14.114220147 +0000 2024-09-13T18:43:53.979 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-13T18:43:53.979 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:43:53.992 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T18:43:53.992 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T18:43:53.992 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00042771 s, 1.2 MB/s 2024-09-13T18:43:53.993 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:43:54.043 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-13T18:43:54.049 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 18:37:14.738226970 +0000 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 18:37:14.538224783 +0000 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 18:37:14.538224783 +0000 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-13T18:43:54.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:43:54.063 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T18:43:54.063 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T18:43:54.063 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000379439 s, 1.3 MB/s 2024-09-13T18:43:54.064 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:43:54.118 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-13 18:37:15.154231216 +0000 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-13 18:37:14.938229157 +0000 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-13 18:37:14.938229157 +0000 2024-09-13T18:43:54.126 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-13T18:43:54.127 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:43:54.140 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-13T18:43:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-13T18:43:54.141 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000374756 s, 1.4 MB/s 2024-09-13T18:43:54.142 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:43:54.191 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:43:54.191 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:43:54.191 INFO:tasks.ceph:Generating config... 2024-09-13T18:43:54.192 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:43:54.192 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-13T18:43:54.192 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:43:54.192 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:43:54.193 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:43:54.193 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:43:54.193 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:43:54.193 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:43:54.194 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:43:54.195 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:43:54.195 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:43:54.195 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:43:54.195 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:43:54.195 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-13T18:43:54.195 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:43:54.196 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:43:54.196 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:43:54.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:43:54.272 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:43:54.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:43:54.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:43:54.397 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.86'), ('mon.c', '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]')] 2024-09-13T18:43:54.398 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:43:54.399 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:54.399 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:43:54.457 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.86 --addv c '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:43:54.574 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:43:54.574 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid e3c44028-1b11-4958-a433-ecab24d0f05e 2024-09-13T18:43:54.574 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = pacific 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:fsid e3c44028-1b11-4958-a433-ecab24d0f05e 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-09-13T18:43:54.573813+0000 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-09-13T18:43:54.573813+0000 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 16 (pacific) 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] mon.c 2024-09-13T18:43:54.575 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:43:54.581 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:43:54.598 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e3c44028-1b11-4958-a433-ecab24d0f05e... 2024-09-13T18:43:54.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:43:54.650 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:43:54.684 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-13T18:43:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-13T18:43:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:43:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-13T18:43:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.685 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.686 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:43:54.687 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-13T18:43:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.32,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = e3c44028-1b11-4958-a433-ecab24d0f05e 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-13T18:43:54.689 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:43:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-13T18:43:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-13T18:43:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-13T18:43:54.690 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-13T18:43:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-13T18:43:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-13T18:43:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-13T18:43:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.691 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:43:54.692 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-13T18:43:54.693 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay max = 1 2024-09-13T18:43:54.694 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay probability = 0.005 2024-09-13T18:43:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay type = client mds 2024-09-13T18:43:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 2500 2024-09-13T18:43:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2024-09-13T18:43:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:43:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2024-09-13T18:43:54.695 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-13T18:43:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2024-09-13T18:43:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.696 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-13T18:43:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-13T18:43:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-13T18:43:54.696 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-13T18:43:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-13T18:43:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:43:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:43:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-13T18:43:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2024-09-13T18:43:54.697 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-13T18:43:54.698 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:43:54.699 INFO:teuthology.orchestra.run.smithi086.stdout: mon op complaint time = 120 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on pool no app = False 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: client mount timeout = 600 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: client_shutdown_timeout = 120 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: debug client = 20 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-13T18:43:54.700 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds = 20 2024-09-13T18:43:54.701 INFO:teuthology.orchestra.run.smithi086.stdout: debug mds balancer = 20 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal fragment size max = 10000 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal merge size = 5 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split bits = 3 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds bal split size = 100 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug frag = True 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds oft prefetch dirfrags = True 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds op complaint time = 180 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds_dir_prefetch = True 2024-09-13T18:43:54.702 INFO:teuthology.orchestra.run.smithi086.stdout: mds_sleep_rank_change = 5000000.0 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay max = 1 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay probability = 0.005 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject delay type = client mds osd 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 2500 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: osd op complaint time = 180 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: rados mon op timeout = 900 2024-09-13T18:43:54.703 INFO:teuthology.orchestra.run.smithi086.stdout: rados osd op timeout = 900 2024-09-13T18:43:54.723 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-09-13T18:43:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-09-13T18:43:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-09-13T18:43:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-09-13T18:43:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:43:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on skipped message = False 2024-09-13T18:43:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = e3c44028-1b11-4958-a433-ecab24d0f05e 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:43:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 20 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 20 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 10 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: mon client directed command retry = 5 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:43:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject delay max = 1 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject delay probability = 0.005 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject delay type = client mds 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject socket failures = 2500 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: osd blocked scrub grace period = 3600 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: osd max markdown count = 1000 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-13T18:43:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-13T18:43:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:43:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on pool no app = False 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-09-13T18:43:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: client_shutdown_timeout = 120 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-09-13T18:43:54.736 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.e] 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.f] 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds bal fragment size max = 10000 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds bal merge size = 5 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds bal split bits = 3 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds bal split size = 100 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds oft prefetch dirfrags = True 2024-09-13T18:43:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: mds_dir_prefetch = True 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: mds_sleep_rank_change = 5000000.0 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: mon client directed command retry = 5 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject delay max = 1 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject delay probability = 0.005 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject delay type = client mds osd 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: ms inject socket failures = 2500 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-09-13T18:43:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-09-13T18:43:54.742 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:43:54.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:43:54.829 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:43:54.830 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:54.830 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:43:54.843 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:54.843 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:43:54.901 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:43:54.902 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:54.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:43:54.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:43:55.004 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:43:55.004 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:43:55.062 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:43:55.062 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:55.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:43:55.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:43:55.089 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:43:55.089 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:43:55.137 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:43:55.137 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:43:55.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:43:55.236 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:43:55.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:43:55.294 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:43:55.323 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:43:55.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:43:55.431 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:43:55.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:43:55.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:43:55.614 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:43:55.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:43:55.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T18:43:55.792 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T18:43:55.799 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-13T18:43:55.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:43:55.883 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:43:55.886 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:43:55.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:43:55.947 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:43:55.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:43:55.965 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-13T18:43:56.056 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-13T18:43:56.059 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-13T18:43:56.070 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:43:56.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:43:56.147 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:43:56.176 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:43:56.176 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:43:56.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:43:56.213 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:43:56.213 INFO:tasks.ceph:role: osd.0 2024-09-13T18:43:56.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:43:56.213 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:43:56.325 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:43:56.326 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:43:56.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-13T18:43:56.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:43:56.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:43:56.441 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:43:56.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:43:56.442 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:43:56.519 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:43:56.519 INFO:tasks.ceph:role: osd.1 2024-09-13T18:43:56.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:43:56.520 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:43:56.634 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:43:56.634 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:43:56.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-13T18:43:56.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:43:56.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:43:56.744 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:43:56.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:43:56.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:43:56.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:43:56.820 INFO:tasks.ceph:role: osd.2 2024-09-13T18:43:56.821 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:43:56.821 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:43:56.931 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:43:56.932 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:43:56.932 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:43:56.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-13T18:43:56.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:43:56.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:43:57.036 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:43:57.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:43:57.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:43:57.113 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:43:57.113 INFO:tasks.ceph:role: osd.3 2024-09-13T18:43:57.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:43:57.113 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:43:57.232 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:43:57.233 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:43:57.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-13T18:43:57.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:43:57.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:43:57.352 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:43:57.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:43:57.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:43:57.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:43:57.515+0000 7f9f966d5880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:43:57.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:43:57.519+0000 7f9f966d5880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:43:57.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:43:57.519+0000 7f9f966d5880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:43:57.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:43:57.519+0000 7f9f966d5880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:43:57.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:43:57.519+0000 7f9f966d5880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:43:57.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:43:57.519+0000 7f9f966d5880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:44:00.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:44:00.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:00.787+0000 7f8bc9372880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:44:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:00.787+0000 7f8bc9372880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:44:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:00.787+0000 7f8bc9372880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:44:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:00.787+0000 7f8bc9372880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:44:00.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:00.787+0000 7f8bc9372880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:44:00.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:00.791+0000 7f8bc9372880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:44:03.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:44:03.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:04.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:04.063+0000 7f5d6c1c8880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:44:04.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:04.063+0000 7f5d6c1c8880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:44:04.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:04.063+0000 7f5d6c1c8880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:44:04.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:04.063+0000 7f5d6c1c8880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:44:04.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:04.063+0000 7f5d6c1c8880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:44:04.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:04.067+0000 7f5d6c1c8880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:44:07.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:44:07.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:07.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:07.319+0000 7f074d1f8880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:44:07.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:07.319+0000 7f074d1f8880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:44:07.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:07.319+0000 7f074d1f8880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:44:07.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:07.319+0000 7f074d1f8880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:44:07.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:07.319+0000 7f074d1f8880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:44:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:07.319+0000 7f074d1f8880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:44:10.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:44:10.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:10.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:10.459 INFO:tasks.ceph:role: osd.4 2024-09-13T18:44:10.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:44:10.459 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:11.052 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:11.055 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-13T18:44:11.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:11.122 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:11.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:44:11.129 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:44:11.129 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:11.138 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:11.138 INFO:tasks.ceph:role: osd.5 2024-09-13T18:44:11.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:44:11.138 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:44:11.655 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:11.655 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:11.655 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:11.656 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:11.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-13T18:44:11.658 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:11.725 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:11.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:44:11.738 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:44:11.738 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:11.753 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:11.753 INFO:tasks.ceph:role: osd.6 2024-09-13T18:44:11.753 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:44:11.753 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:12.223 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:44:12.224 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:12.224 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:12.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-13T18:44:12.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:12.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:12.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:44:12.292 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:44:12.293 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:12.304 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:44:12.304 INFO:tasks.ceph:role: osd.7 2024-09-13T18:44:12.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:44:12.304 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:44:12.855 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:44:12.856 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:44:12.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-13T18:44:12.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:12.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:12.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:44:12.923 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:44:12.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:13.002 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:12.995+0000 7fca2603f880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:44:13.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:12.995+0000 7fca2603f880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:44:13.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:12.995+0000 7fca2603f880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:44:13.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:12.995+0000 7fca2603f880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:44:13.004 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:12.995+0000 7fca2603f880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:44:13.011 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:13.003+0000 7fca2603f880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:44:16.033 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:44:16.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:16.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:16.088+0000 7f19cbaf9880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:44:16.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:16.088+0000 7f19cbaf9880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:44:16.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:16.088+0000 7f19cbaf9880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:44:16.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:16.088+0000 7f19cbaf9880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:44:16.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:16.088+0000 7f19cbaf9880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:44:16.097 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:16.092+0000 7f19cbaf9880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:44:19.086 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:44:19.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:19.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:19.136+0000 7f9fc75c1880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:44:19.144 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:19.136+0000 7f9fc75c1880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:44:19.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:19.136+0000 7f9fc75c1880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:44:19.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:19.136+0000 7f9fc75c1880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:44:19.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:19.136+0000 7f9fc75c1880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:44:19.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:19.140+0000 7f9fc75c1880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:44:22.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:44:22.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:22.208+0000 7f1ee8230880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:44:22.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:22.208+0000 7f1ee8230880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:44:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:22.208+0000 7f1ee8230880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:44:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:22.208+0000 7f1ee8230880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:44:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:22.208+0000 7f1ee8230880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:44:22.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:22.212+0000 7f1ee8230880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:44:22.926 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:22.932 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:25.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:44:25.231 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:44:25.232 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:44:25.272 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:44:25.355 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:44:25.429 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-13T18:44:25.501 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:44:25.578 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:44:25.653 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:44:25.730 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:25.730 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:44:25.809 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.809 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:44:25.825 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:44:25.840 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.840 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:44:25.852 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.852 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-13T18:44:25.912 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.912 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:44:25.922 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.922 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:44:25.936 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:44:25.995 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:25.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:44:26.007 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:26.007 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:44:26.026 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:44:26.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:44:26.078 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:44:26.093 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-09-13T18:44:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+RmNnwRDhAAORQwJwvLTKJzpMMgV30tYg== 2024-09-13T18:44:26.093 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-13T18:44:26.093 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+RmZfusGRAAbEDeuswZJ00cZ/wdHLPvMg== 2024-09-13T18:44:26.093 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+RmTjCVJBAAmSNSZctMgKAK21kh1PBN/Q== 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.e] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+RmGHwtLxAAAmOPh6acenhjQfWKTCdXqA== 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDth+RmabcJHxAAhYQ2RBmOY2D/BJ0rnWYByA== 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDwh+RmSRYdLxAASp/+stBWYG4SsSQe4+gWvw== 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD0h+RmSiPtAxAABwhTrY5yZOCjJn6wX+OcYw== 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD3h+RmGJkyExAAabRC1Avk9MxyxehT0sbejA== 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-09-13T18:44:26.094 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+RmfbthERAA0E4jfdIhj6tPkdFq4o1zkA== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+RmMZRyNBAA61/+ecFhAJG0TztJRrPF9w== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDrh+Rmo9dIOBAAcLYnMLmFUwgURBIvhtyXVA== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.f] 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDsh+RmmzglAxAAnbnMu3lcJOWdVNV4Lip3yA== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQD9h+RmRUsMABAAiio30LkmYw+jiOaIZoN9Cg== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAAiORmYnmoBRAAORrZdWxqE/rN2zktruzRWw== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQADiORm6tt/CBAAx39nQ7tC+NRmCwRnMDIC1g== 2024-09-13T18:44:26.095 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-09-13T18:44:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAGiORm9LTLDBAAqV/zAjY1lchBCNpUNKNIRA== 2024-09-13T18:44:26.096 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-13T18:44:26.096 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQDsh+RmAdG4CBAAWXQFUZaewlr4y7A3UtYc7w== 2024-09-13T18:44:26.107 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-09-13T18:44:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+RmNnwRDhAAORQwJwvLTKJzpMMgV30tYg== 2024-09-13T18:44:26.107 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-09-13T18:44:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+RmZfusGRAAbEDeuswZJ00cZ/wdHLPvMg== 2024-09-13T18:44:26.107 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2024-09-13T18:44:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+RmTjCVJBAAmSNSZctMgKAK21kh1PBN/Q== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.e] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+RmGHwtLxAAAmOPh6acenhjQfWKTCdXqA== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDth+RmabcJHxAAhYQ2RBmOY2D/BJ0rnWYByA== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDwh+RmSRYdLxAASp/+stBWYG4SsSQe4+gWvw== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD0h+RmSiPtAxAABwhTrY5yZOCjJn6wX+OcYw== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD3h+RmGJkyExAAabRC1Avk9MxyxehT0sbejA== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+RmfbthERAA0E4jfdIhj6tPkdFq4o1zkA== 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-09-13T18:44:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+RmMZRyNBAA61/+ecFhAJG0TztJRrPF9w== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrh+Rmo9dIOBAAcLYnMLmFUwgURBIvhtyXVA== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.f] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDsh+RmmzglAxAAnbnMu3lcJOWdVNV4Lip3yA== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD9h+RmRUsMABAAiio30LkmYw+jiOaIZoN9Cg== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAAiORmYnmoBRAAORrZdWxqE/rN2zktruzRWw== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQADiORm6tt/CBAAx39nQ7tC+NRmCwRnMDIC1g== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAGiORm9LTLDBAAqV/zAjY1lchBCNpUNKNIRA== 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-09-13T18:44:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDsh+RmAdG4CBAAWXQFUZaewlr4y7A3UtYc7w== 2024-09-13T18:44:26.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:44:26.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:44:26.243 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.334 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:26.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:44:26.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:44:26.913 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:26.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:27.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:27.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:27.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:27.098 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:44:27.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.184 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.268 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.349 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.431 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:44:27.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:44:27.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:44:27.590 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:44:27.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:44:27.625 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:44:27.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:44:27.811 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:44:27.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:44:27.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:44:27.998 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:44:28.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:44:28.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:44:28.123 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:28.128 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:44:28.138 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:44:28.138 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:44:28.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:44:28.190 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:44:28.190 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:44:28.190 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:44:28.193 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:44:28.193 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:44:28.193 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:44:28.195 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:44:28.195 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:44:28.196 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:44:28.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:44:28.200 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:44:28.200 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:44:28.200 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:44:28.202 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:44:28.202 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:44:28.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:44:28.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 Processor -- start 2024-09-13T18:44:28.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 -- start start 2024-09-13T18:44:28.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:28.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:28.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc278070dc0 con 0x7fc2780c58e0 2024-09-13T18:44:28.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27806fa70 con 0x7fc278070930 2024-09-13T18:44:28.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27815aac0 con 0x7fc2780c5cc0 2024-09-13T18:44:28.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc276a00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc2780c58e0 0x7fc27806e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:47284/0 (socket says 172.21.15.32:47284) 2024-09-13T18:44:28.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 learned_addr learned my addr 172.21.15.32:0/3499680748 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.351+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.355+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.355+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.355+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.355+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:28.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.355+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:44:28.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:28.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.559+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:44:28.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:28.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:28.963+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:44:29.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:29.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:29.767+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:44:31.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 msgr2=0x7fc27806f530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:44:31.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2780c5cc0 0x7fc27806f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:31.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 msgr2=0x7fc2781578a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:44:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc278070930 0x7fc2781578a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v1:172.21.15.86:6789/0 conn(0x7fc2780c58e0 legacy=0x7fc27806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27815ada0 con 0x7fc258006280 2024-09-13T18:44:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27806fa70 con 0x7fc258003740 2024-09-13T18:44:31.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.355+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.355+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.355+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.355+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:31.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.355+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:44:31.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.559+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:31.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.559+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:31.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.559+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:31.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.559+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:31.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.559+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:44:31.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.963+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:31.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.963+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:31.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.963+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:31.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.963+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:31.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:31.963+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:44:32.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:32.767+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:32.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:32.767+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:32.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:32.767+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:32.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:32.767+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:32.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:32.767+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:44:34.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 msgr2=0x7fc258005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:44:34.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.351+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc258003740 0x7fc258005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:34.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.351+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v1:172.21.15.32:6789/0 conn(0x7fc258006280 legacy=0x7fc258008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:34.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.351+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 reap_dead start 2024-09-13T18:44:34.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.351+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:34.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:34.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25800b060 con 0x7fc2780c58e0 2024-09-13T18:44:34.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27806fa70 con 0x7fc25800ab20 2024-09-13T18:44:34.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27815aac0 con 0x7fc25800a0c0 2024-09-13T18:44:34.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:34.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.355+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:44:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:34.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:44:34.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.559+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:44:34.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:34.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:44:34.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:34.963+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:44:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:44:35.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:44:35.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:35.767+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:44:37.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 msgr2=0x7fc25800a500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:44:37.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.86:3300/0 conn(0x7fc25800a0c0 0x7fc25800a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:37.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 msgr2=0x7fc258005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:44:37.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> v2:172.21.15.32:3300/0 conn(0x7fc25800ab20 0x7fc258005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:37.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 >> v1:172.21.15.86:6789/0 conn(0x7fc2780c58e0 legacy=0x7fc25800d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:37.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc258009890 con 0x7fc258009140 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc26fe00700 1 -- 172.21.15.32:0/3499680748 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27806fa70 con 0x7fc258008800 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:37.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.354+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:44:37.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.558+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:37.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.558+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:37.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.558+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:37.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.558+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:37.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.558+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:44:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.962+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.962+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:44:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.962+0000 7fc276a00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:44:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.962+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:44:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:37.962+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:44:38.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.418+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865024225 0 0) 0x7fc258009890 con 0x7fc258009140 2024-09-13T18:44:38.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.418+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c0035d0 con 0x7fc258009140 2024-09-13T18:44:38.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.418+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838416598 0 0) 0x7fc25c0035d0 con 0x7fc258009140 2024-09-13T18:44:38.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.418+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 msgr2=0x7fc258008c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:44:38.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.418+0000 7fc275600700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc258008800 0x7fc258008c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.418+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580151d0 con 0x7fc258009140 2024-09-13T18:44:38.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7fc26400c570 con 0x7fc258009140 2024-09-13T18:44:38.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 >> v1:172.21.15.32:6789/0 conn(0x7fc258009140 legacy=0x7fc258012aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:38.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc277400700 1 -- 172.21.15.32:0/3499680748 reap_dead start 2024-09-13T18:44:38.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc25c003a20 0x7fc25c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:38.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c004870 0x7fc25c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:38.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c005280 0x7fc25c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:38.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27806fa70 con 0x7fc25c003a20 2024-09-13T18:44:38.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c00c1b0 con 0x7fc25c005280 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c00c370 con 0x7fc25c004870 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c004870 0x7fc25c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc277400700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c005280 0x7fc25c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc25c003a20 0x7fc25c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c005280 msgr2=0x7fc25c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c005280 0x7fc25c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc25c003a20 msgr2=0x7fc25c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc25c003a20 0x7fc25c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 -- 172.21.15.32:0/3499680748 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c0035d0 con 0x7fc25c004870 2024-09-13T18:44:38.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276a00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc25c003a20 0x7fc25c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.422+0000 7fc276000700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c004870 0x7fc25c004cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc264006b20 tx=0x7fc25c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e57353b65743d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264014cf0 con 0x7fc25c004870 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400c040 con 0x7fc25c004870 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc275600700 1 -- 172.21.15.32:0/3499680748 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264004270 con 0x7fc25c004870 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 -- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c004870 msgr2=0x7fc25c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c004870 0x7fc25c004cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc264006b20 tx=0x7fc25c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 -- 172.21.15.32:0/3499680748 shutdown_connections 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c005280 0x7fc25c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c004870 0x7fc25c004cf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 --2- 172.21.15.32:0/3499680748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc25c003a20 0x7fc25c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 -- 172.21.15.32:0/3499680748 >> 172.21.15.32:0/3499680748 conn(0x7fc2780c8a60 msgr2=0x7fc2780c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 -- 172.21.15.32:0/3499680748 shutdown_connections 2024-09-13T18:44:38.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.426+0000 7fc277e00700 1 -- 172.21.15.32:0/3499680748 wait complete. 2024-09-13T18:44:38.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 Processor -- start 2024-09-13T18:44:38.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 -- start start 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 0x7fc2781eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c005280 0x7fc2781f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2781534e0 0x7fc278154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780c2df0 con 0x7fc2781534e0 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc278151f30 con 0x7fc25c003a20 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc278153970 con 0x7fc25c005280 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc276a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 0x7fc2781eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:38.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc276a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 0x7fc2781eef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53806/0 (socket says 172.21.15.32:53806) 2024-09-13T18:44:38.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc276a00700 1 -- 172.21.15.32:0/1944501176 learned_addr learned my addr 172.21.15.32:0/1944501176 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:38.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc276000700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c005280 0x7fc2781f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:38.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2781534e0 0x7fc278154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:38.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 -- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c005280 msgr2=0x7fc2781f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:38.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c005280 0x7fc2781f03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 -- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 msgr2=0x7fc2781eef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:38.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 0x7fc2781eef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 -- 172.21.15.32:0/1944501176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278152160 con 0x7fc2781534e0 2024-09-13T18:44:38.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc276a00700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 0x7fc2781eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.430+0000 7fc277400700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2781534e0 0x7fc278154590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc2780c3330 tx=0x7fc270017dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27001c040 con 0x7fc2781534e0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc270003a40 con 0x7fc2781534e0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc278152440 con 0x7fc2781534e0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2700099d0 con 0x7fc2781534e0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc278152a00 con 0x7fc2781534e0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc270016cf0 con 0x7fc2781534e0 2024-09-13T18:44:38.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc2700048c0 con 0x7fc2781534e0 2024-09-13T18:44:38.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.434+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2780c9d60 con 0x7fc2781534e0 2024-09-13T18:44:38.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.438+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc270030060 con 0x7fc2781534e0 2024-09-13T18:44:38.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.522+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc278072750 con 0x7fc2781534e0 2024-09-13T18:44:38.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.526+0000 7fc26ea00700 1 -- 172.21.15.32:0/1944501176 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc270004020 con 0x7fc2781534e0 2024-09-13T18:44:38.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2781534e0 msgr2=0x7fc278154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:38.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2781534e0 0x7fc278154590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc2780c3330 tx=0x7fc270017dd0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 shutdown_connections 2024-09-13T18:44:38.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2781534e0 0x7fc278154590 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc25c005280 0x7fc2781f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 --2- 172.21.15.32:0/1944501176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc25c003a20 0x7fc2781eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:38.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 >> 172.21.15.32:0/1944501176 conn(0x7fc2780c8a60 msgr2=0x7fc2781551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:38.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 shutdown_connections 2024-09-13T18:44:38.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:38.530+0000 7fc277e00700 1 -- 172.21.15.32:0/1944501176 wait complete. 2024-09-13T18:44:38.536 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-09-13T18:44:38.556 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:44:38.557 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:44:38.557 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:38.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:44:38.587 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:38.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:44:38.660 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:38.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:44:38.666 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:38.662+0000 7f64b25b52c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:44:38.696 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:44:38.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:44:38.774 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:38.774 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:44:38.791 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:38.791 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:44:38.848 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:38.848 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:44:38.861 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-13T18:44:38.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:44:38.871 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 973dc52d-4a57-489e-b680-f484a091a77f 0 2024-09-13T18:44:38.986 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:38.980+0000 7f94d05242c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:44:39.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 Processor -- start 2024-09-13T18:44:39.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 -- start start 2024-09-13T18:44:39.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efc541504c0 0x7efc540713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54071920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540c6bf0 con 0x7efc5406e0d0 2024-09-13T18:44:39.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5406e590 con 0x7efc541504c0 2024-09-13T18:44:39.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc5a7c4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5406db40 con 0x7efc5415a160 2024-09-13T18:44:39.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc59fc3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.024+0000 7efc59fc3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54071920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37570/0 (socket says 172.21.15.86:37570) 2024-09-13T18:44:39.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc59fc3700 1 -- 172.21.15.86:0/3295697313 learned_addr learned my addr 172.21.15.86:0/3295697313 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.033 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc597c2700 1 --2- 172.21.15.86:0/3295697313 >> v2:172.21.15.86:3300/0 conn(0x7efc541504c0 0x7efc540713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc59fc3700 1 -- 172.21.15.86:0/3295697313 >> v2:172.21.15.86:3300/0 conn(0x7efc541504c0 msgr2=0x7efc540713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc59fc3700 1 --2- 172.21.15.86:0/3295697313 >> v2:172.21.15.86:3300/0 conn(0x7efc541504c0 0x7efc540713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc59fc3700 1 -- 172.21.15.86:0/3295697313 >> v1:172.21.15.32:6789/0 conn(0x7efc5406e0d0 legacy=0x7efc54159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc59fc3700 1 -- 172.21.15.86:0/3295697313 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5406e7e0 con 0x7efc5415a160 2024-09-13T18:44:39.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc59fc3700 1 --2- 172.21.15.86:0/3295697313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54071920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00d150 tx=0x7efc4c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f450357faa9b339 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.034 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc4bfff700 1 -- 172.21.15.86:0/3295697313 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c010070 con 0x7efc5415a160 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc4bfff700 1 -- 172.21.15.86:0/3295697313 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00dcd0 con 0x7efc5415a160 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc4bfff700 1 -- 172.21.15.86:0/3295697313 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00b310 con 0x7efc5415a160 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3295697313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 msgr2=0x7efc54071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3295697313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54071920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00d150 tx=0x7efc4c00d460 comp rx=0 tx=0).stop 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3295697313 shutdown_connections 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3295697313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54071920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3295697313 >> v2:172.21.15.86:3300/0 conn(0x7efc541504c0 0x7efc540713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3295697313 >> 172.21.15.86:0/3295697313 conn(0x7efc540cbfd0 msgr2=0x7efc540cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3295697313 shutdown_connections 2024-09-13T18:44:39.035 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3295697313 wait complete. 2024-09-13T18:44:39.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 Processor -- start 2024-09-13T18:44:39.036 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.028+0000 7efc5a7c4700 1 -- start start 2024-09-13T18:44:39.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc5406e0d0 0x7efc540cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 0x7efc54157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540c1df0 con 0x7efc5406e0d0 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc541534c0 con 0x7efc541504c0 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc54151770 con 0x7efc5415a160 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 0x7efc54157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 0x7efc54157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38894/0 (socket says 172.21.15.86:38894) 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 -- 172.21.15.86:0/3725909309 learned_addr learned my addr 172.21.15.86:0/3725909309 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc59fc3700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 -- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 msgr2=0x7efc54145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.039 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 -- 172.21.15.86:0/3725909309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc5406e0d0 msgr2=0x7efc540cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc5406e0d0 0x7efc540cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 -- 172.21.15.86:0/3725909309 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c00bd40 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc58fc1700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 0x7efc54157420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c500 tx=0x7efc4400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440054e0 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440036a0 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44003a50 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54152460 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc54152700 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7efc44006840 con 0x7efc541504c0 2024-09-13T18:44:39.040 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc44007560 con 0x7efc541504c0 2024-09-13T18:44:39.041 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.032+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc540723e0 con 0x7efc541504c0 2024-09-13T18:44:39.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.036+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7efc44017070 con 0x7efc541504c0 2024-09-13T18:44:39.122 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.116+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "973dc52d-4a57-489e-b680-f484a091a77f", "id": 0} v 0) v1 -- 0x7efc540c1170 con 0x7efc541504c0 2024-09-13T18:44:39.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc49ffb700 1 -- 172.21.15.86:0/3725909309 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "973dc52d-4a57-489e-b680-f484a091a77f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc44006d70 con 0x7efc541504c0 2024-09-13T18:44:39.129 INFO:teuthology.orchestra.run.smithi086.stdout:0 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 msgr2=0x7efc54157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 0x7efc54157420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c500 tx=0x7efc4400c810 comp rx=0 tx=0).stop 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 shutdown_connections 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc5415a160 0x7efc54145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc541504c0 0x7efc54157420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 --2- 172.21.15.86:0/3725909309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc5406e0d0 0x7efc540cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 >> 172.21.15.86:0/3725909309 conn(0x7efc540cbfd0 msgr2=0x7efc54149c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 shutdown_connections 2024-09-13T18:44:39.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.124+0000 7efc5a7c4700 1 -- 172.21.15.86:0/3725909309 wait complete. 2024-09-13T18:44:39.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 354ae97e-51cf-423c-b257-37bf8960729b 1 2024-09-13T18:44:39.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.252+0000 7f83aaa94700 1 Processor -- start 2024-09-13T18:44:39.260 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.252+0000 7f83aaa94700 1 -- start start 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.252+0000 7f83aaa94700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83a40c79e0 0x7f83a415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 0x7f83a40c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40c3ae0 con 0x7f83a40c6a70 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40c7560 con 0x7f83a40c79e0 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40c3dc0 con 0x7f83a4157d40 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 0x7f83a40c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83a9291700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83a40c79e0 0x7f83a415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 0x7f83a40c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37582/0 (socket says 172.21.15.86:37582) 2024-09-13T18:44:39.262 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 -- 172.21.15.86:0/3950849245 learned_addr learned my addr 172.21.15.86:0/3950849245 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 -- 172.21.15.86:0/3950849245 >> v2:172.21.15.86:3300/0 conn(0x7f83a40c79e0 msgr2=0x7f83a415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 --2- 172.21.15.86:0/3950849245 >> v2:172.21.15.86:3300/0 conn(0x7f83a40c79e0 0x7f83a415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 -- 172.21.15.86:0/3950849245 >> v1:172.21.15.32:6789/0 conn(0x7f83a40c6a70 legacy=0x7f83a40c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 -- 172.21.15.86:0/3950849245 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40c40a0 con 0x7f83a4157d40 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83a9291700 1 --2- 172.21.15.86:0/3950849245 >> v2:172.21.15.86:3300/0 conn(0x7f83a40c79e0 0x7f83a415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aa293700 1 --2- 172.21.15.86:0/3950849245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 0x7f83a40c2000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f839c009e50 tx=0x7f839c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9444b420043524e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83a8a90700 1 -- 172.21.15.86:0/3950849245 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00e070 con 0x7f83a4157d40 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83a8a90700 1 -- 172.21.15.86:0/3950849245 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c003a40 con 0x7f83a4157d40 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83a8a90700 1 -- 172.21.15.86:0/3950849245 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c003df0 con 0x7f83a4157d40 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- 172.21.15.86:0/3950849245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 msgr2=0x7f83a40c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3950849245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 0x7f83a40c2000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f839c009e50 tx=0x7f839c00b330 comp rx=0 tx=0).stop 2024-09-13T18:44:39.263 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- 172.21.15.86:0/3950849245 shutdown_connections 2024-09-13T18:44:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3950849245 >> v2:172.21.15.86:3300/0 conn(0x7f83a40c79e0 0x7f83a415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3950849245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a4157d40 0x7f83a40c2000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- 172.21.15.86:0/3950849245 >> 172.21.15.86:0/3950849245 conn(0x7f83a4073d50 msgr2=0x7f83a406e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- 172.21.15.86:0/3950849245 shutdown_connections 2024-09-13T18:44:39.264 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- 172.21.15.86:0/3950849245 wait complete. 2024-09-13T18:44:39.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 Processor -- start 2024-09-13T18:44:39.266 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.256+0000 7f83aaa94700 1 -- start start 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a40c6a70 0x7f83a41561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 0x7f83a41589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83a4157d40 0x7f83a414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4150d40 con 0x7f83a4157d40 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41505d0 con 0x7f83a40c6a70 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a414d6f0 con 0x7f83a40c79e0 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9291700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 0x7f83a41589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a40c6a70 0x7f83a41561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9291700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 0x7f83a41589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37586/0 (socket says 172.21.15.86:37586) 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9291700 1 -- 172.21.15.86:0/3580684585 learned_addr learned my addr 172.21.15.86:0/3580684585 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 -- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 msgr2=0x7f83a41589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aa293700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83a4157d40 0x7f83a414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.267 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 0x7f83a41589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 -- 172.21.15.86:0/3580684585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83a4157d40 msgr2=0x7f83a414c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83a4157d40 0x7f83a414c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 -- 172.21.15.86:0/3580684585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940094b0 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9291700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 0x7f83a41589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83a9a92700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a40c6a70 0x7f83a41561e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c430 tx=0x7f83a000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00054e0 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00036a0 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c009b30 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0003a50 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4070c40 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f83a001c440 con 0x7f83a40c6a70 2024-09-13T18:44:39.268 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f83a00127b0 con 0x7f83a40c6a70 2024-09-13T18:44:39.269 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.260+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a415a7c0 con 0x7f83a40c6a70 2024-09-13T18:44:39.271 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.264+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f83a0017070 con 0x7f83a40c6a70 2024-09-13T18:44:39.348 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.344+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "354ae97e-51cf-423c-b257-37bf8960729b", "id": 1} v 0) v1 -- 0x7f83a4072010 con 0x7f83a40c6a70 2024-09-13T18:44:39.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f839a7fc700 1 -- 172.21.15.86:0/3580684585 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "354ae97e-51cf-423c-b257-37bf8960729b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83a0012970 con 0x7f83a40c6a70 2024-09-13T18:44:39.356 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a40c6a70 msgr2=0x7f83a41561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a40c6a70 0x7f83a41561e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c430 tx=0x7f83a000c740 comp rx=0 tx=0).stop 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 shutdown_connections 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83a4157d40 0x7f83a414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83a40c79e0 0x7f83a41589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 --2- 172.21.15.86:0/3580684585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83a40c6a70 0x7f83a41561e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 >> 172.21.15.86:0/3580684585 conn(0x7f83a4073d50 msgr2=0x7f83a40c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 shutdown_connections 2024-09-13T18:44:39.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.352+0000 7f83aaa94700 1 -- 172.21.15.86:0/3580684585 wait complete. 2024-09-13T18:44:39.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new b76494fe-9ae4-4444-8f25-15b7bb18dece 2 2024-09-13T18:44:39.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 Processor -- start 2024-09-13T18:44:39.481 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- start start 2024-09-13T18:44:39.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e5c156cc0 0x7f0e5c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c06ca70 0x7f0e5c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.482 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c070f50 con 0x7f0e5c0c79e0 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5c06f900 con 0x7f0e5c156cc0 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c15a120 con 0x7f0e5c06ca70 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e61fd2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e5c156cc0 0x7f0e5c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e627d3700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c06ca70 0x7f0e5c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e61fd2700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0e5c156cc0 0x7f0e5c06a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38910/0 (socket says 172.21.15.86:38910) 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e61fd2700 1 -- 172.21.15.86:0/3834800219 learned_addr learned my addr 172.21.15.86:0/3834800219 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e627d3700 1 -- 172.21.15.86:0/3834800219 >> v2:172.21.15.86:3300/0 conn(0x7f0e5c156cc0 msgr2=0x7f0e5c06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e627d3700 1 --2- 172.21.15.86:0/3834800219 >> v2:172.21.15.86:3300/0 conn(0x7f0e5c156cc0 0x7f0e5c06a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e627d3700 1 -- 172.21.15.86:0/3834800219 >> v1:172.21.15.86:6789/0 conn(0x7f0e5c0c79e0 legacy=0x7f0e5c06c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e627d3700 1 -- 172.21.15.86:0/3834800219 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c15a400 con 0x7f0e5c06ca70 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e627d3700 1 --2- 172.21.15.86:0/3834800219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c06ca70 0x7f0e5c06a8d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009d90 tx=0x7f0e5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f88c553d2832ed5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e60fd0700 1 -- 172.21.15.86:0/3834800219 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400e070 con 0x7f0e5c06ca70 2024-09-13T18:44:39.483 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e60fd0700 1 -- 172.21.15.86:0/3834800219 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5400bb20 con 0x7f0e5c06ca70 2024-09-13T18:44:39.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e60fd0700 1 -- 172.21.15.86:0/3834800219 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54012430 con 0x7f0e5c06ca70 2024-09-13T18:44:39.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- 172.21.15.86:0/3834800219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c06ca70 msgr2=0x7f0e5c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.484 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/3834800219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c06ca70 0x7f0e5c06a8d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009d90 tx=0x7f0e5400b330 comp rx=0 tx=0).stop 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- 172.21.15.86:0/3834800219 shutdown_connections 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/3834800219 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c06ca70 0x7f0e5c06a8d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/3834800219 >> v2:172.21.15.86:3300/0 conn(0x7f0e5c156cc0 0x7f0e5c06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- 172.21.15.86:0/3834800219 >> 172.21.15.86:0/3834800219 conn(0x7f0e5c073d50 msgr2=0x7f0e5c06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- 172.21.15.86:0/3834800219 shutdown_connections 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.476+0000 7f0e62fd4700 1 -- 172.21.15.86:0/3834800219 wait complete. 2024-09-13T18:44:39.485 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 Processor -- start 2024-09-13T18:44:39.486 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 -- start start 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 0x7f0e5c1e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 0x7f0e5c1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e5c156cc0 0x7f0e5c1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c1f3080 con 0x7f0e5c156cc0 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c15dad0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0ccb60 con 0x7f0e5c0c79e0 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 0x7f0e5c1e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e617d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 0x7f0e5c1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e617d1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 0x7f0e5c1f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37598/0 (socket says 172.21.15.86:37598) 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e617d1700 1 -- 172.21.15.86:0/4265410198 learned_addr learned my addr 172.21.15.86:0/4265410198 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.488 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 0x7f0e5c1e6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38916/0 (socket says 172.21.15.86:38916) 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 -- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 msgr2=0x7f0e5c1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 0x7f0e5c1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 -- 172.21.15.86:0/4265410198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e5c156cc0 msgr2=0x7f0e5c1f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e5c156cc0 0x7f0e5c1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 -- 172.21.15.86:0/4265410198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54009a70 con 0x7f0e5c06ca70 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e617d1700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 0x7f0e5c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e61fd2700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 0x7f0e5c1e6320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800e870 tx=0x7f0e5800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58013680 con 0x7f0e5c06ca70 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e580137e0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c1f03a0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58013b50 con 0x7f0e5c06ca70 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c1f2da0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.489 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0e58005a40 con 0x7f0e5c06ca70 2024-09-13T18:44:39.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.480+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0e58005cf0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.490 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.484+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c1570a0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.492 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.484+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0e58021060 con 0x7f0e5c06ca70 2024-09-13T18:44:39.515 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:39.510+0000 7f64b25b52c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:44:39.576 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.572+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b76494fe-9ae4-4444-8f25-15b7bb18dece", "id": 2} v 0) v1 -- 0x7f0e5c15d8b0 con 0x7f0e5c06ca70 2024-09-13T18:44:39.581 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e527fc700 1 -- 172.21.15.86:0/4265410198 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b76494fe-9ae4-4444-8f25-15b7bb18dece", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e58029020 con 0x7f0e5c06ca70 2024-09-13T18:44:39.582 INFO:teuthology.orchestra.run.smithi086.stdout:2 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 msgr2=0x7f0e5c1e6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 0x7f0e5c1e6320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800e870 tx=0x7f0e5800eb80 comp rx=0 tx=0).stop 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 shutdown_connections 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e5c156cc0 0x7f0e5c1f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0e5c0c79e0 0x7f0e5c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 --2- 172.21.15.86:0/4265410198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e5c06ca70 0x7f0e5c1e6320 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.583 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 >> 172.21.15.86:0/4265410198 conn(0x7f0e5c073d50 msgr2=0x7f0e5c06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 shutdown_connections 2024-09-13T18:44:39.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.576+0000 7f0e62fd4700 1 -- 172.21.15.86:0/4265410198 wait complete. 2024-09-13T18:44:39.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 3b89a1fa-2088-4a23-b1e6-31644ebc6000 3 2024-09-13T18:44:39.601 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:39.598+0000 7f64b25b52c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:44:39.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 Processor -- start 2024-09-13T18:44:39.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 -- start start 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2fd014fb50 0x7f2fd00c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fd0155a10 0x7f2fd00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd0159e20 con 0x7f2fd006de80 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd0159b40 con 0x7f2fd0155a10 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd7178700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd006d0c0 con 0x7f2fd014fb50 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd6176700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2fd014fb50 0x7f2fd00c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd6176700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2fd014fb50 0x7f2fd00c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38922/0 (socket says 172.21.15.86:38922) 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.704+0000 7f2fd6176700 1 -- 172.21.15.86:0/163534166 learned_addr learned my addr 172.21.15.86:0/163534166 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd6176700 1 -- 172.21.15.86:0/163534166 >> v2:172.21.15.32:3300/0 conn(0x7f2fd0155a10 msgr2=0x7f2fd00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd6176700 1 --2- 172.21.15.86:0/163534166 >> v2:172.21.15.32:3300/0 conn(0x7f2fd0155a10 0x7f2fd00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd6176700 1 -- 172.21.15.86:0/163534166 >> v1:172.21.15.86:6789/0 conn(0x7f2fd006de80 legacy=0x7f2fd0158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd6176700 1 -- 172.21.15.86:0/163534166 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd006d3a0 con 0x7f2fd014fb50 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd6176700 1 --2- 172.21.15.86:0/163534166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd014fb50 0x7f2fd00c6140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2fd006b8c0 tx=0x7f2fcc00ad90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07f9c4411dd5e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd5174700 1 -- 172.21.15.86:0/163534166 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00cb70 con 0x7f2fd014fb50 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd5174700 1 -- 172.21.15.86:0/163534166 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00ccd0 con 0x7f2fd014fb50 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd5174700 1 -- 172.21.15.86:0/163534166 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc018620 con 0x7f2fd014fb50 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 -- 172.21.15.86:0/163534166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd014fb50 msgr2=0x7f2fd00c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 --2- 172.21.15.86:0/163534166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd014fb50 0x7f2fd00c6140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2fd006b8c0 tx=0x7f2fcc00ad90 comp rx=0 tx=0).stop 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 -- 172.21.15.86:0/163534166 shutdown_connections 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 --2- 172.21.15.86:0/163534166 >> v2:172.21.15.32:3300/0 conn(0x7f2fd0155a10 0x7f2fd00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 --2- 172.21.15.86:0/163534166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd014fb50 0x7f2fd00c6140 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 -- 172.21.15.86:0/163534166 >> 172.21.15.86:0/163534166 conn(0x7f2fd006f530 msgr2=0x7f2fd006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 -- 172.21.15.86:0/163534166 shutdown_connections 2024-09-13T18:44:39.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 -- 172.21.15.86:0/163534166 wait complete. 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 Processor -- start 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.708+0000 7f2fd7178700 1 -- start start 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd006de80 0x7f2fd01ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 0x7f2fd0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd0155a10 0x7f2fd0151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0150c40 con 0x7f2fd006de80 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01edc40 con 0x7f2fd0155a10 2024-09-13T18:44:39.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0152f40 con 0x7f2fd014fb50 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 0x7f2fd0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd6977700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd0155a10 0x7f2fd0151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 0x7f2fd0154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37610/0 (socket says 172.21.15.86:37610) 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 -- 172.21.15.86:0/3605872879 learned_addr learned my addr 172.21.15.86:0/3605872879 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd6176700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd006de80 0x7f2fd01ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 -- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd0155a10 msgr2=0x7f2fd0151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd0155a10 0x7f2fd0151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 -- 172.21.15.86:0/3605872879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd006de80 msgr2=0x7f2fd01ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd006de80 0x7f2fd01ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 -- 172.21.15.86:0/3605872879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc00a710 con 0x7f2fd014fb50 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd5975700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 0x7f2fd0154850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000b550 tx=0x7f2fc000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011830 con 0x7f2fd014fb50 2024-09-13T18:44:39.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0011990 con 0x7f2fd014fb50 2024-09-13T18:44:39.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd0153220 con 0x7f2fd014fb50 2024-09-13T18:44:39.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011d40 con 0x7f2fd014fb50 2024-09-13T18:44:39.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0150580 con 0x7f2fd014fb50 2024-09-13T18:44:39.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2fc001a700 con 0x7f2fd014fb50 2024-09-13T18:44:39.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2fc0019a70 con 0x7f2fd014fb50 2024-09-13T18:44:39.721 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.712+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd006e2b0 con 0x7f2fd014fb50 2024-09-13T18:44:39.723 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.716+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f2fc0039e30 con 0x7f2fd014fb50 2024-09-13T18:44:39.751 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:39.744+0000 7f94d05242c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:44:39.799 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.792+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3b89a1fa-2088-4a23-b1e6-31644ebc6000", "id": 3} v 0) v1 -- 0x7f2fd014c1a0 con 0x7f2fd014fb50 2024-09-13T18:44:39.805 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fc6ffd700 1 -- 172.21.15.86:0/3605872879 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b89a1fa-2088-4a23-b1e6-31644ebc6000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2fc0028030 con 0x7f2fd014fb50 2024-09-13T18:44:39.806 INFO:teuthology.orchestra.run.smithi086.stdout:3 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 msgr2=0x7f2fd0154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 0x7f2fd0154850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000b550 tx=0x7f2fc000b860 comp rx=0 tx=0).stop 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 shutdown_connections 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fd0155a10 0x7f2fd0151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fd014fb50 0x7f2fd0154850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 --2- 172.21.15.86:0/3605872879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fd006de80 0x7f2fd01ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 >> 172.21.15.86:0/3605872879 conn(0x7f2fd006f530 msgr2=0x7f2fd014d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 shutdown_connections 2024-09-13T18:44:39.808 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.800+0000 7f2fd7178700 1 -- 172.21.15.86:0/3605872879 wait complete. 2024-09-13T18:44:39.809 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:39.802+0000 7f64b25b52c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:44:39.810 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:39.804+0000 7f94d05242c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:44:39.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 63973273-0c32-404c-9eb2-943b451d3da7 4 2024-09-13T18:44:39.929 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a9340700 1 Processor -- start 2024-09-13T18:44:39.930 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a9340700 1 -- start start 2024-09-13T18:44:39.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a9340700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4151720 0x7ff9a41589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.931 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a9340700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40c6100 con 0x7ff9a40c3d40 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a9340700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40c66c0 con 0x7ff9a4072400 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a9340700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40c4eb0 con 0x7ff9a4151720 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a37fe700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff9a4072400 0x7ff9a4161e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55736/0 (socket says 172.21.15.86:55736) 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a37fe700 1 -- 172.21.15.86:0/2759756204 learned_addr learned my addr 172.21.15.86:0/2759756204 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a2ffd700 1 --2- 172.21.15.86:0/2759756204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4151720 0x7ff9a41589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a1ffb700 1 -- 172.21.15.86:0/2759756204 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019203657 0 0) 0x7ff99c001490 con 0x7ff9a4072400 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a1ffb700 1 -- 172.21.15.86:0/2759756204 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9900035d0 con 0x7ff9a4072400 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/2759756204 >> v1:172.21.15.86:6789/0 conn(0x7ff9a4072400 legacy=0x7ff9a4161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/2759756204 >> v1:172.21.15.32:6789/0 conn(0x7ff9a40c3d40 legacy=0x7ff9a40cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/2759756204 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4157500 con 0x7ff9a4151720 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a2ffd700 1 --2- 172.21.15.86:0/2759756204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4151720 0x7ff9a41589f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff994009880 tx=0x7ff994009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3b4f72e0ccec2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.932 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a1ffb700 1 -- 172.21.15.86:0/2759756204 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994004230 con 0x7ff9a4151720 2024-09-13T18:44:39.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a1ffb700 1 -- 172.21.15.86:0/2759756204 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994004390 con 0x7ff9a4151720 2024-09-13T18:44:39.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.924+0000 7ff9a1ffb700 1 -- 172.21.15.86:0/2759756204 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940036c0 con 0x7ff9a4151720 2024-09-13T18:44:39.933 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 -- 172.21.15.86:0/2759756204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4151720 msgr2=0x7ff9a41589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 --2- 172.21.15.86:0/2759756204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4151720 0x7ff9a41589f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff994009880 tx=0x7ff994009b90 comp rx=0 tx=0).stop 2024-09-13T18:44:39.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 -- 172.21.15.86:0/2759756204 shutdown_connections 2024-09-13T18:44:39.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 --2- 172.21.15.86:0/2759756204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4151720 0x7ff9a41589f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 -- 172.21.15.86:0/2759756204 >> 172.21.15.86:0/2759756204 conn(0x7ff9a406aec0 msgr2=0x7ff9a406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:39.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 -- 172.21.15.86:0/2759756204 shutdown_connections 2024-09-13T18:44:39.934 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 -- 172.21.15.86:0/2759756204 wait complete. 2024-09-13T18:44:39.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 Processor -- start 2024-09-13T18:44:39.935 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 -- start start 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.928+0000 7ff9a9340700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 0x7ff9a414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9a4151720 0x7ff9a41e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a41e16f0 0x7ff9a415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a41e1c60 con 0x7ff9a4151720 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4151fd0 con 0x7ff9a41e16f0 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4151d30 con 0x7ff9a4072400 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 0x7ff9a414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a37fe700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a41e16f0 0x7ff9a415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 0x7ff9a414ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37620/0 (socket says 172.21.15.86:37620) 2024-09-13T18:44:39.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/3464914817 learned_addr learned my addr 172.21.15.86:0/3464914817 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a27fc700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9a4151720 0x7ff9a41e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a41e16f0 msgr2=0x7ff9a415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a41e16f0 0x7ff9a415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/3464914817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9a4151720 msgr2=0x7ff9a41e11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9a4151720 0x7ff9a41e11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 -- 172.21.15.86:0/3464914817 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940094b0 con 0x7ff9a4072400 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a27fc700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9a4151720 0x7ff9a41e11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a37fe700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a41e16f0 0x7ff9a415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a2ffd700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 0x7ff9a414ab90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff994000c00 tx=0x7ff994004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994006ea0 con 0x7ff9a4072400 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994011630 con 0x7ff9a4072400 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a41ed180 con 0x7ff9a4072400 2024-09-13T18:44:39.939 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940119e0 con 0x7ff9a4072400 2024-09-13T18:44:39.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a41e09b0 con 0x7ff9a4072400 2024-09-13T18:44:39.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff994024460 con 0x7ff9a4072400 2024-09-13T18:44:39.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff99401b950 con 0x7ff9a4072400 2024-09-13T18:44:39.940 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.932+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a4074d70 con 0x7ff9a4072400 2024-09-13T18:44:39.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:39.936+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff99401f070 con 0x7ff9a4072400 2024-09-13T18:44:39.988 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:39.980+0000 7f94d05242c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:44:40.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.012+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "63973273-0c32-404c-9eb2-943b451d3da7", "id": 4} v 0) v1 -- 0x7ff9a414b8a0 con 0x7ff9a4072400 2024-09-13T18:44:40.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.020+0000 7ff99b7fe700 1 -- 172.21.15.86:0/3464914817 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63973273-0c32-404c-9eb2-943b451d3da7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff99401bc80 con 0x7ff9a4072400 2024-09-13T18:44:40.027 INFO:teuthology.orchestra.run.smithi086.stdout:4 2024-09-13T18:44:40.028 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 msgr2=0x7ff9a414ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 0x7ff9a414ab90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff994000c00 tx=0x7ff994004770 comp rx=0 tx=0).stop 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 shutdown_connections 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a41e16f0 0x7ff9a415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9a4151720 0x7ff9a41e11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 --2- 172.21.15.86:0/3464914817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9a4072400 0x7ff9a414ab90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 >> 172.21.15.86:0/3464914817 conn(0x7ff9a406aec0 msgr2=0x7ff9a4150310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 shutdown_connections 2024-09-13T18:44:40.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.024+0000 7ff9a9340700 1 -- 172.21.15.86:0/3464914817 wait complete. 2024-09-13T18:44:40.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 2678edb8-ca2a-497a-8439-5f1dc709dbe8 5 2024-09-13T18:44:40.096 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:40.090+0000 7f64b25b52c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:44:40.145 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 Processor -- start 2024-09-13T18:44:40.146 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 -- start start 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff3140c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3140c2a40 0x7ff314156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff314156300 con 0x7ff314150860 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3141569a0 con 0x7ff3140c2a40 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff319731700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140c3900 con 0x7ff314150480 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff30bfff700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff314150860 0x7ff31406ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55746/0 (socket says 172.21.15.86:55746) 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff30bfff700 1 -- 172.21.15.86:0/626270464 learned_addr learned my addr 172.21.15.86:0/626270464 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff313fff700 1 --2- 172.21.15.86:0/626270464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff3140c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff313fff700 1 -- 172.21.15.86:0/626270464 >> v2:172.21.15.32:3300/0 conn(0x7ff3140c2a40 msgr2=0x7ff314156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff313fff700 1 --2- 172.21.15.86:0/626270464 >> v2:172.21.15.32:3300/0 conn(0x7ff3140c2a40 0x7ff314156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.148 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff313fff700 1 -- 172.21.15.86:0/626270464 >> v1:172.21.15.86:6789/0 conn(0x7ff314150860 legacy=0x7ff31406ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff313fff700 1 -- 172.21.15.86:0/626270464 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314159fd0 con 0x7ff314150480 2024-09-13T18:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff3137fe700 1 -- 172.21.15.86:0/626270464 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615318964 0 0) 0x7ff314156300 con 0x7ff314150860 2024-09-13T18:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff313fff700 1 --2- 172.21.15.86:0/626270464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff3140c41c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff304009850 tx=0x7ff304009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fba39f4f77f8f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff3137fe700 1 -- 172.21.15.86:0/626270464 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011830 con 0x7ff314150480 2024-09-13T18:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff3137fe700 1 -- 172.21.15.86:0/626270464 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304011990 con 0x7ff314150480 2024-09-13T18:44:40.149 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.140+0000 7ff3137fe700 1 -- 172.21.15.86:0/626270464 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011d20 con 0x7ff314150480 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/626270464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 msgr2=0x7ff3140c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 --2- 172.21.15.86:0/626270464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff3140c41c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff304009850 tx=0x7ff304009b60 comp rx=0 tx=0).stop 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/626270464 shutdown_connections 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 --2- 172.21.15.86:0/626270464 >> v2:172.21.15.32:3300/0 conn(0x7ff3140c2a40 0x7ff314156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 --2- 172.21.15.86:0/626270464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff3140c41c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/626270464 >> 172.21.15.86:0/626270464 conn(0x7ff3140722b0 msgr2=0x7ff31406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/626270464 shutdown_connections 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/626270464 wait complete. 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 Processor -- start 2024-09-13T18:44:40.150 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- start start 2024-09-13T18:44:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 0x7ff3141f0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff314151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.152 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff314150860 0x7ff314152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31414d670 con 0x7ff314150860 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314151860 con 0x7ff3140c2a40 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31406d630 con 0x7ff314150480 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 0x7ff3141f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 0x7ff3141f0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38952/0 (socket says 172.21.15.86:38952) 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 -- 172.21.15.86:0/4244174232 learned_addr learned my addr 172.21.15.86:0/4244174232 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff30bfff700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff314151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff318f30700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff314150860 0x7ff314152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 -- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 msgr2=0x7ff314151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff314151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 -- 172.21.15.86:0/4244174232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff314150860 msgr2=0x7ff314152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff314150860 0x7ff314152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.153 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 -- 172.21.15.86:0/4244174232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040094b0 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff313fff700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 0x7ff3141f0280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff3140c4120 tx=0x7ff304004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040038c0 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30401f070 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304003c80 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3141f0d80 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31414d390 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff30401a730 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.144+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff304021070 con 0x7ff3140c2a40 2024-09-13T18:44:40.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.148+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140c3140 con 0x7ff3140c2a40 2024-09-13T18:44:40.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.148+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff30402a020 con 0x7ff3140c2a40 2024-09-13T18:44:40.176 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:40.170+0000 7f64b25b52c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:44:40.212 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:40.204+0000 7f94d05242c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:44:40.229 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.224+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2678edb8-ca2a-497a-8439-5f1dc709dbe8", "id": 5} v 0) v1 -- 0x7ff314073ce0 con 0x7ff3140c2a40 2024-09-13T18:44:40.236 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff3117fa700 1 -- 172.21.15.86:0/4244174232 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2678edb8-ca2a-497a-8439-5f1dc709dbe8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff304015020 con 0x7ff3140c2a40 2024-09-13T18:44:40.236 INFO:teuthology.orchestra.run.smithi086.stdout:5 2024-09-13T18:44:40.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 msgr2=0x7ff3141f0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 0x7ff3141f0280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff3140c4120 tx=0x7ff304004770 comp rx=0 tx=0).stop 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 shutdown_connections 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff314150860 0x7ff314152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff314150480 0x7ff314151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 --2- 172.21.15.86:0/4244174232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140c2a40 0x7ff3141f0280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 >> 172.21.15.86:0/4244174232 conn(0x7ff3140722b0 msgr2=0x7ff31414dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 shutdown_connections 2024-09-13T18:44:40.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.232+0000 7ff319731700 1 -- 172.21.15.86:0/4244174232 wait complete. 2024-09-13T18:44:40.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 8adaa119-857f-4d43-bf54-dcac614aba37 6 2024-09-13T18:44:40.264 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:40.260+0000 7f94d05242c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:44:40.366 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.348+0000 7f4fec024700 1 Processor -- start 2024-09-13T18:44:40.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.348+0000 7f4fec024700 1 -- start start 2024-09-13T18:44:40.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4fe4071780 0x7f4fe41570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe40705c0 con 0x7f4fe4150410 2024-09-13T18:44:40.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe406f6d0 con 0x7f4fe4071b60 2024-09-13T18:44:40.367 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe406f9b0 con 0x7f4fe4071780 2024-09-13T18:44:40.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe95bf700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4fe4071b60 0x7f4fe4070870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:55760/0 (socket says 172.21.15.86:55760) 2024-09-13T18:44:40.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe95bf700 1 -- 172.21.15.86:0/1117220490 learned_addr learned my addr 172.21.15.86:0/1117220490 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-13T18:44:40.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066716442 0 0) 0x7f4fe406f6d0 con 0x7f4fe4071b60 2024-09-13T18:44:40.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fd00035d0 con 0x7f4fe4071b60 2024-09-13T18:44:40.368 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 --2- 172.21.15.86:0/1117220490 >> v2:172.21.15.32:3300/0 conn(0x7f4fe4071780 0x7f4fe41570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276188188 0 0) 0x7f4fd00035d0 con 0x7f4fe4071b60 2024-09-13T18:44:40.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 >> v2:172.21.15.32:3300/0 conn(0x7f4fe4071780 msgr2=0x7f4fe41570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 --2- 172.21.15.86:0/1117220490 >> v2:172.21.15.32:3300/0 conn(0x7f4fe4071780 0x7f4fe41570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 >> v1:172.21.15.32:6789/0 conn(0x7f4fe4150410 legacy=0x7f4fe406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.369 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe406fc90 con 0x7f4fe4071b60 2024-09-13T18:44:40.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 <== mon.1 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7f4fd4001670 con 0x7f4fe4071b60 2024-09-13T18:44:40.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 >> v1:172.21.15.86:6789/0 conn(0x7f4fe4071b60 legacy=0x7f4fe4070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fd0003a20 0x7f4fd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd0004870 0x7f4fd0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0005230 0x7f4fd000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.370 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe406f9b0 con 0x7f4fd0004870 2024-09-13T18:44:40.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd000c160 con 0x7f4fd0005230 2024-09-13T18:44:40.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd000c320 con 0x7f4fd0003a20 2024-09-13T18:44:40.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fd0003a20 0x7f4fd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fea5c1700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0005230 0x7f4fd000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.371 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe95bf700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd0004870 0x7f4fd0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 -- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0005230 msgr2=0x7f4fd000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0005230 0x7f4fd000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 -- 172.21.15.86:0/1117220490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd0004870 msgr2=0x7f4fd0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fd0004870 0x7f4fd0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.372 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 -- 172.21.15.86:0/1117220490 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd00035d0 con 0x7f4fd0003a20 2024-09-13T18:44:40.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fea5c1700 1 -- 172.21.15.86:0/1117220490 reap_dead start 2024-09-13T18:44:40.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe9dc0700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fd0003a20 0x7f4fd0003e20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009880 tx=0x7f4fd00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d7031000ba687b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000c070 con 0x7f4fd0003a20 2024-09-13T18:44:40.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe0013610 con 0x7f4fd0003a20 2024-09-13T18:44:40.373 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fe8dbe700 1 -- 172.21.15.86:0/1117220490 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00139c0 con 0x7f4fd0003a20 2024-09-13T18:44:40.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fd0003a20 msgr2=0x7f4fd0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fd0003a20 0x7f4fd0003e20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009880 tx=0x7f4fd00058a0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- 172.21.15.86:0/1117220490 shutdown_connections 2024-09-13T18:44:40.374 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 --2- 172.21.15.86:0/1117220490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fd0003a20 0x7f4fd0003e20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- 172.21.15.86:0/1117220490 >> 172.21.15.86:0/1117220490 conn(0x7f4fe40c8bd0 msgr2=0x7f4fe40c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- 172.21.15.86:0/1117220490 shutdown_connections 2024-09-13T18:44:40.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.352+0000 7f4fec024700 1 -- 172.21.15.86:0/1117220490 wait complete. 2024-09-13T18:44:40.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 Processor -- start 2024-09-13T18:44:40.375 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 -- start start 2024-09-13T18:44:40.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0003a20 0x7f4fe4147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fe41efb80 0x7f4fe4152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 0x7f4fe4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.376 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe41ec8e0 con 0x7f4fe41efb80 2024-09-13T18:44:40.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe41ef6f0 con 0x7f4fd0003a20 2024-09-13T18:44:40.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe41ec3a0 con 0x7f4fe41516b0 2024-09-13T18:44:40.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fe9dc0700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0003a20 0x7f4fe4147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.377 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 0x7f4fe4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 0x7f4fe4151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:37654/0 (socket says 172.21.15.86:37654) 2024-09-13T18:44:40.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 -- 172.21.15.86:0/2238809547 learned_addr learned my addr 172.21.15.86:0/2238809547 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:40.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fe95bf700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fe41efb80 0x7f4fe4152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 -- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0003a20 msgr2=0x7f4fe4147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0003a20 0x7f4fe4147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 -- 172.21.15.86:0/2238809547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fe41efb80 msgr2=0x7f4fe4152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fe41efb80 0x7f4fe4152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 -- 172.21.15.86:0/2238809547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe41ef0e0 con 0x7f4fe41516b0 2024-09-13T18:44:40.379 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fe95bf700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fe41efb80 0x7f4fe4152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:44:40.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fea5c1700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 0x7f4fe4151b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40c3ec0 tx=0x7f4fdc0059f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc005240 con 0x7f4fe41516b0 2024-09-13T18:44:40.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe41ec600 con 0x7f4fe41516b0 2024-09-13T18:44:40.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc00c750 con 0x7f4fe41516b0 2024-09-13T18:44:40.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00cb00 con 0x7f4fe41516b0 2024-09-13T18:44:40.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe4152840 con 0x7f4fe41516b0 2024-09-13T18:44:40.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4fdc004470 con 0x7f4fe41516b0 2024-09-13T18:44:40.381 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.356+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4fdc01da50 con 0x7f4fe41516b0 2024-09-13T18:44:40.382 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.360+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe41eef40 con 0x7f4fe41516b0 2024-09-13T18:44:40.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.360+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4fe41eef40 con 0x7f4fe41516b0 2024-09-13T18:44:40.430 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:40.426+0000 7f64b25b52c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:44:40.443 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.436+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8adaa119-857f-4d43-bf54-dcac614aba37", "id": 6} v 0) v1 -- 0x7f4fe41ef8a0 con 0x7f4fe41516b0 2024-09-13T18:44:40.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fda7fc700 1 -- 172.21.15.86:0/2238809547 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8adaa119-857f-4d43-bf54-dcac614aba37", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4fe41ef8a0 con 0x7f4fe41516b0 2024-09-13T18:44:40.450 INFO:teuthology.orchestra.run.smithi086.stdout:6 2024-09-13T18:44:40.451 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f94d05242c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:44:40.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 msgr2=0x7f4fe4151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 0x7f4fe4151b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40c3ec0 tx=0x7f4fdc0059f0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 shutdown_connections 2024-09-13T18:44:40.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fe41516b0 0x7f4fe4151b40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fe41efb80 0x7f4fe4152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 --2- 172.21.15.86:0/2238809547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd0003a20 0x7f4fe4147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 >> 172.21.15.86:0/2238809547 conn(0x7f4fe40c8bd0 msgr2=0x7f4fe4155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 shutdown_connections 2024-09-13T18:44:40.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.444+0000 7f4fec024700 1 -- 172.21.15.86:0/2238809547 wait complete. 2024-09-13T18:44:40.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 97880368-e206-4217-aeee-cf13756aa32b 7 2024-09-13T18:44:40.512 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:40.504+0000 7f94d05242c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:44:40.517 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:40.510+0000 7f64b25b52c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:44:40.576 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:40.572+0000 7f94d05242c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:44:40.609 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:40.602+0000 7f64b25b52c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:44:40.616 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.608+0000 7fd1a3fff700 1 Processor -- start 2024-09-13T18:44:40.617 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 -- start start 2024-09-13T18:44:40.631 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd1a4153450 0x7fd1a4153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a4153db0 con 0x7fd1a4072590 2024-09-13T18:44:40.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a415db50 con 0x7fd1a40721b0 2024-09-13T18:44:40.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40716a0 con 0x7fd1a4153450 2024-09-13T18:44:40.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a2ffd700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd1a40721b0 0x7fd1a415a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.86:57294/0 (socket says 172.21.15.86:57294) 2024-09-13T18:44:40.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a2ffd700 1 -- 172.21.15.86:0/1079066373 learned_addr learned my addr 172.21.15.86:0/1079066373 (peer_addr_for_me v1:172.21.15.86:0/0) 2024-09-13T18:44:40.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963518985 0 0) 0x7fd1a415db50 con 0x7fd1a40721b0 2024-09-13T18:44:40.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1900035d0 con 0x7fd1a40721b0 2024-09-13T18:44:40.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a37fe700 1 --2- 172.21.15.86:0/1079066373 >> v2:172.21.15.32:3300/0 conn(0x7fd1a4153450 0x7fd1a4153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.633 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744146694 0 0) 0x7fd1900035d0 con 0x7fd1a40721b0 2024-09-13T18:44:40.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 >> v2:172.21.15.32:3300/0 conn(0x7fd1a4153450 msgr2=0x7fd1a4153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 --2- 172.21.15.86:0/1079066373 >> v2:172.21.15.32:3300/0 conn(0x7fd1a4153450 0x7fd1a4153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 >> v1:172.21.15.32:6789/0 conn(0x7fd1a4072590 legacy=0x7fd1a40c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a415ccf0 con 0x7fd1a40721b0 2024-09-13T18:44:40.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 <== mon.1 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7fd194001670 con 0x7fd1a40721b0 2024-09-13T18:44:40.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 >> v1:172.21.15.86:6789/0 conn(0x7fd1a40721b0 legacy=0x7fd1a415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd190003a20 0x7fd190003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd190004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd190005230 0x7fd19000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40716a0 con 0x7fd190005230 2024-09-13T18:44:40.635 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000c160 con 0x7fd190004870 2024-09-13T18:44:40.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000c320 con 0x7fd190003a20 2024-09-13T18:44:40.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd190004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a2ffd700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd190003a20 0x7fd190003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a37fe700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd190005230 0x7fd19000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.636 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 -- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd190003a20 msgr2=0x7fd190003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd190003a20 0x7fd190003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 -- 172.21.15.86:0/1079066373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd190005230 msgr2=0x7fd19000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd190005230 0x7fd19000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a37fe700 1 -- 172.21.15.86:0/1079066373 reap_dead start 2024-09-13T18:44:40.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 -- 172.21.15.86:0/1079066373 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900035d0 con 0x7fd190004870 2024-09-13T18:44:40.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd19bfff700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd190004cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd18c007fd0 tx=0x7fd1900058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852b01d7806222ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c016070 con 0x7fd190004870 2024-09-13T18:44:40.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c006880 con 0x7fd190004870 2024-09-13T18:44:40.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a27fc700 1 -- 172.21.15.86:0/1079066373 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c003990 con 0x7fd190004870 2024-09-13T18:44:40.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 -- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 msgr2=0x7fd190004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.612+0000 7fd1a3fff700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd190004cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd18c007fd0 tx=0x7fd1900058a0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- 172.21.15.86:0/1079066373 shutdown_connections 2024-09-13T18:44:40.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 --2- 172.21.15.86:0/1079066373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd190004cf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- 172.21.15.86:0/1079066373 >> 172.21.15.86:0/1079066373 conn(0x7fd1a40cbfe0 msgr2=0x7fd1a40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- 172.21.15.86:0/1079066373 shutdown_connections 2024-09-13T18:44:40.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- 172.21.15.86:0/1079066373 wait complete. 2024-09-13T18:44:40.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 Processor -- start 2024-09-13T18:44:40.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- start start 2024-09-13T18:44:40.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd1a414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1a414f490 0x7fd1a40b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a4154590 0x7fd1a4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a414ef60 con 0x7fd1a4154590 2024-09-13T18:44:40.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a414cd00 con 0x7fd190004870 2024-09-13T18:44:40.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a3fff700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4154f50 con 0x7fd1a414f490 2024-09-13T18:44:40.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd1a414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd1a414c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:58224/0 (socket says 172.21.15.86:58224) 2024-09-13T18:44:40.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 -- 172.21.15.86:0/372964099 learned_addr learned my addr 172.21.15.86:0/372964099 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-13T18:44:40.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd19bfff700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1a414f490 0x7fd1a40b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a37fe700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a4154590 0x7fd1a4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 -- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1a414f490 msgr2=0x7fd1a40b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.643 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1a414f490 0x7fd1a40b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 -- 172.21.15.86:0/372964099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a4154590 msgr2=0x7fd1a4154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a4154590 0x7fd1a4154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.616+0000 7fd1a2ffd700 1 -- 172.21.15.86:0/372964099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a41f2e70 con 0x7fd190004870 2024-09-13T18:44:40.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd1a2ffd700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd1a414c7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1940072c0 tx=0x7fd1940075d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.644 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194007cd0 con 0x7fd190004870 2024-09-13T18:44:40.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940077b0 con 0x7fd190004870 2024-09-13T18:44:40.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400fa70 con 0x7fd190004870 2024-09-13T18:44:40.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a414ebc0 con 0x7fd190004870 2024-09-13T18:44:40.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a414e550 con 0x7fd190004870 2024-09-13T18:44:40.645 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd19401d460 con 0x7fd190004870 2024-09-13T18:44:40.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd194013aa0 con 0x7fd190004870 2024-09-13T18:44:40.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.620+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a414f0a0 con 0x7fd190004870 2024-09-13T18:44:40.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.624+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd1a414f0a0 con 0x7fd190004870 2024-09-13T18:44:40.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.696+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97880368-e206-4217-aeee-cf13756aa32b", "id": 7} v 0) v1 -- 0x7fd1a4067a00 con 0x7fd190004870 2024-09-13T18:44:40.716 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.708+0000 7fd19b7fe700 1 -- 172.21.15.86:0/372964099 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97880368-e206-4217-aeee-cf13756aa32b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd194013440 con 0x7fd190004870 2024-09-13T18:44:40.716 INFO:teuthology.orchestra.run.smithi086.stdout:7 2024-09-13T18:44:40.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 msgr2=0x7fd1a414c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd1a414c7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1940072c0 tx=0x7fd1940075d0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 shutdown_connections 2024-09-13T18:44:40.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1a4154590 0x7fd1a4154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd1a414f490 0x7fd1a40b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.719 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 --2- 172.21.15.86:0/372964099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd190004870 0x7fd1a414c7c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 >> 172.21.15.86:0/372964099 conn(0x7fd1a40cbfe0 msgr2=0x7fd1a4157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 shutdown_connections 2024-09-13T18:44:40.720 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-13T18:44:40.712+0000 7fd1a3fff700 1 -- 172.21.15.86:0/372964099 wait complete. 2024-09-13T18:44:40.732 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:44:40.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:44:40.738 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:44:40.739 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:44:40.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:44:40.745 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:44:40.746 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:44:40.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:44:40.749 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:44:40.749 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:44:40.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:44:40.754 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:44:40.754 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:44:40.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:44:40.756 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:44:40.756 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:44:40.756 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:44:40.760 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:44:40.760 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:44:40.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:44:40.762 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:44:40.762 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:44:40.762 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:44:40.764 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:44:40.764 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:44:40.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.934+0000 7fd098000700 1 Processor -- start 2024-09-13T18:44:40.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.934+0000 7fd098000700 1 -- start start 2024-09-13T18:44:40.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.934+0000 7fd098000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd09015e8f0 0x7fd090161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.934+0000 7fd098000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900ca840 con 0x7fd0900c7740 2024-09-13T18:44:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd098000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900c7e50 con 0x7fd0900cabf0 2024-09-13T18:44:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd098000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900cba80 con 0x7fd09015e8f0 2024-09-13T18:44:40.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd0900c7740 0x7fd090168550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:56402/0 (socket says 172.21.15.32:56402) 2024-09-13T18:44:40.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 -- 172.21.15.32:0/3471166505 learned_addr learned my addr 172.21.15.32:0/3471166505 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:40.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd095600700 1 --2- 172.21.15.32:0/3471166505 >> v2:172.21.15.86:3300/0 conn(0x7fd09015e8f0 0x7fd090161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764020004 0 0) 0x7fd0900ca840 con 0x7fd0900c7740 2024-09-13T18:44:40.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0780035d0 con 0x7fd0900c7740 2024-09-13T18:44:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1709765828 0 0) 0x7fd0780035d0 con 0x7fd0900c7740 2024-09-13T18:44:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 >> v2:172.21.15.86:3300/0 conn(0x7fd09015e8f0 msgr2=0x7fd090161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 --2- 172.21.15.32:0/3471166505 >> v2:172.21.15.86:3300/0 conn(0x7fd09015e8f0 0x7fd090161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 >> v1:172.21.15.86:6789/0 conn(0x7fd0900cabf0 legacy=0x7fd0900719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900c80f0 con 0x7fd0900c7740 2024-09-13T18:44:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7fd0880019f0 con 0x7fd0900c7740 2024-09-13T18:44:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 >> v1:172.21.15.32:6789/0 conn(0x7fd0900c7740 legacy=0x7fd090168550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd078003a20 0x7fd078003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078004870 0x7fd078004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd078005230 0x7fd07800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900cba80 con 0x7fd078005230 2024-09-13T18:44:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07800c0e0 con 0x7fd078004870 2024-09-13T18:44:40.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07800c2a0 con 0x7fd078003a20 2024-09-13T18:44:40.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd078005230 0x7fd07800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd094c00700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078004870 0x7fd078004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd095600700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd078003a20 0x7fd078003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 -- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd078003a20 msgr2=0x7fd078003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd078003a20 0x7fd078003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 -- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078004870 msgr2=0x7fd078004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078004870 0x7fd078004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 -- 172.21.15.32:0/3471166505 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780035d0 con 0x7fd078005230 2024-09-13T18:44:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 -- 172.21.15.32:0/3471166505 reap_dead start 2024-09-13T18:44:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd096000700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd078005230 0x7fd07800ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd08800a800 tx=0x7fd0780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ef1d35071460c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800a2f0 con 0x7fd078005230 2024-09-13T18:44:40.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0880072f0 con 0x7fd078005230 2024-09-13T18:44:40.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.938+0000 7fd08fe00700 1 -- 172.21.15.32:0/3471166505 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880076a0 con 0x7fd078005230 2024-09-13T18:44:40.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 -- 172.21.15.32:0/3471166505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd078005230 msgr2=0x7fd07800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd078005230 0x7fd07800ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd08800a800 tx=0x7fd0780058a0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 -- 172.21.15.32:0/3471166505 shutdown_connections 2024-09-13T18:44:40.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 --2- 172.21.15.32:0/3471166505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd078005230 0x7fd07800ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 -- 172.21.15.32:0/3471166505 >> 172.21.15.32:0/3471166505 conn(0x7fd090071240 msgr2=0x7fd09006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:40.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 -- 172.21.15.32:0/3471166505 shutdown_connections 2024-09-13T18:44:40.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 -- 172.21.15.32:0/3471166505 wait complete. 2024-09-13T18:44:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 Processor -- start 2024-09-13T18:44:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.942+0000 7fd098000700 1 -- start start 2024-09-13T18:44:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078005230 0x7fd0901595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd090159ae0 0x7fd090125560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090125aa0 0x7fd0901f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900ac0f0 con 0x7fd090125aa0 2024-09-13T18:44:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901250d0 con 0x7fd078005230 2024-09-13T18:44:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900ad9f0 con 0x7fd090159ae0 2024-09-13T18:44:40.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd094c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd090159ae0 0x7fd090125560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd095600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078005230 0x7fd0901595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090125aa0 0x7fd0901f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd094c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd090159ae0 0x7fd090125560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57926/0 (socket says 172.21.15.32:57926) 2024-09-13T18:44:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd094c00700 1 -- 172.21.15.32:0/3730466903 learned_addr learned my addr 172.21.15.32:0/3730466903 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 -- 172.21.15.32:0/3730466903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd090159ae0 msgr2=0x7fd090125560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd090159ae0 0x7fd090125560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 -- 172.21.15.32:0/3730466903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078005230 msgr2=0x7fd0901595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078005230 0x7fd0901595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 -- 172.21.15.32:0/3730466903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090125f20 con 0x7fd090125aa0 2024-09-13T18:44:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd096000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090125aa0 0x7fd0901f70c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0901282d0 tx=0x7fd088001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:40.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088024030 con 0x7fd090125aa0 2024-09-13T18:44:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088007870 con 0x7fd090125aa0 2024-09-13T18:44:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0900ac340 con 0x7fd090125aa0 2024-09-13T18:44:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088001250 con 0x7fd090125aa0 2024-09-13T18:44:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0900a9810 con 0x7fd090125aa0 2024-09-13T18:44:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd088027070 con 0x7fd090125aa0 2024-09-13T18:44:40.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.946+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd088025070 con 0x7fd090125aa0 2024-09-13T18:44:40.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.950+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd090159ec0 con 0x7fd090125aa0 2024-09-13T18:44:40.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:40.954+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd088018070 con 0x7fd090125aa0 2024-09-13T18:44:40.982 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:40.976+0000 7f94d05242c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:44:41.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd09015ecd0 con 0x7fd090125aa0 2024-09-13T18:44:41.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd08d600700 1 -- 172.21.15.32:0/3730466903 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd08800a450 con 0x7fd090125aa0 2024-09-13T18:44:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:44:41.027 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:44:40.704698+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:44:41.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090125aa0 msgr2=0x7fd0901f70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:41.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090125aa0 0x7fd0901f70c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0901282d0 tx=0x7fd088001d80 comp rx=0 tx=0).stop 2024-09-13T18:44:41.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 shutdown_connections 2024-09-13T18:44:41.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd090125aa0 0x7fd0901f70c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:41.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd090159ae0 0x7fd090125560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:41.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 --2- 172.21.15.32:0/3730466903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd078005230 0x7fd0901595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:41.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 >> 172.21.15.32:0/3730466903 conn(0x7fd090071240 msgr2=0x7fd09015f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:41.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 shutdown_connections 2024-09-13T18:44:41.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:41.022+0000 7fd098000700 1 -- 172.21.15.32:0/3730466903 wait complete. 2024-09-13T18:44:41.045 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:44:41.045 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:44:41.107 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:41.100+0000 7f94d05242c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:44:41.121 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:41.114+0000 7f64b25b52c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:44:41.138 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:44:41.132+0000 7f43a2f4f880 -1 Falling back to public interface 2024-09-13T18:44:41.319 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:41.314+0000 7f64b25b52c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:44:41.390 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:44:41.384+0000 7fdc5ec60880 -1 Falling back to public interface 2024-09-13T18:44:41.390 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:44:41.384+0000 7fb4fe860880 -1 Falling back to public interface 2024-09-13T18:44:41.391 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:44:41.384+0000 7f8bb7199880 -1 Falling back to public interface 2024-09-13T18:44:41.391 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:44:41.384+0000 7fdc5dc2b700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2024-09-13T18:44:41.420 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:44:41.414+0000 7f1507c20880 -1 Falling back to public interface 2024-09-13T18:44:41.431 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:44:41.426+0000 7fd90e641880 -1 Falling back to public interface 2024-09-13T18:44:41.435 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:44:41.430+0000 7f42e6baf880 -1 Falling back to public interface 2024-09-13T18:44:41.438 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:44:41.434+0000 7fd90d200700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-09-13T18:44:41.448 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:44:41.442+0000 7fa48cac2880 -1 Falling back to public interface 2024-09-13T18:44:41.474 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:41.468+0000 7f94d05242c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:44:41.658 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:41.652+0000 7f94d05242c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:44:41.725 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:41.720+0000 7f94d05242c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:44:41.771 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:41.766+0000 7f64b25b52c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:44:41.850 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:44:41.885 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:41.880+0000 7f94d05242c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:44:42.002 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:41.998+0000 7f4e68600700 1 Processor -- start 2024-09-13T18:44:42.002 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:41.998+0000 7f4e68600700 1 -- start start 2024-09-13T18:44:42.005 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e60153ac0 0x7f4e600c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:42.005 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e6006eac0 0x7f4e600c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:42.005 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6006df20 con 0x7f4e600740d0 2024-09-13T18:44:42.006 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6015cd10 con 0x7f4e60153ac0 2024-09-13T18:44:42.006 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60153ea0 con 0x7f4e6006eac0 2024-09-13T18:44:42.006 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e66600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e6006eac0 0x7f4e600c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:42.006 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e65c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e60153ac0 0x7f4e600c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:42.006 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e65200700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4e600740d0 0x7f4e6006e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:47590/0 (socket says 172.21.15.32:47590) 2024-09-13T18:44:42.006 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e65200700 1 -- 172.21.15.32:0/3432143602 learned_addr learned my addr 172.21.15.32:0/3432143602 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:42.007 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e5fe00700 1 -- 172.21.15.32:0/3432143602 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219924369 0 0) 0x7f4e6006df20 con 0x7f4e600740d0 2024-09-13T18:44:42.007 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e5fe00700 1 -- 172.21.15.32:0/3432143602 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e480035d0 con 0x7f4e600740d0 2024-09-13T18:44:42.007 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e66600700 1 -- 172.21.15.32:0/3432143602 >> v2:172.21.15.86:3300/0 conn(0x7f4e60153ac0 msgr2=0x7f4e600c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:42.007 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e66600700 1 --2- 172.21.15.32:0/3432143602 >> v2:172.21.15.86:3300/0 conn(0x7f4e60153ac0 0x7f4e600c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.008 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e66600700 1 -- 172.21.15.32:0/3432143602 >> v1:172.21.15.86:6789/0 conn(0x7f4e600740d0 legacy=0x7f4e6006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:42.008 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e66600700 1 -- 172.21.15.32:0/3432143602 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6015cf70 con 0x7f4e6006eac0 2024-09-13T18:44:42.008 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e65c00700 1 --2- 172.21.15.32:0/3432143602 >> v2:172.21.15.86:3300/0 conn(0x7f4e60153ac0 0x7f4e600c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:42.008 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e66600700 1 --2- 172.21.15.32:0/3432143602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e6006eac0 0x7f4e600c8860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009d90 tx=0x7f4e5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b903b59261b072 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:42.008 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e5fe00700 1 -- 172.21.15.32:0/3432143602 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800e070 con 0x7f4e6006eac0 2024-09-13T18:44:42.009 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e5fe00700 1 -- 172.21.15.32:0/3432143602 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800bb20 con 0x7f4e6006eac0 2024-09-13T18:44:42.009 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e5fe00700 1 -- 172.21.15.32:0/3432143602 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800be90 con 0x7f4e6006eac0 2024-09-13T18:44:42.009 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 -- 172.21.15.32:0/3432143602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e6006eac0 msgr2=0x7f4e600c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:42.009 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.002+0000 7f4e68600700 1 --2- 172.21.15.32:0/3432143602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e6006eac0 0x7f4e600c8860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009d90 tx=0x7f4e5800b330 comp rx=0 tx=0).stop 2024-09-13T18:44:42.010 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- 172.21.15.32:0/3432143602 shutdown_connections 2024-09-13T18:44:42.010 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 --2- 172.21.15.32:0/3432143602 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e6006eac0 0x7f4e600c8860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.010 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 --2- 172.21.15.32:0/3432143602 >> v2:172.21.15.86:3300/0 conn(0x7f4e60153ac0 0x7f4e600c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.010 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- 172.21.15.32:0/3432143602 >> 172.21.15.32:0/3432143602 conn(0x7f4e6006a390 msgr2=0x7f4e6006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:42.010 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- 172.21.15.32:0/3432143602 shutdown_connections 2024-09-13T18:44:42.010 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- 172.21.15.32:0/3432143602 wait complete. 2024-09-13T18:44:42.011 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 Processor -- start 2024-09-13T18:44:42.011 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- start start 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6006eac0 0x7f4e601e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 0x7f4e601e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e60153ac0 0x7f4e6014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e601e5c40 con 0x7f4e60153ac0 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e601e4620 con 0x7f4e6006eac0 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e68600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e601e5e30 con 0x7f4e600740d0 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e65c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6006eac0 0x7f4e601e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e66600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e60153ac0 0x7f4e6014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e65200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 0x7f4e601e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:42.013 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e65200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 0x7f4e601e4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57944/0 (socket says 172.21.15.32:57944) 2024-09-13T18:44:42.014 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.006+0000 7f4e65200700 1 -- 172.21.15.32:0/4122298091 learned_addr learned my addr 172.21.15.32:0/4122298091 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e65200700 1 -- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6006eac0 msgr2=0x7f4e601e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e65200700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6006eac0 0x7f4e601e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e65200700 1 -- 172.21.15.32:0/4122298091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e60153ac0 msgr2=0x7f4e6014ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e65200700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e60153ac0 0x7f4e6014ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e65200700 1 -- 172.21.15.32:0/4122298091 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540094b0 con 0x7f4e600740d0 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e65200700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 0x7f4e601e4fc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c700 tx=0x7f4e4c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c005d90 con 0x7f4e600740d0 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c0070d0 con 0x7f4e600740d0 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c007480 con 0x7f4e600740d0 2024-09-13T18:44:42.015 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58009a70 con 0x7f4e600740d0 2024-09-13T18:44:42.016 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601e63f0 con 0x7f4e600740d0 2024-09-13T18:44:42.016 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4e4c01c440 con 0x7f4e600740d0 2024-09-13T18:44:42.016 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4e4c012ad0 con 0x7f4e600740d0 2024-09-13T18:44:42.016 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.010+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e60067a40 con 0x7f4e600740d0 2024-09-13T18:44:42.022 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.018+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4e4c017070 con 0x7f4e600740d0 2024-09-13T18:44:42.034 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:42.030+0000 7f64b25b52c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:44:42.093 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.086+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e6014fd50 con 0x7f4e600740d0 2024-09-13T18:44:42.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e5d600700 1 -- 172.21.15.32:0/4122298091 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4e4c012400 con 0x7f4e600740d0 2024-09-13T18:44:42.095 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-13T18:44:42.095 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:44:40.704698+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 msgr2=0x7f4e601e4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 0x7f4e601e4fc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c700 tx=0x7f4e4c00ca10 comp rx=0 tx=0).stop 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 shutdown_connections 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e60153ac0 0x7f4e6014ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e600740d0 0x7f4e601e4fc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 --2- 172.21.15.32:0/4122298091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e6006eac0 0x7f4e601e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:42.096 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 >> 172.21.15.32:0/4122298091 conn(0x7f4e6006a390 msgr2=0x7f4e6015adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:42.097 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 shutdown_connections 2024-09-13T18:44:42.097 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:42.090+0000 7f4e68600700 1 -- 172.21.15.32:0/4122298091 wait complete. 2024-09-13T18:44:42.117 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:44:42.133 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:42.126+0000 7f64b25b52c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:44:42.360 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:42.354+0000 7f64b25b52c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:44:42.566 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:42.560+0000 7f94d05242c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:44:42.636 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:42.628+0000 7f94d05242c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:44:42.802 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:42.796+0000 7f94d05242c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:44:42.867 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:42.860+0000 7f94d05242c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:44:42.935 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:42.928+0000 7f94d05242c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:44:43.249 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:43.242+0000 7f64b25b52c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:44:43.255 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:43.248+0000 7f94d05242c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:44:43.332 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:43.324+0000 7f94d05242c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:44:43.342 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:43.338+0000 7f64b25b52c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:44:43.527 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:43.522+0000 7f64b25b52c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:44:43.617 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:43.610+0000 7f64b25b52c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:44:43.723 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:43.718+0000 7f64b25b52c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:44:44.021 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:44.016+0000 7f94d05242c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:44:44.140 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:44.134+0000 7f64b25b52c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:44:44.270 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:44.266+0000 7f64b25b52c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:44:44.764 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:44:44.760+0000 7f8bb7199880 -1 osd.7 0 log_to_monitors true 2024-09-13T18:44:44.994 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:44:44.988+0000 7f43a2f4f880 -1 osd.6 0 log_to_monitors true 2024-09-13T18:44:45.072 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:45.064+0000 7f94b709a700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:44:45.072 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-13T18:44:45.064+0000 7f94b709a700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:44:45.233 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-09-13T18:44:45.226+0000 7f64b25b52c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:44:45.245 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:44:45.240+0000 7fdc5ec60880 -1 osd.4 0 log_to_monitors true 2024-09-13T18:44:45.258 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:44:45.252+0000 7fb4fe860880 -1 osd.5 0 log_to_monitors true 2024-09-13T18:44:45.582 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:44:45.578+0000 7f1507c20880 -1 osd.1 0 log_to_monitors true 2024-09-13T18:44:45.621 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:44:45.614+0000 7fd90e641880 -1 osd.2 0 log_to_monitors true 2024-09-13T18:44:45.659 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:44:45.654+0000 7f42e6baf880 -1 osd.0 0 log_to_monitors true 2024-09-13T18:44:45.677 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:44:45.670+0000 7fa48cac2880 -1 osd.3 0 log_to_monitors true 2024-09-13T18:44:47.723 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:44:47.716+0000 7f439ed8e700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:44:47.733 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:44:47.728+0000 7f439683d700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:47.805 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:44:47.800+0000 7f8bb2fd8700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:44:47.820 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:44:47.816+0000 7f8baaa87700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:48.571 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:44:48.564+0000 7fb4fa69f700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:44:48.577 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:44:48.572+0000 7fb4f214e700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:48.609 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:44:48.604+0000 7fdc5b426700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:44:48.616 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:44:48.608+0000 7fdc5254e700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:48.916 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:44:48.910+0000 7f42e1a00700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:44:48.924 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:44:48.937 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:44:48.930+0000 7f42d7600700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:48.955 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:44:48.950+0000 7fd909600700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:44:48.961 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:44:48.954+0000 7fd8ff200700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:48.966 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:44:48.958+0000 7fa487a00700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:44:48.971 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:44:48.966+0000 7fa47d600700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:48.987 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:44:48.982+0000 7f1502a00700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:44:48.996 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:44:48.990+0000 7f14f8600700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:44:49.087 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.082+0000 7f7063200700 1 Processor -- start 2024-09-13T18:44:49.088 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.082+0000 7f7063200700 1 -- start start 2024-09-13T18:44:49.090 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f70640722a0 0x7f70641572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:49.090 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f706406c5a0 0x7f7064161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:49.090 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70640c2000 con 0x7f7064072680 2024-09-13T18:44:49.090 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70640caa00 con 0x7f70640722a0 2024-09-13T18:44:49.090 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706406cb50 con 0x7f706406c5a0 2024-09-13T18:44:49.091 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7059400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7064072680 0x7f7064151160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:53304/0 (socket says 172.21.15.32:53304) 2024-09-13T18:44:49.091 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7059400700 1 -- 172.21.15.32:0/3373196668 learned_addr learned my addr 172.21.15.32:0/3373196668 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:49.091 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7062800700 1 --2- 172.21.15.32:0/3373196668 >> v2:172.21.15.86:3300/0 conn(0x7f706406c5a0 0x7f7064161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:49.091 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061e00700 1 --2- 172.21.15.32:0/3373196668 >> v2:172.21.15.32:3300/0 conn(0x7f70640722a0 0x7f70641572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061400700 1 -- 172.21.15.32:0/3373196668 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727796751 0 0) 0x7f70640c2000 con 0x7f7064072680 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061400700 1 -- 172.21.15.32:0/3373196668 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70480035d0 con 0x7f7064072680 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061e00700 1 -- 172.21.15.32:0/3373196668 >> v2:172.21.15.86:3300/0 conn(0x7f706406c5a0 msgr2=0x7f7064161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061e00700 1 --2- 172.21.15.32:0/3373196668 >> v2:172.21.15.86:3300/0 conn(0x7f706406c5a0 0x7f7064161bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061e00700 1 -- 172.21.15.32:0/3373196668 >> v1:172.21.15.86:6789/0 conn(0x7f7064072680 legacy=0x7f7064151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061e00700 1 -- 172.21.15.32:0/3373196668 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70640c22a0 con 0x7f70640722a0 2024-09-13T18:44:49.092 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061e00700 1 --2- 172.21.15.32:0/3373196668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70640722a0 0x7f70641572d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7064071970 tx=0x7f7054009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c712a67619f0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:49.093 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061400700 1 -- 172.21.15.32:0/3373196668 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054011830 con 0x7f70640722a0 2024-09-13T18:44:49.093 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061400700 1 -- 172.21.15.32:0/3373196668 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054011990 con 0x7f70640722a0 2024-09-13T18:44:49.093 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7061400700 1 -- 172.21.15.32:0/3373196668 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054011d20 con 0x7f70640722a0 2024-09-13T18:44:49.093 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 -- 172.21.15.32:0/3373196668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70640722a0 msgr2=0x7f70641572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:49.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.086+0000 7f7063200700 1 --2- 172.21.15.32:0/3373196668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70640722a0 0x7f70641572d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7064071970 tx=0x7f7054009b30 comp rx=0 tx=0).stop 2024-09-13T18:44:49.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 -- 172.21.15.32:0/3373196668 shutdown_connections 2024-09-13T18:44:49.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 --2- 172.21.15.32:0/3373196668 >> v2:172.21.15.86:3300/0 conn(0x7f706406c5a0 0x7f7064161bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 --2- 172.21.15.32:0/3373196668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70640722a0 0x7f70641572d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 -- 172.21.15.32:0/3373196668 >> 172.21.15.32:0/3373196668 conn(0x7f7064066200 msgr2=0x7f70640665e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:49.094 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 -- 172.21.15.32:0/3373196668 shutdown_connections 2024-09-13T18:44:49.095 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 -- 172.21.15.32:0/3373196668 wait complete. 2024-09-13T18:44:49.097 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 Processor -- start 2024-09-13T18:44:49.097 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.090+0000 7f7063200700 1 -- start start 2024-09-13T18:44:49.098 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 0x7f7064149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:49.099 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 0x7f70641f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:49.099 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 0x7f70641f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:49.099 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c5390 con 0x7f7064072680 2024-09-13T18:44:49.099 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c46c0 con 0x7f70640722a0 2024-09-13T18:44:49.099 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706414a150 con 0x7f706406c5a0 2024-09-13T18:44:49.101 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7059400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 0x7f70641f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:49.102 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 0x7f7064149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:49.102 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7062800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 0x7f70641f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:49.102 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 0x7f7064149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:49998/0 (socket says 172.21.15.32:49998) 2024-09-13T18:44:49.102 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 -- 172.21.15.32:0/180579040 learned_addr learned my addr 172.21.15.32:0/180579040 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:49.102 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7059400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 0x7f70641f0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:60330/0 (socket says 172.21.15.32:60330) 2024-09-13T18:44:49.102 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7062800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 0x7f70641f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33664/0 (socket says 172.21.15.32:33664) 2024-09-13T18:44:49.103 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 -- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 msgr2=0x7f70641f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:49.103 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 0x7f70641f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.103 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 -- 172.21.15.32:0/180579040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 msgr2=0x7f70641f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:49.103 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 0x7f70641f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.103 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 -- 172.21.15.32:0/180579040 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540094b0 con 0x7f706406c5a0 2024-09-13T18:44:49.103 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7059400700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 0x7f70641f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:49.104 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7062800700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 0x7f70641f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:49.104 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7061e00700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 0x7f7064149c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7054009b70 tx=0x7f7054004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:49.104 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054004380 con 0x7f706406c5a0 2024-09-13T18:44:49.104 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705401f070 con 0x7f706406c5a0 2024-09-13T18:44:49.104 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540036c0 con 0x7f706406c5a0 2024-09-13T18:44:49.104 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.094+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70640c43e0 con 0x7f706406c5a0 2024-09-13T18:44:49.105 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.098+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70641f0040 con 0x7f706406c5a0 2024-09-13T18:44:49.105 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.098+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70640c40b0 con 0x7f706406c5a0 2024-09-13T18:44:49.106 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.098+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f7054021030 con 0x7f706406c5a0 2024-09-13T18:44:49.107 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.102+0000 7f705aa00700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f70400666a0 0x7f7040068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:49.107 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.102+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f7054084520 con 0x7f706406c5a0 2024-09-13T18:44:49.107 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.102+0000 7f7059400700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f70400666a0 0x7f7040068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:49.108 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.102+0000 7f7059400700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f70400666a0 0x7f7040068b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f706414c220 tx=0x7f704c007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:49.118 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.114+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7054052180 con 0x7f706406c5a0 2024-09-13T18:44:49.329 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.322+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70640c6a20 con 0x7f706406c5a0 2024-09-13T18:44:49.331 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.326+0000 7f705aa00700 1 -- 172.21.15.32:0/180579040 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8952 (secure 0 0 0) 0x7f70540557a0 con 0x7f706406c5a0 2024-09-13T18:44:49.331 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-13T18:44:49.332 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":14,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:44:48.738101+0000","last_up_change":"2024-09-13T18:44:48.738101+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:44:49.334 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f70400666a0 msgr2=0x7f7040068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:49.334 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f70400666a0 0x7f7040068b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f706414c220 tx=0x7f704c007de0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.334 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 msgr2=0x7f7064149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:49.334 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 0x7f7064149c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7054009b70 tx=0x7f7054004770 comp rx=0 tx=0).stop 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 shutdown_connections 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f70400666a0 0x7f7040068b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7064072680 0x7f70641f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70640722a0 0x7f70641f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 --2- 172.21.15.32:0/180579040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f706406c5a0 0x7f7064149c10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 >> 172.21.15.32:0/180579040 conn(0x7f7064066200 msgr2=0x7f7064150470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 shutdown_connections 2024-09-13T18:44:49.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:49.330+0000 7f7063200700 1 -- 172.21.15.32:0/180579040 wait complete. 2024-09-13T18:44:49.352 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-09-13T18:44:53.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:53.026 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:56.160 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:44:56.319 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 Processor -- start 2024-09-13T18:44:56.319 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 -- start start 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06c2e0 0x7fcbfc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcbfc06cc00 0x7fcbfc06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc1583e0 con 0x7fcbfc071d30 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc157470 con 0x7fcbfc06cc00 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc02a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc072a60 con 0x7fcbfc06c2e0 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.314+0000 7fcc00c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcbfc06cc00 0x7fcbfc06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcbfc071d30 0x7fcbfc1512f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:53306/0 (socket says 172.21.15.32:53306) 2024-09-13T18:44:56.321 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc01600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06c2e0 0x7fcbfc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.322 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02000700 1 -- 172.21.15.32:0/2487241825 learned_addr learned my addr 172.21.15.32:0/2487241825 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:56.322 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcbfbe00700 1 -- 172.21.15.32:0/2487241825 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024510175 0 0) 0x7fcbfc1583e0 con 0x7fcbfc071d30 2024-09-13T18:44:56.323 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcbfbe00700 1 -- 172.21.15.32:0/2487241825 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe40035d0 con 0x7fcbfc071d30 2024-09-13T18:44:56.323 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc01600700 1 -- 172.21.15.32:0/2487241825 >> v2:172.21.15.32:3300/0 conn(0x7fcbfc06cc00 msgr2=0x7fcbfc06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:56.323 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc01600700 1 --2- 172.21.15.32:0/2487241825 >> v2:172.21.15.32:3300/0 conn(0x7fcbfc06cc00 0x7fcbfc06fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.323 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc01600700 1 -- 172.21.15.32:0/2487241825 >> v1:172.21.15.86:6789/0 conn(0x7fcbfc071d30 legacy=0x7fcbfc1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.323 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc01600700 1 -- 172.21.15.32:0/2487241825 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0727c0 con 0x7fcbfc06c2e0 2024-09-13T18:44:56.324 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc01600700 1 --2- 172.21.15.32:0/2487241825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06c2e0 0x7fcbfc06c6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009850 tx=0x7fcbf0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=401f3f228659fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:56.324 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcbfbe00700 1 -- 172.21.15.32:0/2487241825 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0011830 con 0x7fcbfc06c2e0 2024-09-13T18:44:56.324 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcbfbe00700 1 -- 172.21.15.32:0/2487241825 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0011990 con 0x7fcbfc06c2e0 2024-09-13T18:44:56.324 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcbfbe00700 1 -- 172.21.15.32:0/2487241825 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0011d00 con 0x7fcbfc06c2e0 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 -- 172.21.15.32:0/2487241825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06c2e0 msgr2=0x7fcbfc06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 --2- 172.21.15.32:0/2487241825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06c2e0 0x7fcbfc06c6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009850 tx=0x7fcbf0009b60 comp rx=0 tx=0).stop 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 -- 172.21.15.32:0/2487241825 shutdown_connections 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 --2- 172.21.15.32:0/2487241825 >> v2:172.21.15.32:3300/0 conn(0x7fcbfc06cc00 0x7fcbfc06fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 --2- 172.21.15.32:0/2487241825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06c2e0 0x7fcbfc06c6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 -- 172.21.15.32:0/2487241825 >> 172.21.15.32:0/2487241825 conn(0x7fcbfc06d9f0 msgr2=0x7fcbfc06de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 -- 172.21.15.32:0/2487241825 shutdown_connections 2024-09-13T18:44:56.325 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.318+0000 7fcc02a00700 1 -- 172.21.15.32:0/2487241825 wait complete. 2024-09-13T18:44:56.328 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.322+0000 7fcc02a00700 1 Processor -- start 2024-09-13T18:44:56.328 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.322+0000 7fcc02a00700 1 -- start start 2024-09-13T18:44:56.329 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbfc06c2e0 0x7fcbfc14d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.330 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06cc00 0x7fcbfc0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.330 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbfc071d30 0x7fcbfc1e8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.330 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1eef20 con 0x7fcbfc071d30 2024-09-13T18:44:56.330 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc14da40 con 0x7fcbfc06c2e0 2024-09-13T18:44:56.330 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1f2270 con 0x7fcbfc06cc00 2024-09-13T18:44:56.331 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc01600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbfc06c2e0 0x7fcbfc14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.331 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc00c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06cc00 0x7fcbfc0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.331 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbfc071d30 0x7fcbfc1e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.331 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc01600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbfc06c2e0 0x7fcbfc14d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:60332/0 (socket says 172.21.15.32:60332) 2024-09-13T18:44:56.331 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc01600700 1 -- 172.21.15.32:0/476757732 learned_addr learned my addr 172.21.15.32:0/476757732 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:56.332 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 -- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06cc00 msgr2=0x7fcbfc0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.332 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06cc00 0x7fcbfc0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.332 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 -- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbfc06c2e0 msgr2=0x7fcbfc14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.332 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbfc06c2e0 0x7fcbfc14d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.332 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 -- 172.21.15.32:0/476757732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf00094b0 con 0x7fcbfc071d30 2024-09-13T18:44:56.332 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02000700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbfc071d30 0x7fcbfc1e8950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40012e0 tx=0x7fcbf400ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:56.333 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40074e0 con 0x7fcbfc071d30 2024-09-13T18:44:56.333 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4007640 con 0x7fcbfc071d30 2024-09-13T18:44:56.333 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40079f0 con 0x7fcbfc071d30 2024-09-13T18:44:56.333 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc1f2550 con 0x7fcbfc071d30 2024-09-13T18:44:56.333 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.326+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc1f2b10 con 0x7fcbfc071d30 2024-09-13T18:44:56.334 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.330+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc067a40 con 0x7fcbfc071d30 2024-09-13T18:44:56.335 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.330+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbf401b3b0 con 0x7fcbfc071d30 2024-09-13T18:44:56.337 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.330+0000 7fcbf9600700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcbdc066730 0x7fcbdc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.337 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.334+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcbf4083640 con 0x7fcbfc071d30 2024-09-13T18:44:56.338 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.334+0000 7fcc01600700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcbdc066730 0x7fcbdc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.339 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.334+0000 7fcc01600700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcbdc066730 0x7fcbdc068bf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000c00 tx=0x7fcbf0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:56.345 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.338+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbf4050cf0 con 0x7fcbfc071d30 2024-09-13T18:44:56.541 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.534+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbfc0c5430 con 0x7fcbfc071d30 2024-09-13T18:44:56.542 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.538+0000 7fcbf9600700 1 -- 172.21.15.32:0/476757732 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fcbf4017090 con 0x7fcbfc071d30 2024-09-13T18:44:56.543 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-13T18:44:56.543 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":18,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:44:52.757184+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:44:56.548 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcbdc066730 msgr2=0x7fcbdc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.548 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcbdc066730 0x7fcbdc068bf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000c00 tx=0x7fcbf0008030 comp rx=0 tx=0).stop 2024-09-13T18:44:56.548 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbfc071d30 msgr2=0x7fcbfc1e8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.548 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbfc071d30 0x7fcbfc1e8950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40012e0 tx=0x7fcbf400ca70 comp rx=0 tx=0).stop 2024-09-13T18:44:56.548 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 shutdown_connections 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcbdc066730 0x7fcbdc068bf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbfc071d30 0x7fcbfc1e8950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbfc06cc00 0x7fcbfc0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 --2- 172.21.15.32:0/476757732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbfc06c2e0 0x7fcbfc14d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 >> 172.21.15.32:0/476757732 conn(0x7fcbfc06d9f0 msgr2=0x7fcbfc150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 shutdown_connections 2024-09-13T18:44:56.549 INFO:teuthology.misc.health.smithi032.stderr:2024-09-13T18:44:56.542+0000 7fcc02a00700 1 -- 172.21.15.32:0/476757732 wait complete. 2024-09-13T18:44:56.566 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:44:56.567 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:44:56.567 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:44:56.567 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:44:56.574 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:44:56.574 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:44:56.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:44:56.579 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:44:56.579 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-13T18:44:56.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-13T18:44:56.584 INFO:tasks.ceph.mds.e:Started 2024-09-13T18:44:56.584 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:44:56.584 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:44:56.587 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:44:56.588 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:44:56.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:44:56.591 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:44:56.591 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-13T18:44:56.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-13T18:44:56.594 INFO:tasks.ceph.mds.f:Started 2024-09-13T18:44:56.595 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:44:56.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:44:56.667 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-13T18:44:56.668 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-13T18:44:56.668 INFO:tasks.ceph.mds.f.smithi086.stdout:starting mds.f at 2024-09-13T18:44:56.690 INFO:tasks.ceph.mds.e.smithi032.stdout:starting mds.e at 2024-09-13T18:44:56.692 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2024-09-13T18:44:56.695 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-09-13T18:44:56.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 Processor -- start 2024-09-13T18:44:56.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 -- start start 2024-09-13T18:44:56.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5ed8070540 0x7f5ed8070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ed8157d40 0x7f5ed8161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed80c84b0 con 0x7f5ed806d8e0 2024-09-13T18:44:56.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed815b820 con 0x7f5ed8157d40 2024-09-13T18:44:56.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.762+0000 7f5ed7200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed8070e60 con 0x7f5ed8070540 2024-09-13T18:44:56.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed5400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5ed806d8e0 0x7f5ed8157630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:53334/0 (socket says 172.21.15.32:53334) 2024-09-13T18:44:56.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed5400700 1 -- 172.21.15.32:0/2254548347 learned_addr learned my addr 172.21.15.32:0/2254548347 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:56.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed5e00700 1 --2- 172.21.15.32:0/2254548347 >> v2:172.21.15.86:3300/0 conn(0x7f5ed8070540 0x7f5ed8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed6800700 1 --2- 172.21.15.32:0/2254548347 >> v2:172.21.15.32:3300/0 conn(0x7f5ed8157d40 0x7f5ed8161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed4a00700 1 -- 172.21.15.32:0/2254548347 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356457154 0 0) 0x7f5ed80c84b0 con 0x7f5ed806d8e0 2024-09-13T18:44:56.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed4a00700 1 -- 172.21.15.32:0/2254548347 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc0035d0 con 0x7f5ed806d8e0 2024-09-13T18:44:56.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed6800700 1 -- 172.21.15.32:0/2254548347 >> v2:172.21.15.86:3300/0 conn(0x7f5ed8070540 msgr2=0x7f5ed8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:56.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed6800700 1 --2- 172.21.15.32:0/2254548347 >> v2:172.21.15.86:3300/0 conn(0x7f5ed8070540 0x7f5ed8070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed6800700 1 -- 172.21.15.32:0/2254548347 >> v1:172.21.15.86:6789/0 conn(0x7f5ed806d8e0 legacy=0x7f5ed8157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed6800700 1 -- 172.21.15.32:0/2254548347 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80c8770 con 0x7f5ed8157d40 2024-09-13T18:44:56.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed5e00700 1 --2- 172.21.15.32:0/2254548347 >> v2:172.21.15.86:3300/0 conn(0x7f5ed8070540 0x7f5ed8070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:56.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed6800700 1 --2- 172.21.15.32:0/2254548347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed8161ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8066bb0 tx=0x7f5ed000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e1c70b3c207f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:56.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed4a00700 1 -- 172.21.15.32:0/2254548347 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000e070 con 0x7f5ed8157d40 2024-09-13T18:44:56.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed4a00700 1 -- 172.21.15.32:0/2254548347 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000bb20 con 0x7f5ed8157d40 2024-09-13T18:44:56.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed4a00700 1 -- 172.21.15.32:0/2254548347 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0012430 con 0x7f5ed8157d40 2024-09-13T18:44:56.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed7200700 1 -- 172.21.15.32:0/2254548347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 msgr2=0x7f5ed8161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed7200700 1 --2- 172.21.15.32:0/2254548347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed8161ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8066bb0 tx=0x7f5ed000b330 comp rx=0 tx=0).stop 2024-09-13T18:44:56.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed7200700 1 -- 172.21.15.32:0/2254548347 shutdown_connections 2024-09-13T18:44:56.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed7200700 1 --2- 172.21.15.32:0/2254548347 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed8161ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed7200700 1 --2- 172.21.15.32:0/2254548347 >> v2:172.21.15.86:3300/0 conn(0x7f5ed8070540 0x7f5ed8070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.766+0000 7f5ed7200700 1 -- 172.21.15.32:0/2254548347 >> 172.21.15.32:0/2254548347 conn(0x7f5ed8071080 msgr2=0x7f5ed8071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:56.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.770+0000 7f5ed7200700 1 -- 172.21.15.32:0/2254548347 shutdown_connections 2024-09-13T18:44:56.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.770+0000 7f5ed7200700 1 -- 172.21.15.32:0/2254548347 wait complete. 2024-09-13T18:44:56.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.770+0000 7f5ed7200700 1 Processor -- start 2024-09-13T18:44:56.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.770+0000 7f5ed7200700 1 -- start start 2024-09-13T18:44:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 0x7f5ed81e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8070540 0x7f5ed80bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed80c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81e3660 con 0x7f5ed8157d40 2024-09-13T18:44:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c4620 con 0x7f5ed8070540 2024-09-13T18:44:56.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c2bd0 con 0x7f5ed806d8e0 2024-09-13T18:44:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 0x7f5ed81e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8070540 0x7f5ed80bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 0x7f5ed81e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:50074/0 (socket says 172.21.15.32:50074) 2024-09-13T18:44:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 -- 172.21.15.32:0/1204180125 learned_addr learned my addr 172.21.15.32:0/1204180125 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:56.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed6800700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed80c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 -- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8070540 msgr2=0x7f5ed80bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8070540 0x7f5ed80bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 -- 172.21.15.32:0/1204180125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 msgr2=0x7f5ed80c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed80c0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 -- 172.21.15.32:0/1204180125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80094b0 con 0x7f5ed806d8e0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed5e00700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 0x7f5ed81e26c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800ec40 tx=0x7f5ec800ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800c850 con 0x7f5ed806d8e0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec800c9b0 con 0x7f5ed806d8e0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed0009a70 con 0x7f5ed806d8e0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800cd40 con 0x7f5ed806d8e0 2024-09-13T18:44:56.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.774+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81e3380 con 0x7f5ed806d8e0 2024-09-13T18:44:56.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.778+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed80c3e70 con 0x7f5ed806d8e0 2024-09-13T18:44:56.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.778+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ec8013470 con 0x7f5ed806d8e0 2024-09-13T18:44:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.778+0000 7f5ece000700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5eb4066730 0x7f5eb4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.778+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ec8083e50 con 0x7f5ed806d8e0 2024-09-13T18:44:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.782+0000 7f5ed5400700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5eb4066730 0x7f5eb4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:56.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.782+0000 7f5ed5400700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5eb4066730 0x7f5eb4068bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80cafc0 tx=0x7f5ec0007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:56.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.790+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ed80c3e70 con 0x7f5ed806d8e0 2024-09-13T18:44:56.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.982+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ed80c3e70 con 0x7f5ed806d8e0 2024-09-13T18:44:56.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.982+0000 7f5ece000700 1 -- 172.21.15.32:0/1204180125 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f5ed80c3e70 con 0x7f5ed806d8e0 2024-09-13T18:44:56.988 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:44:56.989 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:44:52.757184+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:44:56.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5eb4066730 msgr2=0x7f5eb4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5eb4066730 0x7f5eb4068bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80cafc0 tx=0x7f5ec0007de0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 msgr2=0x7f5ed81e26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:56.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 0x7f5ed81e26c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800ec40 tx=0x7f5ec800ef50 comp rx=0 tx=0).stop 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 shutdown_connections 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5eb4066730 0x7f5eb4068bf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed8157d40 0x7f5ed80c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed8070540 0x7f5ed80bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 --2- 172.21.15.32:0/1204180125 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ed806d8e0 0x7f5ed81e26c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 >> 172.21.15.32:0/1204180125 conn(0x7f5ed8071080 msgr2=0x7f5ed806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 shutdown_connections 2024-09-13T18:44:56.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:56.986+0000 7f5ed7200700 1 -- 172.21.15.32:0/1204180125 wait complete. 2024-09-13T18:44:57.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:44:57.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:44:57.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.198+0000 7f3383000700 1 Processor -- start 2024-09-13T18:44:57.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.198+0000 7f3383000700 1 -- start start 2024-09-13T18:44:57.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 0x7f337c070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f337c0ca7a0 0x7f337c15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c0c8b40 con 0x7f337c0aa360 2024-09-13T18:44:57.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0c9e70 con 0x7f337c0ca7a0 2024-09-13T18:44:57.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0c8d70 con 0x7f337c0a9f80 2024-09-13T18:44:57.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 0x7f337c070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3381000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f337c0ca7a0 0x7f337c15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 0x7f337c070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:50080/0 (socket says 172.21.15.32:50080) 2024-09-13T18:44:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 -- 172.21.15.32:0/2454750014 learned_addr learned my addr 172.21.15.32:0/2454750014 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 -- 172.21.15.32:0/2454750014 >> v2:172.21.15.32:3300/0 conn(0x7f337c0ca7a0 msgr2=0x7f337c15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 --2- 172.21.15.32:0/2454750014 >> v2:172.21.15.32:3300/0 conn(0x7f337c0ca7a0 0x7f337c15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 -- 172.21.15.32:0/2454750014 >> v1:172.21.15.32:6789/0 conn(0x7f337c0aa360 legacy=0x7f337c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:57.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 -- 172.21.15.32:0/2454750014 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c157d60 con 0x7f337c0a9f80 2024-09-13T18:44:57.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337be00700 1 --2- 172.21.15.32:0/2454750014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 0x7f337c070520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f336c009910 tx=0x7f336c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1100579916ecf051 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:57.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337aa00700 1 -- 172.21.15.32:0/2454750014 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011830 con 0x7f337c0a9f80 2024-09-13T18:44:57.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337aa00700 1 -- 172.21.15.32:0/2454750014 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c011990 con 0x7f337c0a9f80 2024-09-13T18:44:57.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f337aa00700 1 -- 172.21.15.32:0/2454750014 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011d40 con 0x7f337c0a9f80 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 -- 172.21.15.32:0/2454750014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 msgr2=0x7f337c070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 --2- 172.21.15.32:0/2454750014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 0x7f337c070520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f336c009910 tx=0x7f336c009c20 comp rx=0 tx=0).stop 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 -- 172.21.15.32:0/2454750014 shutdown_connections 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 --2- 172.21.15.32:0/2454750014 >> v2:172.21.15.32:3300/0 conn(0x7f337c0ca7a0 0x7f337c15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 --2- 172.21.15.32:0/2454750014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0a9f80 0x7f337c070520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.202+0000 7f3383000700 1 -- 172.21.15.32:0/2454750014 >> 172.21.15.32:0/2454750014 conn(0x7f337c0cad40 msgr2=0x7f337c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 -- 172.21.15.32:0/2454750014 shutdown_connections 2024-09-13T18:44:57.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 -- 172.21.15.32:0/2454750014 wait complete. 2024-09-13T18:44:57.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 Processor -- start 2024-09-13T18:44:57.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 -- start start 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 0x7f337c14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f337c0aa360 0x7f337c0ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0ca7a0 0x7f337c1efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c1ef600 con 0x7f337c0a9f80 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0ab830 con 0x7f337c0aa360 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f3383000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c06e360 con 0x7f337c0ca7a0 2024-09-13T18:44:57.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.206+0000 7f337be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 0x7f337c14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f3381000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0ca7a0 0x7f337c1efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 0x7f337c14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33774/0 (socket says 172.21.15.32:33774) 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 -- 172.21.15.32:0/4134064467 learned_addr learned my addr 172.21.15.32:0/4134064467 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337b400700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f337c0aa360 0x7f337c0ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 -- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0ca7a0 msgr2=0x7f337c1efa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0ca7a0 0x7f337c1efa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 -- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f337c0aa360 msgr2=0x7f337c0ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f337c0aa360 0x7f337c0ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 -- 172.21.15.32:0/4134064467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c009570 con 0x7f337c0a9f80 2024-09-13T18:44:57.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f337be00700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 0x7f337c14e120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f337c0b12c0 tx=0x7f336c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:57.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c004300 con 0x7f337c0a9f80 2024-09-13T18:44:57.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c01f070 con 0x7f337c0a9f80 2024-09-13T18:44:57.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0036c0 con 0x7f337c0a9f80 2024-09-13T18:44:57.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c06e890 con 0x7f337c0a9f80 2024-09-13T18:44:57.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.210+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c06e5b0 con 0x7f337c0a9f80 2024-09-13T18:44:57.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.214+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c1ef870 con 0x7f337c0a9f80 2024-09-13T18:44:57.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.214+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f336c021030 con 0x7f337c0a9f80 2024-09-13T18:44:57.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.214+0000 7f3373e00700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f335c066730 0x7f335c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.214+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f336c085170 con 0x7f337c0a9f80 2024-09-13T18:44:57.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.214+0000 7f337b400700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f335c066730 0x7f335c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.218+0000 7f337b400700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f335c066730 0x7f335c068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f337c157700 tx=0x7f3368009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:57.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.222+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f336c052820 con 0x7f337c0a9f80 2024-09-13T18:44:57.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.414+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f337c0ae060 con 0x7f337c0a9f80 2024-09-13T18:44:57.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.414+0000 7f3373e00700 1 -- 172.21.15.32:0/4134064467 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f336c055e40 con 0x7f337c0a9f80 2024-09-13T18:44:57.421 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:44:57.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f335c066730 msgr2=0x7f335c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f335c066730 0x7f335c068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f337c157700 tx=0x7f3368009040 comp rx=0 tx=0).stop 2024-09-13T18:44:57.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 msgr2=0x7f337c14e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 0x7f337c14e120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f337c0b12c0 tx=0x7f336c004770 comp rx=0 tx=0).stop 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 shutdown_connections 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f335c066730 0x7f335c068bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f337c0ca7a0 0x7f337c1efa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f337c0aa360 0x7f337c0ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 --2- 172.21.15.32:0/4134064467 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f337c0a9f80 0x7f337c14e120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.418+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 >> 172.21.15.32:0/4134064467 conn(0x7f337c0cad40 msgr2=0x7f337c0709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:57.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.422+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 shutdown_connections 2024-09-13T18:44:57.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.422+0000 7f3383000700 1 -- 172.21.15.32:0/4134064467 wait complete. 2024-09-13T18:44:57.449 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:44:57.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.614+0000 7fecb6c00700 1 Processor -- start 2024-09-13T18:44:57.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.614+0000 7fecb6c00700 1 -- start start 2024-09-13T18:44:57.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb6c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb00c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb6c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fecb00c7280 0x7fecb006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb6c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb006f5d0 con 0x7fecb00c7db0 2024-09-13T18:44:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb6c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb006f890 con 0x7fecb00c7280 2024-09-13T18:44:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb6c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb006fb70 con 0x7fecb00c6ea0 2024-09-13T18:44:57.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb00c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb4e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fecb00c7280 0x7fecb006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb00c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:50092/0 (socket says 172.21.15.32:50092) 2024-09-13T18:44:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 -- 172.21.15.32:0/1108270440 learned_addr learned my addr 172.21.15.32:0/1108270440 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:57.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb6200700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fecb00c7db0 0x7fecb006a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54870/0 (socket says 172.21.15.32:54870) 2024-09-13T18:44:57.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 -- 172.21.15.32:0/1108270440 >> v2:172.21.15.32:3300/0 conn(0x7fecb00c7280 msgr2=0x7fecb006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:57.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 --2- 172.21.15.32:0/1108270440 >> v2:172.21.15.32:3300/0 conn(0x7fecb00c7280 0x7fecb006c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 -- 172.21.15.32:0/1108270440 >> v1:172.21.15.32:6789/0 conn(0x7fecb00c7db0 legacy=0x7fecb006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 -- 172.21.15.32:0/1108270440 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb006fe50 con 0x7fecb00c6ea0 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb4e00700 1 --2- 172.21.15.32:0/1108270440 >> v2:172.21.15.32:3300/0 conn(0x7fecb00c7280 0x7fecb006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecafe00700 1 -- 172.21.15.32:0/1108270440 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973600337 0 0) 0x7fecb006f5d0 con 0x7fecb00c7db0 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecb5800700 1 --2- 172.21.15.32:0/1108270440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb00c7870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feca4009910 tx=0x7feca4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc3ec25dc7a152b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecafe00700 1 -- 172.21.15.32:0/1108270440 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4011830 con 0x7fecb00c6ea0 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecafe00700 1 -- 172.21.15.32:0/1108270440 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4011990 con 0x7fecb00c6ea0 2024-09-13T18:44:57.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.618+0000 7fecafe00700 1 -- 172.21.15.32:0/1108270440 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4011d40 con 0x7fecb00c6ea0 2024-09-13T18:44:57.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 -- 172.21.15.32:0/1108270440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 msgr2=0x7fecb00c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 --2- 172.21.15.32:0/1108270440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb00c7870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feca4009910 tx=0x7feca4009c20 comp rx=0 tx=0).stop 2024-09-13T18:44:57.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 -- 172.21.15.32:0/1108270440 shutdown_connections 2024-09-13T18:44:57.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 --2- 172.21.15.32:0/1108270440 >> v2:172.21.15.32:3300/0 conn(0x7fecb00c7280 0x7fecb006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 --2- 172.21.15.32:0/1108270440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb00c7870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 -- 172.21.15.32:0/1108270440 >> 172.21.15.32:0/1108270440 conn(0x7fecb00ccf70 msgr2=0x7fecb00cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:57.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 -- 172.21.15.32:0/1108270440 shutdown_connections 2024-09-13T18:44:57.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 -- 172.21.15.32:0/1108270440 wait complete. 2024-09-13T18:44:57.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 Processor -- start 2024-09-13T18:44:57.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.622+0000 7fecb6c00700 1 -- start start 2024-09-13T18:44:57.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 0x7fecb014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb00c7db0 0x7fecb014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00c2cd0 con 0x7fecb00c7280 2024-09-13T18:44:57.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb014cec0 con 0x7fecb00c7db0 2024-09-13T18:44:57.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb014ded0 con 0x7fecb00c6ea0 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 0x7fecb014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb5800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 0x7fecb014f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33794/0 (socket says 172.21.15.32:33794) 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 -- 172.21.15.32:0/776958106 learned_addr learned my addr 172.21.15.32:0/776958106 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6200700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb00c7db0 0x7fecb014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 -- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 msgr2=0x7fecb014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb014e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 -- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb00c7db0 msgr2=0x7fecb014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb00c7db0 0x7fecb014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 -- 172.21.15.32:0/776958106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0094b0 con 0x7fecb00c7280 2024-09-13T18:44:57.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb4e00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 0x7fecb014f440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00ebe0 tx=0x7fec9c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:57.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00c850 con 0x7fecb00c7280 2024-09-13T18:44:57.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00c9b0 con 0x7fecb00c7280 2024-09-13T18:44:57.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00cd40 con 0x7fecb00c7280 2024-09-13T18:44:57.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca4009570 con 0x7fecb00c7280 2024-09-13T18:44:57.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.626+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb014d110 con 0x7fecb00c7280 2024-09-13T18:44:57.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.630+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb00c7870 con 0x7fecb00c7280 2024-09-13T18:44:57.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.630+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec9c013470 con 0x7fecb00c7280 2024-09-13T18:44:57.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.634+0000 7fecad600700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fec90066730 0x7fec90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:57.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.634+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec9c083e80 con 0x7fecb00c7280 2024-09-13T18:44:57.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.634+0000 7fecb5800700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fec90066730 0x7fec90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:57.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.634+0000 7fecb5800700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fec90066730 0x7fec90068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feca4000c00 tx=0x7feca4008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:57.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.642+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec9c051530 con 0x7fecb00c7280 2024-09-13T18:44:57.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.874+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecb006b940 con 0x7fecb00c7280 2024-09-13T18:44:57.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.874+0000 7fecad600700 1 -- 172.21.15.32:0/776958106 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5036 (secure 0 0 0) 0x7fec9c00cea0 con 0x7fecb00c7280 2024-09-13T18:44:57.881 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:44:57.881 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fec90066730 msgr2=0x7fec90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fec90066730 0x7fec90068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feca4000c00 tx=0x7feca4008030 comp rx=0 tx=0).stop 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 msgr2=0x7fecb014f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 0x7fecb014f440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00ebe0 tx=0x7fec9c00eef0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 shutdown_connections 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fec90066730 0x7fec90068bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecb00c7db0 0x7fecb014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecb00c7280 0x7fecb014f440 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 --2- 172.21.15.32:0/776958106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecb00c6ea0 0x7fecb014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:57.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 >> 172.21.15.32:0/776958106 conn(0x7fecb00ccf70 msgr2=0x7fecb00cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:57.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 shutdown_connections 2024-09-13T18:44:57.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:57.878+0000 7fecb6c00700 1 -- 172.21.15.32:0/776958106 wait complete. 2024-09-13T18:44:57.886 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2024-09-13T18:44:57.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:44:58.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.070+0000 7f8d07200700 1 Processor -- start 2024-09-13T18:44:58.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d07200700 1 -- start start 2024-09-13T18:44:58.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d07200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d00071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d07200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00070510 con 0x7f8d000c6590 2024-09-13T18:44:58.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d07200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00157570 con 0x7f8d000aa360 2024-09-13T18:44:58.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d07200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000aa920 con 0x7f8d000c61b0 2024-09-13T18:44:58.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d06800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8d000c6590 0x7f8d00161e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54882/0 (socket says 172.21.15.32:54882) 2024-09-13T18:44:58.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d06800700 1 -- 172.21.15.32:0/1537737898 learned_addr learned my addr 172.21.15.32:0/1537737898 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:58.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d05400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8d000aa360 0x7f8d001545a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:53340/0 (socket says 172.21.15.32:53340) 2024-09-13T18:44:58.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d05e00700 1 --2- 172.21.15.32:0/1537737898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d00071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d04a00700 1 -- 172.21.15.32:0/1537737898 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627480389 0 0) 0x7f8d00157570 con 0x7f8d000aa360 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d04a00700 1 -- 172.21.15.32:0/1537737898 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce80035d0 con 0x7f8d000aa360 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d04a00700 1 -- 172.21.15.32:0/1537737898 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852003724 0 0) 0x7f8d00070510 con 0x7f8d000c6590 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d05e00700 1 -- 172.21.15.32:0/1537737898 >> v1:172.21.15.86:6789/0 conn(0x7f8d000aa360 legacy=0x7f8d001545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d05e00700 1 -- 172.21.15.32:0/1537737898 >> v1:172.21.15.32:6789/0 conn(0x7f8d000c6590 legacy=0x7f8d00161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.074+0000 7f8d05e00700 1 -- 172.21.15.32:0/1537737898 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00070760 con 0x7f8d000c61b0 2024-09-13T18:44:58.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d05e00700 1 --2- 172.21.15.32:0/1537737898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d00071960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009880 tx=0x7f8cf4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0824b4432304fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d04a00700 1 -- 172.21.15.32:0/1537737898 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4011830 con 0x7f8d000c61b0 2024-09-13T18:44:58.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d04a00700 1 -- 172.21.15.32:0/1537737898 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4011990 con 0x7f8d000c61b0 2024-09-13T18:44:58.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d04a00700 1 -- 172.21.15.32:0/1537737898 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4011d20 con 0x7f8d000c61b0 2024-09-13T18:44:58.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 -- 172.21.15.32:0/1537737898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 msgr2=0x7f8d00071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 --2- 172.21.15.32:0/1537737898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d00071960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009880 tx=0x7f8cf4009b90 comp rx=0 tx=0).stop 2024-09-13T18:44:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 -- 172.21.15.32:0/1537737898 shutdown_connections 2024-09-13T18:44:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 --2- 172.21.15.32:0/1537737898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d00071960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 -- 172.21.15.32:0/1537737898 >> 172.21.15.32:0/1537737898 conn(0x7f8d000cad40 msgr2=0x7f8d000cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 -- 172.21.15.32:0/1537737898 shutdown_connections 2024-09-13T18:44:58.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.078+0000 7f8d07200700 1 -- 172.21.15.32:0/1537737898 wait complete. 2024-09-13T18:44:58.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 Processor -- start 2024-09-13T18:44:58.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 -- start start 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 0x7f8d0006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d0014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d000c6590 0x7f8d0014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0014f230 con 0x7f8d000c6590 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0014e6b0 con 0x7f8d000aa360 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d07200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d001f3150 con 0x7f8d000c61b0 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d05e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 0x7f8d0006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d05e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 0x7f8d0006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:60414/0 (socket says 172.21.15.32:60414) 2024-09-13T18:44:58.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d05e00700 1 -- 172.21.15.32:0/100789909 learned_addr learned my addr 172.21.15.32:0/100789909 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:58.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d06800700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d000c6590 0x7f8d0014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.082+0000 7f8d05400700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d0014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d05e00700 1 -- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 msgr2=0x7f8d0014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d05e00700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d0014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d05e00700 1 -- 172.21.15.32:0/100789909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d000c6590 msgr2=0x7f8d0014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d05e00700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d000c6590 0x7f8d0014dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d05e00700 1 -- 172.21.15.32:0/100789909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40094b0 con 0x7f8d000aa360 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d06800700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d000c6590 0x7f8d0014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d05e00700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 0x7f8d0006dc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097d0 tx=0x7f8cf4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4019950 con 0x7f8d000aa360 2024-09-13T18:44:58.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf401e070 con 0x7f8d000aa360 2024-09-13T18:44:58.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4019d10 con 0x7f8d000aa360 2024-09-13T18:44:58.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0014e900 con 0x7f8d000aa360 2024-09-13T18:44:58.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0014eec0 con 0x7f8d000aa360 2024-09-13T18:44:58.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.086+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0014f050 con 0x7f8d000aa360 2024-09-13T18:44:58.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.090+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cf402d450 con 0x7f8d000aa360 2024-09-13T18:44:58.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.090+0000 7f8cfa000700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8ce4066730 0x7f8ce4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.090+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8cf4084db0 con 0x7f8d000aa360 2024-09-13T18:44:58.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.090+0000 7f8d05400700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8ce4066730 0x7f8ce4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.090+0000 7f8d05400700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8ce4066730 0x7f8ce4068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d000c51d0 tx=0x7f8cf0007da0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.102+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8cf40523d0 con 0x7f8d000aa360 2024-09-13T18:44:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.298+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d001eee70 con 0x7f8d000aa360 2024-09-13T18:44:58.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.298+0000 7f8cfa000700 1 -- 172.21.15.32:0/100789909 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f8cf40559f0 con 0x7f8d000aa360 2024-09-13T18:44:58.304 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:44:58.305 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:44:52.757184+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:44:58.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8ce4066730 msgr2=0x7f8ce4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8ce4066730 0x7f8ce4068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d000c51d0 tx=0x7f8cf0007da0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 msgr2=0x7f8d0006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 0x7f8d0006dc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097d0 tx=0x7f8cf4004770 comp rx=0 tx=0).stop 2024-09-13T18:44:58.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 shutdown_connections 2024-09-13T18:44:58.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8ce4066730 0x7f8ce4068bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d000c6590 0x7f8d0014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d000c61b0 0x7f8d0014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 --2- 172.21.15.32:0/100789909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d000aa360 0x7f8d0006dc60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 >> 172.21.15.32:0/100789909 conn(0x7f8d000cad40 msgr2=0x7f8d00155510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:58.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 shutdown_connections 2024-09-13T18:44:58.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.306+0000 7f8d07200700 1 -- 172.21.15.32:0/100789909 wait complete. 2024-09-13T18:44:58.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:44:58.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:44:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1fe00700 1 Processor -- start 2024-09-13T18:44:58.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1fe00700 1 -- start start 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5b2006fac0 0x7f5b2006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1fe00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b200c9440 con 0x7f5b200c9e90 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1fe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b200c7aa0 con 0x7f5b2006ea50 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1fe00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b200c9a70 con 0x7f5b2006fac0 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5b2006fac0 0x7f5b2006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1ea00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5b2006ea50 0x7f5b2015aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:53352/0 (socket says 172.21.15.32:53352) 2024-09-13T18:44:58.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.510+0000 7f5b1ea00700 1 -- 172.21.15.32:0/2512495745 learned_addr learned my addr 172.21.15.32:0/2512495745 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:58.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1f400700 1 -- 172.21.15.32:0/2512495745 >> v1:172.21.15.86:6789/0 conn(0x7f5b2006ea50 legacy=0x7f5b2015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1f400700 1 -- 172.21.15.32:0/2512495745 >> v1:172.21.15.32:6789/0 conn(0x7f5b200c9e90 legacy=0x7f5b200ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1f400700 1 -- 172.21.15.32:0/2512495745 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200c7d60 con 0x7f5b2006fac0 2024-09-13T18:44:58.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1f400700 1 --2- 172.21.15.32:0/2512495745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006fac0 0x7f5b2006ff70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009d90 tx=0x7f5b1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1886fa3829a0be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1d600700 1 -- 172.21.15.32:0/2512495745 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1800e070 con 0x7f5b2006fac0 2024-09-13T18:44:58.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1d600700 1 -- 172.21.15.32:0/2512495745 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1800bbd0 con 0x7f5b2006fac0 2024-09-13T18:44:58.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1d600700 1 -- 172.21.15.32:0/2512495745 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18012430 con 0x7f5b2006fac0 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2512495745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006fac0 msgr2=0x7f5b2006ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2512495745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006fac0 0x7f5b2006ff70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009d90 tx=0x7f5b1800b330 comp rx=0 tx=0).stop 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2512495745 shutdown_connections 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2512495745 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006fac0 0x7f5b2006ff70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2512495745 >> 172.21.15.32:0/2512495745 conn(0x7f5b200cac60 msgr2=0x7f5b200cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2512495745 shutdown_connections 2024-09-13T18:44:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2512495745 wait complete. 2024-09-13T18:44:58.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.514+0000 7f5b1fe00700 1 Processor -- start 2024-09-13T18:44:58.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 -- start start 2024-09-13T18:44:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006ea50 0x7f5b201ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 0x7f5b201e3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b200c9e90 0x7f5b200c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200c3370 con 0x7f5b2006fac0 2024-09-13T18:44:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201efdb0 con 0x7f5b2006ea50 2024-09-13T18:44:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2015b460 con 0x7f5b200c9e90 2024-09-13T18:44:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 0x7f5b201e3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 0x7f5b201e3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33818/0 (socket says 172.21.15.32:33818) 2024-09-13T18:44:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 -- 172.21.15.32:0/2323515926 learned_addr learned my addr 172.21.15.32:0/2323515926 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1ea00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006ea50 0x7f5b201ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1f400700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b200c9e90 0x7f5b200c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 -- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b200c9e90 msgr2=0x7f5b200c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b200c9e90 0x7f5b200c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 -- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006ea50 msgr2=0x7f5b201ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006ea50 0x7f5b201ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 -- 172.21.15.32:0/2323515926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18009a70 con 0x7f5b2006fac0 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1e000700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 0x7f5b201e3af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00c560 tx=0x7f5b0c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0052d0 con 0x7f5b2006fac0 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00ce90 con 0x7f5b2006fac0 2024-09-13T18:44:58.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b200c2a10 con 0x7f5b2006fac0 2024-09-13T18:44:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0036a0 con 0x7f5b2006fac0 2024-09-13T18:44:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.518+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b200c2cb0 con 0x7f5b2006fac0 2024-09-13T18:44:58.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.522+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b200c34b0 con 0x7f5b2006fac0 2024-09-13T18:44:58.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.522+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b0c003800 con 0x7f5b2006fac0 2024-09-13T18:44:58.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.522+0000 7f5b16a00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b00066760 0x7f5b00068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.526+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b0c083450 con 0x7f5b2006fac0 2024-09-13T18:44:58.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.526+0000 7f5b1ea00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b00066760 0x7f5b00068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.526+0000 7f5b1ea00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b00066760 0x7f5b00068c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b10005930 tx=0x7f5b10009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.530+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b0c050af0 con 0x7f5b2006fac0 2024-09-13T18:44:58.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.706+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b200c34b0 con 0x7f5b2006fac0 2024-09-13T18:44:58.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.706+0000 7f5b16a00700 1 -- 172.21.15.32:0/2323515926 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b200c34b0 con 0x7f5b2006fac0 2024-09-13T18:44:58.714 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:44:58.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b00066760 msgr2=0x7f5b00068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b00066760 0x7f5b00068c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b10005930 tx=0x7f5b10009040 comp rx=0 tx=0).stop 2024-09-13T18:44:58.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 msgr2=0x7f5b201e3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 0x7f5b201e3af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00c560 tx=0x7f5b0c00c870 comp rx=0 tx=0).stop 2024-09-13T18:44:58.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 shutdown_connections 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b00066760 0x7f5b00068c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b200c9e90 0x7f5b200c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b2006fac0 0x7f5b201e3af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 --2- 172.21.15.32:0/2323515926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b2006ea50 0x7f5b201ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 >> 172.21.15.32:0/2323515926 conn(0x7f5b200cac60 msgr2=0x7f5b20153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 shutdown_connections 2024-09-13T18:44:58.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.714+0000 7f5b1fe00700 1 -- 172.21.15.32:0/2323515926 wait complete. 2024-09-13T18:44:58.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:44:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd536c00700 1 Processor -- start 2024-09-13T18:44:58.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd536c00700 1 -- start start 2024-09-13T18:44:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd536c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd5300aa360 0x7fd5301545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd536c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530070510 con 0x7fd5300c6590 2024-09-13T18:44:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd536c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530157570 con 0x7fd5300c61b0 2024-09-13T18:44:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd536c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300aa920 con 0x7fd5300aa360 2024-09-13T18:44:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd535800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fd5300c61b0 0x7fd530071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34096/0 (socket says 172.21.15.32:34096) 2024-09-13T18:44:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd535800700 1 -- 172.21.15.32:0/3493055383 learned_addr learned my addr 172.21.15.32:0/3493055383 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:44:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.898+0000 7fd534e00700 1 --2- 172.21.15.32:0/3493055383 >> v2:172.21.15.86:3300/0 conn(0x7fd5300aa360 0x7fd5301545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715396828 0 0) 0x7fd530157570 con 0x7fd5300c61b0 2024-09-13T18:44:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5180035d0 con 0x7fd5300c61b0 2024-09-13T18:44:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269854127 0 0) 0x7fd530070510 con 0x7fd5300c6590 2024-09-13T18:44:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd530157570 con 0x7fd5300c6590 2024-09-13T18:44:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1831963182 0 0) 0x7fd5180035d0 con 0x7fd5300c61b0 2024-09-13T18:44:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd534e00700 1 -- 172.21.15.32:0/3493055383 >> v1:172.21.15.86:6789/0 conn(0x7fd5300c61b0 legacy=0x7fd530071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd534e00700 1 -- 172.21.15.32:0/3493055383 >> v1:172.21.15.32:6789/0 conn(0x7fd5300c6590 legacy=0x7fd530161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd534e00700 1 -- 172.21.15.32:0/3493055383 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530070760 con 0x7fd5300aa360 2024-09-13T18:44:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd534e00700 1 --2- 172.21.15.32:0/3493055383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300aa360 0x7fd5301545a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0097d0 tx=0x7fd51c009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a3b541d1131d600 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5240019f0 con 0x7fd5300aa360 2024-09-13T18:44:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c004030 con 0x7fd5300aa360 2024-09-13T18:44:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd52fe00700 1 -- 172.21.15.32:0/3493055383 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0043a0 con 0x7fd5300aa360 2024-09-13T18:44:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 -- 172.21.15.32:0/3493055383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300aa360 msgr2=0x7fd5301545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 --2- 172.21.15.32:0/3493055383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300aa360 0x7fd5301545a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0097d0 tx=0x7fd51c009ae0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 -- 172.21.15.32:0/3493055383 shutdown_connections 2024-09-13T18:44:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 --2- 172.21.15.32:0/3493055383 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300aa360 0x7fd5301545a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 -- 172.21.15.32:0/3493055383 >> 172.21.15.32:0/3493055383 conn(0x7fd5300cad40 msgr2=0x7fd5300cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 -- 172.21.15.32:0/3493055383 shutdown_connections 2024-09-13T18:44:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.902+0000 7fd536c00700 1 -- 172.21.15.32:0/3493055383 wait complete. 2024-09-13T18:44:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 Processor -- start 2024-09-13T18:44:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 -- start start 2024-09-13T18:44:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 0x7fd5300bfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300c61b0 0x7fd5300af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5300c6590 0x7fd5300c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300c0a20 con 0x7fd5300aa360 2024-09-13T18:44:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301f2da0 con 0x7fd5300c61b0 2024-09-13T18:44:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.906+0000 7fd536c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300afb10 con 0x7fd5300c6590 2024-09-13T18:44:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd535800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 0x7fd5300bfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd535800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 0x7fd5300bfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42636/0 (socket says 172.21.15.32:42636) 2024-09-13T18:44:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd535800700 1 -- 172.21.15.32:0/1680900649 learned_addr learned my addr 172.21.15.32:0/1680900649 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300c61b0 0x7fd5300af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd536200700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5300c6590 0x7fd5300c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 -- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5300c6590 msgr2=0x7fd5300c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5300c6590 0x7fd5300c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 -- 172.21.15.32:0/1680900649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 msgr2=0x7fd5300bfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 0x7fd5300bfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 -- 172.21.15.32:0/1680900649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0094b0 con 0x7fd5300c61b0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd535800700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 0x7fd5300bfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd534e00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300c61b0 0x7fd5300af5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd51c015000 tx=0x7fd51c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c003dd0 con 0x7fd5300c61b0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c01f070 con 0x7fd5300c61b0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5300c1b30 con 0x7fd5300c61b0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011870 con 0x7fd5300c61b0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5300c2690 con 0x7fd5300c61b0 2024-09-13T18:44:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.910+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53006e600 con 0x7fd5300c61b0 2024-09-13T18:44:58.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.914+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd51c0119d0 con 0x7fd5300c61b0 2024-09-13T18:44:58.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.914+0000 7fd52d600700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd510066730 0x7fd510068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:58.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.914+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd51c021070 con 0x7fd5300c61b0 2024-09-13T18:44:58.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.914+0000 7fd535800700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd510066730 0x7fd510068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.918+0000 7fd535800700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd510066730 0x7fd510068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd524001b20 tx=0x7fd5240015b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:58.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:58.926+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd51c053020 con 0x7fd5300c61b0 2024-09-13T18:44:59.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.114+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd5300a9490 con 0x7fd5300c61b0 2024-09-13T18:44:59.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.118+0000 7fd52d600700 1 -- 172.21.15.32:0/1680900649 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd51c02b020 con 0x7fd5300c61b0 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:44:59.123 INFO:teuthology.orchestra.run.smithi032.stdout:] 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.118+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd510066730 msgr2=0x7fd510068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.118+0000 7fd536c00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd510066730 0x7fd510068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd524001b20 tx=0x7fd5240015b0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.118+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300c61b0 msgr2=0x7fd5300af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.118+0000 7fd536c00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300c61b0 0x7fd5300af5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd51c015000 tx=0x7fd51c004770 comp rx=0 tx=0).stop 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 shutdown_connections 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd510066730 0x7fd510068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5300c6590 0x7fd5300c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5300c61b0 0x7fd5300af5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 --2- 172.21.15.32:0/1680900649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5300aa360 0x7fd5300bfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 >> 172.21.15.32:0/1680900649 conn(0x7fd5300cad40 msgr2=0x7fd5300c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 shutdown_connections 2024-09-13T18:44:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.122+0000 7fd536c00700 1 -- 172.21.15.32:0/1680900649 wait complete. 2024-09-13T18:44:59.147 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:44:59.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:44:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 Processor -- start 2024-09-13T18:44:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 -- start start 2024-09-13T18:44:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff74c154f90 0x7ff74c072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c0a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c158600 con 0x7ff74c071b80 2024-09-13T18:44:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0aa310 con 0x7ff74c154f90 2024-09-13T18:44:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff752a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0ca620 con 0x7ff74c0a9490 2024-09-13T18:44:59.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff74be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff74c154f90 0x7ff74c072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff750a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c0a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff74be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff74c154f90 0x7ff74c072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42642/0 (socket says 172.21.15.32:42642) 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.318+0000 7ff74be00700 1 -- 172.21.15.32:0/1110850285 learned_addr learned my addr 172.21.15.32:0/1110850285 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74be00700 1 -- 172.21.15.32:0/1110850285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 msgr2=0x7ff74c0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74be00700 1 --2- 172.21.15.32:0/1110850285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c0a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74be00700 1 -- 172.21.15.32:0/1110850285 >> v1:172.21.15.86:6789/0 conn(0x7ff74c071b80 legacy=0x7ff74c157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74be00700 1 -- 172.21.15.32:0/1110850285 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c0ca900 con 0x7ff74c154f90 2024-09-13T18:44:59.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74be00700 1 --2- 172.21.15.32:0/1110850285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c154f90 0x7ff74c072080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009910 tx=0x7ff73c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3798c07d3ca8991b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:59.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74aa00700 1 -- 172.21.15.32:0/1110850285 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011830 con 0x7ff74c154f90 2024-09-13T18:44:59.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74aa00700 1 -- 172.21.15.32:0/1110850285 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c011990 con 0x7ff74c154f90 2024-09-13T18:44:59.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff74aa00700 1 -- 172.21.15.32:0/1110850285 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011d40 con 0x7ff74c154f90 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 -- 172.21.15.32:0/1110850285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c154f90 msgr2=0x7ff74c072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 --2- 172.21.15.32:0/1110850285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c154f90 0x7ff74c072080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009910 tx=0x7ff73c009c20 comp rx=0 tx=0).stop 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 -- 172.21.15.32:0/1110850285 shutdown_connections 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 --2- 172.21.15.32:0/1110850285 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c0a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 --2- 172.21.15.32:0/1110850285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c154f90 0x7ff74c072080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 -- 172.21.15.32:0/1110850285 >> 172.21.15.32:0/1110850285 conn(0x7ff74c0accb0 msgr2=0x7ff74c0ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 -- 172.21.15.32:0/1110850285 shutdown_connections 2024-09-13T18:44:59.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.322+0000 7ff752a00700 1 -- 172.21.15.32:0/1110850285 wait complete. 2024-09-13T18:44:59.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 Processor -- start 2024-09-13T18:44:59.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 -- start start 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 0x7ff74c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff74c154f90 0x7ff74c0ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c06ca20 con 0x7ff74c071b80 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0c1050 con 0x7ff74c154f90 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.326+0000 7ff752a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c06da80 con 0x7ff74c0a9490 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 0x7ff74c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff750a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff74c154f90 0x7ff74c0ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:59.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 0x7ff74c06d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42656/0 (socket says 172.21.15.32:42656) 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff750a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff74c154f90 0x7ff74c0ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:57588/0 (socket says 172.21.15.32:57588) 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 -- 172.21.15.32:0/2044009869 learned_addr learned my addr 172.21.15.32:0/2044009869 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 -- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 msgr2=0x7ff74c153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 -- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff74c154f90 msgr2=0x7ff74c0ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff74c154f90 0x7ff74c0ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 -- 172.21.15.32:0/2044009869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009570 con 0x7ff74c071b80 2024-09-13T18:44:59.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff74be00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 0x7ff74c06d540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0c7960 tx=0x7ff73c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:59.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004450 con 0x7ff74c071b80 2024-09-13T18:44:59.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c01e070 con 0x7ff74c071b80 2024-09-13T18:44:59.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c06c740 con 0x7ff74c071b80 2024-09-13T18:44:59.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003900 con 0x7ff74c071b80 2024-09-13T18:44:59.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.330+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c0c1ba0 con 0x7ff74c071b80 2024-09-13T18:44:59.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.334+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c067a40 con 0x7ff74c071b80 2024-09-13T18:44:59.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.334+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff73c003a60 con 0x7ff74c071b80 2024-09-13T18:44:59.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.338+0000 7ff743e00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff72c066780 0x7ff72c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:44:59.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.338+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff73c0849a0 con 0x7ff74c071b80 2024-09-13T18:44:59.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.338+0000 7ff74b400700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff72c066780 0x7ff72c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:44:59.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.338+0000 7ff74b400700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff72c066780 0x7ff72c068c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0aa980 tx=0x7ff738009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:44:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.342+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff73c052040 con 0x7ff74c071b80 2024-09-13T18:44:59.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.526+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff74c0c8d00 con 0x7ff74c071b80 2024-09-13T18:44:59.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.822+0000 7ff743e00700 1 -- 172.21.15.32:0/2044009869 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff73c0150b0 con 0x7ff74c071b80 2024-09-13T18:44:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff72c066780 msgr2=0x7ff72c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff72c066780 0x7ff72c068c40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0aa980 tx=0x7ff738009040 comp rx=0 tx=0).stop 2024-09-13T18:44:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 msgr2=0x7ff74c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:44:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 0x7ff74c06d540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0c7960 tx=0x7ff73c004770 comp rx=0 tx=0).stop 2024-09-13T18:44:59.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 shutdown_connections 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff72c066780 0x7ff72c068c40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff74c154f90 0x7ff74c0ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff74c0a9490 0x7ff74c153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 --2- 172.21.15.32:0/2044009869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff74c071b80 0x7ff74c06d540 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 >> 172.21.15.32:0/2044009869 conn(0x7ff74c0accb0 msgr2=0x7ff74c0711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 shutdown_connections 2024-09-13T18:44:59.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:44:59.830+0000 7ff752a00700 1 -- 172.21.15.32:0/2044009869 wait complete. 2024-09-13T18:44:59.838 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2024-09-13T18:44:59.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T18:45:00.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.046+0000 7f5c2f200700 1 Processor -- start 2024-09-13T18:45:00.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.046+0000 7f5c2f200700 1 -- start start 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2f200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5c3006e470 0x7f5c3006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2f200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300c5450 con 0x7f5c30151370 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2f200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c30157330 con 0x7f5c3006ada0 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2f200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c300c5730 con 0x7f5c3006e470 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2d400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5c3006ada0 0x7f5c30158610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34112/0 (socket says 172.21.15.32:34112) 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2d400700 1 -- 172.21.15.32:0/4240869967 learned_addr learned my addr 172.21.15.32:0/4240869967 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:00.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2de00700 1 --1- 172.21.15.32:0/4240869967 >> v1:172.21.15.32:6789/0 conn(0x7f5c30151370 0x7f5c300c4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49770/0 (socket says 172.21.15.32:49770) 2024-09-13T18:45:00.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.050+0000 7f5c2e800700 1 --2- 172.21.15.32:0/4240869967 >> v2:172.21.15.32:3300/0 conn(0x7f5c3006e470 0x7f5c3006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:00.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575930326 0 0) 0x7f5c300c5450 con 0x7f5c30151370 2024-09-13T18:45:00.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c140035d0 con 0x7f5c30151370 2024-09-13T18:45:00.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353898443 0 0) 0x7f5c30157330 con 0x7f5c3006ada0 2024-09-13T18:45:00.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c300c5450 con 0x7f5c3006ada0 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2e800700 1 -- 172.21.15.32:0/4240869967 >> v1:172.21.15.86:6789/0 conn(0x7f5c3006ada0 legacy=0x7f5c30158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2e800700 1 -- 172.21.15.32:0/4240869967 >> v1:172.21.15.32:6789/0 conn(0x7f5c30151370 legacy=0x7f5c300c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2e800700 1 -- 172.21.15.32:0/4240869967 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30157610 con 0x7f5c3006e470 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2e800700 1 --2- 172.21.15.32:0/4240869967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c3006e8c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009d90 tx=0x7f5c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f876d440a1015b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800e070 con 0x7f5c3006e470 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800bb20 con 0x7f5c3006e470 2024-09-13T18:45:00.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2ca00700 1 -- 172.21.15.32:0/4240869967 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800be90 con 0x7f5c3006e470 2024-09-13T18:45:00.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 -- 172.21.15.32:0/4240869967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 msgr2=0x7f5c3006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 --2- 172.21.15.32:0/4240869967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c3006e8c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009d90 tx=0x7f5c2800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:00.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 -- 172.21.15.32:0/4240869967 shutdown_connections 2024-09-13T18:45:00.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 --2- 172.21.15.32:0/4240869967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c3006e8c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 -- 172.21.15.32:0/4240869967 >> 172.21.15.32:0/4240869967 conn(0x7f5c3006f530 msgr2=0x7f5c3006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:00.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 -- 172.21.15.32:0/4240869967 shutdown_connections 2024-09-13T18:45:00.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.054+0000 7f5c2f200700 1 -- 172.21.15.32:0/4240869967 wait complete. 2024-09-13T18:45:00.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.058+0000 7f5c2f200700 1 Processor -- start 2024-09-13T18:45:00.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.058+0000 7f5c2f200700 1 -- start start 2024-09-13T18:45:00.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 0x7f5c300c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:00.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c301e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:00.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c30151370 0x7f5c301e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:00.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301e3450 con 0x7f5c3006e470 2024-09-13T18:45:00.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301e31b0 con 0x7f5c3006ada0 2024-09-13T18:45:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301ef940 con 0x7f5c30151370 2024-09-13T18:45:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 0x7f5c300c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c301e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 0x7f5c300c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:57590/0 (socket says 172.21.15.32:57590) 2024-09-13T18:45:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2de00700 1 -- 172.21.15.32:0/3774057240 learned_addr learned my addr 172.21.15.32:0/3774057240 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:00.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2e800700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c30151370 0x7f5c301e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 -- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c30151370 msgr2=0x7f5c301e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c30151370 0x7f5c301e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 -- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 msgr2=0x7f5c300c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 0x7f5c300c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 -- 172.21.15.32:0/3774057240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c28009a70 con 0x7f5c3006e470 2024-09-13T18:45:00.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2e800700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c30151370 0x7f5c301e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2de00700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 0x7f5c300c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2d400700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c301e4290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c500 tx=0x7f5c1c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c005d90 con 0x7f5c3006e470 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c0070d0 con 0x7f5c3006e470 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c301efc20 con 0x7f5c3006e470 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007440 con 0x7f5c3006e470 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.062+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c300c9720 con 0x7f5c3006e470 2024-09-13T18:45:00.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.066+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3006d3b0 con 0x7f5c3006e470 2024-09-13T18:45:00.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.066+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5c1c0075a0 con 0x7f5c3006e470 2024-09-13T18:45:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.070+0000 7f5c26000700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5c10066760 0x7f5c10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.070+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5c1c083410 con 0x7f5c3006e470 2024-09-13T18:45:00.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.070+0000 7f5c2de00700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5c10066760 0x7f5c10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:00.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.070+0000 7f5c2de00700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5c10066760 0x7f5c10068c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000f60 tx=0x7f5c20000bc0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:00.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.074+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5c1c0508c0 con 0x7f5c3006e470 2024-09-13T18:45:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.262+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5c3006cd80 con 0x7f5c3006e470 2024-09-13T18:45:00.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.822+0000 7f5c26000700 1 -- 172.21.15.32:0/3774057240 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5c1c053ee0 con 0x7f5c3006e470 2024-09-13T18:45:00.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5c10066760 msgr2=0x7f5c10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5c10066760 0x7f5c10068c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000f60 tx=0x7f5c20000bc0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 msgr2=0x7f5c301e4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c301e4290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c500 tx=0x7f5c1c00c810 comp rx=0 tx=0).stop 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 shutdown_connections 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5c10066760 0x7f5c10068c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c30151370 0x7f5c301e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5c3006e470 0x7f5c301e4290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 --2- 172.21.15.32:0/3774057240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c3006ada0 0x7f5c300c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:00.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 >> 172.21.15.32:0/3774057240 conn(0x7f5c3006f530 msgr2=0x7f5c3014fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:00.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 shutdown_connections 2024-09-13T18:45:00.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:00.830+0000 7f5c2f200700 1 -- 172.21.15.32:0/3774057240 wait complete. 2024-09-13T18:45:00.851 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2024-09-13T18:45:00.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:45:01.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.050+0000 7fc4ce800700 1 Processor -- start 2024-09-13T18:45:01.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.050+0000 7fc4ce800700 1 -- start start 2024-09-13T18:45:01.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4ce800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c8073990 0x7fc4c815a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4ce800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc4c8073d70 0x7fc4c815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4ce800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c806dbe0 con 0x7fc4c80c8510 2024-09-13T18:45:01.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4ce800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c806de30 con 0x7fc4c8073d70 2024-09-13T18:45:01.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4ce800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80c6890 con 0x7fc4c8073990 2024-09-13T18:45:01.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c8073990 0x7fc4c815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc4c80c8510 0x7fc4c80717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49776/0 (socket says 172.21.15.32:49776) 2024-09-13T18:45:01.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6a00700 1 -- 172.21.15.32:0/2157555673 learned_addr learned my addr 172.21.15.32:0/2157555673 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:01.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7e00700 1 --2- 172.21.15.32:0/2157555673 >> v2:172.21.15.32:3300/0 conn(0x7fc4c8073d70 0x7fc4c815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6000700 1 -- 172.21.15.32:0/2157555673 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202196650 0 0) 0x7fc4c806dbe0 con 0x7fc4c80c8510 2024-09-13T18:45:01.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6000700 1 -- 172.21.15.32:0/2157555673 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ac0035d0 con 0x7fc4c80c8510 2024-09-13T18:45:01.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7400700 1 -- 172.21.15.32:0/2157555673 >> v2:172.21.15.32:3300/0 conn(0x7fc4c8073d70 msgr2=0x7fc4c815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:01.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7400700 1 --2- 172.21.15.32:0/2157555673 >> v2:172.21.15.32:3300/0 conn(0x7fc4c8073d70 0x7fc4c815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7400700 1 -- 172.21.15.32:0/2157555673 >> v1:172.21.15.32:6789/0 conn(0x7fc4c80c8510 legacy=0x7fc4c80717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7400700 1 -- 172.21.15.32:0/2157555673 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80c6b70 con 0x7fc4c8073990 2024-09-13T18:45:01.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c7400700 1 --2- 172.21.15.32:0/2157555673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c8073990 0x7fc4c815a280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009850 tx=0x7fc4b8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a540657fbc4668 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:01.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6000700 1 -- 172.21.15.32:0/2157555673 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8011830 con 0x7fc4c8073990 2024-09-13T18:45:01.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6000700 1 -- 172.21.15.32:0/2157555673 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8011990 con 0x7fc4c8073990 2024-09-13T18:45:01.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.054+0000 7fc4c6000700 1 -- 172.21.15.32:0/2157555673 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8011d00 con 0x7fc4c8073990 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 -- 172.21.15.32:0/2157555673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c8073990 msgr2=0x7fc4c815a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 --2- 172.21.15.32:0/2157555673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c8073990 0x7fc4c815a280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009850 tx=0x7fc4b8009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 -- 172.21.15.32:0/2157555673 shutdown_connections 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 --2- 172.21.15.32:0/2157555673 >> v2:172.21.15.32:3300/0 conn(0x7fc4c8073d70 0x7fc4c815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 --2- 172.21.15.32:0/2157555673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c8073990 0x7fc4c815a280 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 -- 172.21.15.32:0/2157555673 >> 172.21.15.32:0/2157555673 conn(0x7fc4c80c8bd0 msgr2=0x7fc4c80c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 -- 172.21.15.32:0/2157555673 shutdown_connections 2024-09-13T18:45:01.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.058+0000 7fc4ce800700 1 -- 172.21.15.32:0/2157555673 wait complete. 2024-09-13T18:45:01.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 Processor -- start 2024-09-13T18:45:01.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 -- start start 2024-09-13T18:45:01.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 0x7fc4c81f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4c8073d70 0x7fc4c80c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c80c8510 0x7fc4c815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81f7280 con 0x7fc4c8073d70 2024-09-13T18:45:01.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80bfe90 con 0x7fc4c8073990 2024-09-13T18:45:01.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4ce800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80c0170 con 0x7fc4c80c8510 2024-09-13T18:45:01.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4c7400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 0x7fc4c81f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4c6a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4c8073d70 0x7fc4c80c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4c7400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 0x7fc4c81f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:57606/0 (socket says 172.21.15.32:57606) 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4c7400700 1 -- 172.21.15.32:0/4020974676 learned_addr learned my addr 172.21.15.32:0/4020974676 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.062+0000 7fc4c7e00700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c80c8510 0x7fc4c815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7400700 1 -- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c80c8510 msgr2=0x7fc4c815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7400700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c80c8510 0x7fc4c815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7400700 1 -- 172.21.15.32:0/4020974676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4c8073d70 msgr2=0x7fc4c80c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7400700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4c8073d70 0x7fc4c80c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7400700 1 -- 172.21.15.32:0/4020974676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80094b0 con 0x7fc4c8073990 2024-09-13T18:45:01.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7e00700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c80c8510 0x7fc4c815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:01.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4c7400700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 0x7fc4c81f6d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80090b0 tx=0x7fc4b8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:01.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8004610 con 0x7fc4c8073990 2024-09-13T18:45:01.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b801f070 con 0x7fc4c8073990 2024-09-13T18:45:01.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c80c0450 con 0x7fc4c8073990 2024-09-13T18:45:01.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80038c0 con 0x7fc4c8073990 2024-09-13T18:45:01.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c80c0a10 con 0x7fc4c8073990 2024-09-13T18:45:01.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.066+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c806f530 con 0x7fc4c8073990 2024-09-13T18:45:01.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.070+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4b8003a20 con 0x7fc4c8073990 2024-09-13T18:45:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.070+0000 7fc4bf400700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc4a8066730 0x7fc4a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.070+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc4b8021070 con 0x7fc4c8073990 2024-09-13T18:45:01.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.070+0000 7fc4c6a00700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc4a8066730 0x7fc4a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.074+0000 7fc4c6a00700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc4a8066730 0x7fc4a8068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4c815a880 tx=0x7fc4b4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:01.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.078+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4b8052b10 con 0x7fc4c8073990 2024-09-13T18:45:01.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.294+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc4c80c2270 con 0x7fc4c8073990 2024-09-13T18:45:01.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.310+0000 7fc4bf400700 1 -- 172.21.15.32:0/4020974676 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc4b8056130 con 0x7fc4c8073990 2024-09-13T18:45:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc4a8066730 msgr2=0x7fc4a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc4a8066730 0x7fc4a8068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4c815a880 tx=0x7fc4b4009040 comp rx=0 tx=0).stop 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 msgr2=0x7fc4c81f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 0x7fc4c81f6d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80090b0 tx=0x7fc4b8004770 comp rx=0 tx=0).stop 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 shutdown_connections 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc4a8066730 0x7fc4a8068bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4c80c8510 0x7fc4c815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4c8073d70 0x7fc4c80c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 --2- 172.21.15.32:0/4020974676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c8073990 0x7fc4c81f6d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 >> 172.21.15.32:0/4020974676 conn(0x7fc4c80c8bd0 msgr2=0x7fc4c8159050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 shutdown_connections 2024-09-13T18:45:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.318+0000 7fc4ce800700 1 -- 172.21.15.32:0/4020974676 wait complete. 2024-09-13T18:45:01.332 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:45:01.354 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T18:45:01.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T18:45:01.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.514+0000 7feb0be00700 1 Processor -- start 2024-09-13T18:45:01.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.514+0000 7feb0be00700 1 -- start start 2024-09-13T18:45:01.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0be00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb0c153be0 0x7feb0c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7feb0c0c5850 0x7feb0c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0be00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c06cc30 con 0x7feb0c0c8040 2024-09-13T18:45:01.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0be00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c153fc0 con 0x7feb0c0c5850 2024-09-13T18:45:01.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0be00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c066fd0 con 0x7feb0c153be0 2024-09-13T18:45:01.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0aa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb0c153be0 0x7feb0c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0aa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb0c153be0 0x7feb0c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:57614/0 (socket says 172.21.15.32:57614) 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0aa00700 1 -- 172.21.15.32:0/3252228830 learned_addr learned my addr 172.21.15.32:0/3252228830 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.518+0000 7feb0a000700 1 --2- 172.21.15.32:0/3252228830 >> v2:172.21.15.32:3300/0 conn(0x7feb0c0c5850 0x7feb0c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0aa00700 1 -- 172.21.15.32:0/3252228830 >> v2:172.21.15.32:3300/0 conn(0x7feb0c0c5850 msgr2=0x7feb0c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0aa00700 1 --2- 172.21.15.32:0/3252228830 >> v2:172.21.15.32:3300/0 conn(0x7feb0c0c5850 0x7feb0c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0aa00700 1 -- 172.21.15.32:0/3252228830 >> v1:172.21.15.32:6789/0 conn(0x7feb0c0c8040 legacy=0x7feb0c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0aa00700 1 -- 172.21.15.32:0/3252228830 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c06ce80 con 0x7feb0c153be0 2024-09-13T18:45:01.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0aa00700 1 --2- 172.21.15.32:0/3252228830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c153be0 0x7feb0c15a1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb0c070540 tx=0x7feafc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1bc1c5ce2e73182 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:01.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb09600700 1 -- 172.21.15.32:0/3252228830 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc011830 con 0x7feb0c153be0 2024-09-13T18:45:01.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb09600700 1 -- 172.21.15.32:0/3252228830 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc011990 con 0x7feb0c153be0 2024-09-13T18:45:01.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb09600700 1 -- 172.21.15.32:0/3252228830 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc011d20 con 0x7feb0c153be0 2024-09-13T18:45:01.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 -- 172.21.15.32:0/3252228830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c153be0 msgr2=0x7feb0c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 --2- 172.21.15.32:0/3252228830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c153be0 0x7feb0c15a1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb0c070540 tx=0x7feafc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 -- 172.21.15.32:0/3252228830 shutdown_connections 2024-09-13T18:45:01.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 --2- 172.21.15.32:0/3252228830 >> v2:172.21.15.32:3300/0 conn(0x7feb0c0c5850 0x7feb0c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 --2- 172.21.15.32:0/3252228830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c153be0 0x7feb0c15a1c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 -- 172.21.15.32:0/3252228830 >> 172.21.15.32:0/3252228830 conn(0x7feb0c0720e0 msgr2=0x7feb0c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:01.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 -- 172.21.15.32:0/3252228830 shutdown_connections 2024-09-13T18:45:01.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.522+0000 7feb0be00700 1 -- 172.21.15.32:0/3252228830 wait complete. 2024-09-13T18:45:01.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 Processor -- start 2024-09-13T18:45:01.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 -- start start 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c0c5850 0x7feb0c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 0x7feb0c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb0c153be0 0x7feb0c1f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0c4d40 con 0x7feb0c0c8040 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0c51d0 con 0x7feb0c0c5850 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0c70d0 con 0x7feb0c153be0 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 0x7feb0c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 0x7feb0c156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42706/0 (socket says 172.21.15.32:42706) 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.526+0000 7feb0a000700 1 -- 172.21.15.32:0/3029012838 learned_addr learned my addr 172.21.15.32:0/3029012838 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:01.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0aa00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c0c5850 0x7feb0c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0b400700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb0c153be0 0x7feb0c1f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0a000700 1 -- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb0c153be0 msgr2=0x7feb0c1f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0a000700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb0c153be0 0x7feb0c1f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0a000700 1 -- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c0c5850 msgr2=0x7feb0c154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0a000700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c0c5850 0x7feb0c154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0a000700 1 -- 172.21.15.32:0/3029012838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc009570 con 0x7feb0c0c8040 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0aa00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c0c5850 0x7feb0c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:01.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0b400700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb0c153be0 0x7feb0c1f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:01.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0a000700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 0x7feb0c156b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feaf800e9d0 tx=0x7feaf800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:01.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8009720 con 0x7feb0c0c8040 2024-09-13T18:45:01.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800c850 con 0x7feb0c0c8040 2024-09-13T18:45:01.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c0c73b0 con 0x7feb0c0c8040 2024-09-13T18:45:01.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800cbc0 con 0x7feb0c0c8040 2024-09-13T18:45:01.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c0c46f0 con 0x7feb0c0c8040 2024-09-13T18:45:01.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.530+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c15a1c0 con 0x7feb0c0c8040 2024-09-13T18:45:01.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.534+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feaf800cd20 con 0x7feb0c0c8040 2024-09-13T18:45:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.534+0000 7feb02a00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feaec066730 0x7feaec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.534+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaf80842f0 con 0x7feb0c0c8040 2024-09-13T18:45:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.534+0000 7feb0aa00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feaec066730 0x7feaec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.538+0000 7feb0aa00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feaec066730 0x7feaec068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feafc000c00 tx=0x7feafc008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:01.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.542+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feaf8051650 con 0x7feb0c0c8040 2024-09-13T18:45:01.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:01.738+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7feb0c06d160 con 0x7feb0c0c8040 2024-09-13T18:45:02.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.310+0000 7feb02a00700 1 -- 172.21.15.32:0/3029012838 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7feaf8054c70 con 0x7feb0c0c8040 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.314+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feaec066730 msgr2=0x7feaec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.314+0000 7feb0be00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feaec066730 0x7feaec068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feafc000c00 tx=0x7feafc008030 comp rx=0 tx=0).stop 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.314+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 msgr2=0x7feb0c156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.314+0000 7feb0be00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 0x7feb0c156b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feaf800e9d0 tx=0x7feaf800ed90 comp rx=0 tx=0).stop 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 shutdown_connections 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feaec066730 0x7feaec068bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb0c153be0 0x7feb0c1f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb0c0c8040 0x7feb0c156b50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 --2- 172.21.15.32:0/3029012838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb0c0c5850 0x7feb0c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 >> 172.21.15.32:0/3029012838 conn(0x7feb0c0720e0 msgr2=0x7feb0c06de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 shutdown_connections 2024-09-13T18:45:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.318+0000 7feb0be00700 1 -- 172.21.15.32:0/3029012838 wait complete. 2024-09-13T18:45:02.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:45:02.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.522+0000 7f522fe00700 1 Processor -- start 2024-09-13T18:45:02.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.522+0000 7f522fe00700 1 -- start start 2024-09-13T18:45:02.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5230153840 0x7f52300c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:02.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52300c8950 0x7f523015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:02.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522fe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300c8370 con 0x7f52300c8f10 2024-09-13T18:45:02.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522fe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523006b810 con 0x7f52300c8950 2024-09-13T18:45:02.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522fe00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300c8650 con 0x7f5230153840 2024-09-13T18:45:02.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522e000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f52300c8f10 0x7f52300ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34118/0 (socket says 172.21.15.32:34118) 2024-09-13T18:45:02.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522e000700 1 -- 172.21.15.32:0/2964675743 learned_addr learned my addr 172.21.15.32:0/2964675743 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:02.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522ea00700 1 --2- 172.21.15.32:0/2964675743 >> v2:172.21.15.86:3300/0 conn(0x7f5230153840 0x7f52300c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:02.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522f400700 1 --2- 172.21.15.32:0/2964675743 >> v2:172.21.15.32:3300/0 conn(0x7f52300c8950 0x7f523015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:02.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522d600700 1 -- 172.21.15.32:0/2964675743 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774642067 0 0) 0x7f52300c8370 con 0x7f52300c8f10 2024-09-13T18:45:02.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.526+0000 7f522d600700 1 -- 172.21.15.32:0/2964675743 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52140035d0 con 0x7f52300c8f10 2024-09-13T18:45:02.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522ea00700 1 -- 172.21.15.32:0/2964675743 >> v2:172.21.15.32:3300/0 conn(0x7f52300c8950 msgr2=0x7f523015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:02.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522ea00700 1 --2- 172.21.15.32:0/2964675743 >> v2:172.21.15.32:3300/0 conn(0x7f52300c8950 0x7f523015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522d600700 1 -- 172.21.15.32:0/2964675743 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970898590 0 0) 0x7f52140035d0 con 0x7f52300c8f10 2024-09-13T18:45:02.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522ea00700 1 -- 172.21.15.32:0/2964675743 >> v1:172.21.15.86:6789/0 conn(0x7f52300c8f10 legacy=0x7f52300ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:02.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522ea00700 1 -- 172.21.15.32:0/2964675743 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523006ae70 con 0x7f5230153840 2024-09-13T18:45:02.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522ea00700 1 --2- 172.21.15.32:0/2964675743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f52300c93e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f523006d7b0 tx=0x7f5220009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cda586292599b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:02.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522d600700 1 -- 172.21.15.32:0/2964675743 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c001670 con 0x7f5230153840 2024-09-13T18:45:02.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522d600700 1 -- 172.21.15.32:0/2964675743 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220004030 con 0x7f5230153840 2024-09-13T18:45:02.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522d600700 1 -- 172.21.15.32:0/2964675743 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200043c0 con 0x7f5230153840 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 -- 172.21.15.32:0/2964675743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 msgr2=0x7f52300c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 --2- 172.21.15.32:0/2964675743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f52300c93e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f523006d7b0 tx=0x7f5220009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 -- 172.21.15.32:0/2964675743 shutdown_connections 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 --2- 172.21.15.32:0/2964675743 >> v2:172.21.15.32:3300/0 conn(0x7f52300c8950 0x7f523015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 --2- 172.21.15.32:0/2964675743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f52300c93e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 -- 172.21.15.32:0/2964675743 >> 172.21.15.32:0/2964675743 conn(0x7f5230071740 msgr2=0x7f5230071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 -- 172.21.15.32:0/2964675743 shutdown_connections 2024-09-13T18:45:02.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.530+0000 7f522fe00700 1 -- 172.21.15.32:0/2964675743 wait complete. 2024-09-13T18:45:02.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 Processor -- start 2024-09-13T18:45:02.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 -- start start 2024-09-13T18:45:02.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52300c8950 0x7f52301f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:02.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 0x7f52301f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:02.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f5230146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:02.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301e66a0 con 0x7f52300c8950 2024-09-13T18:45:02.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230148ea0 con 0x7f5230153840 2024-09-13T18:45:02.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52301f2b70 con 0x7f52300c8f10 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 0x7f52301f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f5230146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52300c8950 0x7f52301f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52300c8950 0x7f52301f04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42724/0 (socket says 172.21.15.32:42724) 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 0x7f52301f09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51822/0 (socket says 172.21.15.32:51822) 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f5230146600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:57638/0 (socket says 172.21.15.32:57638) 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522ea00700 1 -- 172.21.15.32:0/4088012946 learned_addr learned my addr 172.21.15.32:0/4088012946 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 -- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 msgr2=0x7f5230146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f5230146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 -- 172.21.15.32:0/4088012946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52300c8950 msgr2=0x7f52301f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:02.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52300c8950 0x7f52301f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:02.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 -- 172.21.15.32:0/4088012946 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200094b0 con 0x7f52300c8f10 2024-09-13T18:45:02.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.534+0000 7f522e000700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 0x7f52301f09f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f521c0011e0 tx=0x7f521c00ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:02.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.538+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c004ca0 con 0x7f52300c8f10 2024-09-13T18:45:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.538+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c004e00 con 0x7f52300c8f10 2024-09-13T18:45:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.538+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52301f2e30 con 0x7f52300c8f10 2024-09-13T18:45:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.538+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c007310 con 0x7f52300c8f10 2024-09-13T18:45:02.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.538+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301e63c0 con 0x7f52300c8f10 2024-09-13T18:45:02.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.538+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5230153c20 con 0x7f52300c8f10 2024-09-13T18:45:02.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.542+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f521c007470 con 0x7f52300c8f10 2024-09-13T18:45:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.542+0000 7f5226a00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5210066760 0x7f5210068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.542+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f521c083e30 con 0x7f52300c8f10 2024-09-13T18:45:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.542+0000 7f522ea00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5210066760 0x7f5210068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.546+0000 7f522ea00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5210066760 0x7f5210068c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5220009b70 tx=0x7f5220008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:02.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.554+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f521c0510b0 con 0x7f52300c8f10 2024-09-13T18:45:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:02.738+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f523014a3b0 con 0x7f52300c8f10 2024-09-13T18:45:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.322+0000 7f5226a00700 1 -- 172.21.15.32:0/4088012946 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f521c007720 con 0x7f52300c8f10 2024-09-13T18:45:04.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5210066760 msgr2=0x7f5210068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5210066760 0x7f5210068c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5220009b70 tx=0x7f5220008030 comp rx=0 tx=0).stop 2024-09-13T18:45:04.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 msgr2=0x7f52301f09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 0x7f52301f09f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f521c0011e0 tx=0x7f521c00ca30 comp rx=0 tx=0).stop 2024-09-13T18:45:04.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 shutdown_connections 2024-09-13T18:45:04.343 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5210066760 0x7f5210068c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5230153840 0x7f5230146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52300c8f10 0x7f52301f09f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 --2- 172.21.15.32:0/4088012946 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52300c8950 0x7f52301f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 >> 172.21.15.32:0/4088012946 conn(0x7f5230071740 msgr2=0x7f5230151060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:04.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 shutdown_connections 2024-09-13T18:45:04.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.338+0000 7f522fe00700 1 -- 172.21.15.32:0/4088012946 wait complete. 2024-09-13T18:45:04.345 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data_ec' created 2024-09-13T18:45:04.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T18:45:04.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.542+0000 7fa4c2800700 1 Processor -- start 2024-09-13T18:45:04.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.542+0000 7fa4c2800700 1 -- start start 2024-09-13T18:45:04.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c2800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa4bc0c7870 0x7fa4bc06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c2800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0c4610 con 0x7fa4bc0c70d0 2024-09-13T18:45:04.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c2800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc157fe0 con 0x7fa4bc0c6cf0 2024-09-13T18:45:04.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c2800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc1585a0 con 0x7fa4bc0c7870 2024-09-13T18:45:04.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fa4bc0c6cf0 0x7fa4bc1575c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34130/0 (socket says 172.21.15.32:34130) 2024-09-13T18:45:04.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 -- 172.21.15.32:0/1377287361 learned_addr learned my addr 172.21.15.32:0/1377287361 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:04.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1e00700 1 --2- 172.21.15.32:0/1377287361 >> v2:172.21.15.32:3300/0 conn(0x7fa4bc0c7870 0x7fa4bc06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021997039 0 0) 0x7fa4bc157fe0 con 0x7fa4bc0c6cf0 2024-09-13T18:45:04.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a40035d0 con 0x7fa4bc0c6cf0 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783863579 0 0) 0x7fa4bc0c4610 con 0x7fa4bc0c70d0 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc157fe0 con 0x7fa4bc0c70d0 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3854347615 0 0) 0x7fa4bc157fe0 con 0x7fa4bc0c70d0 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 >> v2:172.21.15.32:3300/0 conn(0x7fa4bc0c7870 msgr2=0x7fa4bc06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 --2- 172.21.15.32:0/1377287361 >> v2:172.21.15.32:3300/0 conn(0x7fa4bc0c7870 0x7fa4bc06a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 >> v1:172.21.15.86:6789/0 conn(0x7fa4bc0c6cf0 legacy=0x7fa4bc1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc1582c0 con 0x7fa4bc0c70d0 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7fa4a8001670 con 0x7fa4bc0c70d0 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 >> v1:172.21.15.32:6789/0 conn(0x7fa4bc0c70d0 legacy=0x7fa4bc151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4a4004cb0 0x7fa4a4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4003810 0x7fa4a4003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4a40041d0 0x7fa4a400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0001230 con 0x7fa4a4004cb0 2024-09-13T18:45:04.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1585a0 con 0x7fa4a40041d0 2024-09-13T18:45:04.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a400c0d0 con 0x7fa4a4003810 2024-09-13T18:45:04.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4a4004cb0 0x7fa4a4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c0a00700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4003810 0x7fa4a4003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1e00700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4a40041d0 0x7fa4a400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 -- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4003810 msgr2=0x7fa4a4003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:04.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4003810 0x7fa4a4003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 -- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4a40041d0 msgr2=0x7fa4a400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4a40041d0 0x7fa4a400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 -- 172.21.15.32:0/1377287361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc157fe0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1e00700 1 -- 172.21.15.32:0/1377287361 reap_dead start 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.546+0000 7fa4c1400700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4a4004cb0 0x7fa4a4005090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c1e0 tx=0x7fa4a40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c1cf6ab52ac583 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0007b30 con 0x7fa4a4004cb0 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b000cd20 con 0x7fa4a4004cb0 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4bbe00700 1 -- 172.21.15.32:0/1377287361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0004b90 con 0x7fa4a4004cb0 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 -- 172.21.15.32:0/1377287361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4a4004cb0 msgr2=0x7fa4a4005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4a4004cb0 0x7fa4a4005090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c1e0 tx=0x7fa4a40058a0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 -- 172.21.15.32:0/1377287361 shutdown_connections 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 --2- 172.21.15.32:0/1377287361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4a4004cb0 0x7fa4a4005090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 -- 172.21.15.32:0/1377287361 >> 172.21.15.32:0/1377287361 conn(0x7fa4bc0ccf70 msgr2=0x7fa4bc0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:04.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 -- 172.21.15.32:0/1377287361 shutdown_connections 2024-09-13T18:45:04.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 -- 172.21.15.32:0/1377287361 wait complete. 2024-09-13T18:45:04.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.550+0000 7fa4c2800700 1 Processor -- start 2024-09-13T18:45:04.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 -- start start 2024-09-13T18:45:04.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 0x7fa4bc153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4bc1e1dd0 0x7fa4bc154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4bc1e0a50 0x7fa4bc152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1eba60 con 0x7fa4bc1e1dd0 2024-09-13T18:45:04.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1543f0 con 0x7fa4bc1e0a50 2024-09-13T18:45:04.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc1eade0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 0x7fa4bc153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4bc1e0a50 0x7fa4bc152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4bc1e1dd0 0x7fa4bc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 0x7fa4bc153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51846/0 (socket says 172.21.15.32:51846) 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 -- 172.21.15.32:0/3548376130 learned_addr learned my addr 172.21.15.32:0/3548376130 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 -- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4bc1e0a50 msgr2=0x7fa4bc152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4bc1e0a50 0x7fa4bc152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 -- 172.21.15.32:0/3548376130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4bc1e1dd0 msgr2=0x7fa4bc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4bc1e1dd0 0x7fa4bc154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 -- 172.21.15.32:0/3548376130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc1eb0c0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c0a00700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4bc1e1dd0 0x7fa4bc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:04.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c1400700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 0x7fa4bc153eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00017e0 tx=0x7fa4b0001750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:04.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00015f0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b000ce90 con 0x7fa4a4004cb0 2024-09-13T18:45:04.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc1eb3a0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.554+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00072f0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.558+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc0c9170 con 0x7fa4a4004cb0 2024-09-13T18:45:04.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.558+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc0c4360 con 0x7fa4a4004cb0 2024-09-13T18:45:04.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.558+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4b0007450 con 0x7fa4a4004cb0 2024-09-13T18:45:04.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.562+0000 7fa4b9600700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa49c066730 0x7fa49c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:04.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.562+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fa4b00854a0 con 0x7fa4a4004cb0 2024-09-13T18:45:04.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.562+0000 7fa4c0a00700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa49c066730 0x7fa49c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:04.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.562+0000 7fa4c0a00700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa49c066730 0x7fa49c068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc1e21b0 tx=0x7fa4a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:04.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.574+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4b0052650 con 0x7fa4a4004cb0 2024-09-13T18:45:04.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:04.758+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa4bc06ba30 con 0x7fa4a4004cb0 2024-09-13T18:45:05.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.325+0000 7fa4b9600700 1 -- 172.21.15.32:0/3548376130 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4b0055c70 con 0x7fa4a4004cb0 2024-09-13T18:45:05.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.345+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa49c066730 msgr2=0x7fa49c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.345+0000 7fa4c2800700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa49c066730 0x7fa49c068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc1e21b0 tx=0x7fa4a8009040 comp rx=0 tx=0).stop 2024-09-13T18:45:05.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.345+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 msgr2=0x7fa4bc153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.345+0000 7fa4c2800700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 0x7fa4bc153eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00017e0 tx=0x7fa4b0001750 comp rx=0 tx=0).stop 2024-09-13T18:45:05.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 shutdown_connections 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa49c066730 0x7fa49c068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4bc1e0a50 0x7fa4bc152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4bc1e1dd0 0x7fa4bc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 --2- 172.21.15.32:0/3548376130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4a4004cb0 0x7fa4bc153eb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 >> 172.21.15.32:0/3548376130 conn(0x7fa4bc0ccf70 msgr2=0x7fa4bc157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 shutdown_connections 2024-09-13T18:45:05.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.349+0000 7fa4c2800700 1 -- 172.21.15.32:0/3548376130 wait complete. 2024-09-13T18:45:05.363 INFO:teuthology.orchestra.run.smithi032.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T18:45:05.384 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T18:45:05.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.557+0000 7fb183e00700 1 Processor -- start 2024-09-13T18:45:05.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.557+0000 7fb183e00700 1 -- start start 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1840c27a0 0x7fb184156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1840c2b80 0x7fb18406f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb184157420 con 0x7fb1840b1e00 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18406edc0 con 0x7fb1840c27a0 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18406ded0 con 0x7fb1840c2b80 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1840c2b80 0x7fb18406f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb1840b1e00 0x7fb184150200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49804/0 (socket says 172.21.15.32:49804) 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1840c27a0 0x7fb184156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb183400700 1 -- 172.21.15.32:0/3592608188 learned_addr learned my addr 172.21.15.32:0/3592608188 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb181600700 1 -- 172.21.15.32:0/3592608188 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143215439 0 0) 0x7fb17c001490 con 0x7fb1840b1e00 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182000700 1 -- 172.21.15.32:0/3592608188 >> v2:172.21.15.32:3300/0 conn(0x7fb1840c27a0 msgr2=0x7fb184156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182000700 1 --2- 172.21.15.32:0/3592608188 >> v2:172.21.15.32:3300/0 conn(0x7fb1840c27a0 0x7fb184156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182000700 1 -- 172.21.15.32:0/3592608188 >> v1:172.21.15.32:6789/0 conn(0x7fb1840b1e00 legacy=0x7fb184150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182000700 1 -- 172.21.15.32:0/3592608188 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18406e1b0 con 0x7fb1840c2b80 2024-09-13T18:45:05.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb182000700 1 --2- 172.21.15.32:0/3592608188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb18406f5c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1840b1610 tx=0x7fb170009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318650d60c3195f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:05.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb181600700 1 -- 172.21.15.32:0/3592608188 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170011830 con 0x7fb1840c2b80 2024-09-13T18:45:05.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb181600700 1 -- 172.21.15.32:0/3592608188 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170011990 con 0x7fb1840c2b80 2024-09-13T18:45:05.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.561+0000 7fb181600700 1 -- 172.21.15.32:0/3592608188 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170011d20 con 0x7fb1840c2b80 2024-09-13T18:45:05.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 -- 172.21.15.32:0/3592608188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 msgr2=0x7fb18406f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 --2- 172.21.15.32:0/3592608188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb18406f5c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1840b1610 tx=0x7fb170009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:05.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 -- 172.21.15.32:0/3592608188 shutdown_connections 2024-09-13T18:45:05.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 --2- 172.21.15.32:0/3592608188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb18406f5c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 --2- 172.21.15.32:0/3592608188 >> v2:172.21.15.32:3300/0 conn(0x7fb1840c27a0 0x7fb184156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 -- 172.21.15.32:0/3592608188 >> 172.21.15.32:0/3592608188 conn(0x7fb1840c8a60 msgr2=0x7fb1840c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:05.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 -- 172.21.15.32:0/3592608188 shutdown_connections 2024-09-13T18:45:05.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 -- 172.21.15.32:0/3592608188 wait complete. 2024-09-13T18:45:05.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 Processor -- start 2024-09-13T18:45:05.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 -- start start 2024-09-13T18:45:05.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.565+0000 7fb183e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 0x7fb1841f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1840c27a0 0x7fb1841f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb184149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1841528f0 con 0x7fb1840b1e00 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184152b20 con 0x7fb1840c2b80 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184152e00 con 0x7fb1840c27a0 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 0x7fb1841f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 0x7fb1841f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42776/0 (socket says 172.21.15.32:42776) 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 -- 172.21.15.32:0/3923017466 learned_addr learned my addr 172.21.15.32:0/3923017466 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182000700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1840c27a0 0x7fb1841f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183400700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb184149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 -- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1840c27a0 msgr2=0x7fb1841f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1840c27a0 0x7fb1841f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 -- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 msgr2=0x7fb184149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb184149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 -- 172.21.15.32:0/3923017466 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700094b0 con 0x7fb1840b1e00 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183400700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb184149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb182a00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 0x7fb1841f0ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb17400e9d0 tx=0x7fb17400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174009720 con 0x7fb1840b1e00 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400c850 con 0x7fb1840b1e00 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1841530e0 con 0x7fb1840b1e00 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400cbc0 con 0x7fb1840b1e00 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1841536a0 con 0x7fb1840b1e00 2024-09-13T18:45:05.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.569+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1841f0920 con 0x7fb1840b1e00 2024-09-13T18:45:05.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.573+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb17400cd20 con 0x7fb1840b1e00 2024-09-13T18:45:05.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.573+0000 7fb17aa00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb164066730 0x7fb164068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.573+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb174084980 con 0x7fb1840b1e00 2024-09-13T18:45:05.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.573+0000 7fb182000700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb164066730 0x7fb164068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:05.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.577+0000 7fb182000700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb164066730 0x7fb164068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1840c2f90 tx=0x7fb170008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:05.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.581+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1740518f0 con 0x7fb1840b1e00 2024-09-13T18:45:05.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.809+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb18414cc60 con 0x7fb1840b1e00 2024-09-13T18:45:05.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.817+0000 7fb17aa00700 1 -- 172.21.15.32:0/3923017466 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb1740170b0 con 0x7fb1840b1e00 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb164066730 msgr2=0x7fb164068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb164066730 0x7fb164068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1840c2f90 tx=0x7fb170008030 comp rx=0 tx=0).stop 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 msgr2=0x7fb1841f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 0x7fb1841f0ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb17400e9d0 tx=0x7fb17400ece0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 shutdown_connections 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb164066730 0x7fb164068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1840c2b80 0x7fb184149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1840c27a0 0x7fb1841f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 --2- 172.21.15.32:0/3923017466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1840b1e00 0x7fb1841f0ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 >> 172.21.15.32:0/3923017466 conn(0x7fb1840c8a60 msgr2=0x7fb18414d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 shutdown_connections 2024-09-13T18:45:05.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:05.821+0000 7fb183e00700 1 -- 172.21.15.32:0/3923017466 wait complete. 2024-09-13T18:45:05.828 INFO:teuthology.orchestra.run.smithi032.stderr:added data pool 4 to fsmap 2024-09-13T18:45:05.850 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.021+0000 7f4f0d400700 1 Processor -- start 2024-09-13T18:45:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.021+0000 7f4f0d400700 1 -- start start 2024-09-13T18:45:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f0d400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f0815e8f0 0x7f4f08161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f0d400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4f080c7740 0x7f4f08168550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f0d400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080ca840 con 0x7f4f080cabf0 2024-09-13T18:45:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f0d400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f080c7e50 con 0x7f4f0815e8f0 2024-09-13T18:45:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f0d400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f080cba80 con 0x7f4f080c7740 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f0815e8f0 0x7f4f08161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f0815e8f0 0x7f4f08161a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42784/0 (socket says 172.21.15.32:42784) 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 -- 172.21.15.32:0/173543425 learned_addr learned my addr 172.21.15.32:0/173543425 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f07200700 1 --2- 172.21.15.32:0/173543425 >> v2:172.21.15.86:3300/0 conn(0x7f4f080c7740 0x7f4f08168550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 -- 172.21.15.32:0/173543425 >> v2:172.21.15.86:3300/0 conn(0x7f4f080c7740 msgr2=0x7f4f08168550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 --2- 172.21.15.32:0/173543425 >> v2:172.21.15.86:3300/0 conn(0x7f4f080c7740 0x7f4f08168550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 -- 172.21.15.32:0/173543425 >> v1:172.21.15.32:6789/0 conn(0x7f4f080cabf0 legacy=0x7f4f080719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.025+0000 7f4f06800700 1 -- 172.21.15.32:0/173543425 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080c80f0 con 0x7f4f0815e8f0 2024-09-13T18:45:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f06800700 1 --2- 172.21.15.32:0/173543425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f08161a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f0806af40 tx=0x7f4ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e70ca21840d8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f05400700 1 -- 172.21.15.32:0/173543425 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800e070 con 0x7f4f0815e8f0 2024-09-13T18:45:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f05400700 1 -- 172.21.15.32:0/173543425 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800b9c0 con 0x7f4f0815e8f0 2024-09-13T18:45:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f05400700 1 -- 172.21.15.32:0/173543425 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800bd70 con 0x7f4f0815e8f0 2024-09-13T18:45:06.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 -- 172.21.15.32:0/173543425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 msgr2=0x7f4f08161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 --2- 172.21.15.32:0/173543425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f08161a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f0806af40 tx=0x7f4ef800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:06.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 -- 172.21.15.32:0/173543425 shutdown_connections 2024-09-13T18:45:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 --2- 172.21.15.32:0/173543425 >> v2:172.21.15.86:3300/0 conn(0x7f4f080c7740 0x7f4f08168550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 --2- 172.21.15.32:0/173543425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f08161a20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 -- 172.21.15.32:0/173543425 >> 172.21.15.32:0/173543425 conn(0x7f4f08071240 msgr2=0x7f4f0806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 -- 172.21.15.32:0/173543425 shutdown_connections 2024-09-13T18:45:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.029+0000 7f4f0d400700 1 -- 172.21.15.32:0/173543425 wait complete. 2024-09-13T18:45:06.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.033+0000 7f4f0d400700 1 Processor -- start 2024-09-13T18:45:06.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.033+0000 7f4f0d400700 1 -- start start 2024-09-13T18:45:06.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.033+0000 7f4f0d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080c7740 0x7f4f080c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.033+0000 7f4f0d400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f080cabf0 0x7f4f08125ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f0d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f0815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f0d400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080c4b10 con 0x7f4f0815e8f0 2024-09-13T18:45:06.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f0d400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08127280 con 0x7f4f080cabf0 2024-09-13T18:45:06.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f0d400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08127540 con 0x7f4f080c7740 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f0815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f05e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f080cabf0 0x7f4f08125ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f0815b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42788/0 (socket says 172.21.15.32:42788) 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 -- 172.21.15.32:0/2256455438 learned_addr learned my addr 172.21.15.32:0/2256455438 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f06800700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080c7740 0x7f4f080c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 -- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080c7740 msgr2=0x7f4f080c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080c7740 0x7f4f080c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 -- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f080cabf0 msgr2=0x7f4f08125ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f080cabf0 0x7f4f08125ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 -- 172.21.15.32:0/2256455438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8009b30 con 0x7f4f0815e8f0 2024-09-13T18:45:06.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f07200700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f0815b170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000e810 tx=0x7f4f0000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0000c070 con 0x7f4f0815e8f0 2024-09-13T18:45:06.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00013630 con 0x7f4f0815e8f0 2024-09-13T18:45:06.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08127b70 con 0x7f4f0815e8f0 2024-09-13T18:45:06.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000139e0 con 0x7f4f0815e8f0 2024-09-13T18:45:06.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.037+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f080c5860 con 0x7f4f0815e8f0 2024-09-13T18:45:06.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.041+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f080703c0 con 0x7f4f0815e8f0 2024-09-13T18:45:06.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.041+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f00013b40 con 0x7f4f0815e8f0 2024-09-13T18:45:06.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.041+0000 7f4efea00700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ee8066730 0x7f4ee8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.041+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f00084290 con 0x7f4f0815e8f0 2024-09-13T18:45:06.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.041+0000 7f4f06800700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ee8066730 0x7f4ee8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.041+0000 7f4f06800700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ee8066730 0x7f4ee8068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f80 tx=0x7f4ef8009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.049+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f00051270 con 0x7f4f0815e8f0 2024-09-13T18:45:06.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.285+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f0815ecd0 con 0x7f4f0815e8f0 2024-09-13T18:45:06.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4efea00700 1 -- 172.21.15.32:0/2256455438 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6244 (secure 0 0 0) 0x7f4f00054890 con 0x7f4f0815e8f0 2024-09-13T18:45:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:06.440 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:05.815060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ee8066730 msgr2=0x7f4ee8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ee8066730 0x7f4ee8068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f80 tx=0x7f4ef8009000 comp rx=0 tx=0).stop 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 msgr2=0x7f4f0815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f0815b170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000e810 tx=0x7f4f0000eb20 comp rx=0 tx=0).stop 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 shutdown_connections 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ee8066730 0x7f4ee8068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f0815e8f0 0x7f4f0815b170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f080cabf0 0x7f4f08125ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 --2- 172.21.15.32:0/2256455438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f080c7740 0x7f4f080c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 >> 172.21.15.32:0/2256455438 conn(0x7f4f08071240 msgr2=0x7f4f080c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 shutdown_connections 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.289+0000 7f4f0d400700 1 -- 172.21.15.32:0/2256455438 wait complete. 2024-09-13T18:45:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 5 2024-09-13T18:45:06.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:06.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 Processor -- start 2024-09-13T18:45:06.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 -- start start 2024-09-13T18:45:06.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1815b370 0x7fdc180c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdc1806cdf0 0x7fdc180cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1806d590 con 0x7fdc1815af90 2024-09-13T18:45:06.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180c67c0 con 0x7fdc1806cdf0 2024-09-13T18:45:06.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc1dc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1815e620 con 0x7fdc1815b370 2024-09-13T18:45:06.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc16a00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdc1815af90 0x7fdc180c7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34132/0 (socket says 172.21.15.32:34132) 2024-09-13T18:45:06.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.653+0000 7fdc16a00700 1 -- 172.21.15.32:0/1483494680 learned_addr learned my addr 172.21.15.32:0/1483494680 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:06.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc0e000700 1 --2- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1815b370 0x7fdc180c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc17400700 1 --2- 172.21.15.32:0/1483494680 >> v2:172.21.15.86:3300/0 conn(0x7fdc1806cdf0 0x7fdc180cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc16000700 1 -- 172.21.15.32:0/1483494680 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075920724 0 0) 0x7fdc1806d590 con 0x7fdc1815af90 2024-09-13T18:45:06.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc16000700 1 -- 172.21.15.32:0/1483494680 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc0035d0 con 0x7fdc1815af90 2024-09-13T18:45:06.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc17400700 1 -- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1815b370 msgr2=0x7fdc180c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:06.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc17400700 1 --2- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1815b370 0x7fdc180c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc17400700 1 -- 172.21.15.32:0/1483494680 >> v1:172.21.15.86:6789/0 conn(0x7fdc1815af90 legacy=0x7fdc180c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc17400700 1 -- 172.21.15.32:0/1483494680 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1815e900 con 0x7fdc1806cdf0 2024-09-13T18:45:06.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc17400700 1 --2- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc1806cdf0 0x7fdc180cb670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009850 tx=0x7fdc10009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf5bbfdca3f24fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc16000700 1 -- 172.21.15.32:0/1483494680 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10011830 con 0x7fdc1806cdf0 2024-09-13T18:45:06.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc16000700 1 -- 172.21.15.32:0/1483494680 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10011990 con 0x7fdc1806cdf0 2024-09-13T18:45:06.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc16000700 1 -- 172.21.15.32:0/1483494680 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10011d40 con 0x7fdc1806cdf0 2024-09-13T18:45:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc1dc00700 1 -- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc1806cdf0 msgr2=0x7fdc180cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.657+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc1806cdf0 0x7fdc180cb670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009850 tx=0x7fdc10009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:06.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 -- 172.21.15.32:0/1483494680 shutdown_connections 2024-09-13T18:45:06.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc1806cdf0 0x7fdc180cb670 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/1483494680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1815b370 0x7fdc180c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 -- 172.21.15.32:0/1483494680 >> 172.21.15.32:0/1483494680 conn(0x7fdc180724e0 msgr2=0x7fdc1806ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 -- 172.21.15.32:0/1483494680 shutdown_connections 2024-09-13T18:45:06.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 -- 172.21.15.32:0/1483494680 wait complete. 2024-09-13T18:45:06.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 Processor -- start 2024-09-13T18:45:06.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.661+0000 7fdc1dc00700 1 -- start start 2024-09-13T18:45:06.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc1dc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1806cdf0 0x7fdc1815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc1dc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 0x7fdc181e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc1dc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc181e7dd0 0x7fdc181f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc1dc00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181e9cf0 con 0x7fdc1815af90 2024-09-13T18:45:06.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc1dc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181e9300 con 0x7fdc181e7dd0 2024-09-13T18:45:06.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc1dc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181f6250 con 0x7fdc1806cdf0 2024-09-13T18:45:06.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 0x7fdc181e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc17400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc181e7dd0 0x7fdc181f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 0x7fdc181e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42794/0 (socket says 172.21.15.32:42794) 2024-09-13T18:45:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 -- 172.21.15.32:0/2539714196 learned_addr learned my addr 172.21.15.32:0/2539714196 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:06.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc16a00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1806cdf0 0x7fdc1815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 -- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1806cdf0 msgr2=0x7fdc1815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1806cdf0 0x7fdc1815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 -- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc181e7dd0 msgr2=0x7fdc181f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc181e7dd0 0x7fdc181f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 -- 172.21.15.32:0/2539714196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100094b0 con 0x7fdc1815af90 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.665+0000 7fdc0e000700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 0x7fdc181e7890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000efc0 tx=0x7fdc00009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.669+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000cae0 con 0x7fdc1815af90 2024-09-13T18:45:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.669+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000f040 con 0x7fdc1815af90 2024-09-13T18:45:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.669+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000ce60 con 0x7fdc1815af90 2024-09-13T18:45:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.669+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc181e9770 con 0x7fdc1815af90 2024-09-13T18:45:06.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.669+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc181e9a10 con 0x7fdc1815af90 2024-09-13T18:45:06.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.669+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180c6930 con 0x7fdc1815af90 2024-09-13T18:45:06.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.673+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc00014480 con 0x7fdc1815af90 2024-09-13T18:45:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.673+0000 7fdc0f400700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdbf4066730 0x7fdbf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.673+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc00085100 con 0x7fdc1815af90 2024-09-13T18:45:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.673+0000 7fdc16a00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdbf4066730 0x7fdbf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:06.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.673+0000 7fdc16a00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdbf4066730 0x7fdbf4068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc08007fd0 tx=0x7fdc08007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:06.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.677+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc000520e0 con 0x7fdc1815af90 2024-09-13T18:45:06.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.869+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc181e74b0 con 0x7fdc1815af90 2024-09-13T18:45:06.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.873+0000 7fdc0f400700 1 -- 172.21.15.32:0/2539714196 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fdc00055700 con 0x7fdc1815af90 2024-09-13T18:45:06.880 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:06.882 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:06.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdbf4066730 msgr2=0x7fdbf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdbf4066730 0x7fdbf4068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdc08007fd0 tx=0x7fdc08007de0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 msgr2=0x7fdc181e7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:06.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 0x7fdc181e7890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000efc0 tx=0x7fdc00009f80 comp rx=0 tx=0).stop 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 shutdown_connections 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdbf4066730 0x7fdbf4068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc181e7dd0 0x7fdc181f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815af90 0x7fdc181e7890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 --2- 172.21.15.32:0/2539714196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdc1806cdf0 0x7fdc1815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 >> 172.21.15.32:0/2539714196 conn(0x7fdc180724e0 msgr2=0x7fdc1815a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 shutdown_connections 2024-09-13T18:45:06.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:06.877+0000 7fdc1dc00700 1 -- 172.21.15.32:0/2539714196 wait complete. 2024-09-13T18:45:06.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:07.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.081+0000 7f4a2be00700 1 Processor -- start 2024-09-13T18:45:07.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.081+0000 7f4a2be00700 1 -- start start 2024-09-13T18:45:07.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 0x7f4a2c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a2c158040 0x7f4a2c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2be00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c15b8f0 con 0x7f4a2c151680 2024-09-13T18:45:07.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2be00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c15a940 con 0x7f4a2c158040 2024-09-13T18:45:07.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c1573d0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 0x7f4a2c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2aa00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4a2c151680 0x7f4a2c0c9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34142/0 (socket says 172.21.15.32:34142) 2024-09-13T18:45:07.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2aa00700 1 -- 172.21.15.32:0/3032787333 learned_addr learned my addr 172.21.15.32:0/3032787333 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:07.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 0x7f4a2c157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51880/0 (socket says 172.21.15.32:51880) 2024-09-13T18:45:07.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2b400700 1 --2- 172.21.15.32:0/3032787333 >> v2:172.21.15.32:3300/0 conn(0x7f4a2c158040 0x7f4a2c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 -- 172.21.15.32:0/3032787333 >> v2:172.21.15.32:3300/0 conn(0x7f4a2c158040 msgr2=0x7f4a2c06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:07.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 --2- 172.21.15.32:0/3032787333 >> v2:172.21.15.32:3300/0 conn(0x7f4a2c158040 0x7f4a2c06c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 -- 172.21.15.32:0/3032787333 >> v1:172.21.15.86:6789/0 conn(0x7f4a2c151680 legacy=0x7f4a2c0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 -- 172.21.15.32:0/3032787333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c0cd370 con 0x7f4a2c0ca550 2024-09-13T18:45:07.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a2a000700 1 --2- 172.21.15.32:0/3032787333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 0x7f4a2c157b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009850 tx=0x7f4a18009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a98bdeeb959458e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a29600700 1 -- 172.21.15.32:0/3032787333 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011830 con 0x7f4a2c0ca550 2024-09-13T18:45:07.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a29600700 1 -- 172.21.15.32:0/3032787333 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18011990 con 0x7f4a2c0ca550 2024-09-13T18:45:07.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.085+0000 7f4a29600700 1 -- 172.21.15.32:0/3032787333 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011d20 con 0x7f4a2c0ca550 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 -- 172.21.15.32:0/3032787333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 msgr2=0x7f4a2c157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3032787333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 0x7f4a2c157b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009850 tx=0x7f4a18009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 -- 172.21.15.32:0/3032787333 shutdown_connections 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3032787333 >> v2:172.21.15.32:3300/0 conn(0x7f4a2c158040 0x7f4a2c06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3032787333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c0ca550 0x7f4a2c157b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 -- 172.21.15.32:0/3032787333 >> 172.21.15.32:0/3032787333 conn(0x7f4a2c06a390 msgr2=0x7f4a2c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 -- 172.21.15.32:0/3032787333 shutdown_connections 2024-09-13T18:45:07.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 -- 172.21.15.32:0/3032787333 wait complete. 2024-09-13T18:45:07.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 Processor -- start 2024-09-13T18:45:07.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.089+0000 7f4a2be00700 1 -- start start 2024-09-13T18:45:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 0x7f4a2c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a2c151680 0x7f4a2c1f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c158040 0x7f4a2c0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c152320 con 0x7f4a2c0ca550 2024-09-13T18:45:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c153f00 con 0x7f4a2c151680 2024-09-13T18:45:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0c6960 con 0x7f4a2c158040 2024-09-13T18:45:07.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 0x7f4a2c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 0x7f4a2c0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42820/0 (socket says 172.21.15.32:42820) 2024-09-13T18:45:07.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 -- 172.21.15.32:0/3411969234 learned_addr learned my addr 172.21.15.32:0/3411969234 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:07.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2b400700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c158040 0x7f4a2c0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2a000700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a2c151680 0x7f4a2c1f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 -- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c158040 msgr2=0x7f4a2c0c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c158040 0x7f4a2c0c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 -- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a2c151680 msgr2=0x7f4a2c1f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a2c151680 0x7f4a2c1f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 -- 172.21.15.32:0/3411969234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180094b0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2aa00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 0x7f4a2c0cc150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00c4d0 tx=0x7f4a1c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c005d90 con 0x7f4a2c0ca550 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0070d0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c007440 con 0x7f4a2c0ca550 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c154d80 con 0x7f4a2c0ca550 2024-09-13T18:45:07.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.093+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c154aa0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.097+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c156670 con 0x7f4a2c0ca550 2024-09-13T18:45:07.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.097+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a1c0075a0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.101+0000 7f4a22a00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4a0c066730 0x7f4a0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.101+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a1c083650 con 0x7f4a2c0ca550 2024-09-13T18:45:07.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.101+0000 7f4a2a000700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4a0c066730 0x7f4a0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.101+0000 7f4a2a000700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4a0c066730 0x7f4a0c068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009850 tx=0x7f4a18008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.105+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a1c0506e0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.297+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a2c15b8f0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a22a00700 1 -- 172.21.15.32:0/3411969234 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f4a2c15b8f0 con 0x7f4a2c0ca550 2024-09-13T18:45:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:07.307 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:07.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4a0c066730 msgr2=0x7f4a0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4a0c066730 0x7f4a0c068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009850 tx=0x7f4a18008030 comp rx=0 tx=0).stop 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 msgr2=0x7f4a2c0cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 0x7f4a2c0cc150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00c4d0 tx=0x7f4a1c00c7e0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 shutdown_connections 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4a0c066730 0x7f4a0c068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a2c158040 0x7f4a2c0c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a2c151680 0x7f4a2c1f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 --2- 172.21.15.32:0/3411969234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a2c0ca550 0x7f4a2c0cc150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 >> 172.21.15.32:0/3411969234 conn(0x7f4a2c06a390 msgr2=0x7f4a2c06be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 shutdown_connections 2024-09-13T18:45:07.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.301+0000 7f4a2be00700 1 -- 172.21.15.32:0/3411969234 wait complete. 2024-09-13T18:45:07.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.529+0000 7f149f200700 1 Processor -- start 2024-09-13T18:45:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.529+0000 7f149f200700 1 -- start start 2024-09-13T18:45:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149f200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14a00cb860 0x7f14a00c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149f200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a00c5d90 con 0x7f14a00c6b30 2024-09-13T18:45:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149f200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a00c5a00 con 0x7f14a00cb860 2024-09-13T18:45:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c6fc0 con 0x7f14a00c7890 2024-09-13T18:45:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149d400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14a00cb860 0x7f14a00c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149e800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f14a00c6b30 0x7f14a015e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:34144/0 (socket says 172.21.15.32:34144) 2024-09-13T18:45:07.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149e800700 1 -- 172.21.15.32:0/127983204 learned_addr learned my addr 172.21.15.32:0/127983204 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149de00700 1 -- 172.21.15.32:0/127983204 >> v2:172.21.15.32:3300/0 conn(0x7f14a00cb860 msgr2=0x7f14a00c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149de00700 1 --2- 172.21.15.32:0/127983204 >> v2:172.21.15.32:3300/0 conn(0x7f14a00cb860 0x7f14a00c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149de00700 1 -- 172.21.15.32:0/127983204 >> v1:172.21.15.86:6789/0 conn(0x7f14a00c6b30 legacy=0x7f14a015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149de00700 1 -- 172.21.15.32:0/127983204 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00c6110 con 0x7f14a00c7890 2024-09-13T18:45:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149d400700 1 --2- 172.21.15.32:0/127983204 >> v2:172.21.15.32:3300/0 conn(0x7f14a00cb860 0x7f14a00c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:07.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149ca00700 1 -- 172.21.15.32:0/127983204 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412784110 0 0) 0x7f1498001110 con 0x7f14a00c6b30 2024-09-13T18:45:07.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.533+0000 7f149de00700 1 --2- 172.21.15.32:0/127983204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a00c7c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1490009d90 tx=0x7f149000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c820149e467bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149ca00700 1 -- 172.21.15.32:0/127983204 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000e070 con 0x7f14a00c7890 2024-09-13T18:45:07.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149ca00700 1 -- 172.21.15.32:0/127983204 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000bb20 con 0x7f14a00c7890 2024-09-13T18:45:07.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149ca00700 1 -- 172.21.15.32:0/127983204 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490012430 con 0x7f14a00c7890 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 -- 172.21.15.32:0/127983204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 msgr2=0x7f14a00c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 --2- 172.21.15.32:0/127983204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a00c7c70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1490009d90 tx=0x7f149000b330 comp rx=0 tx=0).stop 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 -- 172.21.15.32:0/127983204 shutdown_connections 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 --2- 172.21.15.32:0/127983204 >> v2:172.21.15.32:3300/0 conn(0x7f14a00cb860 0x7f14a00c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 --2- 172.21.15.32:0/127983204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a00c7c70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 -- 172.21.15.32:0/127983204 >> 172.21.15.32:0/127983204 conn(0x7f14a00cad40 msgr2=0x7f14a00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 -- 172.21.15.32:0/127983204 shutdown_connections 2024-09-13T18:45:07.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 -- 172.21.15.32:0/127983204 wait complete. 2024-09-13T18:45:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 Processor -- start 2024-09-13T18:45:07.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.537+0000 7f149f200700 1 -- start start 2024-09-13T18:45:07.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a00c6b30 0x7f14a01e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a01f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a00cb860 0x7f14a01e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0155b60 con 0x7f14a00cb860 2024-09-13T18:45:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c2cc0 con 0x7f14a00c6b30 2024-09-13T18:45:07.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a01f7350 con 0x7f14a00c7890 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a01f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a01f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51912/0 (socket says 172.21.15.32:51912) 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 -- 172.21.15.32:0/2825972634 learned_addr learned my addr 172.21.15.32:0/2825972634 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149de00700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a00c6b30 0x7f14a01e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149e800700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a00cb860 0x7f14a01e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 -- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a00c6b30 msgr2=0x7f14a01e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a00c6b30 0x7f14a01e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 -- 172.21.15.32:0/2825972634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a00cb860 msgr2=0x7f14a01e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a00cb860 0x7f14a01e7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 -- 172.21.15.32:0/2825972634 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0094b0 con 0x7f14a00c7890 2024-09-13T18:45:07.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149d400700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a01f6a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f148c00ebb0 tx=0x7f148c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00c7f0 con 0x7f14a00c7890 2024-09-13T18:45:07.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c00c950 con 0x7f14a00c7890 2024-09-13T18:45:07.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1490009a70 con 0x7f14a00c7890 2024-09-13T18:45:07.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00cce0 con 0x7f14a00c7890 2024-09-13T18:45:07.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.541+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a01e9410 con 0x7f14a00c7890 2024-09-13T18:45:07.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.545+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a0067140 con 0x7f14a00c7890 2024-09-13T18:45:07.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.545+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f148c013470 con 0x7f14a00c7890 2024-09-13T18:45:07.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.545+0000 7f1496000700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1480066730 0x7f1480068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.545+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f148c0844b0 con 0x7f14a00c7890 2024-09-13T18:45:07.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.545+0000 7f149de00700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1480066730 0x7f1480068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:07.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.549+0000 7f149de00700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1480066730 0x7f1480068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1490014040 tx=0x7f1490011000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:07.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.557+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f148c051400 con 0x7f14a00c7890 2024-09-13T18:45:07.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.789+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14a00cb2c0 con 0x7f14a00c7890 2024-09-13T18:45:07.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.789+0000 7f1496000700 1 -- 172.21.15.32:0/2825972634 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6242 (secure 0 0 0) 0x7f148c054a20 con 0x7f14a00c7890 2024-09-13T18:45:07.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:07.797 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:06.817753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1480066730 msgr2=0x7f1480068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1480066730 0x7f1480068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1490014040 tx=0x7f1490011000 comp rx=0 tx=0).stop 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 msgr2=0x7f14a01f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a01f6a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f148c00ebb0 tx=0x7f148c00eec0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 shutdown_connections 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1480066730 0x7f1480068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a00cb860 0x7f14a01e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14a00c7890 0x7f14a01f6a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 --2- 172.21.15.32:0/2825972634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14a00c6b30 0x7f14a01e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:07.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 >> 172.21.15.32:0/2825972634 conn(0x7f14a00cad40 msgr2=0x7f14a00c0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:07.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 shutdown_connections 2024-09-13T18:45:07.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.797+0000 7f149f200700 1 -- 172.21.15.32:0/2825972634 wait complete. 2024-09-13T18:45:07.804 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 7 2024-09-13T18:45:07.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:07.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.989+0000 7ff31fe00700 1 Processor -- start 2024-09-13T18:45:07.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.989+0000 7ff31fe00700 1 -- start start 2024-09-13T18:45:07.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3200aa360 0x7ff3201545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:07.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31fe00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff320070510 con 0x7ff3200c61b0 2024-09-13T18:45:08.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31fe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff320157570 con 0x7ff3200c6590 2024-09-13T18:45:08.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31fe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200aa920 con 0x7ff3200aa360 2024-09-13T18:45:08.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31ea00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff3200c61b0 0x7ff320071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49820/0 (socket says 172.21.15.32:49820) 2024-09-13T18:45:08.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31ea00700 1 -- 172.21.15.32:0/208158007 learned_addr learned my addr 172.21.15.32:0/208158007 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:08.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31e000700 1 --2- 172.21.15.32:0/208158007 >> v2:172.21.15.32:3300/0 conn(0x7ff3200aa360 0x7ff3201545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773412684 0 0) 0x7ff320157570 con 0x7ff3200c6590 2024-09-13T18:45:08.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3040035d0 con 0x7ff3200c6590 2024-09-13T18:45:08.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911256529 0 0) 0x7ff320070510 con 0x7ff3200c61b0 2024-09-13T18:45:08.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320157570 con 0x7ff3200c61b0 2024-09-13T18:45:08.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210994773 0 0) 0x7ff320157570 con 0x7ff3200c61b0 2024-09-13T18:45:08.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 >> v2:172.21.15.32:3300/0 conn(0x7ff3200aa360 msgr2=0x7ff3201545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:08.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 --2- 172.21.15.32:0/208158007 >> v2:172.21.15.32:3300/0 conn(0x7ff3200aa360 0x7ff3201545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 >> v1:172.21.15.86:6789/0 conn(0x7ff3200c6590 legacy=0x7ff320161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320070760 con 0x7ff3200c61b0 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7ff310001670 con 0x7ff3200c61b0 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31e000700 1 --2- 172.21.15.32:0/208158007 >> v2:172.21.15.32:3300/0 conn(0x7ff3200aa360 0x7ff3201545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 >> v1:172.21.15.32:6789/0 conn(0x7ff3200c61b0 legacy=0x7ff320071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff304004c10 0x7ff304005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff304003810 0x7ff304003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3040041d0 0x7ff30400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200aa920 con 0x7ff3040041d0 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040104c0 con 0x7ff304003810 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.993+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff304010680 con 0x7ff304004c10 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff304004c10 0x7ff304005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31e000700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff304003810 0x7ff304003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31f400700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3040041d0 0x7ff30400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 -- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff304003810 msgr2=0x7ff304003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:08.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff304003810 0x7ff304003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 -- 172.21.15.32:0/208158007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3040041d0 msgr2=0x7ff30400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:08.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3040041d0 0x7ff30400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 -- 172.21.15.32:0/208158007 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320157570 con 0x7ff304004c10 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31f400700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3040041d0 0x7ff30400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31f400700 1 -- 172.21.15.32:0/208158007 reap_dead start 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31e000700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff304003810 0x7ff304003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31ea00700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff304004c10 0x7ff304005010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c240 tx=0x7ff3040058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff836a4c1b8aa54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310007b90 con 0x7ff304004c10 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000cda0 con 0x7ff304004c10 2024-09-13T18:45:08.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31d600700 1 -- 172.21.15.32:0/208158007 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310005bc0 con 0x7ff304004c10 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 -- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff304004c10 msgr2=0x7ff304005010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff304004c10 0x7ff304005010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c240 tx=0x7ff3040058a0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 -- 172.21.15.32:0/208158007 shutdown_connections 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 --2- 172.21.15.32:0/208158007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff304004c10 0x7ff304005010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 -- 172.21.15.32:0/208158007 >> 172.21.15.32:0/208158007 conn(0x7ff3200cad40 msgr2=0x7ff3200cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 -- 172.21.15.32:0/208158007 shutdown_connections 2024-09-13T18:45:08.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:07.997+0000 7ff31fe00700 1 -- 172.21.15.32:0/208158007 wait complete. 2024-09-13T18:45:08.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.001+0000 7ff31fe00700 1 Processor -- start 2024-09-13T18:45:08.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.001+0000 7ff31fe00700 1 -- start start 2024-09-13T18:45:08.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 0x7ff3200c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3200b0e60 0x7ff32014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3200c4b60 0x7ff32014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201ebc30 con 0x7ff304004c10 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320152540 con 0x7ff3200c4b60 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201eb040 con 0x7ff3200b0e60 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 0x7ff3200c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 0x7ff3200c23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42870/0 (socket says 172.21.15.32:42870) 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 -- 172.21.15.32:0/362246929 learned_addr learned my addr 172.21.15.32:0/362246929 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31e000700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3200b0e60 0x7ff32014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31f400700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3200c4b60 0x7ff32014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 -- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3200b0e60 msgr2=0x7ff32014d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3200b0e60 0x7ff32014d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 -- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3200c4b60 msgr2=0x7ff32014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3200c4b60 0x7ff32014d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 -- 172.21.15.32:0/362246929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3201eb300 con 0x7ff304004c10 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31e000700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3200b0e60 0x7ff32014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31ea00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 0x7ff3200c23b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff304010810 tx=0x7ff3200ca850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004d20 con 0x7ff304004c10 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100070d0 con 0x7ff304004c10 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310007480 con 0x7ff304004c10 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3201eb5e0 con 0x7ff304004c10 2024-09-13T18:45:08.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.005+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3200c28f0 con 0x7ff304004c10 2024-09-13T18:45:08.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.009+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3200c1be0 con 0x7ff304004c10 2024-09-13T18:45:08.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.009+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3100075e0 con 0x7ff304004c10 2024-09-13T18:45:08.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.009+0000 7ff316a00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff300066760 0x7ff300068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:08.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.009+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3100852b0 con 0x7ff304004c10 2024-09-13T18:45:08.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.009+0000 7ff31e000700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff300066760 0x7ff300068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:08.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.013+0000 7ff31e000700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff300066760 0x7ff300068c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0098e0 tx=0x7ff30c009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:08.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.017+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff310052320 con 0x7ff304004c10 2024-09-13T18:45:08.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.209+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3200ca3e0 con 0x7ff304004c10 2024-09-13T18:45:08.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.213+0000 7ff316a00700 1 -- 172.21.15.32:0/362246929 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7ff310055940 con 0x7ff304004c10 2024-09-13T18:45:08.220 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:08.221 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:08.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff300066760 msgr2=0x7ff300068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff300066760 0x7ff300068c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0098e0 tx=0x7ff30c009240 comp rx=0 tx=0).stop 2024-09-13T18:45:08.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 msgr2=0x7ff3200c23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:08.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 0x7ff3200c23b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff304010810 tx=0x7ff3200ca850 comp rx=0 tx=0).stop 2024-09-13T18:45:08.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 shutdown_connections 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff300066760 0x7ff300068c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3200c4b60 0x7ff32014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3200b0e60 0x7ff32014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 --2- 172.21.15.32:0/362246929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff304004c10 0x7ff3200c23b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 >> 172.21.15.32:0/362246929 conn(0x7ff3200cad40 msgr2=0x7ff3200c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 shutdown_connections 2024-09-13T18:45:08.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:08.217+0000 7ff31fe00700 1 -- 172.21.15.32:0/362246929 wait complete. 2024-09-13T18:45:08.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:45:01.303364+0000', 'modified': '2024-09-13T18:45:06.817753+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4262}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4262': {'gid': 4262, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.32:6837/1489168013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6835', 'nonce': 1489168013}, {'type': 'v1', 'addr': '172.21.15.32:6837', 'nonce': 1489168013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T18:45:08.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:45:08.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:45:09.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.029+0000 7f29d9600700 1 Processor -- start 2024-09-13T18:45:09.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.029+0000 7f29d9600700 1 -- start start 2024-09-13T18:45:09.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.029+0000 7f29d9600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29d4073990 0x7f29d406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.029+0000 7f29d9600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29d406f530 0x7f29d4159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.029+0000 7f29d9600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d415a560 con 0x7f29d4159ac0 2024-09-13T18:45:09.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d406d5e0 con 0x7f29d4073990 2024-09-13T18:45:09.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d406f150 con 0x7f29d406f530 2024-09-13T18:45:09.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29d406f530 0x7f29d4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f29d406f530 0x7f29d4159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:38014/0 (socket says 172.21.15.32:38014) 2024-09-13T18:45:09.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29d4073990 0x7f29d406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 -- 172.21.15.32:0/1398151556 learned_addr learned my addr 172.21.15.32:0/1398151556 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:09.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d8c00700 1 --1- 172.21.15.32:0/1398151556 >> v1:172.21.15.32:6789/0 conn(0x7f29d4159ac0 0x7f29d41533c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41504/0 (socket says 172.21.15.32:41504) 2024-09-13T18:45:09.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 -- 172.21.15.32:0/1398151556 >> v2:172.21.15.32:3300/0 conn(0x7f29d4073990 msgr2=0x7f29d406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:09.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 --2- 172.21.15.32:0/1398151556 >> v2:172.21.15.32:3300/0 conn(0x7f29d4073990 0x7f29d406ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 -- 172.21.15.32:0/1398151556 >> v1:172.21.15.32:6789/0 conn(0x7f29d4159ac0 legacy=0x7f29d41533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:09.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 -- 172.21.15.32:0/1398151556 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d4159fa0 con 0x7f29d406f530 2024-09-13T18:45:09.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3e00700 1 --2- 172.21.15.32:0/1398151556 >> v2:172.21.15.32:3300/0 conn(0x7f29d4073990 0x7f29d406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:09.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d3400700 1 --2- 172.21.15.32:0/1398151556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d406f530 0x7f29d4159580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29d406aab0 tx=0x7f29c0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f49dd5e77a20c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:09.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d2a00700 1 -- 172.21.15.32:0/1398151556 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000b8a0 con 0x7f29d406f530 2024-09-13T18:45:09.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d2a00700 1 -- 172.21.15.32:0/1398151556 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c000ba00 con 0x7f29d406f530 2024-09-13T18:45:09.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d2a00700 1 -- 172.21.15.32:0/1398151556 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000bd90 con 0x7f29d406f530 2024-09-13T18:45:09.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 -- 172.21.15.32:0/1398151556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d406f530 msgr2=0x7f29d4159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 --2- 172.21.15.32:0/1398151556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d406f530 0x7f29d4159580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29d406aab0 tx=0x7f29c0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 -- 172.21.15.32:0/1398151556 shutdown_connections 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 --2- 172.21.15.32:0/1398151556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d406f530 0x7f29d4159580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 --2- 172.21.15.32:0/1398151556 >> v2:172.21.15.32:3300/0 conn(0x7f29d4073990 0x7f29d406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.033+0000 7f29d9600700 1 -- 172.21.15.32:0/1398151556 >> 172.21.15.32:0/1398151556 conn(0x7f29d40c8a60 msgr2=0x7f29d40c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.037+0000 7f29d9600700 1 -- 172.21.15.32:0/1398151556 shutdown_connections 2024-09-13T18:45:09.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.037+0000 7f29d9600700 1 -- 172.21.15.32:0/1398151556 wait complete. 2024-09-13T18:45:09.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.037+0000 7f29d9600700 1 Processor -- start 2024-09-13T18:45:09.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.037+0000 7f29d9600700 1 -- start start 2024-09-13T18:45:09.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 0x7f29d41533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d4073990 0x7f29d41e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d4159ac0 0x7f29d41e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41efba0 con 0x7f29d406f530 2024-09-13T18:45:09.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415c880 con 0x7f29d4073990 2024-09-13T18:45:09.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415c5e0 con 0x7f29d4159ac0 2024-09-13T18:45:09.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 0x7f29d41533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 0x7f29d41533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:50996/0 (socket says 172.21.15.32:50996) 2024-09-13T18:45:09.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 -- 172.21.15.32:0/3039194264 learned_addr learned my addr 172.21.15.32:0/3039194264 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:09.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3400700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d4073990 0x7f29d41e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d8c00700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d4159ac0 0x7f29d41e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 -- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d4159ac0 msgr2=0x7f29d41e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:09.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d4159ac0 0x7f29d41e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 -- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d4073990 msgr2=0x7f29d41e29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:09.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d4073990 0x7f29d41e29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 -- 172.21.15.32:0/3039194264 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0009570 con 0x7f29d406f530 2024-09-13T18:45:09.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 0x7f29d41533c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f29c400e790 tx=0x7f29c400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:09.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29cbe00700 1 -- 172.21.15.32:0/3039194264 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c400c070 con 0x7f29d406f530 2024-09-13T18:45:09.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29cbe00700 1 -- 172.21.15.32:0/3039194264 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4004230 con 0x7f29d406f530 2024-09-13T18:45:09.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29cbe00700 1 -- 172.21.15.32:0/3039194264 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c40045c0 con 0x7f29d406f530 2024-09-13T18:45:09.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d41eef90 con 0x7f29d406f530 2024-09-13T18:45:09.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.041+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d41ef550 con 0x7f29d406f530 2024-09-13T18:45:09.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.045+0000 7f29cbe00700 1 -- 172.21.15.32:0/3039194264 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29c40036c0 con 0x7f29d406f530 2024-09-13T18:45:09.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.049+0000 7f29cbe00700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f29b4066730 0x7f29b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.049+0000 7f29cbe00700 1 -- 172.21.15.32:0/3039194264 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29c4084120 con 0x7f29d406f530 2024-09-13T18:45:09.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.049+0000 7f29d3400700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f29b4066730 0x7f29b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.049+0000 7f29d3400700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f29b4066730 0x7f29b4068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29d406f910 tx=0x7f29c0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.049+0000 7f29ddf93740 1 Processor -- start 2024-09-13T18:45:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.049+0000 7f29ddf93740 1 -- start start 2024-09-13T18:45:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac52a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab9cd80 con 0x2ac52620 2024-09-13T18:45:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab9a510 con 0x2ac65ba0 2024-09-13T18:45:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ab95e00 con 0x2ac51d00 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35316/0 (socket says 172.21.15.32:35316) 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3400700 1 -- 172.21.15.32:0/3459345045 learned_addr learned my addr 172.21.15.32:0/3459345045 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac52a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 -- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 msgr2=0x2ac520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 -- 172.21.15.32:0/3459345045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 msgr2=0x2ac52a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac52a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 -- 172.21.15.32:0/3459345045 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2aa08960 con 0x2ac65ba0 2024-09-13T18:45:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d8c00700 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac52a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:09.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac517c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f29c4082350 tx=0x7f29c4084050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15a905f9c0eb0023 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29bfe00700 1 -- 172.21.15.32:0/3459345045 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c405d240 con 0x2ac65ba0 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29bfe00700 1 -- 172.21.15.32:0/3459345045 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c40531f0 con 0x2ac65ba0 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29bfe00700 1 -- 172.21.15.32:0/3459345045 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c40552d0 con 0x2ac65ba0 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 msgr2=0x2ac517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac517c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f29c4082350 tx=0x7f29c4084050 comp rx=0 tx=0).stop 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- 172.21.15.32:0/3459345045 shutdown_connections 2024-09-13T18:45:09.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac52a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3459345045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac517c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- 172.21.15.32:0/3459345045 >> 172.21.15.32:0/3459345045 conn(0x2a9bd4d0 msgr2=0x2ac68990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- 172.21.15.32:0/3459345045 shutdown_connections 2024-09-13T18:45:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.053+0000 7f29ddf93740 1 -- 172.21.15.32:0/3459345045 wait complete. 2024-09-13T18:45:09.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 -- start start 2024-09-13T18:45:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 Processor -- start 2024-09-13T18:45:09.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac53cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac2eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac78a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab53730 con 0x2ac52620 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab595b0 con 0x2ac65ba0 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aa41aa0 con 0x2ac51d00 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29ddf93740 10 client.0 _ll_register_callbacks cb 0x2ab8f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac78a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac53cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac2eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac53cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35332/0 (socket says 172.21.15.32:35332) 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 -- 172.21.15.32:0/475305917 learned_addr learned my addr 172.21.15.32:0/475305917 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:09.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac78a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:38034/0 (socket says 172.21.15.32:38034) 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 -- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 msgr2=0x2ac78a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac78a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 -- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 msgr2=0x2ac2eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac2eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d3e00700 1 -- 172.21.15.32:0/475305917 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d415a560 con 0x2ac51d00 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.057+0000 7f29d8c00700 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29d3e00700 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac53cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f29c405cd10 tx=0x7f29c4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c11ef164aa3b08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:09.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 10 client.0 ms_handle_connect on v2:172.21.15.86:3301/0 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 1 -- 172.21.15.32:0/475305917 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c40820b0 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 1 -- 172.21.15.32:0/475305917 <== mon.2 v2:172.21.15.86:3301/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29c405d240 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a9ca1e0 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 1 -- 172.21.15.32:0/475305917 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29c4009500 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 10 client.4343 fetch_fsmap learned FSMap version 7 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f29d41ef550 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 1 -- 172.21.15.32:0/475305917 <== mon.2 v2:172.21.15.86:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a9ca1e0 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 1 -- 172.21.15.32:0/475305917 <== mon.2 v2:172.21.15.86:3301/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f29c407e070 con 0x2ac51d00 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 10 client.4343 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 10 client.4343 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 20 client.4343 populate_metadata read hostname 'smithi032' 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2ac7a150 0x2ac7a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:09.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 4 client.4343 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:45:09.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 --> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2aa14460 con 0x2ac7a150 2024-09-13T18:45:09.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29d3400700 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2ac7a150 0x2ac7a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:09.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29d3400700 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2ac7a150 0x2ac7a530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d382a741ff5e8886 server_cookie=5d260a256431857c in_seq=0 out_seq=0 2024-09-13T18:45:09.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:09.061+0000 7f29bcc00700 10 client.4343 ms_handle_connect on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29bcc00700 1 -- 172.21.15.32:0/475305917 <== mds.0 v2:172.21.15.32:6835/1489168013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2aa14460 con 0x2ac7a150 2024-09-13T18:45:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29bcc00700 10 client.4343 handle_command_reply: tid=0 2024-09-13T18:45:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 client.4343 shutdown 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 msgr2=0x2ac53cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac53cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f29c405cd10 tx=0x7f29c4011000 comp rx=0 tx=0).stop 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 shutdown_connections 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2ac7a150 0x2ac7a530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2ac78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac52620 0x2ac2eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 --2- 172.21.15.32:0/475305917 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac53cf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29bcc00700 0 client.4343 ms_handle_reset on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.821+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 >> 172.21.15.32:0/475305917 conn(0x2a9bd4d0 msgr2=0x2ac65f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.825+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 shutdown_connections 2024-09-13T18:45:11.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.825+0000 7f29ddf93740 1 -- 172.21.15.32:0/475305917 wait complete. 2024-09-13T18:45:11.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.825+0000 7f29ddf93740 20 client.4343 trim_cache size 0 max 16384 2024-09-13T18:45:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 Processor -- start 2024-09-13T18:45:11.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 -- start start 2024-09-13T18:45:11.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac89540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac52620 0x2ac50570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 0x2ac50ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aa41aa0 con 0x2ac65ba0 2024-09-13T18:45:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac79950 con 0x2ac52620 2024-09-13T18:45:11.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x2abc4ec0 con 0x2ac51d00 2024-09-13T18:45:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 0x2ac50ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 0x2ac50ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51032/0 (socket says 172.21.15.32:51032) 2024-09-13T18:45:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29d8c00700 1 -- 172.21.15.32:0/3818148862 learned_addr learned my addr 172.21.15.32:0/3818148862 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29d3400700 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac52620 0x2ac50570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.845+0000 7f29d3e00700 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac89540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29d8c00700 1 -- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 msgr2=0x2ac89540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29d8c00700 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac89540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29d8c00700 1 -- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac52620 msgr2=0x2ac50570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29d8c00700 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac52620 0x2ac50570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29d8c00700 1 -- 172.21.15.32:0/3818148862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ab5c220 con 0x2ac65ba0 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29d8c00700 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 0x2ac50ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0076a0 tx=0x7f29cc001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334ae236a567ff2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29c9200700 1 -- 172.21.15.32:0/3818148862 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc007a70 con 0x2ac65ba0 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29c9200700 1 -- 172.21.15.32:0/3818148862 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc01a070 con 0x2ac65ba0 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29c9200700 1 -- 172.21.15.32:0/3818148862 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc015c30 con 0x2ac65ba0 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 -- 172.21.15.32:0/3818148862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 msgr2=0x2ac50ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 0x2ac50ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0076a0 tx=0x7f29cc001aa0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 -- 172.21.15.32:0/3818148862 shutdown_connections 2024-09-13T18:45:11.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac65ba0 0x2ac50ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac52620 0x2ac50570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 --2- 172.21.15.32:0/3818148862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac51d00 0x2ac89540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 -- 172.21.15.32:0/3818148862 >> 172.21.15.32:0/3818148862 conn(0x2a9bd4d0 msgr2=0x2ac2f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 -- 172.21.15.32:0/3818148862 shutdown_connections 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 -- 172.21.15.32:0/3818148862 wait complete. 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 -- start start 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.849+0000 7f29ddf93740 1 Processor -- start 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac51d00 0x2acd5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac52620 0x2acd5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2acd2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab604f0 con 0x2ac51d00 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab53730 con 0x2ac65ba0 2024-09-13T18:45:11.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ac25390 con 0x2ac52620 2024-09-13T18:45:11.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 10 client.0 _ll_register_callbacks cb 0x7f29c4051210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2acd2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2acd2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:38050/0 (socket says 172.21.15.32:38050) 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 -- 172.21.15.32:0/806848534 learned_addr learned my addr 172.21.15.32:0/806848534 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d3400700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac52620 0x2acd5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d3e00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac51d00 0x2acd5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 -- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac52620 msgr2=0x2acd5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac52620 0x2acd5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 -- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac51d00 msgr2=0x2acd5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac51d00 0x2acd5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 -- 172.21.15.32:0/806848534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc0073d0 con 0x2ac65ba0 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d3e00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac51d00 0x2acd5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:11.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29d8c00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2acd2300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0012e0 tx=0x7f29cc001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29b7fe87366f561d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29bcc00700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29bcc00700 1 -- 172.21.15.32:0/806848534 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc029640 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29c40531f0 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29bcc00700 1 -- 172.21.15.32:0/806848534 <== mon.1 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29cc020430 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29bcc00700 1 -- 172.21.15.32:0/806848534 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29cc0297a0 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 10 client.4420 fetch_fsmap learned FSMap version 7 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x2ab42450 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29bcc00700 1 -- 172.21.15.32:0/806848534 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c40531f0 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29bcc00700 1 -- 172.21.15.32:0/806848534 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f29cc012050 con 0x2ac65ba0 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 10 client.4420 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 10 client.4420 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 20 client.4420 populate_metadata read hostname 'smithi032' 2024-09-13T18:45:11.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2acd2840 0x2acd2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:11.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 4 client.4420 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:45:11.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.853+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 --> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2aa391e0 con 0x2acd2840 2024-09-13T18:45:11.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d3e00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2acd2840 0x2acd2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:11.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d3e00700 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2acd2840 0x2acd2c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c2469fe8500a1d server_cookie=5cafd74245fca665 in_seq=0 out_seq=0 2024-09-13T18:45:11.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29bcc00700 10 client.4420 ms_handle_connect on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29bcc00700 1 -- 172.21.15.32:0/806848534 <== mds.0 v2:172.21.15.32:6835/1489168013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x2aa391e0 con 0x2acd2840 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29bcc00700 10 client.4420 handle_command_reply: tid=0 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 client.4420 shutdown 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 msgr2=0x2acd2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2acd2300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0012e0 tx=0x7f29cc001250 comp rx=0 tx=0).stop 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 shutdown_connections 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x2acd2840 0x2acd2c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x2ac65ba0 0x2acd2300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x2ac52620 0x2acd5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 --2- 172.21.15.32:0/806848534 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x2ac51d00 0x2acd5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29bcc00700 0 client.4420 ms_handle_reset on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 >> 172.21.15.32:0/806848534 conn(0x2a9bd4d0 msgr2=0x2ac50570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 shutdown_connections 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 1 -- 172.21.15.32:0/806848534 wait complete. 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29ddf93740 20 client.4420 trim_cache size 0 max 16384 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "e3c44028-1b11-4958-a433-ecab24d0f05e", 2024-09-13T18:45:11.867 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4262, 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 10.552599565, 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 6, 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 26, 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 26, 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 15.161604782 2024-09-13T18:45:11.868 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f29b4066730 msgr2=0x7f29b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f29b4066730 0x7f29b4068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29d406f910 tx=0x7f29c0008030 comp rx=0 tx=0).stop 2024-09-13T18:45:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 msgr2=0x7f29d41533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 0x7f29d41533c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f29c400e790 tx=0x7f29c400eaa0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 shutdown_connections 2024-09-13T18:45:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f29b4066730 0x7f29b4068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29d4159ac0 0x7f29d41e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29d4073990 0x7f29d41e29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 --2- 172.21.15.32:0/3039194264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29d406f530 0x7f29d41533c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.857+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 >> 172.21.15.32:0/3039194264 conn(0x7f29d40c8a60 msgr2=0x7f29d4070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.861+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 shutdown_connections 2024-09-13T18:45:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:11.861+0000 7f29d9600700 1 -- 172.21.15.32:0/3039194264 wait complete. 2024-09-13T18:45:11.890 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:45:11.890 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:11.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:45:12.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.057+0000 7fe9fda00700 1 Processor -- start 2024-09-13T18:45:12.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.057+0000 7fe9fda00700 1 -- start start 2024-09-13T18:45:12.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9fda00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9f80cb860 0x7fe9f80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9fda00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9f80c9390 0x7fe9f8156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9fda00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f8072370 con 0x7fe9f815cfd0 2024-09-13T18:45:12.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9fda00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80c97c0 con 0x7fe9f80cb860 2024-09-13T18:45:12.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9fda00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80aa1a0 con 0x7fe9f80c9390 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9f7400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9f80cb860 0x7fe9f80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9f7e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe9f815cfd0 0x7fe9f815d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44590/0 (socket says 172.21.15.32:44590) 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9f7e00700 1 -- 172.21.15.32:0/2734001353 learned_addr learned my addr 172.21.15.32:0/2734001353 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9f7400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9f80cb860 0x7fe9f80c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51050/0 (socket says 172.21.15.32:51050) 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.061+0000 7fe9fd000700 1 --2- 172.21.15.32:0/2734001353 >> v2:172.21.15.86:3300/0 conn(0x7fe9f80c9390 0x7fe9f8156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f7400700 1 -- 172.21.15.32:0/2734001353 >> v2:172.21.15.86:3300/0 conn(0x7fe9f80c9390 msgr2=0x7fe9f8156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f7400700 1 --2- 172.21.15.32:0/2734001353 >> v2:172.21.15.86:3300/0 conn(0x7fe9f80c9390 0x7fe9f8156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f7400700 1 -- 172.21.15.32:0/2734001353 >> v1:172.21.15.86:6789/0 conn(0x7fe9f815cfd0 legacy=0x7fe9f815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f7400700 1 -- 172.21.15.32:0/2734001353 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80a9d00 con 0x7fe9f80cb860 2024-09-13T18:45:12.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f7400700 1 --2- 172.21.15.32:0/2734001353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f80c8e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80a9490 tx=0x7fe9e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce373f2fe17ac2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:12.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f6a00700 1 -- 172.21.15.32:0/2734001353 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011830 con 0x7fe9f80cb860 2024-09-13T18:45:12.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f6a00700 1 -- 172.21.15.32:0/2734001353 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4011990 con 0x7fe9f80cb860 2024-09-13T18:45:12.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9f6a00700 1 -- 172.21.15.32:0/2734001353 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011d40 con 0x7fe9f80cb860 2024-09-13T18:45:12.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 -- 172.21.15.32:0/2734001353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 msgr2=0x7fe9f80c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 --2- 172.21.15.32:0/2734001353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f80c8e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80a9490 tx=0x7fe9e4009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:12.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 -- 172.21.15.32:0/2734001353 shutdown_connections 2024-09-13T18:45:12.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 --2- 172.21.15.32:0/2734001353 >> v2:172.21.15.86:3300/0 conn(0x7fe9f80c9390 0x7fe9f8156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 --2- 172.21.15.32:0/2734001353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f80c8e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 -- 172.21.15.32:0/2734001353 >> 172.21.15.32:0/2734001353 conn(0x7fe9f80cad40 msgr2=0x7fe9f80cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:12.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 -- 172.21.15.32:0/2734001353 shutdown_connections 2024-09-13T18:45:12.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.065+0000 7fe9fda00700 1 -- 172.21.15.32:0/2734001353 wait complete. 2024-09-13T18:45:12.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 Processor -- start 2024-09-13T18:45:12.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 -- start start 2024-09-13T18:45:12.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9f80c9390 0x7fe9f814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f81eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9f815cfd0 0x7fe9f8155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81ef4f0 con 0x7fe9f80cb860 2024-09-13T18:45:12.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814e9a0 con 0x7fe9f815cfd0 2024-09-13T18:45:12.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c0770 con 0x7fe9f80c9390 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f81eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9f80c9390 0x7fe9f814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f81eff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51056/0 (socket says 172.21.15.32:51056) 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 -- 172.21.15.32:0/4087870908 learned_addr learned my addr 172.21.15.32:0/4087870908 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fd000700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9f815cfd0 0x7fe9f8155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 -- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9f80c9390 msgr2=0x7fe9f814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9f80c9390 0x7fe9f814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 -- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9f815cfd0 msgr2=0x7fe9f8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9f815cfd0 0x7fe9f8155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 -- 172.21.15.32:0/4087870908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40094b0 con 0x7fe9f80cb860 2024-09-13T18:45:12.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9f7400700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f81eff20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40090b0 tx=0x7fe9e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:12.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4004480 con 0x7fe9f80cb860 2024-09-13T18:45:12.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e401f070 con 0x7fe9f80cb860 2024-09-13T18:45:12.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4003900 con 0x7fe9f80cb860 2024-09-13T18:45:12.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.069+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f81eebc0 con 0x7fe9f80cb860 2024-09-13T18:45:12.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.073+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f81ef180 con 0x7fe9f80cb860 2024-09-13T18:45:12.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.073+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f80a9950 con 0x7fe9f80cb860 2024-09-13T18:45:12.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.073+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9e4021030 con 0x7fe9f80cb860 2024-09-13T18:45:12.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.077+0000 7fe9efe00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe9d8066760 0x7fe9d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:12.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.077+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9e4085770 con 0x7fe9f80cb860 2024-09-13T18:45:12.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.077+0000 7fe9f7e00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe9d8066760 0x7fe9d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:12.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.077+0000 7fe9f7e00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe9d8066760 0x7fe9d8068c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8005930 tx=0x7fe9e8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:12.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.085+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9e4052880 con 0x7fe9f80cb860 2024-09-13T18:45:12.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.317+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9f80706b0 con 0x7fe9f80cb860 2024-09-13T18:45:12.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.317+0000 7fe9efe00700 1 -- 172.21.15.32:0/4087870908 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe9e4055ea0 con 0x7fe9f80cb860 2024-09-13T18:45:12.325 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:45:12.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe9d8066760 msgr2=0x7fe9d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe9d8066760 0x7fe9d8068c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8005930 tx=0x7fe9e8009040 comp rx=0 tx=0).stop 2024-09-13T18:45:12.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 msgr2=0x7fe9f81eff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:12.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f81eff20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40090b0 tx=0x7fe9e4004770 comp rx=0 tx=0).stop 2024-09-13T18:45:12.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 shutdown_connections 2024-09-13T18:45:12.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe9d8066760 0x7fe9d8068c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9f815cfd0 0x7fe9f8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9f80cb860 0x7fe9f81eff20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 --2- 172.21.15.32:0/4087870908 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9f80c9390 0x7fe9f814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:12.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 >> 172.21.15.32:0/4087870908 conn(0x7fe9f80cad40 msgr2=0x7fe9f80c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:12.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.321+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 shutdown_connections 2024-09-13T18:45:12.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:12.325+0000 7fe9fda00700 1 -- 172.21.15.32:0/4087870908 wait complete. 2024-09-13T18:45:12.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:45:12.353 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:45:12.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.354 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-09-13T18:45:12.372 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:45:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:45:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:45:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:82:10:93:56 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:45:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:12.376 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:45:12.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.376 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:12.376 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:12.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:45:12.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-09-13T18:45:12.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-09-13T18:45:12.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:45:12.377 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:12.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.527 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:45:12.565 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-09-13T18:45:12.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.569 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-09-13T18:45:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-09-13T18:45:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:45:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:45:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:45:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:45:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:45:12.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.651 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:12.651 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:12.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:45:12.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:45:12.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:45:12.651 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:12.693 INFO:tasks.ceph.mds.c.smithi032.stderr:2024-09-13T18:45:12.685+0000 7ff5ca400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:45:12.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.787 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-09-13T18:45:12.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.804 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-09-13T18:45:12.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.863 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:12.863 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:12.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:45:12.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T18:45:12.864 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:12.973 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T18:45:12.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T18:45:12.974 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:13.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:13.151 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:13.152 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:13.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-09-13T18:45:13.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:45:13.152 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:13.225 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T18:45:13.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:13.226 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:13.243 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:45:13.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:13.243 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:13.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-09-13T18:45:13.387 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:13.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:13.462 INFO:teuthology.orchestra.run.smithi032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:13.466 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:13.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:13.466 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-09-13T18:45:13.531 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:45:13.532 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T18:45:13.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-09-13T18:45:13.616 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:13.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:13.691 INFO:teuthology.orchestra.run.smithi032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:13.694 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:13.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:13.694 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-09-13T18:45:13.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:2024-09-13T18:45:13.721+0000 7f92b9abf640 -1 init, newargv = 0x5559946dceb0 newargc=15 2024-09-13T18:45:13.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[31101]: starting ceph client 2024-09-13T18:45:13.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[31101]: starting fuse 2024-09-13T18:45:14.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2024-09-13T18:45:14.879 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:45:14.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:45:14.954 INFO:teuthology.orchestra.run.smithi032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:45:14.958 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:45:14.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:14.959 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2024-09-13T18:45:15.018 INFO:teuthology.orchestra.run.smithi032.stdout:50 2024-09-13T18:45:15.019 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> import re 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> import os 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2024-09-13T18:45:15.019 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> return f 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:45:15.020 DEBUG:teuthology.orchestra.run.smithi032:> 2024-09-13T18:45:15.021 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.admin")) 2024-09-13T18:45:15.021 DEBUG:teuthology.orchestra.run.smithi032:> ' 2024-09-13T18:45:15.187 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.admin.31101.asok 2024-09-13T18:45:15.374 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31101.asok 2024-09-13T18:45:15.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:15.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31101.asok status 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "admin", 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "31101", 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2024-09-13T18:45:15.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4358, 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4358 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:45:15.576 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3646518075 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3646518075 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4358 192.168.0.1:0/3646518075", 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/3646518075", 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 6, 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 26, 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:45:15.577 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2024-09-13T18:45:15.578 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2024-09-13T18:45:15.578 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:15.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:15.590 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2024-09-13T18:45:15.590 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:15.606 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2024-09-13T18:45:15.607 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:15.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:15.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:15.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:15.683 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T18:45:15.796 INFO:teuthology.orchestra.run.smithi032.stdout:# file: . 2024-09-13T18:45:15.796 INFO:teuthology.orchestra.run.smithi032.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T18:45:15.796 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:15.797 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:45:15.797 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:15.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:16.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.029+0000 7efeb1000700 1 Processor -- start 2024-09-13T18:45:16.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.029+0000 7efeb1000700 1 -- start start 2024-09-13T18:45:16.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeb1000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efeac0aa360 0x7efeac1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeb1000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7efeac0c6590 0x7efeac154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeb1000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac070510 con 0x7efeac0c61b0 2024-09-13T18:45:16.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeb1000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0aa920 con 0x7efeac0aa360 2024-09-13T18:45:16.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeb1000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac155020 con 0x7efeac0c6590 2024-09-13T18:45:16.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efeac0aa360 0x7efeac1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efeac0aa360 0x7efeac1545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51066/0 (socket says 172.21.15.32:51066) 2024-09-13T18:45:16.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 -- 172.21.15.32:0/4106692298 learned_addr learned my addr 172.21.15.32:0/4106692298 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:16.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeabe00700 1 --2- 172.21.15.32:0/4106692298 >> v2:172.21.15.86:3300/0 conn(0x7efeac0c6590 0x7efeac154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 -- 172.21.15.32:0/4106692298 >> v2:172.21.15.86:3300/0 conn(0x7efeac0c6590 msgr2=0x7efeac154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 --2- 172.21.15.32:0/4106692298 >> v2:172.21.15.86:3300/0 conn(0x7efeac0c6590 0x7efeac154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 -- 172.21.15.32:0/4106692298 >> v1:172.21.15.86:6789/0 conn(0x7efeac0c61b0 legacy=0x7efeac071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 -- 172.21.15.32:0/4106692298 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac157570 con 0x7efeac0aa360 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efea2a00700 1 --2- 172.21.15.32:0/4106692298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0aa360 0x7efeac1545a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efeac0b1290 tx=0x7efe94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f480bb608d33f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeaaa00700 1 -- 172.21.15.32:0/4106692298 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400b8a0 con 0x7efeac0aa360 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeaaa00700 1 -- 172.21.15.32:0/4106692298 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400ba00 con 0x7efeac0aa360 2024-09-13T18:45:16.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.033+0000 7efeaaa00700 1 -- 172.21.15.32:0/4106692298 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400bd90 con 0x7efeac0aa360 2024-09-13T18:45:16.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 -- 172.21.15.32:0/4106692298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0aa360 msgr2=0x7efeac1545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 --2- 172.21.15.32:0/4106692298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0aa360 0x7efeac1545a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efeac0b1290 tx=0x7efe94009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 -- 172.21.15.32:0/4106692298 shutdown_connections 2024-09-13T18:45:16.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 --2- 172.21.15.32:0/4106692298 >> v2:172.21.15.86:3300/0 conn(0x7efeac0c6590 0x7efeac154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 --2- 172.21.15.32:0/4106692298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0aa360 0x7efeac1545a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 -- 172.21.15.32:0/4106692298 >> 172.21.15.32:0/4106692298 conn(0x7efeac0cad40 msgr2=0x7efeac0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 -- 172.21.15.32:0/4106692298 shutdown_connections 2024-09-13T18:45:16.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 -- 172.21.15.32:0/4106692298 wait complete. 2024-09-13T18:45:16.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 Processor -- start 2024-09-13T18:45:16.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.037+0000 7efeb1000700 1 -- start start 2024-09-13T18:45:16.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 0x7efeac1f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeac0c61b0 0x7efeac158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0c6590 0x7efeac14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac1f10a0 con 0x7efeac0c6590 2024-09-13T18:45:16.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac14ede0 con 0x7efeac0c61b0 2024-09-13T18:45:16.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac1586d0 con 0x7efeac0aa360 2024-09-13T18:45:16.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeab400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 0x7efeac1f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeac0c61b0 0x7efeac158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeabe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0c6590 0x7efeac14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeab400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 0x7efeac1f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35370/0 (socket says 172.21.15.32:35370) 2024-09-13T18:45:16.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeab400700 1 -- 172.21.15.32:0/3119261826 learned_addr learned my addr 172.21.15.32:0/3119261826 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 -- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 msgr2=0x7efeac1f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 0x7efeac1f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 -- 172.21.15.32:0/3119261826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0c6590 msgr2=0x7efeac14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0c6590 0x7efeac14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 -- 172.21.15.32:0/3119261826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94009570 con 0x7efeac0c61b0 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeab400700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 0x7efeac1f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeabe00700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0c6590 0x7efeac14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:16.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea2a00700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeac0c61b0 0x7efeac158e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe94016000 tx=0x7efe94004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940036c0 con 0x7efeac0c61b0 2024-09-13T18:45:16.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9401f070 con 0x7efeac0c61b0 2024-09-13T18:45:16.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac0c28a0 con 0x7efeac0c61b0 2024-09-13T18:45:16.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.041+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94003a80 con 0x7efeac0c61b0 2024-09-13T18:45:16.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.045+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac0c22e0 con 0x7efeac0c61b0 2024-09-13T18:45:16.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.045+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac158310 con 0x7efeac0c61b0 2024-09-13T18:45:16.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.045+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe94021030 con 0x7efeac0c61b0 2024-09-13T18:45:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.049+0000 7efea3e00700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7efe88066760 0x7efe88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.049+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe94085a00 con 0x7efeac0c61b0 2024-09-13T18:45:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.049+0000 7efeab400700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7efe88066760 0x7efe88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.049+0000 7efeab400700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7efe88066760 0x7efe88068c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001ce0 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.057+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe94052aa0 con 0x7efeac0c61b0 2024-09-13T18:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.257+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeac1568f0 con 0x7efeac0c61b0 2024-09-13T18:45:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efea3e00700 1 -- 172.21.15.32:0/3119261826 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7efe940560c0 con 0x7efeac0c61b0 2024-09-13T18:45:16.268 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:16.268 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:16.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7efe88066760 msgr2=0x7efe88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7efe88066760 0x7efe88068c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe9c001ce0 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeac0c61b0 msgr2=0x7efeac158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeac0c61b0 0x7efeac158e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe94016000 tx=0x7efe94004770 comp rx=0 tx=0).stop 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 shutdown_connections 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7efe88066760 0x7efe88068c20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efeac0c6590 0x7efeac14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeac0c61b0 0x7efeac158e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 --2- 172.21.15.32:0/3119261826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efeac0aa360 0x7efeac1f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 >> 172.21.15.32:0/3119261826 conn(0x7efeac0cad40 msgr2=0x7efeac152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 shutdown_connections 2024-09-13T18:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.265+0000 7efeb1000700 1 -- 172.21.15.32:0/3119261826 wait complete. 2024-09-13T18:45:16.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:16.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:16.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.469+0000 7f3285600700 1 Processor -- start 2024-09-13T18:45:16.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.469+0000 7f3285600700 1 -- start start 2024-09-13T18:45:16.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32800c7960 0x7f328015a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32800c7d40 0x7f3280071b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328015a840 con 0x7f32800c5870 2024-09-13T18:45:16.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3280156e30 con 0x7f32800c7d40 2024-09-13T18:45:16.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3280072410 con 0x7f32800c7960 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32800c7960 0x7f328015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32800c7d40 0x7f3280071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f32800c7960 0x7f328015a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:38084/0 (socket says 172.21.15.32:38084) 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 -- 172.21.15.32:0/80437024 learned_addr learned my addr 172.21.15.32:0/80437024 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 -- 172.21.15.32:0/80437024 >> v2:172.21.15.32:3300/0 conn(0x7f32800c7d40 msgr2=0x7f3280071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 --2- 172.21.15.32:0/80437024 >> v2:172.21.15.32:3300/0 conn(0x7f32800c7d40 0x7f3280071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 -- 172.21.15.32:0/80437024 >> v1:172.21.15.32:6789/0 conn(0x7f32800c5870 legacy=0x7f3280153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 -- 172.21.15.32:0/80437024 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800726f0 con 0x7f32800c7960 2024-09-13T18:45:16.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327f400700 1 --2- 172.21.15.32:0/80437024 >> v2:172.21.15.32:3300/0 conn(0x7f32800c7d40 0x7f3280071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:16.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327fe00700 1 --2- 172.21.15.32:0/80437024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c7960 0x7f328015a300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32800708b0 tx=0x7f3270009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a24b3b1a6900172d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327ea00700 1 -- 172.21.15.32:0/80437024 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270011830 con 0x7f32800c7960 2024-09-13T18:45:16.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327ea00700 1 -- 172.21.15.32:0/80437024 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270011990 con 0x7f32800c7960 2024-09-13T18:45:16.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f327ea00700 1 -- 172.21.15.32:0/80437024 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270011d20 con 0x7f32800c7960 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 -- 172.21.15.32:0/80437024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c7960 msgr2=0x7f328015a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.473+0000 7f3285600700 1 --2- 172.21.15.32:0/80437024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c7960 0x7f328015a300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32800708b0 tx=0x7f3270009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- 172.21.15.32:0/80437024 shutdown_connections 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 --2- 172.21.15.32:0/80437024 >> v2:172.21.15.32:3300/0 conn(0x7f32800c7d40 0x7f3280071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 --2- 172.21.15.32:0/80437024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c7960 0x7f328015a300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- 172.21.15.32:0/80437024 >> 172.21.15.32:0/80437024 conn(0x7f32800cac60 msgr2=0x7f32800cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- 172.21.15.32:0/80437024 shutdown_connections 2024-09-13T18:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- 172.21.15.32:0/80437024 wait complete. 2024-09-13T18:45:16.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 Processor -- start 2024-09-13T18:45:16.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- start start 2024-09-13T18:45:16.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c5870 0x7f32801f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 0x7f328006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32800c7d40 0x7f328006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328006eb70 con 0x7f32800c7960 2024-09-13T18:45:16.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32801f2f40 con 0x7f32800c5870 2024-09-13T18:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.477+0000 7f3285600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328006e5b0 con 0x7f32800c7d40 2024-09-13T18:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 0x7f328006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c5870 0x7f32801f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 0x7f328006d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51078/0 (socket says 172.21.15.32:51078) 2024-09-13T18:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 -- 172.21.15.32:0/292406252 learned_addr learned my addr 172.21.15.32:0/292406252 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3284c00700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32800c7d40 0x7f328006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 -- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32800c7d40 msgr2=0x7f328006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32800c7d40 0x7f328006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 -- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c5870 msgr2=0x7f32801f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c5870 0x7f32801f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 -- 172.21.15.32:0/292406252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0094b0 con 0x7f32800c7960 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f327f400700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 0x7f328006d440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f326c00ebe0 tx=0x7f326c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00c850 con 0x7f32800c7960 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00c9b0 con 0x7f32800c7960 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00cd40 con 0x7f32800c7960 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3270009570 con 0x7f32800c7960 2024-09-13T18:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328006cf20 con 0x7f32800c7960 2024-09-13T18:45:16.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.481+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280157230 con 0x7f32800c7960 2024-09-13T18:45:16.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.485+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f326c013470 con 0x7f32800c7960 2024-09-13T18:45:16.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.485+0000 7f3277e00700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3260066730 0x7f3260068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.485+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f326c084470 con 0x7f32800c7960 2024-09-13T18:45:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.485+0000 7f327fe00700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3260066730 0x7f3260068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.489+0000 7f327fe00700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3260066730 0x7f3260068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3270000c00 tx=0x7f3270008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.493+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3280157230 con 0x7f32800c7960 2024-09-13T18:45:16.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.673+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3280157230 con 0x7f32800c7960 2024-09-13T18:45:16.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.673+0000 7f3277e00700 1 -- 172.21.15.32:0/292406252 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3280157230 con 0x7f32800c7960 2024-09-13T18:45:16.679 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:45:16.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3260066730 msgr2=0x7f3260068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3260066730 0x7f3260068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3270000c00 tx=0x7f3270008030 comp rx=0 tx=0).stop 2024-09-13T18:45:16.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 msgr2=0x7f328006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 0x7f328006d440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f326c00ebe0 tx=0x7f326c00eef0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 shutdown_connections 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3260066730 0x7f3260068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32800c7d40 0x7f328006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32800c7960 0x7f328006d440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 --2- 172.21.15.32:0/292406252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32800c5870 0x7f32801f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 >> 172.21.15.32:0/292406252 conn(0x7f32800cac60 msgr2=0x7f32800c5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 shutdown_connections 2024-09-13T18:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.677+0000 7f3285600700 1 -- 172.21.15.32:0/292406252 wait complete. 2024-09-13T18:45:16.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 Processor -- start 2024-09-13T18:45:16.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 -- start start 2024-09-13T18:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3960153840 0x7f39600c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f39600c8950 0x7f396015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600c8370 con 0x7f39600c8f10 2024-09-13T18:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396006b810 con 0x7f39600c8950 2024-09-13T18:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f3965c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600c8650 con 0x7f3960153840 2024-09-13T18:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f395f400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f39600c8f10 0x7f39600ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41516/0 (socket says 172.21.15.32:41516) 2024-09-13T18:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f395f400700 1 -- 172.21.15.32:0/3228795009 learned_addr learned my addr 172.21.15.32:0/3228795009 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.877+0000 7f395fe00700 1 --2- 172.21.15.32:0/3228795009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3960153840 0x7f39600c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965200700 1 --2- 172.21.15.32:0/3228795009 >> v2:172.21.15.32:3300/0 conn(0x7f39600c8950 0x7f396015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395ea00700 1 -- 172.21.15.32:0/3228795009 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877074062 0 0) 0x7f39600c8370 con 0x7f39600c8f10 2024-09-13T18:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395ea00700 1 -- 172.21.15.32:0/3228795009 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39440035d0 con 0x7f39600c8f10 2024-09-13T18:45:16.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395fe00700 1 -- 172.21.15.32:0/3228795009 >> v2:172.21.15.32:3300/0 conn(0x7f39600c8950 msgr2=0x7f396015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:16.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395fe00700 1 --2- 172.21.15.32:0/3228795009 >> v2:172.21.15.32:3300/0 conn(0x7f39600c8950 0x7f396015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395fe00700 1 -- 172.21.15.32:0/3228795009 >> v1:172.21.15.32:6789/0 conn(0x7f39600c8f10 legacy=0x7f39600ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395fe00700 1 -- 172.21.15.32:0/3228795009 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396006ae70 con 0x7f3960153840 2024-09-13T18:45:16.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395fe00700 1 --2- 172.21.15.32:0/3228795009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3960153840 0x7f39600c93e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3950009850 tx=0x7f3950009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded831ba8bf48621 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395ea00700 1 -- 172.21.15.32:0/3228795009 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950011830 con 0x7f3960153840 2024-09-13T18:45:16.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395ea00700 1 -- 172.21.15.32:0/3228795009 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3950011990 con 0x7f3960153840 2024-09-13T18:45:16.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f395ea00700 1 -- 172.21.15.32:0/3228795009 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950011d40 con 0x7f3960153840 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 -- 172.21.15.32:0/3228795009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3960153840 msgr2=0x7f39600c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 --2- 172.21.15.32:0/3228795009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3960153840 0x7f39600c93e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3950009850 tx=0x7f3950009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 -- 172.21.15.32:0/3228795009 shutdown_connections 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 --2- 172.21.15.32:0/3228795009 >> v2:172.21.15.32:3300/0 conn(0x7f39600c8950 0x7f396015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 --2- 172.21.15.32:0/3228795009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3960153840 0x7f39600c93e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 -- 172.21.15.32:0/3228795009 >> 172.21.15.32:0/3228795009 conn(0x7f3960071740 msgr2=0x7f3960071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 -- 172.21.15.32:0/3228795009 shutdown_connections 2024-09-13T18:45:16.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.881+0000 7f3965c00700 1 -- 172.21.15.32:0/3228795009 wait complete. 2024-09-13T18:45:16.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 Processor -- start 2024-09-13T18:45:16.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 -- start start 2024-09-13T18:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39600c8950 0x7f3960141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 0x7f3960147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3960153840 0x7f3960154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960147600 con 0x7f3960153840 2024-09-13T18:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960154340 con 0x7f39600c8950 2024-09-13T18:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39601559b0 con 0x7f39600c8f10 2024-09-13T18:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3960153840 0x7f3960154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 0x7f3960147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39600c8950 0x7f3960141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 0x7f3960147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35388/0 (socket says 172.21.15.32:35388) 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395f400700 1 -- 172.21.15.32:0/2168735883 learned_addr learned my addr 172.21.15.32:0/2168735883 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395fe00700 1 -- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 msgr2=0x7f3960147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395fe00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 0x7f3960147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395fe00700 1 -- 172.21.15.32:0/2168735883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3960153840 msgr2=0x7f3960154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395fe00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3960153840 0x7f3960154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395fe00700 1 -- 172.21.15.32:0/2168735883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500094b0 con 0x7f39600c8950 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f395f400700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 0x7f3960147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:16.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.885+0000 7f3965200700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3960153840 0x7f3960154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:16.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f395fe00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39600c8950 0x7f3960141de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3950016000 tx=0x7f3950004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950004510 con 0x7f39600c8950 2024-09-13T18:45:16.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395001e070 con 0x7f39600c8950 2024-09-13T18:45:16.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500038e0 con 0x7f39600c8950 2024-09-13T18:45:16.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39601468e0 con 0x7f39600c8950 2024-09-13T18:45:16.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3960147220 con 0x7f39600c8950 2024-09-13T18:45:16.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.889+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3960147740 con 0x7f39600c8950 2024-09-13T18:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.893+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3950003a40 con 0x7f39600c8950 2024-09-13T18:45:16.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.893+0000 7f3957e00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3940066760 0x7f3940068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:16.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.893+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3950085430 con 0x7f39600c8950 2024-09-13T18:45:16.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.893+0000 7f395f400700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3940066760 0x7f3940068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:16.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.893+0000 7f395f400700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3940066760 0x7f3940068c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39601526d0 tx=0x7f394c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:16.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:16.901+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3950052520 con 0x7f39600c8950 2024-09-13T18:45:17.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.085+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3960147740 con 0x7f39600c8950 2024-09-13T18:45:17.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.085+0000 7f3957e00700 1 -- 172.21.15.32:0/2168735883 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3960147740 con 0x7f39600c8950 2024-09-13T18:45:17.093 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:17.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3940066760 msgr2=0x7f3940068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3940066760 0x7f3940068c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39601526d0 tx=0x7f394c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:17.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39600c8950 msgr2=0x7f3960141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39600c8950 0x7f3960141de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3950016000 tx=0x7f3950004770 comp rx=0 tx=0).stop 2024-09-13T18:45:17.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 shutdown_connections 2024-09-13T18:45:17.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3940066760 0x7f3940068c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3960153840 0x7f3960154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39600c8f10 0x7f3960147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 --2- 172.21.15.32:0/2168735883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39600c8950 0x7f3960141de0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 >> 172.21.15.32:0/2168735883 conn(0x7f3960071740 msgr2=0x7f396006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:17.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 shutdown_connections 2024-09-13T18:45:17.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.089+0000 7f3965c00700 1 -- 172.21.15.32:0/2168735883 wait complete. 2024-09-13T18:45:17.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:17.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.313+0000 7feb64a00700 1 Processor -- start 2024-09-13T18:45:17.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.317+0000 7feb64a00700 1 -- start start 2024-09-13T18:45:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.317+0000 7feb64a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb60151680 0x7feb6006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.317+0000 7feb64a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 0x7feb6006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6015aa50 con 0x7feb600ccf30 2024-09-13T18:45:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6015aca0 con 0x7feb60151680 2024-09-13T18:45:17.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6015af80 con 0x7feb60151a60 2024-09-13T18:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 0x7feb6006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5e800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb60151680 0x7feb6006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 0x7feb6006b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35394/0 (socket says 172.21.15.32:35394) 2024-09-13T18:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 -- 172.21.15.32:0/1269029092 learned_addr learned my addr 172.21.15.32:0/1269029092 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 -- 172.21.15.32:0/1269029092 >> v2:172.21.15.86:3300/0 conn(0x7feb60151680 msgr2=0x7feb6006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 --2- 172.21.15.32:0/1269029092 >> v2:172.21.15.86:3300/0 conn(0x7feb60151680 0x7feb6006b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 -- 172.21.15.32:0/1269029092 >> v1:172.21.15.32:6789/0 conn(0x7feb600ccf30 legacy=0x7feb60157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 -- 172.21.15.32:0/1269029092 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6015b260 con 0x7feb60151a60 2024-09-13T18:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5de00700 1 --2- 172.21.15.32:0/1269029092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 0x7feb6006b7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009910 tx=0x7feb4c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e15087ff582d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5d400700 1 -- 172.21.15.32:0/1269029092 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011830 con 0x7feb60151a60 2024-09-13T18:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5d400700 1 -- 172.21.15.32:0/1269029092 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c011990 con 0x7feb60151a60 2024-09-13T18:45:17.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb5d400700 1 -- 172.21.15.32:0/1269029092 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011d40 con 0x7feb60151a60 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- 172.21.15.32:0/1269029092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 msgr2=0x7feb6006b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 --2- 172.21.15.32:0/1269029092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 0x7feb6006b7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009910 tx=0x7feb4c009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- 172.21.15.32:0/1269029092 shutdown_connections 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 --2- 172.21.15.32:0/1269029092 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151a60 0x7feb6006b7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 --2- 172.21.15.32:0/1269029092 >> v2:172.21.15.86:3300/0 conn(0x7feb60151680 0x7feb6006b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- 172.21.15.32:0/1269029092 >> 172.21.15.32:0/1269029092 conn(0x7feb60071740 msgr2=0x7feb60071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- 172.21.15.32:0/1269029092 shutdown_connections 2024-09-13T18:45:17.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.321+0000 7feb64a00700 1 -- 172.21.15.32:0/1269029092 wait complete. 2024-09-13T18:45:17.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 Processor -- start 2024-09-13T18:45:17.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 -- start start 2024-09-13T18:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb600ccf30 0x7feb60159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151680 0x7feb60158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb6014f620 0x7feb60158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb601efcc0 con 0x7feb6014f620 2024-09-13T18:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb601ef0d0 con 0x7feb600ccf30 2024-09-13T18:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.325+0000 7feb64a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6014dec0 con 0x7feb60151680 2024-09-13T18:45:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb6014f620 0x7feb60158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151680 0x7feb60158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151680 0x7feb60158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35404/0 (socket says 172.21.15.32:35404) 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5de00700 1 -- 172.21.15.32:0/274258673 learned_addr learned my addr 172.21.15.32:0/274258673 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5e800700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb600ccf30 0x7feb60159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 -- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151680 msgr2=0x7feb60158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151680 0x7feb60158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 -- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb600ccf30 msgr2=0x7feb60159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb600ccf30 0x7feb60159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 -- 172.21.15.32:0/274258673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009570 con 0x7feb6014f620 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb5f200700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb6014f620 0x7feb60158e70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb5800cb90 tx=0x7feb5800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:17.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58003c20 con 0x7feb6014f620 2024-09-13T18:45:17.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58003d80 con 0x7feb6014f620 2024-09-13T18:45:17.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800aa80 con 0x7feb6014f620 2024-09-13T18:45:17.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb601ef390 con 0x7feb6014f620 2024-09-13T18:45:17.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb601ef950 con 0x7feb6014f620 2024-09-13T18:45:17.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.329+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb601efae0 con 0x7feb6014f620 2024-09-13T18:45:17.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.333+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb5800abe0 con 0x7feb6014f620 2024-09-13T18:45:17.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.333+0000 7feb56a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb40066730 0x7feb40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.340 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.333+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb58084470 con 0x7feb6014f620 2024-09-13T18:45:17.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.333+0000 7feb5e800700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb40066730 0x7feb40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.337+0000 7feb5e800700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb40066730 0x7feb40068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb50009bf0 tx=0x7feb50009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:17.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.341+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb580513c0 con 0x7feb6014f620 2024-09-13T18:45:17.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.525+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb600cd3a0 con 0x7feb6014f620 2024-09-13T18:45:17.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.525+0000 7feb56a00700 1 -- 172.21.15.32:0/274258673 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb580549e0 con 0x7feb6014f620 2024-09-13T18:45:17.531 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-09-13T18:45:17.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb40066730 msgr2=0x7feb40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb40066730 0x7feb40068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb50009bf0 tx=0x7feb50009240 comp rx=0 tx=0).stop 2024-09-13T18:45:17.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb6014f620 msgr2=0x7feb60158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb6014f620 0x7feb60158e70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb5800cb90 tx=0x7feb5800cea0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 shutdown_connections 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb40066730 0x7feb40068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb6014f620 0x7feb60158e70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb60151680 0x7feb60158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 --2- 172.21.15.32:0/274258673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb600ccf30 0x7feb60159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 >> 172.21.15.32:0/274258673 conn(0x7feb60071740 msgr2=0x7feb60150630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 shutdown_connections 2024-09-13T18:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.529+0000 7feb64a00700 1 -- 172.21.15.32:0/274258673 wait complete. 2024-09-13T18:45:17.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:17.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.733+0000 7fa10b200700 1 Processor -- start 2024-09-13T18:45:17.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.733+0000 7fa10b200700 1 -- start start 2024-09-13T18:45:17.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa10b200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa10c151a60 0x7fa10c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa10b200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa10c0cd470 0x7fa10c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa10b200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c15aa50 con 0x7fa10c151680 2024-09-13T18:45:17.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa10b200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0cd880 con 0x7fa10c151a60 2024-09-13T18:45:17.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa10b200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c15aca0 con 0x7fa10c0cd470 2024-09-13T18:45:17.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa10c151680 0x7fa10c06b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41536/0 (socket says 172.21.15.32:41536) 2024-09-13T18:45:17.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109e00700 1 -- 172.21.15.32:0/160350426 learned_addr learned my addr 172.21.15.32:0/160350426 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:17.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109400700 1 --2- 172.21.15.32:0/160350426 >> v2:172.21.15.32:3300/0 conn(0x7fa10c151a60 0x7fa10c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa10a800700 1 --2- 172.21.15.32:0/160350426 >> v2:172.21.15.86:3300/0 conn(0x7fa10c0cd470 0x7fa10c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa108a00700 1 -- 172.21.15.32:0/160350426 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178375487 0 0) 0x7fa10c15aa50 con 0x7fa10c151680 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa108a00700 1 -- 172.21.15.32:0/160350426 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f00035d0 con 0x7fa10c151680 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109400700 1 -- 172.21.15.32:0/160350426 >> v2:172.21.15.86:3300/0 conn(0x7fa10c0cd470 msgr2=0x7fa10c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109400700 1 --2- 172.21.15.32:0/160350426 >> v2:172.21.15.86:3300/0 conn(0x7fa10c0cd470 0x7fa10c157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109400700 1 -- 172.21.15.32:0/160350426 >> v1:172.21.15.32:6789/0 conn(0x7fa10c151680 legacy=0x7fa10c06b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.737+0000 7fa109400700 1 -- 172.21.15.32:0/160350426 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c15af80 con 0x7fa10c151a60 2024-09-13T18:45:17.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa109400700 1 --2- 172.21.15.32:0/160350426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151a60 0x7fa10c0ccf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0b2c90 tx=0x7fa0f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236eb0516239120e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:17.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa108a00700 1 -- 172.21.15.32:0/160350426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8011830 con 0x7fa10c151a60 2024-09-13T18:45:17.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa108a00700 1 -- 172.21.15.32:0/160350426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8011990 con 0x7fa10c151a60 2024-09-13T18:45:17.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa108a00700 1 -- 172.21.15.32:0/160350426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8011d00 con 0x7fa10c151a60 2024-09-13T18:45:17.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 -- 172.21.15.32:0/160350426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151a60 msgr2=0x7fa10c0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 --2- 172.21.15.32:0/160350426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151a60 0x7fa10c0ccf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0b2c90 tx=0x7fa0f8009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:17.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 -- 172.21.15.32:0/160350426 shutdown_connections 2024-09-13T18:45:17.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 --2- 172.21.15.32:0/160350426 >> v2:172.21.15.86:3300/0 conn(0x7fa10c0cd470 0x7fa10c157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 --2- 172.21.15.32:0/160350426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151a60 0x7fa10c0ccf30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 -- 172.21.15.32:0/160350426 >> 172.21.15.32:0/160350426 conn(0x7fa10c071740 msgr2=0x7fa10c071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:17.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 -- 172.21.15.32:0/160350426 shutdown_connections 2024-09-13T18:45:17.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.741+0000 7fa10b200700 1 -- 172.21.15.32:0/160350426 wait complete. 2024-09-13T18:45:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 Processor -- start 2024-09-13T18:45:17.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 -- start start 2024-09-13T18:45:17.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa10c0cd470 0x7fa10c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 0x7fa10c0cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c1f0bf0 0x7fa10c1f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0ae3c0 con 0x7fa10c151680 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c1f01a0 con 0x7fa10c1f0bf0 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0ae770 con 0x7fa10c0cd470 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa109400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 0x7fa10c0cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa109400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 0x7fa10c0cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51128/0 (socket says 172.21.15.32:51128) 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa109400700 1 -- 172.21.15.32:0/1649716056 learned_addr learned my addr 172.21.15.32:0/1649716056 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa10a800700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c1f0bf0 0x7fa10c1f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.745+0000 7fa109e00700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa10c0cd470 0x7fa10c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa109400700 1 -- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa10c0cd470 msgr2=0x7fa10c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa109400700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa10c0cd470 0x7fa10c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa109400700 1 -- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c1f0bf0 msgr2=0x7fa10c1f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa109400700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c1f0bf0 0x7fa10c1f1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa109400700 1 -- 172.21.15.32:0/1649716056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80094b0 con 0x7fa10c151680 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa109400700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 0x7fa10c0cc840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80090b0 tx=0x7fa0f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80044d0 con 0x7fa10c151680 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f801e070 con 0x7fa10c151680 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c1f15b0 con 0x7fa10c151680 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8003900 con 0x7fa10c151680 2024-09-13T18:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c1528a0 con 0x7fa10c151680 2024-09-13T18:45:17.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.749+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c0c40b0 con 0x7fa10c151680 2024-09-13T18:45:17.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.753+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0f8003a60 con 0x7fa10c151680 2024-09-13T18:45:17.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.753+0000 7fa102000700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa0ec066760 0x7fa0ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:17.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.753+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0f80851a0 con 0x7fa10c151680 2024-09-13T18:45:17.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.753+0000 7fa109e00700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa0ec066760 0x7fa0ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:17.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.757+0000 7fa109e00700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa0ec066760 0x7fa0ec068c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc007fd0 tx=0x7fa0fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.761+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0f8052180 con 0x7fa10c151680 2024-09-13T18:45:17.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.941+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa10c0c5cf0 con 0x7fa10c151680 2024-09-13T18:45:17.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa102000700 1 -- 172.21.15.32:0/1649716056 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa0f80557a0 con 0x7fa10c151680 2024-09-13T18:45:17.951 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:17.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa0ec066760 msgr2=0x7fa0ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa0ec066760 0x7fa0ec068c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc007fd0 tx=0x7fa0fc009040 comp rx=0 tx=0).stop 2024-09-13T18:45:17.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 msgr2=0x7fa10c0cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 0x7fa10c0cc840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80090b0 tx=0x7fa0f8004770 comp rx=0 tx=0).stop 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 shutdown_connections 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa0ec066760 0x7fa0ec068c20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa10c1f0bf0 0x7fa10c1f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa10c151680 0x7fa10c0cc840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 --2- 172.21.15.32:0/1649716056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa10c0cd470 0x7fa10c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.945+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 >> 172.21.15.32:0/1649716056 conn(0x7fa10c071740 msgr2=0x7fa10c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:17.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.949+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 shutdown_connections 2024-09-13T18:45:17.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:17.949+0000 7fa10b200700 1 -- 172.21.15.32:0/1649716056 wait complete. 2024-09-13T18:45:17.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:45:18.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.141+0000 7f967ce00700 1 Processor -- start 2024-09-13T18:45:18.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.145+0000 7f967ce00700 1 -- start start 2024-09-13T18:45:18.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.145+0000 7f967ce00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96780721b0 0x7f967815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967815a620 con 0x7f9678072590 2024-09-13T18:45:18.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967815db50 con 0x7f9678153450 2024-09-13T18:45:18.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96780716a0 con 0x7f96780721b0 2024-09-13T18:45:18.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9678072590 0x7f96780c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41550/0 (socket says 172.21.15.32:41550) 2024-09-13T18:45:18.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676a00700 1 -- 172.21.15.32:0/3991480877 learned_addr learned my addr 172.21.15.32:0/3991480877 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:18.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9677400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96780721b0 0x7f967815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508778359 0 0) 0x7f967815db50 con 0x7f9678153450 2024-09-13T18:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f965c0035d0 con 0x7f9678153450 2024-09-13T18:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876743509 0 0) 0x7f967815a620 con 0x7f9678072590 2024-09-13T18:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f967815db50 con 0x7f9678072590 2024-09-13T18:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9677400700 1 -- 172.21.15.32:0/3991480877 >> v1:172.21.15.86:6789/0 conn(0x7f9678153450 legacy=0x7f9678153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9677400700 1 -- 172.21.15.32:0/3991480877 >> v1:172.21.15.32:6789/0 conn(0x7f9678072590 legacy=0x7f96780c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9677400700 1 -- 172.21.15.32:0/3991480877 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967815ccf0 con 0x7f96780721b0 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9677400700 1 --2- 172.21.15.32:0/3991480877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96780721b0 0x7f967815a0e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9668009850 tx=0x7f9668009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8026c6e4e4720e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668011830 con 0x7f96780721b0 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9668011990 con 0x7f96780721b0 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f9676000700 1 -- 172.21.15.32:0/3991480877 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668011d40 con 0x7f96780721b0 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- 172.21.15.32:0/3991480877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96780721b0 msgr2=0x7f967815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 --2- 172.21.15.32:0/3991480877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96780721b0 0x7f967815a0e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9668009850 tx=0x7f9668009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:18.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- 172.21.15.32:0/3991480877 shutdown_connections 2024-09-13T18:45:18.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 --2- 172.21.15.32:0/3991480877 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96780721b0 0x7f967815a0e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- 172.21.15.32:0/3991480877 >> 172.21.15.32:0/3991480877 conn(0x7f96780cbfe0 msgr2=0x7f96780cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- 172.21.15.32:0/3991480877 shutdown_connections 2024-09-13T18:45:18.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.149+0000 7f967ce00700 1 -- 172.21.15.32:0/3991480877 wait complete. 2024-09-13T18:45:18.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 Processor -- start 2024-09-13T18:45:18.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 -- start start 2024-09-13T18:45:18.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 0x7f96780ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9678072590 0x7f967815c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9678153450 0x7f9678149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96781f34d0 con 0x7f9678153450 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967815ca50 con 0x7f96780721b0 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f967ce00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96781f28c0 con 0x7f9678072590 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 0x7f96780ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9678153450 0x7f9678149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 0x7f96780ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:38116/0 (socket says 172.21.15.32:38116) 2024-09-13T18:45:18.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 -- 172.21.15.32:0/2171564753 learned_addr learned my addr 172.21.15.32:0/2171564753 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9676a00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9678072590 0x7f967815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 -- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9678072590 msgr2=0x7f967815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9678072590 0x7f967815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 -- 172.21.15.32:0/2171564753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9678153450 msgr2=0x7f9678149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9678153450 0x7f9678149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.153+0000 7f9677400700 1 -- 172.21.15.32:0/2171564753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96680094b0 con 0x7f96780721b0 2024-09-13T18:45:18.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f9677400700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 0x7f96780ce1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96780d01b0 tx=0x7f9668004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966801a990 con 0x7f96780721b0 2024-09-13T18:45:18.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966801f070 con 0x7f96780721b0 2024-09-13T18:45:18.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96781f2ba0 con 0x7f96780721b0 2024-09-13T18:45:18.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966801ad30 con 0x7f96780721b0 2024-09-13T18:45:18.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96781f3160 con 0x7f96780721b0 2024-09-13T18:45:18.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.157+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96781f32f0 con 0x7f96780721b0 2024-09-13T18:45:18.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.161+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f966801b430 con 0x7f96780721b0 2024-09-13T18:45:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.161+0000 7f966f400700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9658066730 0x7f9658068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.161+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9668085940 con 0x7f96780721b0 2024-09-13T18:45:18.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.161+0000 7f9676a00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9658066730 0x7f9658068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.161+0000 7f9676a00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9658066730 0x7f9658068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9678150c40 tx=0x7f9664009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.169+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9668052a30 con 0x7f96780721b0 2024-09-13T18:45:18.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.369+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9678067a00 con 0x7f96780721b0 2024-09-13T18:45:18.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.369+0000 7f966f400700 1 -- 172.21.15.32:0/2171564753 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9668015080 con 0x7f96780721b0 2024-09-13T18:45:18.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9658066730 msgr2=0x7f9658068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9658066730 0x7f9658068bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9678150c40 tx=0x7f9664009040 comp rx=0 tx=0).stop 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 msgr2=0x7f96780ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 0x7f96780ce1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96780d01b0 tx=0x7f9668004770 comp rx=0 tx=0).stop 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 shutdown_connections 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9658066730 0x7f9658068bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9678153450 0x7f9678149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9678072590 0x7f967815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 --2- 172.21.15.32:0/2171564753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96780721b0 0x7f96780ce1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 >> 172.21.15.32:0/2171564753 conn(0x7f96780cbfe0 msgr2=0x7f9678152570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 shutdown_connections 2024-09-13T18:45:18.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.373+0000 7f967ce00700 1 -- 172.21.15.32:0/2171564753 wait complete. 2024-09-13T18:45:18.383 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-09-13T18:45:18.403 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:45:18.403 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:18.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:18.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.621+0000 7f195d200700 1 Processor -- start 2024-09-13T18:45:18.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.621+0000 7f195d200700 1 -- start start 2024-09-13T18:45:18.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f195d200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f195815e8f0 0x7f1958161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f195d200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19580c7740 0x7f1958168550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f195d200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580ca840 con 0x7f19580cabf0 2024-09-13T18:45:18.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f195d200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19580c7e50 con 0x7f19580c7740 2024-09-13T18:45:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f195d200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19580cba80 con 0x7f195815e8f0 2024-09-13T18:45:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f195815e8f0 0x7f1958161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1956800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f19580c7740 0x7f1958168550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f195815e8f0 0x7f1958161a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:38128/0 (socket says 172.21.15.32:38128) 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 -- 172.21.15.32:0/1312770163 learned_addr learned my addr 172.21.15.32:0/1312770163 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 -- 172.21.15.32:0/1312770163 >> v2:172.21.15.32:3300/0 conn(0x7f19580c7740 msgr2=0x7f1958168550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 --2- 172.21.15.32:0/1312770163 >> v2:172.21.15.32:3300/0 conn(0x7f19580c7740 0x7f1958168550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 -- 172.21.15.32:0/1312770163 >> v1:172.21.15.32:6789/0 conn(0x7f19580cabf0 legacy=0x7f19580719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 -- 172.21.15.32:0/1312770163 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580c80f0 con 0x7f195815e8f0 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1956800700 1 --2- 172.21.15.32:0/1312770163 >> v2:172.21.15.32:3300/0 conn(0x7f19580c7740 0x7f1958168550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.625+0000 7f1955e00700 1 --2- 172.21.15.32:0/1312770163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f195815e8f0 0x7f1958161a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19580add20 tx=0x7f1948009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=754eab5daa702219 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f1955400700 1 -- 172.21.15.32:0/1312770163 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948011830 con 0x7f195815e8f0 2024-09-13T18:45:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f1955400700 1 -- 172.21.15.32:0/1312770163 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948011990 con 0x7f195815e8f0 2024-09-13T18:45:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f1955400700 1 -- 172.21.15.32:0/1312770163 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948011d20 con 0x7f195815e8f0 2024-09-13T18:45:18.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 -- 172.21.15.32:0/1312770163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f195815e8f0 msgr2=0x7f1958161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 --2- 172.21.15.32:0/1312770163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f195815e8f0 0x7f1958161a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19580add20 tx=0x7f1948009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 -- 172.21.15.32:0/1312770163 shutdown_connections 2024-09-13T18:45:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 --2- 172.21.15.32:0/1312770163 >> v2:172.21.15.32:3300/0 conn(0x7f19580c7740 0x7f1958168550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 --2- 172.21.15.32:0/1312770163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f195815e8f0 0x7f1958161a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 -- 172.21.15.32:0/1312770163 >> 172.21.15.32:0/1312770163 conn(0x7f1958071240 msgr2=0x7f195806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 -- 172.21.15.32:0/1312770163 shutdown_connections 2024-09-13T18:45:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.629+0000 7f195d200700 1 -- 172.21.15.32:0/1312770163 wait complete. 2024-09-13T18:45:18.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 Processor -- start 2024-09-13T18:45:18.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 -- start start 2024-09-13T18:45:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19580c7740 0x7f19580c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19580cabf0 0x7f1958127690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 0x7f1958127bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580c6120 con 0x7f195815e8f0 2024-09-13T18:45:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19581f7600 con 0x7f19580c7740 2024-09-13T18:45:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f195d200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19580c5510 con 0x7f19580cabf0 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1956800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 0x7f1958127bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1955e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19580c7740 0x7f19580c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1956800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 0x7f1958127bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51156/0 (socket says 172.21.15.32:51156) 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1956800700 1 -- 172.21.15.32:0/3586260640 learned_addr learned my addr 172.21.15.32:0/3586260640 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f194d400700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19580cabf0 0x7f1958127690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1955e00700 1 -- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19580cabf0 msgr2=0x7f1958127690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1955e00700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19580cabf0 0x7f1958127690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1955e00700 1 -- 172.21.15.32:0/3586260640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 msgr2=0x7f1958127bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1955e00700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 0x7f1958127bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1955e00700 1 -- 172.21.15.32:0/3586260640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950009a70 con 0x7f19580c7740 2024-09-13T18:45:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.633+0000 7f1956800700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 0x7f1958127bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f1955e00700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19580c7740 0x7f19580c47e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1948016000 tx=0x7f1948004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948004510 con 0x7f19580c7740 2024-09-13T18:45:18.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194801e070 con 0x7f19580c7740 2024-09-13T18:45:18.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948003900 con 0x7f19580c7740 2024-09-13T18:45:18.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1948009570 con 0x7f19580c7740 2024-09-13T18:45:18.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19580c5ad0 con 0x7f19580c7740 2024-09-13T18:45:18.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.637+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195815ecd0 con 0x7f19580c7740 2024-09-13T18:45:18.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.641+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1948003a60 con 0x7f19580c7740 2024-09-13T18:45:18.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.641+0000 7f194ea00700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f19340667b0 0x7f1934068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:18.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.641+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1948084eb0 con 0x7f19580c7740 2024-09-13T18:45:18.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.641+0000 7f194d400700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f19340667b0 0x7f1934068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:18.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.641+0000 7f194d400700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f19340667b0 0x7f1934068c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19580b03c0 tx=0x7f1940009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:18.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.649+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1948052040 con 0x7f19580c7740 2024-09-13T18:45:18.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.841+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19580cbcc0 con 0x7f19580c7740 2024-09-13T18:45:18.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.841+0000 7f194ea00700 1 -- 172.21.15.32:0/3586260640 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f1948055660 con 0x7f19580c7740 2024-09-13T18:45:18.850 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:18.850 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f19340667b0 msgr2=0x7f1934068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f19340667b0 0x7f1934068c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19580b03c0 tx=0x7f1940009040 comp rx=0 tx=0).stop 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19580c7740 msgr2=0x7f19580c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19580c7740 0x7f19580c47e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1948016000 tx=0x7f1948004770 comp rx=0 tx=0).stop 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 shutdown_connections 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f19340667b0 0x7f1934068c70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195815e8f0 0x7f1958127bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19580cabf0 0x7f1958127690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 --2- 172.21.15.32:0/3586260640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19580c7740 0x7f19580c47e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 >> 172.21.15.32:0/3586260640 conn(0x7f1958071240 msgr2=0x7f195815ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 shutdown_connections 2024-09-13T18:45:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:18.849+0000 7f195d200700 1 -- 172.21.15.32:0/3586260640 wait complete. 2024-09-13T18:45:18.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:18.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:19.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.061+0000 7f0d05c00700 1 Processor -- start 2024-09-13T18:45:19.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.061+0000 7f0d05c00700 1 -- start start 2024-09-13T18:45:19.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0d05c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d000c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0d05c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0d0006f5a0 0x7f0d000cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0d05c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d00071570 con 0x7f0d0006f9c0 2024-09-13T18:45:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0d05c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d00070920 con 0x7f0d0006f5a0 2024-09-13T18:45:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0d05c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0015dad0 con 0x7f0d00156e30 2024-09-13T18:45:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d000c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cff400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0d0006f9c0 0x7f0d00159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33660/0 (socket says 172.21.15.32:33660) 2024-09-13T18:45:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cff400700 1 -- 172.21.15.32:0/3543647873 learned_addr learned my addr 172.21.15.32:0/3543647873 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:19.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfe000700 1 --2- 172.21.15.32:0/3543647873 >> v2:172.21.15.86:3300/0 conn(0x7f0d0006f5a0 0x7f0d000cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfd600700 1 -- 172.21.15.32:0/3543647873 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059019931 0 0) 0x7f0d00071570 con 0x7f0d0006f9c0 2024-09-13T18:45:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfd600700 1 -- 172.21.15.32:0/3543647873 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce40035d0 con 0x7f0d0006f9c0 2024-09-13T18:45:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfea00700 1 -- 172.21.15.32:0/3543647873 >> v2:172.21.15.86:3300/0 conn(0x7f0d0006f5a0 msgr2=0x7f0d000cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfea00700 1 --2- 172.21.15.32:0/3543647873 >> v2:172.21.15.86:3300/0 conn(0x7f0d0006f5a0 0x7f0d000cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfea00700 1 -- 172.21.15.32:0/3543647873 >> v1:172.21.15.32:6789/0 conn(0x7f0d0006f9c0 legacy=0x7f0d00159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfea00700 1 -- 172.21.15.32:0/3543647873 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0015ce90 con 0x7f0d00156e30 2024-09-13T18:45:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.065+0000 7f0cfe000700 1 --2- 172.21.15.32:0/3543647873 >> v2:172.21.15.86:3300/0 conn(0x7f0d0006f5a0 0x7f0d000cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0cfea00700 1 --2- 172.21.15.32:0/3543647873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d000c80a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009850 tx=0x7f0cf0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=390b4c11c531f104 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0cfd600700 1 -- 172.21.15.32:0/3543647873 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011830 con 0x7f0d00156e30 2024-09-13T18:45:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0cfd600700 1 -- 172.21.15.32:0/3543647873 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0011990 con 0x7f0d00156e30 2024-09-13T18:45:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0cfd600700 1 -- 172.21.15.32:0/3543647873 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011d00 con 0x7f0d00156e30 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 -- 172.21.15.32:0/3543647873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 msgr2=0x7f0d000c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3543647873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d000c80a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009850 tx=0x7f0cf0009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 -- 172.21.15.32:0/3543647873 shutdown_connections 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3543647873 >> v2:172.21.15.86:3300/0 conn(0x7f0d0006f5a0 0x7f0d000cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3543647873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d000c80a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 -- 172.21.15.32:0/3543647873 >> 172.21.15.32:0/3543647873 conn(0x7f0d0006eae0 msgr2=0x7f0d0006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 -- 172.21.15.32:0/3543647873 shutdown_connections 2024-09-13T18:45:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.069+0000 7f0d05c00700 1 -- 172.21.15.32:0/3543647873 wait complete. 2024-09-13T18:45:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.073+0000 7f0d05c00700 1 Processor -- start 2024-09-13T18:45:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.073+0000 7f0d05c00700 1 -- start start 2024-09-13T18:45:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.073+0000 7f0d05c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 0x7f0d00155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0006f9c0 0x7f0d0014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d0014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001500e0 con 0x7f0d0006f9c0 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001f00a0 con 0x7f0d0006f5a0 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000c67b0 con 0x7f0d00156e30 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfe000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0006f9c0 0x7f0d0014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 0x7f0d00155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cff400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d0014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cff400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d0014cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59828/0 (socket says 172.21.15.32:59828) 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 0x7f0d00155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49362/0 (socket says 172.21.15.32:49362) 2024-09-13T18:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cff400700 1 -- 172.21.15.32:0/3820516453 learned_addr learned my addr 172.21.15.32:0/3820516453 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 -- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 msgr2=0x7f0d0014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d0014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 -- 172.21.15.32:0/3820516453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0006f9c0 msgr2=0x7f0d0014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0006f9c0 0x7f0d0014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 -- 172.21.15.32:0/3820516453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094b0 con 0x7f0d0006f5a0 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cfea00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 0x7f0d00155870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0016000 tx=0x7f0cf0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0004450 con 0x7f0d0006f5a0 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf001e070 con 0x7f0d0006f5a0 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0003900 con 0x7f0d0006f5a0 2024-09-13T18:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf00094b0 con 0x7f0d0006f5a0 2024-09-13T18:45:19.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.077+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d00150310 con 0x7f0d0006f5a0 2024-09-13T18:45:19.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.081+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d00067a00 con 0x7f0d0006f5a0 2024-09-13T18:45:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.081+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cf0003a60 con 0x7f0d0006f5a0 2024-09-13T18:45:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.085+0000 7f0cf6a00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0ce0066730 0x7f0ce0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.085+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cf00850e0 con 0x7f0d0006f5a0 2024-09-13T18:45:19.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.085+0000 7f0cfe000700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0ce0066730 0x7f0ce0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.085+0000 7f0cfe000700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0ce0066730 0x7f0ce0068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d001535b0 tx=0x7f0cec009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.093+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cf0052150 con 0x7f0d0006f5a0 2024-09-13T18:45:19.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.277+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d00074d70 con 0x7f0d0006f5a0 2024-09-13T18:45:19.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.277+0000 7f0cf6a00700 1 -- 172.21.15.32:0/3820516453 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cf00045d0 con 0x7f0d0006f5a0 2024-09-13T18:45:19.283 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.277+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0ce0066730 msgr2=0x7f0ce0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.277+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0ce0066730 0x7f0ce0068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d001535b0 tx=0x7f0cec009240 comp rx=0 tx=0).stop 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.277+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 msgr2=0x7f0d00155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.277+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 0x7f0d00155870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0016000 tx=0x7f0cf0004770 comp rx=0 tx=0).stop 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 shutdown_connections 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0ce0066730 0x7f0ce0068bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00156e30 0x7f0d0014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0006f9c0 0x7f0d0014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 --2- 172.21.15.32:0/3820516453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f5a0 0x7f0d00155870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 >> 172.21.15.32:0/3820516453 conn(0x7f0d0006eae0 msgr2=0x7f0d000c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 shutdown_connections 2024-09-13T18:45:19.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.281+0000 7f0d05c00700 1 -- 172.21.15.32:0/3820516453 wait complete. 2024-09-13T18:45:19.307 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.469+0000 7f4c9de00700 1 Processor -- start 2024-09-13T18:45:19.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.469+0000 7f4c9de00700 1 -- start start 2024-09-13T18:45:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.469+0000 7f4c9de00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c9814fb50 0x7f4c980c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.469+0000 7f4c9de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c980c6680 0x7f4c98158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c98159e20 con 0x7f4c98155a10 2024-09-13T18:45:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c98159b40 con 0x7f4c9814fb50 2024-09-13T18:45:19.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9806d0c0 con 0x7f4c980c6680 2024-09-13T18:45:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9ca00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4c9814fb50 0x7f4c980c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4c98155a10 0x7f4c9806de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33672/0 (socket says 172.21.15.32:33672) 2024-09-13T18:45:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97e00700 1 -- 172.21.15.32:0/2763044557 learned_addr learned my addr 172.21.15.32:0/2763044557 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9d400700 1 --2- 172.21.15.32:0/2763044557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c980c6680 0x7f4c98158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97400700 1 -- 172.21.15.32:0/2763044557 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413698618 0 0) 0x7f4c84001110 con 0x7f4c98155a10 2024-09-13T18:45:19.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97400700 1 -- 172.21.15.32:0/2763044557 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c800057e0 con 0x7f4c98155a10 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9ca00700 1 -- 172.21.15.32:0/2763044557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c980c6680 msgr2=0x7f4c98158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9ca00700 1 --2- 172.21.15.32:0/2763044557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c980c6680 0x7f4c98158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9ca00700 1 -- 172.21.15.32:0/2763044557 >> v1:172.21.15.32:6789/0 conn(0x7f4c98155a10 legacy=0x7f4c9806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9ca00700 1 -- 172.21.15.32:0/2763044557 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9806d3a0 con 0x7f4c9814fb50 2024-09-13T18:45:19.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9ca00700 1 --2- 172.21.15.32:0/2763044557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c9814fb50 0x7f4c980c6140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009850 tx=0x7f4c8c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7589d30f810e022 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97400700 1 -- 172.21.15.32:0/2763044557 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c011830 con 0x7f4c9814fb50 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97400700 1 -- 172.21.15.32:0/2763044557 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c011990 con 0x7f4c9814fb50 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c97400700 1 -- 172.21.15.32:0/2763044557 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c011d40 con 0x7f4c9814fb50 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- 172.21.15.32:0/2763044557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c9814fb50 msgr2=0x7f4c980c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 --2- 172.21.15.32:0/2763044557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c9814fb50 0x7f4c980c6140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009850 tx=0x7f4c8c009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:19.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- 172.21.15.32:0/2763044557 shutdown_connections 2024-09-13T18:45:19.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 --2- 172.21.15.32:0/2763044557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c980c6680 0x7f4c98158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 --2- 172.21.15.32:0/2763044557 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c9814fb50 0x7f4c980c6140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- 172.21.15.32:0/2763044557 >> 172.21.15.32:0/2763044557 conn(0x7f4c9806f530 msgr2=0x7f4c9806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- 172.21.15.32:0/2763044557 shutdown_connections 2024-09-13T18:45:19.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.473+0000 7f4c9de00700 1 -- 172.21.15.32:0/2763044557 wait complete. 2024-09-13T18:45:19.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.477+0000 7f4c9de00700 1 Processor -- start 2024-09-13T18:45:19.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.477+0000 7f4c9de00700 1 -- start start 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c980c6680 0x7f4c981f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c9814fb50 0x7f4c98154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 0x7f4c98148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9814bee0 con 0x7f4c98155a10 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98149440 con 0x7f4c980c6680 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c980c94e0 con 0x7f4c9814fb50 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 0x7f4c98148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c97e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c9814fb50 0x7f4c98154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 0x7f4c98148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42960/0 (socket says 172.21.15.32:42960) 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 -- 172.21.15.32:0/3477165407 learned_addr learned my addr 172.21.15.32:0/3477165407 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9ca00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c980c6680 0x7f4c981f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 -- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c9814fb50 msgr2=0x7f4c98154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c9814fb50 0x7f4c98154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 -- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c980c6680 msgr2=0x7f4c981f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c980c6680 0x7f4c981f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 -- 172.21.15.32:0/3477165407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0094b0 con 0x7f4c98155a10 2024-09-13T18:45:19.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9d400700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 0x7f4c98148990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000efc0 tx=0x7f4c9000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000cad0 con 0x7f4c98155a10 2024-09-13T18:45:19.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000f040 con 0x7f4c98155a10 2024-09-13T18:45:19.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c981496e0 con 0x7f4c98155a10 2024-09-13T18:45:19.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000ce70 con 0x7f4c98155a10 2024-09-13T18:45:19.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.481+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c981f74f0 con 0x7f4c98155a10 2024-09-13T18:45:19.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.485+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c980c2c90 con 0x7f4c98155a10 2024-09-13T18:45:19.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.485+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c90014480 con 0x7f4c98155a10 2024-09-13T18:45:19.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.485+0000 7f4c94c00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4c78066730 0x7f4c78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.485+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c90084c70 con 0x7f4c98155a10 2024-09-13T18:45:19.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.489+0000 7f4c9ca00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4c78066730 0x7f4c78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.489+0000 7f4c9ca00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4c78066730 0x7f4c78068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0090b0 tx=0x7f4c8c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.493+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c90051c70 con 0x7f4c98155a10 2024-09-13T18:45:19.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c980c6140 con 0x7f4c98155a10 2024-09-13T18:45:19.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c94c00700 1 -- 172.21.15.32:0/3477165407 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c90018020 con 0x7f4c98155a10 2024-09-13T18:45:19.679 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:19.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4c78066730 msgr2=0x7f4c78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4c78066730 0x7f4c78068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0090b0 tx=0x7f4c8c008030 comp rx=0 tx=0).stop 2024-09-13T18:45:19.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 msgr2=0x7f4c98148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 0x7f4c98148990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000efc0 tx=0x7f4c9000c0c0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 shutdown_connections 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4c78066730 0x7f4c78068bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.673+0000 7f4c9de00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c98155a10 0x7f4c98148990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.677+0000 7f4c9de00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4c9814fb50 0x7f4c98154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.677+0000 7f4c9de00700 1 --2- 172.21.15.32:0/3477165407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c980c6680 0x7f4c981f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.677+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 >> 172.21.15.32:0/3477165407 conn(0x7f4c9806f530 msgr2=0x7f4c98155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.677+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 shutdown_connections 2024-09-13T18:45:19.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.677+0000 7f4c9de00700 1 -- 172.21.15.32:0/3477165407 wait complete. 2024-09-13T18:45:19.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:19.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.881+0000 7fea83600700 1 Processor -- start 2024-09-13T18:45:19.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.881+0000 7fea83600700 1 -- start start 2024-09-13T18:45:19.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea83600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c071ca0 0x7fea7c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea83600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c0c8b40 con 0x7fea7c0c75c0 2024-09-13T18:45:19.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea83600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c0a9e90 con 0x7fea7c15a450 2024-09-13T18:45:19.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea83600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0c9330 con 0x7fea7c071ca0 2024-09-13T18:45:19.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea80c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c071ca0 0x7fea7c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea81600700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fea7c15a450 0x7fea7c0c7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45062/0 (socket says 172.21.15.32:45062) 2024-09-13T18:45:19.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea81600700 1 -- 172.21.15.32:0/959656831 learned_addr learned my addr 172.21.15.32:0/959656831 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:19.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea80c00700 1 -- 172.21.15.32:0/959656831 >> v1:172.21.15.86:6789/0 conn(0x7fea7c15a450 legacy=0x7fea7c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea80c00700 1 -- 172.21.15.32:0/959656831 >> v1:172.21.15.32:6789/0 conn(0x7fea7c0c75c0 legacy=0x7fea7c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea80c00700 1 -- 172.21.15.32:0/959656831 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c072790 con 0x7fea7c071ca0 2024-09-13T18:45:19.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea7b400700 1 -- 172.21.15.32:0/959656831 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725824265 0 0) 0x7fea7c0a9e90 con 0x7fea7c15a450 2024-09-13T18:45:19.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.885+0000 7fea80c00700 1 --2- 172.21.15.32:0/959656831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c071ca0 0x7fea7c0aa320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea70009880 tx=0x7fea70009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633c3811801ad798 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea7b400700 1 -- 172.21.15.32:0/959656831 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70011830 con 0x7fea7c071ca0 2024-09-13T18:45:19.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea7b400700 1 -- 172.21.15.32:0/959656831 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea70011990 con 0x7fea7c071ca0 2024-09-13T18:45:19.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea7b400700 1 -- 172.21.15.32:0/959656831 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70011d20 con 0x7fea7c071ca0 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 -- 172.21.15.32:0/959656831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c071ca0 msgr2=0x7fea7c0aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 --2- 172.21.15.32:0/959656831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c071ca0 0x7fea7c0aa320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea70009880 tx=0x7fea70009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 -- 172.21.15.32:0/959656831 shutdown_connections 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 --2- 172.21.15.32:0/959656831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c071ca0 0x7fea7c0aa320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 -- 172.21.15.32:0/959656831 >> 172.21.15.32:0/959656831 conn(0x7fea7c0cad40 msgr2=0x7fea7c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 -- 172.21.15.32:0/959656831 shutdown_connections 2024-09-13T18:45:19.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 -- 172.21.15.32:0/959656831 wait complete. 2024-09-13T18:45:19.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 Processor -- start 2024-09-13T18:45:19.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.889+0000 7fea83600700 1 -- start start 2024-09-13T18:45:19.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 0x7fea7c0c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c0c75c0 0x7fea7c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea7c15a450 0x7fea7c1f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c1eff70 con 0x7fea7c071ca0 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0c1a60 con 0x7fea7c15a450 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0c1d40 con 0x7fea7c0c75c0 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 0x7fea7c0c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea81600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea7c15a450 0x7fea7c1f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 0x7fea7c0c0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42962/0 (socket says 172.21.15.32:42962) 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 -- 172.21.15.32:0/3163692051 learned_addr learned my addr 172.21.15.32:0/3163692051 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:19.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea7be00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c0c75c0 0x7fea7c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 -- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c0c75c0 msgr2=0x7fea7c06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c0c75c0 0x7fea7c06e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 -- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea7c15a450 msgr2=0x7fea7c1f0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea7c15a450 0x7fea7c1f0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 -- 172.21.15.32:0/3163692051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea700094b0 con 0x7fea7c071ca0 2024-09-13T18:45:19.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea80c00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 0x7fea7c0c0770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea700097d0 tx=0x7fea70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7000bab0 con 0x7fea7c071ca0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7001f070 con 0x7fea7c071ca0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c0c2020 con 0x7fea7c071ca0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7000be30 con 0x7fea7c071ca0 2024-09-13T18:45:19.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.893+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c06e7f0 con 0x7fea7c071ca0 2024-09-13T18:45:19.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.897+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c0c5a70 con 0x7fea7c071ca0 2024-09-13T18:45:19.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.897+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea7001a430 con 0x7fea7c071ca0 2024-09-13T18:45:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.897+0000 7fea78c00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fea5c066730 0x7fea5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:19.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.897+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea70021070 con 0x7fea7c071ca0 2024-09-13T18:45:19.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.901+0000 7fea7be00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fea5c066730 0x7fea5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:19.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.901+0000 7fea7be00700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fea5c066730 0x7fea5c068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0c1850 tx=0x7fea68009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:19.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:19.905+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea70087e60 con 0x7fea7c071ca0 2024-09-13T18:45:20.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.093+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea7c0a9b20 con 0x7fea7c071ca0 2024-09-13T18:45:20.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.093+0000 7fea78c00700 1 -- 172.21.15.32:0/3163692051 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea7002a0a0 con 0x7fea7c071ca0 2024-09-13T18:45:20.102 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-09-13T18:45:20.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fea5c066730 msgr2=0x7fea5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fea5c066730 0x7fea5c068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0c1850 tx=0x7fea68009040 comp rx=0 tx=0).stop 2024-09-13T18:45:20.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 msgr2=0x7fea7c0c0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 0x7fea7c0c0770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fea700097d0 tx=0x7fea70004770 comp rx=0 tx=0).stop 2024-09-13T18:45:20.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 shutdown_connections 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fea5c066730 0x7fea5c068bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea7c15a450 0x7fea7c1f0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea7c0c75c0 0x7fea7c06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 --2- 172.21.15.32:0/3163692051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea7c071ca0 0x7fea7c0c0770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 >> 172.21.15.32:0/3163692051 conn(0x7fea7c0cad40 msgr2=0x7fea7c072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 shutdown_connections 2024-09-13T18:45:20.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.097+0000 7fea83600700 1 -- 172.21.15.32:0/3163692051 wait complete. 2024-09-13T18:45:20.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:20.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.301+0000 7f4de6c00700 1 Processor -- start 2024-09-13T18:45:20.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.301+0000 7f4de6c00700 1 -- start start 2024-09-13T18:45:20.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de6c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4de00c5730 0x7f4de015e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de6c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4de006a390 0x7f4de006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de6c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de00c7100 con 0x7f4de00c5350 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de6c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de015e790 con 0x7f4de00c5730 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de6c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de00c5f40 con 0x7f4de006a390 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de4e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4de00c5730 0x7f4de015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de6200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4de006a390 0x7f4de006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de5800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4de00c5350 0x7f4de006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33690/0 (socket says 172.21.15.32:33690) 2024-09-13T18:45:20.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.305+0000 7f4de5800700 1 -- 172.21.15.32:0/36034263 learned_addr learned my addr 172.21.15.32:0/36034263 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:20.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6200700 1 -- 172.21.15.32:0/36034263 >> v2:172.21.15.32:3300/0 conn(0x7f4de00c5730 msgr2=0x7f4de015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:20.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6200700 1 --2- 172.21.15.32:0/36034263 >> v2:172.21.15.32:3300/0 conn(0x7f4de00c5730 0x7f4de015e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6200700 1 -- 172.21.15.32:0/36034263 >> v1:172.21.15.32:6789/0 conn(0x7f4de00c5350 legacy=0x7f4de006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6200700 1 -- 172.21.15.32:0/36034263 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0157e70 con 0x7f4de006a390 2024-09-13T18:45:20.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6200700 1 --2- 172.21.15.32:0/36034263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de006a390 0x7f4de006a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4de0157d80 tx=0x7f4dd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814b6b7977ce4c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4ddfe00700 1 -- 172.21.15.32:0/36034263 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800e070 con 0x7f4de006a390 2024-09-13T18:45:20.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4ddfe00700 1 -- 172.21.15.32:0/36034263 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800bb20 con 0x7f4de006a390 2024-09-13T18:45:20.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4ddfe00700 1 -- 172.21.15.32:0/36034263 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8012430 con 0x7f4de006a390 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 -- 172.21.15.32:0/36034263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de006a390 msgr2=0x7f4de006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 --2- 172.21.15.32:0/36034263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de006a390 0x7f4de006a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4de0157d80 tx=0x7f4dd800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 -- 172.21.15.32:0/36034263 shutdown_connections 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 --2- 172.21.15.32:0/36034263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de006a390 0x7f4de006a7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 --2- 172.21.15.32:0/36034263 >> v2:172.21.15.32:3300/0 conn(0x7f4de00c5730 0x7f4de015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 -- 172.21.15.32:0/36034263 >> 172.21.15.32:0/36034263 conn(0x7f4de006f530 msgr2=0x7f4de006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 -- 172.21.15.32:0/36034263 shutdown_connections 2024-09-13T18:45:20.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.309+0000 7f4de6c00700 1 -- 172.21.15.32:0/36034263 wait complete. 2024-09-13T18:45:20.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 Processor -- start 2024-09-13T18:45:20.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 -- start start 2024-09-13T18:45:20.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4de006a390 0x7f4de014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 0x7f4de0158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de00c5730 0x7f4de0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de014bc90 con 0x7f4de00c5350 2024-09-13T18:45:20.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de015a270 con 0x7f4de00c5730 2024-09-13T18:45:20.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0158240 con 0x7f4de006a390 2024-09-13T18:45:20.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 0x7f4de0158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 0x7f4de0158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42974/0 (socket says 172.21.15.32:42974) 2024-09-13T18:45:20.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 -- 172.21.15.32:0/1395875784 learned_addr learned my addr 172.21.15.32:0/1395875784 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:20.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6200700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de00c5730 0x7f4de0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de5800700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4de006a390 0x7f4de014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 -- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4de006a390 msgr2=0x7f4de014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4de006a390 0x7f4de014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 -- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de00c5730 msgr2=0x7f4de0158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de00c5730 0x7f4de0158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 -- 172.21.15.32:0/1395875784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8009a70 con 0x7f4de00c5350 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de4e00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 0x7f4de0158740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00e840 tx=0x7f4dcc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0095a0 con 0x7f4de00c5350 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc013680 con 0x7f4de00c5350 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.313+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de015a4c0 con 0x7f4de00c5350 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.317+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0139f0 con 0x7f4de00c5350 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.317+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de015aa80 con 0x7f4de00c5350 2024-09-13T18:45:20.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.317+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de006e440 con 0x7f4de00c5350 2024-09-13T18:45:20.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.317+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4dcc013b50 con 0x7f4de00c5350 2024-09-13T18:45:20.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.321+0000 7f4ddd600700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4dc0066760 0x7f4dc0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.321+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4dcc0843d0 con 0x7f4de00c5350 2024-09-13T18:45:20.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.321+0000 7f4de5800700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4dc0066760 0x7f4dc0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.321+0000 7f4de5800700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4dc0066760 0x7f4dc0068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4005930 tx=0x7f4dd4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.325+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4dcc0513b0 con 0x7f4de00c5350 2024-09-13T18:45:20.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.509+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4de015aca0 con 0x7f4de00c5350 2024-09-13T18:45:20.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.509+0000 7f4ddd600700 1 -- 172.21.15.32:0/1395875784 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4dcc0549d0 con 0x7f4de00c5350 2024-09-13T18:45:20.517 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4dc0066760 msgr2=0x7f4dc0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4dc0066760 0x7f4dc0068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4005930 tx=0x7f4dd4009040 comp rx=0 tx=0).stop 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 msgr2=0x7f4de0158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 0x7f4de0158740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00e840 tx=0x7f4dcc00eb50 comp rx=0 tx=0).stop 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 shutdown_connections 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4dc0066760 0x7f4dc0068c20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4de00c5730 0x7f4de0158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4de00c5350 0x7f4de0158740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 --2- 172.21.15.32:0/1395875784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4de006a390 0x7f4de014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 >> 172.21.15.32:0/1395875784 conn(0x7f4de006f530 msgr2=0x7f4de006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 shutdown_connections 2024-09-13T18:45:20.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.513+0000 7f4de6c00700 1 -- 172.21.15.32:0/1395875784 wait complete. 2024-09-13T18:45:20.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:45:20.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 Processor -- start 2024-09-13T18:45:20.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 -- start start 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9490 0x7f0188161da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01880aa3d0 0x7f018815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01881622e0 con 0x7f01880a9ff0 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880c9cf0 con 0x7f01880aa3d0 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f018e600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880a9c20 con 0x7f01880a9490 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f0187e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01880aa3d0 0x7f018815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f0187e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01880aa3d0 0x7f018815d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42984/0 (socket says 172.21.15.32:42984) 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f0187e00700 1 -- 172.21.15.32:0/1463561993 learned_addr learned my addr 172.21.15.32:0/1463561993 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f0187400700 1 --1- 172.21.15.32:0/1463561993 >> v1:172.21.15.86:6789/0 conn(0x7f01880a9ff0 0x7f018815e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45076/0 (socket says 172.21.15.32:45076) 2024-09-13T18:45:20.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.709+0000 7f0186a00700 1 --2- 172.21.15.32:0/1463561993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9490 0x7f0188161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0187e00700 1 -- 172.21.15.32:0/1463561993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9490 msgr2=0x7f0188161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0187e00700 1 --2- 172.21.15.32:0/1463561993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9490 0x7f0188161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0187e00700 1 -- 172.21.15.32:0/1463561993 >> v1:172.21.15.86:6789/0 conn(0x7f01880a9ff0 legacy=0x7f018815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0187e00700 1 -- 172.21.15.32:0/1463561993 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880c92a0 con 0x7f01880aa3d0 2024-09-13T18:45:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0187e00700 1 --2- 172.21.15.32:0/1463561993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f018815d1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e50 tx=0x7f018000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d628e6a6d5f10ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0186000700 1 -- 172.21.15.32:0/1463561993 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000e070 con 0x7f01880aa3d0 2024-09-13T18:45:20.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0186000700 1 -- 172.21.15.32:0/1463561993 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018000b910 con 0x7f01880aa3d0 2024-09-13T18:45:20.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f0186000700 1 -- 172.21.15.32:0/1463561993 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000bcc0 con 0x7f01880aa3d0 2024-09-13T18:45:20.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 -- 172.21.15.32:0/1463561993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 msgr2=0x7f018815d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 --2- 172.21.15.32:0/1463561993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f018815d1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e50 tx=0x7f018000b330 comp rx=0 tx=0).stop 2024-09-13T18:45:20.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 -- 172.21.15.32:0/1463561993 shutdown_connections 2024-09-13T18:45:20.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 --2- 172.21.15.32:0/1463561993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f018815d1f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 --2- 172.21.15.32:0/1463561993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9490 0x7f0188161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 -- 172.21.15.32:0/1463561993 >> 172.21.15.32:0/1463561993 conn(0x7f01880cad40 msgr2=0x7f01880cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 -- 172.21.15.32:0/1463561993 shutdown_connections 2024-09-13T18:45:20.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.713+0000 7f018e600700 1 -- 172.21.15.32:0/1463561993 wait complete. 2024-09-13T18:45:20.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.717+0000 7f018e600700 1 Processor -- start 2024-09-13T18:45:20.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.717+0000 7f018e600700 1 -- start start 2024-09-13T18:45:20.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01880a9490 0x7f01881f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9ff0 0x7f0188126ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f01880aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01881f3f90 con 0x7f01880aa3d0 2024-09-13T18:45:20.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880afdb0 con 0x7f01880a9490 2024-09-13T18:45:20.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880af270 con 0x7f01880a9ff0 2024-09-13T18:45:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f01880aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01880a9490 0x7f01881f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f01880aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42992/0 (socket says 172.21.15.32:42992) 2024-09-13T18:45:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 -- 172.21.15.32:0/2141370656 learned_addr learned my addr 172.21.15.32:0/2141370656 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0186a00700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9ff0 0x7f0188126ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 -- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9ff0 msgr2=0x7f0188126ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9ff0 0x7f0188126ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 -- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01880a9490 msgr2=0x7f01881f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01880a9490 0x7f01881f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 -- 172.21.15.32:0/2141370656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180009b30 con 0x7f01880aa3d0 2024-09-13T18:45:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f0187e00700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f01880aafb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0180012000 tx=0x7f0180004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180004800 con 0x7f01880aa3d0 2024-09-13T18:45:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800092e0 con 0x7f01880aa3d0 2024-09-13T18:45:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01880af510 con 0x7f01880aa3d0 2024-09-13T18:45:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018001c660 con 0x7f01880aa3d0 2024-09-13T18:45:20.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.721+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01880afad0 con 0x7f01880aa3d0 2024-09-13T18:45:20.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.725+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01880ca880 con 0x7f01880aa3d0 2024-09-13T18:45:20.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.725+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f018001c7c0 con 0x7f01880aa3d0 2024-09-13T18:45:20.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.729+0000 7f017f400700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0168066760 0x7f0168068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:20.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.729+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0180085fe0 con 0x7f01880aa3d0 2024-09-13T18:45:20.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.729+0000 7f0187400700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0168066760 0x7f0168068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:20.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.729+0000 7f0187400700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0168066760 0x7f0168068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0178000f60 tx=0x7f0178007ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:20.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.733+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0180053030 con 0x7f01880aa3d0 2024-09-13T18:45:20.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.929+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f01880c1860 con 0x7f01880aa3d0 2024-09-13T18:45:20.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.929+0000 7f017f400700 1 -- 172.21.15.32:0/2141370656 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0180056650 con 0x7f01880aa3d0 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0168066760 msgr2=0x7f0168068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0168066760 0x7f0168068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0178000f60 tx=0x7f0178007ef0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 msgr2=0x7f01880aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f01880aafb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0180012000 tx=0x7f0180004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 shutdown_connections 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0168066760 0x7f0168068c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01880aa3d0 0x7f01880aafb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f01880a9ff0 0x7f0188126ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 --2- 172.21.15.32:0/2141370656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01880a9490 0x7f01881f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:20.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 >> 172.21.15.32:0/2141370656 conn(0x7f01880cad40 msgr2=0x7f018806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:20.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.933+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 shutdown_connections 2024-09-13T18:45:20.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:20.937+0000 7f018e600700 1 -- 172.21.15.32:0/2141370656 wait complete. 2024-09-13T18:45:20.944 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-09-13T18:45:20.964 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2024-09-13T18:45:20.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:20.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:45:21.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[31101]: fuse finished with error 0 and tester_r 0 2024-09-13T18:45:21.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:21.115 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:45:21.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:21.115 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T18:45:21.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 Processor -- start 2024-09-13T18:45:21.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 -- start start 2024-09-13T18:45:21.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80aa360 0x7f34a81545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f34a80c6590 0x7f34a8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a8070510 con 0x7f34a80c61b0 2024-09-13T18:45:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a80aa920 con 0x7f34a80c6590 2024-09-13T18:45:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ada00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8155020 con 0x7f34a80aa360 2024-09-13T18:45:21.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34a7e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f34a80c61b0 0x7f34a8071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33698/0 (socket says 172.21.15.32:33698) 2024-09-13T18:45:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34a7e00700 1 -- 172.21.15.32:0/1011632546 learned_addr learned my addr 172.21.15.32:0/1011632546 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ad000700 1 --2- 172.21.15.32:0/1011632546 >> v2:172.21.15.86:3300/0 conn(0x7f34a80c6590 0x7f34a8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f349f400700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80aa360 0x7f34a81545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34a7400700 1 -- 172.21.15.32:0/1011632546 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418767294 0 0) 0x7f34a8070510 con 0x7f34a80c61b0 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34a7400700 1 -- 172.21.15.32:0/1011632546 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348c0035d0 con 0x7f34a80c61b0 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ad000700 1 -- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80aa360 msgr2=0x7f34a81545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ad000700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80aa360 0x7f34a81545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ad000700 1 -- 172.21.15.32:0/1011632546 >> v1:172.21.15.32:6789/0 conn(0x7f34a80c61b0 legacy=0x7f34a8071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f34ad000700 1 -- 172.21.15.32:0/1011632546 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8157570 con 0x7f34a80c6590 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.685+0000 7f349f400700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80aa360 0x7f34a81545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:21.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ad000700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a8154ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009850 tx=0x7f34a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218ef07bd8615beb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34a7400700 1 -- 172.21.15.32:0/1011632546 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011830 con 0x7f34a80c6590 2024-09-13T18:45:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34a7400700 1 -- 172.21.15.32:0/1011632546 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011990 con 0x7f34a80c6590 2024-09-13T18:45:21.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34a7400700 1 -- 172.21.15.32:0/1011632546 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011d40 con 0x7f34a80c6590 2024-09-13T18:45:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 -- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 msgr2=0x7f34a8154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a8154ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009850 tx=0x7f34a0009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 -- 172.21.15.32:0/1011632546 shutdown_connections 2024-09-13T18:45:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a8154ae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 --2- 172.21.15.32:0/1011632546 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80aa360 0x7f34a81545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 -- 172.21.15.32:0/1011632546 >> 172.21.15.32:0/1011632546 conn(0x7f34a80cad40 msgr2=0x7f34a80cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 -- 172.21.15.32:0/1011632546 shutdown_connections 2024-09-13T18:45:21.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.689+0000 7f34ada00700 1 -- 172.21.15.32:0/1011632546 wait complete. 2024-09-13T18:45:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 Processor -- start 2024-09-13T18:45:21.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 -- start start 2024-09-13T18:45:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 0x7f34a81590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80c61b0 0x7f34a80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8159600 con 0x7f34a80aa360 2024-09-13T18:45:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81ed3e0 con 0x7f34a80c6590 2024-09-13T18:45:21.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ada00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c3190 con 0x7f34a80c61b0 2024-09-13T18:45:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34a7e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 0x7f34a81590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34a7e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 0x7f34a81590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42996/0 (socket says 172.21.15.32:42996) 2024-09-13T18:45:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34a7e00700 1 -- 172.21.15.32:0/2759167014 learned_addr learned my addr 172.21.15.32:0/2759167014 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f34ad000700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.693+0000 7f349f400700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80c61b0 0x7f34a80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a7e00700 1 -- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80c61b0 msgr2=0x7f34a80c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a7e00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80c61b0 0x7f34a80c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a7e00700 1 -- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 msgr2=0x7f34a814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a7e00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a7e00700 1 -- 172.21.15.32:0/2759167014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900094b0 con 0x7f34a80aa360 2024-09-13T18:45:21.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a7e00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 0x7f34a81590c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f349800cbc0 tx=0x7f349800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349800a770 con 0x7f34a80aa360 2024-09-13T18:45:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349800a8d0 con 0x7f34a80aa360 2024-09-13T18:45:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a00094b0 con 0x7f34a80aa360 2024-09-13T18:45:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349800ac60 con 0x7f34a80aa360 2024-09-13T18:45:21.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a80c3750 con 0x7f34a80aa360 2024-09-13T18:45:21.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.697+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a8158310 con 0x7f34a80aa360 2024-09-13T18:45:21.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.701+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f349801b3b0 con 0x7f34a80aa360 2024-09-13T18:45:21.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.701+0000 7f34a4c00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3484066760 0x7f3484068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:21.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.701+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3498083f40 con 0x7f34a80aa360 2024-09-13T18:45:21.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.701+0000 7f349f400700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3484066760 0x7f3484068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:21.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.701+0000 7f349f400700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3484066760 0x7f3484068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34a8154200 tx=0x7f3490009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:21.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.709+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3498050ea0 con 0x7f34a80aa360 2024-09-13T18:45:21.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.905+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34a80c8b40 con 0x7f34a80aa360 2024-09-13T18:45:21.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.909+0000 7f34a4c00700 1 -- 172.21.15.32:0/2759167014 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f34980544c0 con 0x7f34a80aa360 2024-09-13T18:45:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:21.917 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3484066760 msgr2=0x7f3484068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3484066760 0x7f3484068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34a8154200 tx=0x7f3490009240 comp rx=0 tx=0).stop 2024-09-13T18:45:21.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 msgr2=0x7f34a81590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 0x7f34a81590c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f349800cbc0 tx=0x7f349800cbf0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 shutdown_connections 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3484066760 0x7f3484068c20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34a80c6590 0x7f34a814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34a80c61b0 0x7f34a80c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 --2- 172.21.15.32:0/2759167014 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34a80aa360 0x7f34a81590c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 >> 172.21.15.32:0/2759167014 conn(0x7f34a80cad40 msgr2=0x7f34a8156630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 shutdown_connections 2024-09-13T18:45:21.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:21.913+0000 7f34ada00700 1 -- 172.21.15.32:0/2759167014 wait complete. 2024-09-13T18:45:21.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:22.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.117+0000 7f6ed9400700 1 Processor -- start 2024-09-13T18:45:22.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.117+0000 7f6ed9400700 1 -- start start 2024-09-13T18:45:22.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed9400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6ed40aa360 0x7f6ed41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed9400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6ed40c6590 0x7f6ed4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed9400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed4070510 con 0x7f6ed40c61b0 2024-09-13T18:45:22.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed9400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed40aa920 con 0x7f6ed40aa360 2024-09-13T18:45:22.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed9400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed4155020 con 0x7f6ed40c6590 2024-09-13T18:45:22.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6ed40c61b0 0x7f6ed4071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33710/0 (socket says 172.21.15.32:33710) 2024-09-13T18:45:22.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3e00700 1 -- 172.21.15.32:0/3347250568 learned_addr learned my addr 172.21.15.32:0/3347250568 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:22.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ecb400700 1 --2- 172.21.15.32:0/3347250568 >> v2:172.21.15.32:3300/0 conn(0x7f6ed40aa360 0x7f6ed41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed8a00700 1 --2- 172.21.15.32:0/3347250568 >> v2:172.21.15.86:3300/0 conn(0x7f6ed40c6590 0x7f6ed4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3400700 1 -- 172.21.15.32:0/3347250568 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408470865 0 0) 0x7f6ed4070510 con 0x7f6ed40c61b0 2024-09-13T18:45:22.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3400700 1 -- 172.21.15.32:0/3347250568 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb80035d0 con 0x7f6ed40c61b0 2024-09-13T18:45:22.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed8a00700 1 -- 172.21.15.32:0/3347250568 >> v2:172.21.15.32:3300/0 conn(0x7f6ed40aa360 msgr2=0x7f6ed41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:22.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed8a00700 1 --2- 172.21.15.32:0/3347250568 >> v2:172.21.15.32:3300/0 conn(0x7f6ed40aa360 0x7f6ed41545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed8a00700 1 -- 172.21.15.32:0/3347250568 >> v1:172.21.15.32:6789/0 conn(0x7f6ed40c61b0 legacy=0x7f6ed4071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed8a00700 1 -- 172.21.15.32:0/3347250568 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4157570 con 0x7f6ed40c6590 2024-09-13T18:45:22.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ecb400700 1 --2- 172.21.15.32:0/3347250568 >> v2:172.21.15.32:3300/0 conn(0x7f6ed40aa360 0x7f6ed41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:22.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed8a00700 1 --2- 172.21.15.32:0/3347250568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed4154ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40b1290 tx=0x7f6ecc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1066c97656ce323b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3400700 1 -- 172.21.15.32:0/3347250568 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc011830 con 0x7f6ed40c6590 2024-09-13T18:45:22.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3400700 1 -- 172.21.15.32:0/3347250568 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc011990 con 0x7f6ed40c6590 2024-09-13T18:45:22.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.121+0000 7f6ed3400700 1 -- 172.21.15.32:0/3347250568 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc011d00 con 0x7f6ed40c6590 2024-09-13T18:45:22.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 -- 172.21.15.32:0/3347250568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 msgr2=0x7f6ed4154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 --2- 172.21.15.32:0/3347250568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed4154ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40b1290 tx=0x7f6ecc009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:22.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 -- 172.21.15.32:0/3347250568 shutdown_connections 2024-09-13T18:45:22.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 --2- 172.21.15.32:0/3347250568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed4154ae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 --2- 172.21.15.32:0/3347250568 >> v2:172.21.15.32:3300/0 conn(0x7f6ed40aa360 0x7f6ed41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 -- 172.21.15.32:0/3347250568 >> 172.21.15.32:0/3347250568 conn(0x7f6ed40cad40 msgr2=0x7f6ed40cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:22.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 -- 172.21.15.32:0/3347250568 shutdown_connections 2024-09-13T18:45:22.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 -- 172.21.15.32:0/3347250568 wait complete. 2024-09-13T18:45:22.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 Processor -- start 2024-09-13T18:45:22.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.125+0000 7f6ed9400700 1 -- start start 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ed40aa360 0x7f6ed40c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ed40c61b0 0x7f6ed41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed406cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40c2c00 con 0x7f6ed40aa360 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41494f0 con 0x7f6ed40c6590 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed40c2f40 con 0x7f6ed40c61b0 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ed40aa360 0x7f6ed40c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed8a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed406cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ecb400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ed40c61b0 0x7f6ed41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed8a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed406cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49436/0 (socket says 172.21.15.32:49436) 2024-09-13T18:45:22.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed8a00700 1 -- 172.21.15.32:0/1790752501 learned_addr learned my addr 172.21.15.32:0/1790752501 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:22.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 -- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ed40c61b0 msgr2=0x7f6ed41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ed40c61b0 0x7f6ed41512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 -- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 msgr2=0x7f6ed406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed406cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 -- 172.21.15.32:0/1790752501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc009a70 con 0x7f6ed40aa360 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed8a00700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed406cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed3e00700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ed40aa360 0x7f6ed40c26c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c4d0 tx=0x7f6ec400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4005d90 con 0x7f6ed40aa360 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400ce80 con 0x7f6ed40aa360 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0094b0 con 0x7f6ed40aa360 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40072f0 con 0x7f6ed40aa360 2024-09-13T18:45:22.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.129+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed414a800 con 0x7f6ed40aa360 2024-09-13T18:45:22.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.133+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed4158310 con 0x7f6ed40aa360 2024-09-13T18:45:22.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.133+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ec4007450 con 0x7f6ed40aa360 2024-09-13T18:45:22.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.137+0000 7f6ed0c00700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6eb0066730 0x7f6eb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.137+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ec40837e0 con 0x7f6ed40aa360 2024-09-13T18:45:22.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.137+0000 7f6ecb400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6eb0066730 0x7f6eb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.137+0000 7f6ecb400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6eb0066730 0x7f6eb0068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009fd0 tx=0x7f6ebc00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.141+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ec40507c0 con 0x7f6ed40aa360 2024-09-13T18:45:22.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.337+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ed40c8b40 con 0x7f6ed40aa360 2024-09-13T18:45:22.344 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.337+0000 7f6ed0c00700 1 -- 172.21.15.32:0/1790752501 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f6ec4017090 con 0x7f6ed40aa360 2024-09-13T18:45:22.345 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:22.345 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6eb0066730 msgr2=0x7f6eb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6eb0066730 0x7f6eb0068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009fd0 tx=0x7f6ebc00b040 comp rx=0 tx=0).stop 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ed40aa360 msgr2=0x7f6ed40c26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ed40aa360 0x7f6ed40c26c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c4d0 tx=0x7f6ec400c7e0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 shutdown_connections 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6eb0066730 0x7f6eb0068bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ed40c6590 0x7f6ed406cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ed40c61b0 0x7f6ed41512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 --2- 172.21.15.32:0/1790752501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ed40aa360 0x7f6ed40c26c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 >> 172.21.15.32:0/1790752501 conn(0x7f6ed40cad40 msgr2=0x7f6ed4071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 shutdown_connections 2024-09-13T18:45:22.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.341+0000 7f6ed9400700 1 -- 172.21.15.32:0/1790752501 wait complete. 2024-09-13T18:45:22.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:45:22.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.549+0000 7f44e0c00700 1 Processor -- start 2024-09-13T18:45:22.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44e0c00700 1 -- start start 2024-09-13T18:45:22.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44e0c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44dc156f50 0x7f44dc06f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44e0c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f44dc06fa70 0x7f44dc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44e0c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44dc06e940 con 0x7f44dc0b0db0 2024-09-13T18:45:22.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44e0c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44dc06ee70 con 0x7f44dc06fa70 2024-09-13T18:45:22.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44e0c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44dc0c78a0 con 0x7f44dc156f50 2024-09-13T18:45:22.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.553+0000 7f44d9e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f44dc156f50 0x7f44dc06f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44da800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f44dc0b0db0 0x7f44dc073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45088/0 (socket says 172.21.15.32:45088) 2024-09-13T18:45:22.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44da800700 1 -- 172.21.15.32:0/3048812033 learned_addr learned my addr 172.21.15.32:0/3048812033 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:22.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9400700 1 --2- 172.21.15.32:0/3048812033 >> v2:172.21.15.32:3300/0 conn(0x7f44dc06fa70 0x7f44dc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9e00700 1 -- 172.21.15.32:0/3048812033 >> v2:172.21.15.32:3300/0 conn(0x7f44dc06fa70 msgr2=0x7f44dc0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:22.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9e00700 1 --2- 172.21.15.32:0/3048812033 >> v2:172.21.15.32:3300/0 conn(0x7f44dc06fa70 0x7f44dc0706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9e00700 1 -- 172.21.15.32:0/3048812033 >> v1:172.21.15.86:6789/0 conn(0x7f44dc0b0db0 legacy=0x7f44dc073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d8a00700 1 -- 172.21.15.32:0/3048812033 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093642939 0 0) 0x7f44dc06e940 con 0x7f44dc0b0db0 2024-09-13T18:45:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9e00700 1 -- 172.21.15.32:0/3048812033 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc0c6ce0 con 0x7f44dc156f50 2024-09-13T18:45:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9400700 1 --2- 172.21.15.32:0/3048812033 >> v2:172.21.15.32:3300/0 conn(0x7f44dc06fa70 0x7f44dc0706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d9e00700 1 --2- 172.21.15.32:0/3048812033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc156f50 0x7f44dc06f530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0c9bd0 tx=0x7f44cc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9534864e01eb2123 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d8a00700 1 -- 172.21.15.32:0/3048812033 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011830 con 0x7f44dc156f50 2024-09-13T18:45:22.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d8a00700 1 -- 172.21.15.32:0/3048812033 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc011990 con 0x7f44dc156f50 2024-09-13T18:45:22.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44d8a00700 1 -- 172.21.15.32:0/3048812033 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011d40 con 0x7f44dc156f50 2024-09-13T18:45:22.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 -- 172.21.15.32:0/3048812033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc156f50 msgr2=0x7f44dc06f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 --2- 172.21.15.32:0/3048812033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc156f50 0x7f44dc06f530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0c9bd0 tx=0x7f44cc009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:22.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 -- 172.21.15.32:0/3048812033 shutdown_connections 2024-09-13T18:45:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 --2- 172.21.15.32:0/3048812033 >> v2:172.21.15.32:3300/0 conn(0x7f44dc06fa70 0x7f44dc0706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 --2- 172.21.15.32:0/3048812033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc156f50 0x7f44dc06f530 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 -- 172.21.15.32:0/3048812033 >> 172.21.15.32:0/3048812033 conn(0x7f44dc06b1f0 msgr2=0x7f44dc06b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 -- 172.21.15.32:0/3048812033 shutdown_connections 2024-09-13T18:45:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.557+0000 7f44e0c00700 1 -- 172.21.15.32:0/3048812033 wait complete. 2024-09-13T18:45:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 Processor -- start 2024-09-13T18:45:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 -- start start 2024-09-13T18:45:22.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 0x7f44dc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44dc0b0db0 0x7f44dc158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44dc156f50 0x7f44dc15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc14e6e0 con 0x7f44dc0b0db0 2024-09-13T18:45:22.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc15d550 con 0x7f44dc06fa70 2024-09-13T18:45:22.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44e0c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc157550 con 0x7f44dc156f50 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44dc0b0db0 0x7f44dc158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 0x7f44dc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 0x7f44dc1582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49456/0 (socket says 172.21.15.32:49456) 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 -- 172.21.15.32:0/4189753599 learned_addr learned my addr 172.21.15.32:0/4189753599 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44da800700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44dc156f50 0x7f44dc15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 -- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44dc156f50 msgr2=0x7f44dc15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44dc156f50 0x7f44dc15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 -- 172.21.15.32:0/4189753599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44dc0b0db0 msgr2=0x7f44dc158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:22.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44dc0b0db0 0x7f44dc158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:22.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.561+0000 7f44d9e00700 1 -- 172.21.15.32:0/4189753599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0094b0 con 0x7f44dc06fa70 2024-09-13T18:45:22.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44d9e00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 0x7f44dc1582e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0090b0 tx=0x7f44cc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc019980 con 0x7f44dc06fa70 2024-09-13T18:45:22.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc01e070 con 0x7f44dc06fa70 2024-09-13T18:45:22.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc019d40 con 0x7f44dc06fa70 2024-09-13T18:45:22.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc157d60 con 0x7f44dc06fa70 2024-09-13T18:45:22.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc157a80 con 0x7f44dc06fa70 2024-09-13T18:45:22.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.565+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc06e060 con 0x7f44dc06fa70 2024-09-13T18:45:22.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.569+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44cc01a420 con 0x7f44dc06fa70 2024-09-13T18:45:22.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.569+0000 7f44d2000700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f44bc066730 0x7f44bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:22.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.569+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44cc085d90 con 0x7f44dc06fa70 2024-09-13T18:45:22.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.569+0000 7f44d9400700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f44bc066730 0x7f44bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:22.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.569+0000 7f44d9400700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f44bc066730 0x7f44bc068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0b0c80 tx=0x7f44c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:22.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.577+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44cc052e80 con 0x7f44dc06fa70 2024-09-13T18:45:22.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:22.801+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f44dc06e720 con 0x7f44dc06fa70 2024-09-13T18:45:23.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:23.108 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:23.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.489+0000 7f44d2000700 1 -- 172.21.15.32:0/4189753599 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f44cc015020 con 0x7f44dc06fa70 2024-09-13T18:45:23.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f44bc066730 msgr2=0x7f44bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f44bc066730 0x7f44bc068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0b0c80 tx=0x7f44c8008040 comp rx=0 tx=0).stop 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 msgr2=0x7f44dc1582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 0x7f44dc1582e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0090b0 tx=0x7f44cc004770 comp rx=0 tx=0).stop 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 shutdown_connections 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f44bc066730 0x7f44bc068bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f44dc156f50 0x7f44dc15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f44dc0b0db0 0x7f44dc158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 --2- 172.21.15.32:0/4189753599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44dc06fa70 0x7f44dc1582e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 >> 172.21.15.32:0/4189753599 conn(0x7f44dc06b1f0 msgr2=0x7f44dc0c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 shutdown_connections 2024-09-13T18:45:23.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.493+0000 7f44e0c00700 1 -- 172.21.15.32:0/4189753599 wait complete. 2024-09-13T18:45:23.522 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-09-13T18:45:23.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:45:23.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.693+0000 7fac99e00700 1 Processor -- start 2024-09-13T18:45:23.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.693+0000 7fac99e00700 1 -- start start 2024-09-13T18:45:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac99e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac94151680 0x7fac9406b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac99e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9415aa50 con 0x7fac94151a60 2024-09-13T18:45:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac99e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9415aca0 con 0x7fac940cd640 2024-09-13T18:45:23.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac99e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9415af80 con 0x7fac94151680 2024-09-13T18:45:23.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac93e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fac94151a60 0x7fac940ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:33712/0 (socket says 172.21.15.32:33712) 2024-09-13T18:45:23.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac93e00700 1 -- 172.21.15.32:0/850949338 learned_addr learned my addr 172.21.15.32:0/850949338 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:23.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac99400700 1 --1- 172.21.15.32:0/850949338 >> v1:172.21.15.86:6789/0 conn(0x7fac940cd640 0x7fac94157a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45098/0 (socket says 172.21.15.32:45098) 2024-09-13T18:45:23.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac98a00700 1 --2- 172.21.15.32:0/850949338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac94151680 0x7fac9406b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175868097 0 0) 0x7fac9415aa50 con 0x7fac94151a60 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac7c0035d0 con 0x7fac94151a60 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427187405 0 0) 0x7fac9415aca0 con 0x7fac940cd640 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9415aa50 con 0x7fac940cd640 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac98a00700 1 -- 172.21.15.32:0/850949338 >> v1:172.21.15.86:6789/0 conn(0x7fac940cd640 legacy=0x7fac94157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac98a00700 1 -- 172.21.15.32:0/850949338 >> v1:172.21.15.32:6789/0 conn(0x7fac94151a60 legacy=0x7fac940ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac98a00700 1 -- 172.21.15.32:0/850949338 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9415b260 con 0x7fac94151680 2024-09-13T18:45:23.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.697+0000 7fac98a00700 1 --2- 172.21.15.32:0/850949338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac94151680 0x7fac9406b260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac88009880 tx=0x7fac88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d32842d6a3f35e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:23.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88011830 con 0x7fac94151680 2024-09-13T18:45:23.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88011990 con 0x7fac94151680 2024-09-13T18:45:23.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac93400700 1 -- 172.21.15.32:0/850949338 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88011d20 con 0x7fac94151680 2024-09-13T18:45:23.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 -- 172.21.15.32:0/850949338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac94151680 msgr2=0x7fac9406b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 --2- 172.21.15.32:0/850949338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac94151680 0x7fac9406b260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac88009880 tx=0x7fac88009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:23.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 -- 172.21.15.32:0/850949338 shutdown_connections 2024-09-13T18:45:23.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 --2- 172.21.15.32:0/850949338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac94151680 0x7fac9406b260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 -- 172.21.15.32:0/850949338 >> 172.21.15.32:0/850949338 conn(0x7fac94071740 msgr2=0x7fac94071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:23.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 -- 172.21.15.32:0/850949338 shutdown_connections 2024-09-13T18:45:23.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.701+0000 7fac99e00700 1 -- 172.21.15.32:0/850949338 wait complete. 2024-09-13T18:45:23.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 Processor -- start 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 -- start start 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac940cd640 0x7fac941564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94151680 0x7fac94159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac9414a5d0 0x7fac94159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94158d10 con 0x7fac9414a5d0 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac941ef920 con 0x7fac94151680 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac941efc00 con 0x7fac940cd640 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac93e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94151680 0x7fac94159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac98a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac940cd640 0x7fac941564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac93e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94151680 0x7fac94159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49468/0 (socket says 172.21.15.32:49468) 2024-09-13T18:45:23.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac93e00700 1 -- 172.21.15.32:0/1972334372 learned_addr learned my addr 172.21.15.32:0/1972334372 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac99400700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac9414a5d0 0x7fac94159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac98a00700 1 -- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94151680 msgr2=0x7fac94159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.705+0000 7fac98a00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94151680 0x7fac94159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac98a00700 1 -- 172.21.15.32:0/1972334372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac9414a5d0 msgr2=0x7fac94159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac98a00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac9414a5d0 0x7fac94159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac98a00700 1 -- 172.21.15.32:0/1972334372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880094b0 con 0x7fac940cd640 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac99400700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac9414a5d0 0x7fac94159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:23.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac98a00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac940cd640 0x7fac941564d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac88015000 tx=0x7fac88004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:23.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8801a8c0 con 0x7fac940cd640 2024-09-13T18:45:23.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8801e070 con 0x7fac940cd640 2024-09-13T18:45:23.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac94158f60 con 0x7fac940cd640 2024-09-13T18:45:23.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8801ac80 con 0x7fac940cd640 2024-09-13T18:45:23.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac94159520 con 0x7fac940cd640 2024-09-13T18:45:23.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.709+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac94159710 con 0x7fac940cd640 2024-09-13T18:45:23.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.713+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac8802d450 con 0x7fac940cd640 2024-09-13T18:45:23.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.713+0000 7fac90c00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fac74066730 0x7fac74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:23.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.713+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac88085310 con 0x7fac940cd640 2024-09-13T18:45:23.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.713+0000 7fac93e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fac74066730 0x7fac74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:23.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.717+0000 7fac93e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fac74066730 0x7fac74068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac940c31e0 tx=0x7fac80007e60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:23.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.721+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac880522f0 con 0x7fac940cd640 2024-09-13T18:45:23.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:23.941+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fac940ccf30 con 0x7fac940cd640 2024-09-13T18:45:24.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.505+0000 7fac90c00700 1 -- 172.21.15.32:0/1972334372 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac88055910 con 0x7fac940cd640 2024-09-13T18:45:24.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fac74066730 msgr2=0x7fac74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:24.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fac74066730 0x7fac74068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac940c31e0 tx=0x7fac80007e60 comp rx=0 tx=0).stop 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac940cd640 msgr2=0x7fac941564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac940cd640 0x7fac941564d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac88015000 tx=0x7fac88004770 comp rx=0 tx=0).stop 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 shutdown_connections 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fac74066730 0x7fac74068bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac9414a5d0 0x7fac94159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94151680 0x7fac94159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 --2- 172.21.15.32:0/1972334372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac940cd640 0x7fac941564d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 >> 172.21.15.32:0/1972334372 conn(0x7fac94071740 msgr2=0x7fac9414f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 shutdown_connections 2024-09-13T18:45:24.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.509+0000 7fac99e00700 1 -- 172.21.15.32:0/1972334372 wait complete. 2024-09-13T18:45:24.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T18:45:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.721+0000 7f1652c00700 1 Processor -- start 2024-09-13T18:45:24.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.721+0000 7f1652c00700 1 -- start start 2024-09-13T18:45:24.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c06b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f164c151a60 0x7f164c06b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f164c0ccf30 0x7f164c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c15aa50 con 0x7f164c151a60 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0cd8c0 con 0x7f164c0ccf30 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c15aca0 con 0x7f164c151680 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f164c151a60 0x7f164c06b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1652200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f164c0ccf30 0x7f164c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f164c151a60 0x7f164c06b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43062/0 (socket says 172.21.15.32:43062) 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1651800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c06b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 -- 172.21.15.32:0/411585297 learned_addr learned my addr 172.21.15.32:0/411585297 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:24.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 -- 172.21.15.32:0/411585297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 msgr2=0x7f164c06b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 --2- 172.21.15.32:0/411585297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c06b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 -- 172.21.15.32:0/411585297 >> v2:172.21.15.86:3300/0 conn(0x7f164c0ccf30 msgr2=0x7f164c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 --2- 172.21.15.32:0/411585297 >> v2:172.21.15.86:3300/0 conn(0x7f164c0ccf30 0x7f164c0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 -- 172.21.15.32:0/411585297 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c15af80 con 0x7f164c151a60 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f1650e00700 1 --2- 172.21.15.32:0/411585297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c151a60 0x7f164c06b7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f164c066cf0 tx=0x7f1638009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d19f19b1030919 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f164be00700 1 -- 172.21.15.32:0/411585297 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638011830 con 0x7f164c151a60 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f164be00700 1 -- 172.21.15.32:0/411585297 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638011990 con 0x7f164c151a60 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.725+0000 7f164be00700 1 -- 172.21.15.32:0/411585297 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638011d20 con 0x7f164c151a60 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 -- 172.21.15.32:0/411585297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c151a60 msgr2=0x7f164c06b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 --2- 172.21.15.32:0/411585297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c151a60 0x7f164c06b7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f164c066cf0 tx=0x7f1638009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 -- 172.21.15.32:0/411585297 shutdown_connections 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 --2- 172.21.15.32:0/411585297 >> v2:172.21.15.86:3300/0 conn(0x7f164c0ccf30 0x7f164c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 --2- 172.21.15.32:0/411585297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c151a60 0x7f164c06b7a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 --2- 172.21.15.32:0/411585297 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c06b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 -- 172.21.15.32:0/411585297 >> 172.21.15.32:0/411585297 conn(0x7f164c071740 msgr2=0x7f164c071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 -- 172.21.15.32:0/411585297 shutdown_connections 2024-09-13T18:45:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 -- 172.21.15.32:0/411585297 wait complete. 2024-09-13T18:45:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 Processor -- start 2024-09-13T18:45:24.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.729+0000 7f1652c00700 1 -- start start 2024-09-13T18:45:24.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 0x7f164c0c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c154af0 0x7f164c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1efb20 con 0x7f164c0ccf30 2024-09-13T18:45:24.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1526e0 con 0x7f164c154af0 2024-09-13T18:45:24.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1ef580 con 0x7f164c151680 2024-09-13T18:45:24.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 0x7f164c0c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 0x7f164c0c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43074/0 (socket says 172.21.15.32:43074) 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 -- 172.21.15.32:0/2469553688 learned_addr learned my addr 172.21.15.32:0/2469553688 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1650e00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652200700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c154af0 0x7f164c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 -- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 msgr2=0x7f164c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 -- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c154af0 msgr2=0x7f164c1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c154af0 0x7f164c1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 -- 172.21.15.32:0/2469553688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009570 con 0x7f164c0ccf30 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1650e00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652200700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c154af0 0x7f164c1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1651800700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 0x7f164c0c83f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f164000e9d0 tx=0x7f164000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:24.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640009720 con 0x7f164c0ccf30 2024-09-13T18:45:24.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000c850 con 0x7f164c0ccf30 2024-09-13T18:45:24.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c1ef840 con 0x7f164c0ccf30 2024-09-13T18:45:24.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000cbc0 con 0x7f164c0ccf30 2024-09-13T18:45:24.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.733+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c0b1550 con 0x7f164c0ccf30 2024-09-13T18:45:24.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.737+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c1524d0 con 0x7f164c0ccf30 2024-09-13T18:45:24.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.737+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f164000cd20 con 0x7f164c0ccf30 2024-09-13T18:45:24.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.737+0000 7f1649600700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f162c066760 0x7f162c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:24.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.737+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1640084630 con 0x7f164c0ccf30 2024-09-13T18:45:24.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.737+0000 7f1650e00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f162c066760 0x7f162c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:24.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.741+0000 7f1650e00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f162c066760 0x7f162c068c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f164c0cdc30 tx=0x7f1638008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:24.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.741+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1640051580 con 0x7f164c0ccf30 2024-09-13T18:45:24.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:24.965+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f164c0b1740 con 0x7f164c0ccf30 2024-09-13T18:45:25.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.505+0000 7f1649600700 1 -- 172.21.15.32:0/2469553688 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1640054ba0 con 0x7f164c0ccf30 2024-09-13T18:45:25.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f162c066760 msgr2=0x7f162c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f162c066760 0x7f162c068c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f164c0cdc30 tx=0x7f1638008030 comp rx=0 tx=0).stop 2024-09-13T18:45:25.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 msgr2=0x7f164c0c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 0x7f164c0c83f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f164000e9d0 tx=0x7f164000ed90 comp rx=0 tx=0).stop 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 shutdown_connections 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f162c066760 0x7f162c068c20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c154af0 0x7f164c1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f164c151680 0x7f164c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 --2- 172.21.15.32:0/2469553688 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f164c0ccf30 0x7f164c0c83f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 >> 172.21.15.32:0/2469553688 conn(0x7f164c071740 msgr2=0x7f164c0cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 shutdown_connections 2024-09-13T18:45:25.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.513+0000 7f1652c00700 1 -- 172.21.15.32:0/2469553688 wait complete. 2024-09-13T18:45:25.548 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:45:25.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:25.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.721+0000 7f3feb000700 1 Processor -- start 2024-09-13T18:45:25.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.721+0000 7f3feb000700 1 -- start start 2024-09-13T18:45:25.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3feb000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe40ca610 0x7f3fe40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3feb000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40caa60 con 0x7f3fe4151760 2024-09-13T18:45:25.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3feb000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe4157c70 con 0x7f3fe4151b40 2024-09-13T18:45:25.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3feb000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415b340 con 0x7f3fe40ca610 2024-09-13T18:45:25.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3fe3400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3fe4151b40 0x7f3fe4071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45102/0 (socket says 172.21.15.32:45102) 2024-09-13T18:45:25.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3fe3400700 1 -- 172.21.15.32:0/1249976806 learned_addr learned my addr 172.21.15.32:0/1249976806 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:25.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.725+0000 7f3fe9000700 1 --2- 172.21.15.32:0/1249976806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe40ca610 0x7f3fe40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231125843 0 0) 0x7f3fe4157c70 con 0x7f3fe4151b40 2024-09-13T18:45:25.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc80035d0 con 0x7f3fe4151b40 2024-09-13T18:45:25.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862536825 0 0) 0x7f3fe40caa60 con 0x7f3fe4151760 2024-09-13T18:45:25.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe4157c70 con 0x7f3fe4151760 2024-09-13T18:45:25.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe9000700 1 -- 172.21.15.32:0/1249976806 >> v1:172.21.15.86:6789/0 conn(0x7f3fe4151b40 legacy=0x7f3fe4071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe9000700 1 -- 172.21.15.32:0/1249976806 >> v1:172.21.15.32:6789/0 conn(0x7f3fe4151760 legacy=0x7f3fe415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe9000700 1 -- 172.21.15.32:0/1249976806 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe415b620 con 0x7f3fe40ca610 2024-09-13T18:45:25.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe9000700 1 --2- 172.21.15.32:0/1249976806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe40ca610 0x7f3fe40c8cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009dc0 tx=0x7f3fdc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b923d0d2da0949 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:25.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00e070 con 0x7f3fe40ca610 2024-09-13T18:45:25.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00bb20 con 0x7f3fe40ca610 2024-09-13T18:45:25.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3fe2a00700 1 -- 172.21.15.32:0/1249976806 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc012430 con 0x7f3fe40ca610 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 -- 172.21.15.32:0/1249976806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe40ca610 msgr2=0x7f3fe40c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 --2- 172.21.15.32:0/1249976806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe40ca610 0x7f3fe40c8cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009dc0 tx=0x7f3fdc00b330 comp rx=0 tx=0).stop 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 -- 172.21.15.32:0/1249976806 shutdown_connections 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 --2- 172.21.15.32:0/1249976806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe40ca610 0x7f3fe40c8cd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 -- 172.21.15.32:0/1249976806 >> 172.21.15.32:0/1249976806 conn(0x7f3fe406a740 msgr2=0x7f3fe406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 -- 172.21.15.32:0/1249976806 shutdown_connections 2024-09-13T18:45:25.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.729+0000 7f3feb000700 1 -- 172.21.15.32:0/1249976806 wait complete. 2024-09-13T18:45:25.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 Processor -- start 2024-09-13T18:45:25.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 -- start start 2024-09-13T18:45:25.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe40ca610 0x7f3fe40c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fe4151760 0x7f3fe4154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4151b40 0x7f3fe4154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41539e0 con 0x7f3fe4151760 2024-09-13T18:45:25.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4153c80 con 0x7f3fe40ca610 2024-09-13T18:45:25.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3feb000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c5610 con 0x7f3fe4151b40 2024-09-13T18:45:25.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3fe3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe40ca610 0x7f3fe40c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3fe3400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fe4151760 0x7f3fe4154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3fe9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4151b40 0x7f3fe4154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3fe3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe40ca610 0x7f3fe40c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49506/0 (socket says 172.21.15.32:49506) 2024-09-13T18:45:25.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.733+0000 7f3fe3e00700 1 -- 172.21.15.32:0/1552067826 learned_addr learned my addr 172.21.15.32:0/1552067826 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:25.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe9000700 1 -- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe40ca610 msgr2=0x7f3fe40c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe9000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe40ca610 0x7f3fe40c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe9000700 1 -- 172.21.15.32:0/1552067826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fe4151760 msgr2=0x7f3fe4154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:25.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe9000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fe4151760 0x7f3fe4154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:25.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe9000700 1 -- 172.21.15.32:0/1552067826 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009a70 con 0x7f3fe4151b40 2024-09-13T18:45:25.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe3400700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fe4151760 0x7f3fe4154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:25.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fe9000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4151b40 0x7f3fe4154650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc016000 tx=0x7f3fdc004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:25.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc012430 con 0x7f3fe4151b40 2024-09-13T18:45:25.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc020070 con 0x7f3fe4151b40 2024-09-13T18:45:25.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40c6d70 con 0x7f3fe4151b40 2024-09-13T18:45:25.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc01ba90 con 0x7f3fe4151b40 2024-09-13T18:45:25.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe40c7330 con 0x7f3fe4151b40 2024-09-13T18:45:25.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.737+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe40ade40 con 0x7f3fe4151b40 2024-09-13T18:45:25.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.741+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3fdc01bbf0 con 0x7f3fe4151b40 2024-09-13T18:45:25.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.741+0000 7f3fdbe00700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3fc4066730 0x7f3fc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:25.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.741+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fdc022070 con 0x7f3fe4151b40 2024-09-13T18:45:25.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.741+0000 7f3fe3e00700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3fc4066730 0x7f3fc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:25.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.745+0000 7f3fe3e00700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3fc4066730 0x7f3fc4068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40011e0 tx=0x7f3fd4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.753+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3fdc053b70 con 0x7f3fe4151b40 2024-09-13T18:45:26.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.997+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe4153df0 con 0x7f3fe4151b40 2024-09-13T18:45:26.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:25.997+0000 7f3fdbe00700 1 -- 172.21.15.32:0/1552067826 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f3fdc057190 con 0x7f3fe4151b40 2024-09-13T18:45:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:26.005 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:25.505215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3fc4066730 msgr2=0x7f3fc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3fc4066730 0x7f3fc4068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40011e0 tx=0x7f3fd4009040 comp rx=0 tx=0).stop 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4151b40 msgr2=0x7f3fe4154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4151b40 0x7f3fe4154650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc016000 tx=0x7f3fdc004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 shutdown_connections 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3fc4066730 0x7f3fc4068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3fe4151b40 0x7f3fe4154650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fe4151760 0x7f3fe4154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 --2- 172.21.15.32:0/1552067826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fe40ca610 0x7f3fe40c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 >> 172.21.15.32:0/1552067826 conn(0x7f3fe406a740 msgr2=0x7f3fe40c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 shutdown_connections 2024-09-13T18:45:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.001+0000 7f3feb000700 1 -- 172.21.15.32:0/1552067826 wait complete. 2024-09-13T18:45:26.011 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 10 2024-09-13T18:45:26.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:26.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.197+0000 7fe9bb200700 1 Processor -- start 2024-09-13T18:45:26.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.197+0000 7fe9bb200700 1 -- start start 2024-09-13T18:45:26.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9bb200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9bc0c61b0 0x7fe9bc071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9bb200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9bc0aa360 0x7fe9bc1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9bb200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9bc070510 con 0x7fe9bc0c6590 2024-09-13T18:45:26.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9bb200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc0aa920 con 0x7fe9bc0aa360 2024-09-13T18:45:26.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9bb200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc157570 con 0x7fe9bc0c61b0 2024-09-13T18:45:26.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9bc0c61b0 0x7fe9bc071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe9bc0c61b0 0x7fe9bc071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49516/0 (socket says 172.21.15.32:49516) 2024-09-13T18:45:26.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 -- 172.21.15.32:0/451556175 learned_addr learned my addr 172.21.15.32:0/451556175 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:26.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b1400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9bc0aa360 0x7fe9bc1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 -- 172.21.15.32:0/451556175 >> v2:172.21.15.32:3300/0 conn(0x7fe9bc0aa360 msgr2=0x7fe9bc1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:26.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 --2- 172.21.15.32:0/451556175 >> v2:172.21.15.32:3300/0 conn(0x7fe9bc0aa360 0x7fe9bc1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 -- 172.21.15.32:0/451556175 >> v1:172.21.15.32:6789/0 conn(0x7fe9bc0c6590 legacy=0x7fe9bc15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 -- 172.21.15.32:0/451556175 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc070760 con 0x7fe9bc0c61b0 2024-09-13T18:45:26.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9e00700 1 --2- 172.21.15.32:0/451556175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc071960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0740a0 tx=0x7fe9ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e202189de7376ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9400700 1 -- 172.21.15.32:0/451556175 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00e070 con 0x7fe9bc0c61b0 2024-09-13T18:45:26.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9400700 1 -- 172.21.15.32:0/451556175 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00b910 con 0x7fe9bc0c61b0 2024-09-13T18:45:26.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.201+0000 7fe9b9400700 1 -- 172.21.15.32:0/451556175 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00bcc0 con 0x7fe9bc0c61b0 2024-09-13T18:45:26.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 -- 172.21.15.32:0/451556175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0c61b0 msgr2=0x7fe9bc071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 --2- 172.21.15.32:0/451556175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc071960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0740a0 tx=0x7fe9ac00b330 comp rx=0 tx=0).stop 2024-09-13T18:45:26.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 -- 172.21.15.32:0/451556175 shutdown_connections 2024-09-13T18:45:26.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 --2- 172.21.15.32:0/451556175 >> v2:172.21.15.32:3300/0 conn(0x7fe9bc0aa360 0x7fe9bc1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 --2- 172.21.15.32:0/451556175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc071960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 -- 172.21.15.32:0/451556175 >> 172.21.15.32:0/451556175 conn(0x7fe9bc0cad40 msgr2=0x7fe9bc0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 -- 172.21.15.32:0/451556175 shutdown_connections 2024-09-13T18:45:26.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.205+0000 7fe9bb200700 1 -- 172.21.15.32:0/451556175 wait complete. 2024-09-13T18:45:26.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 Processor -- start 2024-09-13T18:45:26.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 -- start start 2024-09-13T18:45:26.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 0x7fe9bc150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9bc0c6590 0x7fe9bc0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0c2210 con 0x7fe9bc0c61b0 2024-09-13T18:45:26.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0c3df0 con 0x7fe9bc0aa360 2024-09-13T18:45:26.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9bb200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0c3770 con 0x7fe9bc0c6590 2024-09-13T18:45:26.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9b9e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 0x7fe9bc150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9ba800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9bc0c6590 0x7fe9bc0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9b9e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 0x7fe9bc150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49522/0 (socket says 172.21.15.32:49522) 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc0c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43094/0 (socket says 172.21.15.32:43094) 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.209+0000 7fe9b9e00700 1 -- 172.21.15.32:0/2887133908 learned_addr learned my addr 172.21.15.32:0/2887133908 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b9e00700 1 -- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9bc0c6590 msgr2=0x7fe9bc0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b9e00700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9bc0c6590 0x7fe9bc0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b9e00700 1 -- 172.21.15.32:0/2887133908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 msgr2=0x7fe9bc0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b9e00700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b9e00700 1 -- 172.21.15.32:0/2887133908 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac009b30 con 0x7fe9bc0aa360 2024-09-13T18:45:26.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b1400700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:26.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b9e00700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 0x7fe9bc150240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc1576b0 tx=0x7fe9ac004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0048c0 con 0x7fe9bc0aa360 2024-09-13T18:45:26.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0092e0 con 0x7fe9bc0aa360 2024-09-13T18:45:26.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc0ca080 con 0x7fe9bc0aa360 2024-09-13T18:45:26.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac01c660 con 0x7fe9bc0aa360 2024-09-13T18:45:26.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc0c3a10 con 0x7fe9bc0aa360 2024-09-13T18:45:26.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.213+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc0c3f30 con 0x7fe9bc0aa360 2024-09-13T18:45:26.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.217+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9ac01c7c0 con 0x7fe9bc0aa360 2024-09-13T18:45:26.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.217+0000 7fe9b2a00700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe998066730 0x7fe998068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.217+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9ac085d20 con 0x7fe9bc0aa360 2024-09-13T18:45:26.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.217+0000 7fe9b1400700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe998066730 0x7fe998068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.221+0000 7fe9b1400700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe998066730 0x7fe998068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc155d70 tx=0x7fe9a4009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.229+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9ac052f30 con 0x7fe9bc0aa360 2024-09-13T18:45:26.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.425+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9bc0c3f30 con 0x7fe9bc0aa360 2024-09-13T18:45:26.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.425+0000 7fe9b2a00700 1 -- 172.21.15.32:0/2887133908 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fe9bc0c3f30 con 0x7fe9bc0aa360 2024-09-13T18:45:26.434 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:26.434 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe998066730 msgr2=0x7fe998068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe998066730 0x7fe998068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc155d70 tx=0x7fe9a4009240 comp rx=0 tx=0).stop 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 msgr2=0x7fe9bc150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 0x7fe9bc150240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc1576b0 tx=0x7fe9ac004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 shutdown_connections 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe998066730 0x7fe998068bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9bc0c6590 0x7fe9bc0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9bc0c61b0 0x7fe9bc0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 --2- 172.21.15.32:0/2887133908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9bc0aa360 0x7fe9bc150240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 >> 172.21.15.32:0/2887133908 conn(0x7fe9bc0cad40 msgr2=0x7fe9bc0c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 shutdown_connections 2024-09-13T18:45:26.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.433+0000 7fe9bb200700 1 -- 172.21.15.32:0/2887133908 wait complete. 2024-09-13T18:45:26.463 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:45:26.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:26.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f633f800700 1 Processor -- start 2024-09-13T18:45:26.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f633f800700 1 -- start start 2024-09-13T18:45:26.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f633f800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6338151b40 0x7f63380ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f633f800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6338157c70 con 0x7f6338151760 2024-09-13T18:45:26.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f633f800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63380c90e0 con 0x7f63380c8cd0 2024-09-13T18:45:26.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f633f800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633815b340 con 0x7f6338151b40 2024-09-13T18:45:26.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6338151b40 0x7f63380ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6338151b40 0x7f63380ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43104/0 (socket says 172.21.15.32:43104) 2024-09-13T18:45:26.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 -- 172.21.15.32:0/1593047770 learned_addr learned my addr 172.21.15.32:0/1593047770 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:26.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 -- 172.21.15.32:0/1593047770 >> v1:172.21.15.86:6789/0 conn(0x7f63380c8cd0 legacy=0x7f6338071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 -- 172.21.15.32:0/1593047770 >> v1:172.21.15.32:6789/0 conn(0x7f6338151760 legacy=0x7f633815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:26.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 -- 172.21.15.32:0/1593047770 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633815b620 con 0x7f6338151b40 2024-09-13T18:45:26.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337e00700 1 --2- 172.21.15.32:0/1593047770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151b40 0x7f63380ca610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6324009910 tx=0x7f6324009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab90dd24b93d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.629+0000 7f6337400700 1 -- 172.21.15.32:0/1593047770 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324004230 con 0x7f6338151b40 2024-09-13T18:45:26.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f6337400700 1 -- 172.21.15.32:0/1593047770 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324004390 con 0x7f6338151b40 2024-09-13T18:45:26.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f6337400700 1 -- 172.21.15.32:0/1593047770 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324009e60 con 0x7f6338151b40 2024-09-13T18:45:26.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 -- 172.21.15.32:0/1593047770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151b40 msgr2=0x7f63380ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 --2- 172.21.15.32:0/1593047770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151b40 0x7f63380ca610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6324009910 tx=0x7f6324009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:26.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 -- 172.21.15.32:0/1593047770 shutdown_connections 2024-09-13T18:45:26.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 --2- 172.21.15.32:0/1593047770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151b40 0x7f63380ca610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 -- 172.21.15.32:0/1593047770 >> 172.21.15.32:0/1593047770 conn(0x7f633806a740 msgr2=0x7f633806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 -- 172.21.15.32:0/1593047770 shutdown_connections 2024-09-13T18:45:26.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.633+0000 7f633f800700 1 -- 172.21.15.32:0/1593047770 wait complete. 2024-09-13T18:45:26.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 Processor -- start 2024-09-13T18:45:26.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 -- start start 2024-09-13T18:45:26.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 0x7f63380b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151760 0x7f63381eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338151b40 0x7f633806f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381596e0 con 0x7f6338151760 2024-09-13T18:45:26.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338158b90 con 0x7f6338151b40 2024-09-13T18:45:26.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633f800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6338158610 con 0x7f63380c8cd0 2024-09-13T18:45:26.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 0x7f63380b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633d800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338151b40 0x7f633806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f6337e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151760 0x7f63381eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 0x7f63380b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:60008/0 (socket says 172.21.15.32:60008) 2024-09-13T18:45:26.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633d800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338151b40 0x7f633806f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49528/0 (socket says 172.21.15.32:49528) 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 -- 172.21.15.32:0/2172649029 learned_addr learned my addr 172.21.15.32:0/2172649029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 -- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338151b40 msgr2=0x7f633806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338151b40 0x7f633806f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 -- 172.21.15.32:0/2172649029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151760 msgr2=0x7f63381eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151760 0x7f63381eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f633ce00700 1 -- 172.21.15.32:0/2172649029 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6324009570 con 0x7f63380c8cd0 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.637+0000 7f6337e00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151760 0x7f63381eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:26.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f633ce00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 0x7f63380b2ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c4e0 tx=0x7f632c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c011790 con 0x7f63380c8cd0 2024-09-13T18:45:26.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c011910 con 0x7f63380c8cd0 2024-09-13T18:45:26.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c011cc0 con 0x7f63380c8cd0 2024-09-13T18:45:26.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63381588b0 con 0x7f63380c8cd0 2024-09-13T18:45:26.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6338159370 con 0x7f63380c8cd0 2024-09-13T18:45:26.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.641+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338159500 con 0x7f63380c8cd0 2024-09-13T18:45:26.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.645+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f632c01c460 con 0x7f63380c8cd0 2024-09-13T18:45:26.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.645+0000 7f6334c00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6318066730 0x7f6318068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:26.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.645+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f632c0842f0 con 0x7f63380c8cd0 2024-09-13T18:45:26.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.645+0000 7f6337e00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6318066730 0x7f6318068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:26.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.645+0000 7f6337e00700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6318066730 0x7f6318068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6324009910 tx=0x7f6324008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:26.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.653+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f632c0511c0 con 0x7f63380c8cd0 2024-09-13T18:45:26.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.849+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63380af720 con 0x7f6318066730 2024-09-13T18:45:26.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.873+0000 7f6334c00700 1 -- 172.21.15.32:0/2172649029 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345149 (secure 0 0 0) 0x7f63380af720 con 0x7f6318066730 2024-09-13T18:45:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6318066730 msgr2=0x7f6318068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6318066730 0x7f6318068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6324009910 tx=0x7f6324008030 comp rx=0 tx=0).stop 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 msgr2=0x7f63380b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 0x7f63380b2ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c4e0 tx=0x7f632c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 shutdown_connections 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6318066730 0x7f6318068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338151b40 0x7f633806f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6338151760 0x7f63381eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 --2- 172.21.15.32:0/2172649029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63380c8cd0 0x7f63380b2ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 >> 172.21.15.32:0/2172649029 conn(0x7f633806a740 msgr2=0x7f63381509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 shutdown_connections 2024-09-13T18:45:26.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:26.877+0000 7f633f800700 1 -- 172.21.15.32:0/2172649029 wait complete. 2024-09-13T18:45:26.888 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:45:26.904 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-13T18:45:26.070565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3416064,"data_stored":2038274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004398"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.332147+0000","last_change":"2024-09-13T18:45:00.864148+0000","last_active":"2024-09-13T18:45:06.332147+0000","last_peered":"2024-09-13T18:45:06.332147+0000","last_clean":"2024-09-13T18:45:06.332147+0000","last_became_active":"2024-09-13T18:45:00.863883+0000","last_became_peered":"2024-09-13T18:45:00.863883+0000","last_unstale":"2024-09-13T18:45:06.332147+0000","last_undegraded":"2024-09-13T18:45:06.332147+0000","last_fullsized":"2024-09-13T18:45:06.332147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:45:05.341525+0000","last_peered":"2024-09-13T18:45:05.341525+0000","last_clean":"2024-09-13T18:45:05.341525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:45:05.341525+0000","last_undegraded":"2024-09-13T18:45:05.341525+0000","last_fullsized":"2024-09-13T18:45:05.341525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824414+0000","last_change":"2024-09-13T18:45:05.359268+0000","last_active":"2024-09-13T18:45:05.824414+0000","last_peered":"2024-09-13T18:45:05.824414+0000","last_clean":"2024-09-13T18:45:05.824414+0000","last_became_active":"2024-09-13T18:45:05.358933+0000","last_became_peered":"2024-09-13T18:45:05.358933+0000","last_unstale":"2024-09-13T18:45:05.824414+0000","last_undegraded":"2024-09-13T18:45:05.824414+0000","last_fullsized":"2024-09-13T18:45:05.824414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:00.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330857+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:45:06.330857+0000","last_peered":"2024-09-13T18:45:06.330857+0000","last_clean":"2024-09-13T18:45:06.330857+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:45:06.330857+0000","last_undegraded":"2024-09-13T18:45:06.330857+0000","last_fullsized":"2024-09-13T18:45:06.330857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341543+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:45:05.341543+0000","last_peered":"2024-09-13T18:45:05.341543+0000","last_clean":"2024-09-13T18:45:05.341543+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:45:05.341543+0000","last_undegraded":"2024-09-13T18:45:05.341543+0000","last_fullsized":"2024-09-13T18:45:05.341543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.357301+0000","last_change":"2024-09-13T18:45:05.351838+0000","last_active":"2024-09-13T18:45:05.357301+0000","last_peered":"2024-09-13T18:45:05.357301+0000","last_clean":"2024-09-13T18:45:05.357301+0000","last_became_active":"2024-09-13T18:45:05.351437+0000","last_became_peered":"2024-09-13T18:45:05.351437+0000","last_unstale":"2024-09-13T18:45:05.357301+0000","last_undegraded":"2024-09-13T18:45:05.357301+0000","last_fullsized":"2024-09-13T18:45:05.357301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:46.755054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328767+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:45:06.328767+0000","last_peered":"2024-09-13T18:45:06.328767+0000","last_clean":"2024-09-13T18:45:06.328767+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:45:06.328767+0000","last_undegraded":"2024-09-13T18:45:06.328767+0000","last_fullsized":"2024-09-13T18:45:06.328767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341864+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:45:05.341864+0000","last_peered":"2024-09-13T18:45:05.341864+0000","last_clean":"2024-09-13T18:45:05.341864+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:45:05.341864+0000","last_undegraded":"2024-09-13T18:45:05.341864+0000","last_fullsized":"2024-09-13T18:45:05.341864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366911+0000","last_change":"2024-09-13T18:45:05.363274+0000","last_active":"2024-09-13T18:45:05.366911+0000","last_peered":"2024-09-13T18:45:05.366911+0000","last_clean":"2024-09-13T18:45:05.366911+0000","last_became_active":"2024-09-13T18:45:05.362870+0000","last_became_peered":"2024-09-13T18:45:05.362870+0000","last_unstale":"2024-09-13T18:45:05.366911+0000","last_undegraded":"2024-09-13T18:45:05.366911+0000","last_fullsized":"2024-09-13T18:45:05.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:54.494396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327442+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:45:06.327442+0000","last_peered":"2024-09-13T18:45:06.327442+0000","last_clean":"2024-09-13T18:45:06.327442+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:45:06.327442+0000","last_undegraded":"2024-09-13T18:45:06.327442+0000","last_fullsized":"2024-09-13T18:45:06.327442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330635+0000","last_change":"2024-09-13T18:45:01.355711+0000","last_active":"2024-09-13T18:45:05.330635+0000","last_peered":"2024-09-13T18:45:05.330635+0000","last_clean":"2024-09-13T18:45:05.330635+0000","last_became_active":"2024-09-13T18:45:01.355463+0000","last_became_peered":"2024-09-13T18:45:01.355463+0000","last_unstale":"2024-09-13T18:45:05.330635+0000","last_undegraded":"2024-09-13T18:45:05.330635+0000","last_fullsized":"2024-09-13T18:45:05.330635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365664+0000","last_change":"2024-09-13T18:45:05.360940+0000","last_active":"2024-09-13T18:45:05.365664+0000","last_peered":"2024-09-13T18:45:05.365664+0000","last_clean":"2024-09-13T18:45:05.365664+0000","last_became_active":"2024-09-13T18:45:05.360491+0000","last_became_peered":"2024-09-13T18:45:05.360491+0000","last_unstale":"2024-09-13T18:45:05.365664+0000","last_undegraded":"2024-09-13T18:45:05.365664+0000","last_fullsized":"2024-09-13T18:45:05.365664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:26.565354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328208+0000","last_change":"2024-09-13T18:45:01.345265+0000","last_active":"2024-09-13T18:45:05.328208+0000","last_peered":"2024-09-13T18:45:05.328208+0000","last_clean":"2024-09-13T18:45:05.328208+0000","last_became_active":"2024-09-13T18:45:01.344996+0000","last_became_peered":"2024-09-13T18:45:01.344996+0000","last_unstale":"2024-09-13T18:45:05.328208+0000","last_undegraded":"2024-09-13T18:45:05.328208+0000","last_fullsized":"2024-09-13T18:45:05.328208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:11.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327878+0000","last_change":"2024-09-13T18:45:00.867459+0000","last_active":"2024-09-13T18:45:06.327878+0000","last_peered":"2024-09-13T18:45:06.327878+0000","last_clean":"2024-09-13T18:45:06.327878+0000","last_became_active":"2024-09-13T18:45:00.867028+0000","last_became_peered":"2024-09-13T18:45:00.867028+0000","last_unstale":"2024-09-13T18:45:06.327878+0000","last_undegraded":"2024-09-13T18:45:06.327878+0000","last_fullsized":"2024-09-13T18:45:06.327878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.262031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370686+0000","last_change":"2024-09-13T18:45:05.368886+0000","last_active":"2024-09-13T18:45:05.370686+0000","last_peered":"2024-09-13T18:45:05.370686+0000","last_clean":"2024-09-13T18:45:05.370686+0000","last_became_active":"2024-09-13T18:45:05.368510+0000","last_became_peered":"2024-09-13T18:45:05.368510+0000","last_unstale":"2024-09-13T18:45:05.370686+0000","last_undegraded":"2024-09-13T18:45:05.370686+0000","last_fullsized":"2024-09-13T18:45:05.370686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:26.194694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341816+0000","last_change":"2024-09-13T18:45:01.332274+0000","last_active":"2024-09-13T18:45:05.341816+0000","last_peered":"2024-09-13T18:45:05.341816+0000","last_clean":"2024-09-13T18:45:05.341816+0000","last_became_active":"2024-09-13T18:45:01.331671+0000","last_became_peered":"2024-09-13T18:45:01.331671+0000","last_unstale":"2024-09-13T18:45:05.341816+0000","last_undegraded":"2024-09-13T18:45:05.341816+0000","last_fullsized":"2024-09-13T18:45:05.341816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:38.214360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332230+0000","last_change":"2024-09-13T18:45:00.843856+0000","last_active":"2024-09-13T18:45:05.332230+0000","last_peered":"2024-09-13T18:45:05.332230+0000","last_clean":"2024-09-13T18:45:05.332230+0000","last_became_active":"2024-09-13T18:45:00.843456+0000","last_became_peered":"2024-09-13T18:45:00.843456+0000","last_unstale":"2024-09-13T18:45:05.332230+0000","last_undegraded":"2024-09-13T18:45:05.332230+0000","last_fullsized":"2024-09-13T18:45:05.332230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:52.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.353284+0000","last_change":"2024-09-13T18:45:05.349810+0000","last_active":"2024-09-13T18:45:05.353284+0000","last_peered":"2024-09-13T18:45:05.353284+0000","last_clean":"2024-09-13T18:45:05.353284+0000","last_became_active":"2024-09-13T18:45:05.348815+0000","last_became_peered":"2024-09-13T18:45:05.348815+0000","last_unstale":"2024-09-13T18:45:05.353284+0000","last_undegraded":"2024-09-13T18:45:05.353284+0000","last_fullsized":"2024-09-13T18:45:05.353284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:20.676172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336422+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:45:05.336422+0000","last_peered":"2024-09-13T18:45:05.336422+0000","last_clean":"2024-09-13T18:45:05.336422+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:45:05.336422+0000","last_undegraded":"2024-09-13T18:45:05.336422+0000","last_fullsized":"2024-09-13T18:45:05.336422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336648+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:45:05.336648+0000","last_peered":"2024-09-13T18:45:05.336648+0000","last_clean":"2024-09-13T18:45:05.336648+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:45:05.336648+0000","last_undegraded":"2024-09-13T18:45:05.336648+0000","last_fullsized":"2024-09-13T18:45:05.336648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.827311+0000","last_change":"2024-09-13T18:45:05.357361+0000","last_active":"2024-09-13T18:45:05.827311+0000","last_peered":"2024-09-13T18:45:05.827311+0000","last_clean":"2024-09-13T18:45:05.827311+0000","last_became_active":"2024-09-13T18:45:05.357036+0000","last_became_peered":"2024-09-13T18:45:05.357036+0000","last_unstale":"2024-09-13T18:45:05.827311+0000","last_undegraded":"2024-09-13T18:45:05.827311+0000","last_fullsized":"2024-09-13T18:45:05.827311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:00.105880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327853+0000","last_change":"2024-09-13T18:45:01.329048+0000","last_active":"2024-09-13T18:45:05.327853+0000","last_peered":"2024-09-13T18:45:05.327853+0000","last_clean":"2024-09-13T18:45:05.327853+0000","last_became_active":"2024-09-13T18:45:01.328762+0000","last_became_peered":"2024-09-13T18:45:01.328762+0000","last_unstale":"2024-09-13T18:45:05.327853+0000","last_undegraded":"2024-09-13T18:45:05.327853+0000","last_fullsized":"2024-09-13T18:45:05.327853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:21.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336115+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:45:05.336115+0000","last_peered":"2024-09-13T18:45:05.336115+0000","last_clean":"2024-09-13T18:45:05.336115+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:45:05.336115+0000","last_undegraded":"2024-09-13T18:45:05.336115+0000","last_fullsized":"2024-09-13T18:45:05.336115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366976+0000","last_change":"2024-09-13T18:45:05.364829+0000","last_active":"2024-09-13T18:45:05.366976+0000","last_peered":"2024-09-13T18:45:05.366976+0000","last_clean":"2024-09-13T18:45:05.366976+0000","last_became_active":"2024-09-13T18:45:05.364538+0000","last_became_peered":"2024-09-13T18:45:05.364538+0000","last_unstale":"2024-09-13T18:45:05.366976+0000","last_undegraded":"2024-09-13T18:45:05.366976+0000","last_fullsized":"2024-09-13T18:45:05.366976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.945041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336737+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:45:05.336737+0000","last_peered":"2024-09-13T18:45:05.336737+0000","last_clean":"2024-09-13T18:45:05.336737+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:45:05.336737+0000","last_undegraded":"2024-09-13T18:45:05.336737+0000","last_fullsized":"2024-09-13T18:45:05.336737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327578+0000","last_change":"2024-09-13T18:45:00.863206+0000","last_active":"2024-09-13T18:45:06.327578+0000","last_peered":"2024-09-13T18:45:06.327578+0000","last_clean":"2024-09-13T18:45:06.327578+0000","last_became_active":"2024-09-13T18:45:00.862917+0000","last_became_peered":"2024-09-13T18:45:00.862917+0000","last_unstale":"2024-09-13T18:45:06.327578+0000","last_undegraded":"2024-09-13T18:45:06.327578+0000","last_fullsized":"2024-09-13T18:45:06.327578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.289662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.367010+0000","last_change":"2024-09-13T18:45:05.364598+0000","last_active":"2024-09-13T18:45:05.367010+0000","last_peered":"2024-09-13T18:45:05.367010+0000","last_clean":"2024-09-13T18:45:05.367010+0000","last_became_active":"2024-09-13T18:45:05.364194+0000","last_became_peered":"2024-09-13T18:45:05.364194+0000","last_unstale":"2024-09-13T18:45:05.367010+0000","last_undegraded":"2024-09-13T18:45:05.367010+0000","last_fullsized":"2024-09-13T18:45:05.367010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.594403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336439+0000","last_change":"2024-09-13T18:45:01.333827+0000","last_active":"2024-09-13T18:45:05.336439+0000","last_peered":"2024-09-13T18:45:05.336439+0000","last_clean":"2024-09-13T18:45:05.336439+0000","last_became_active":"2024-09-13T18:45:01.333500+0000","last_became_peered":"2024-09-13T18:45:01.333500+0000","last_unstale":"2024-09-13T18:45:05.336439+0000","last_undegraded":"2024-09-13T18:45:05.336439+0000","last_fullsized":"2024-09-13T18:45:05.336439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:37.963424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826853+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:45:05.826853+0000","last_peered":"2024-09-13T18:45:05.826853+0000","last_clean":"2024-09-13T18:45:05.826853+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:45:05.826853+0000","last_undegraded":"2024-09-13T18:45:05.826853+0000","last_fullsized":"2024-09-13T18:45:05.826853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824166+0000","last_change":"2024-09-13T18:45:05.349605+0000","last_active":"2024-09-13T18:45:05.824166+0000","last_peered":"2024-09-13T18:45:05.824166+0000","last_clean":"2024-09-13T18:45:05.824166+0000","last_became_active":"2024-09-13T18:45:05.349213+0000","last_became_peered":"2024-09-13T18:45:05.349213+0000","last_unstale":"2024-09-13T18:45:05.824166+0000","last_undegraded":"2024-09-13T18:45:05.824166+0000","last_fullsized":"2024-09-13T18:45:05.824166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:17.638750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333067+0000","last_change":"2024-09-13T18:45:01.331576+0000","last_active":"2024-09-13T18:45:05.333067+0000","last_peered":"2024-09-13T18:45:05.333067+0000","last_clean":"2024-09-13T18:45:05.333067+0000","last_became_active":"2024-09-13T18:45:01.331313+0000","last_became_peered":"2024-09-13T18:45:01.331313+0000","last_unstale":"2024-09-13T18:45:05.333067+0000","last_undegraded":"2024-09-13T18:45:05.333067+0000","last_fullsized":"2024-09-13T18:45:05.333067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:15.549020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330831+0000","last_change":"2024-09-13T18:45:00.856368+0000","last_active":"2024-09-13T18:45:05.330831+0000","last_peered":"2024-09-13T18:45:05.330831+0000","last_clean":"2024-09-13T18:45:05.330831+0000","last_became_active":"2024-09-13T18:45:00.856067+0000","last_became_peered":"2024-09-13T18:45:00.856067+0000","last_unstale":"2024-09-13T18:45:05.330831+0000","last_undegraded":"2024-09-13T18:45:05.330831+0000","last_fullsized":"2024-09-13T18:45:05.330831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:29.141185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602069+0000","last_change":"2024-09-13T18:45:05.358233+0000","last_active":"2024-09-13T18:45:06.602069+0000","last_peered":"2024-09-13T18:45:06.602069+0000","last_clean":"2024-09-13T18:45:06.602069+0000","last_became_active":"2024-09-13T18:45:05.357819+0000","last_became_peered":"2024-09-13T18:45:05.357819+0000","last_unstale":"2024-09-13T18:45:06.602069+0000","last_undegraded":"2024-09-13T18:45:06.602069+0000","last_fullsized":"2024-09-13T18:45:06.602069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:06.840619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.349889+0000","last_change":"2024-09-13T18:45:01.323768+0000","last_active":"2024-09-13T18:45:05.349889+0000","last_peered":"2024-09-13T18:45:05.349889+0000","last_clean":"2024-09-13T18:45:05.349889+0000","last_became_active":"2024-09-13T18:45:01.323449+0000","last_became_peered":"2024-09-13T18:45:01.323449+0000","last_unstale":"2024-09-13T18:45:05.349889+0000","last_undegraded":"2024-09-13T18:45:05.349889+0000","last_fullsized":"2024-09-13T18:45:05.349889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:32.782226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340579+0000","last_change":"2024-09-13T18:45:00.848001+0000","last_active":"2024-09-13T18:45:05.340579+0000","last_peered":"2024-09-13T18:45:05.340579+0000","last_clean":"2024-09-13T18:45:05.340579+0000","last_became_active":"2024-09-13T18:45:00.847720+0000","last_became_peered":"2024-09-13T18:45:00.847720+0000","last_unstale":"2024-09-13T18:45:05.340579+0000","last_undegraded":"2024-09-13T18:45:05.340579+0000","last_fullsized":"2024-09-13T18:45:05.340579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.566248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.601658+0000","last_change":"2024-09-13T18:45:05.344571+0000","last_active":"2024-09-13T18:45:06.601658+0000","last_peered":"2024-09-13T18:45:06.601658+0000","last_clean":"2024-09-13T18:45:06.601658+0000","last_became_active":"2024-09-13T18:45:05.344171+0000","last_became_peered":"2024-09-13T18:45:05.344171+0000","last_unstale":"2024-09-13T18:45:06.601658+0000","last_undegraded":"2024-09-13T18:45:06.601658+0000","last_fullsized":"2024-09-13T18:45:06.601658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:15.473898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338368+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:45:05.338368+0000","last_peered":"2024-09-13T18:45:05.338368+0000","last_clean":"2024-09-13T18:45:05.338368+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:45:05.338368+0000","last_undegraded":"2024-09-13T18:45:05.338368+0000","last_fullsized":"2024-09-13T18:45:05.338368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329231+0000","last_change":"2024-09-13T18:45:00.861944+0000","last_active":"2024-09-13T18:45:05.329231+0000","last_peered":"2024-09-13T18:45:05.329231+0000","last_clean":"2024-09-13T18:45:05.329231+0000","last_became_active":"2024-09-13T18:45:00.861249+0000","last_became_peered":"2024-09-13T18:45:00.861249+0000","last_unstale":"2024-09-13T18:45:05.329231+0000","last_undegraded":"2024-09-13T18:45:05.329231+0000","last_fullsized":"2024-09-13T18:45:05.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:09.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602419+0000","last_change":"2024-09-13T18:45:05.351737+0000","last_active":"2024-09-13T18:45:06.602419+0000","last_peered":"2024-09-13T18:45:06.602419+0000","last_clean":"2024-09-13T18:45:06.602419+0000","last_became_active":"2024-09-13T18:45:05.351311+0000","last_became_peered":"2024-09-13T18:45:05.351311+0000","last_unstale":"2024-09-13T18:45:06.602419+0000","last_undegraded":"2024-09-13T18:45:06.602419+0000","last_fullsized":"2024-09-13T18:45:06.602419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.229616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340831+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:45:05.340831+0000","last_peered":"2024-09-13T18:45:05.340831+0000","last_clean":"2024-09-13T18:45:05.340831+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:45:05.340831+0000","last_undegraded":"2024-09-13T18:45:05.340831+0000","last_fullsized":"2024-09-13T18:45:05.340831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341794+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:45:05.341794+0000","last_peered":"2024-09-13T18:45:05.341794+0000","last_clean":"2024-09-13T18:45:05.341794+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:45:05.341794+0000","last_undegraded":"2024-09-13T18:45:05.341794+0000","last_fullsized":"2024-09-13T18:45:05.341794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602617+0000","last_change":"2024-09-13T18:45:05.354392+0000","last_active":"2024-09-13T18:45:06.602617+0000","last_peered":"2024-09-13T18:45:06.602617+0000","last_clean":"2024-09-13T18:45:06.602617+0000","last_became_active":"2024-09-13T18:45:05.354022+0000","last_became_peered":"2024-09-13T18:45:05.354022+0000","last_unstale":"2024-09-13T18:45:06.602617+0000","last_undegraded":"2024-09-13T18:45:06.602617+0000","last_fullsized":"2024-09-13T18:45:06.602617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.160746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330365+0000","last_change":"2024-09-13T18:45:01.342993+0000","last_active":"2024-09-13T18:45:05.330365+0000","last_peered":"2024-09-13T18:45:05.330365+0000","last_clean":"2024-09-13T18:45:05.330365+0000","last_became_active":"2024-09-13T18:45:01.342730+0000","last_became_peered":"2024-09-13T18:45:01.342730+0000","last_unstale":"2024-09-13T18:45:05.330365+0000","last_undegraded":"2024-09-13T18:45:05.330365+0000","last_fullsized":"2024-09-13T18:45:05.330365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:53.451442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330417+0000","last_change":"2024-09-13T18:45:00.861710+0000","last_active":"2024-09-13T18:45:05.330417+0000","last_peered":"2024-09-13T18:45:05.330417+0000","last_clean":"2024-09-13T18:45:05.330417+0000","last_became_active":"2024-09-13T18:45:00.861091+0000","last_became_peered":"2024-09-13T18:45:00.861091+0000","last_unstale":"2024-09-13T18:45:05.330417+0000","last_undegraded":"2024-09-13T18:45:05.330417+0000","last_fullsized":"2024-09-13T18:45:05.330417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:30.431815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334987+0000","last_change":"2024-09-13T18:45:05.349312+0000","last_active":"2024-09-13T18:45:06.334987+0000","last_peered":"2024-09-13T18:45:06.334987+0000","last_clean":"2024-09-13T18:45:06.334987+0000","last_became_active":"2024-09-13T18:45:05.348858+0000","last_became_peered":"2024-09-13T18:45:05.348858+0000","last_unstale":"2024-09-13T18:45:06.334987+0000","last_undegraded":"2024-09-13T18:45:06.334987+0000","last_fullsized":"2024-09-13T18:45:06.334987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:09.955609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336475+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:45:05.336475+0000","last_peered":"2024-09-13T18:45:05.336475+0000","last_clean":"2024-09-13T18:45:05.336475+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:45:05.336475+0000","last_undegraded":"2024-09-13T18:45:05.336475+0000","last_fullsized":"2024-09-13T18:45:05.336475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328614+0000","last_change":"2024-09-13T18:45:00.870886+0000","last_active":"2024-09-13T18:45:05.328614+0000","last_peered":"2024-09-13T18:45:05.328614+0000","last_clean":"2024-09-13T18:45:05.328614+0000","last_became_active":"2024-09-13T18:45:00.870563+0000","last_became_peered":"2024-09-13T18:45:00.870563+0000","last_unstale":"2024-09-13T18:45:05.328614+0000","last_undegraded":"2024-09-13T18:45:05.328614+0000","last_fullsized":"2024-09-13T18:45:05.328614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341074+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:45:05.341074+0000","last_peered":"2024-09-13T18:45:05.341074+0000","last_clean":"2024-09-13T18:45:05.341074+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:45:05.341074+0000","last_undegraded":"2024-09-13T18:45:05.341074+0000","last_fullsized":"2024-09-13T18:45:05.341074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.371253+0000","last_change":"2024-09-13T18:45:05.369616+0000","last_active":"2024-09-13T18:45:05.371253+0000","last_peered":"2024-09-13T18:45:05.371253+0000","last_clean":"2024-09-13T18:45:05.371253+0000","last_became_active":"2024-09-13T18:45:05.368904+0000","last_became_peered":"2024-09-13T18:45:05.368904+0000","last_unstale":"2024-09-13T18:45:05.371253+0000","last_undegraded":"2024-09-13T18:45:05.371253+0000","last_fullsized":"2024-09-13T18:45:05.371253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:55.985326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330699+0000","last_change":"2024-09-13T18:45:01.342548+0000","last_active":"2024-09-13T18:45:05.330699+0000","last_peered":"2024-09-13T18:45:05.330699+0000","last_clean":"2024-09-13T18:45:05.330699+0000","last_became_active":"2024-09-13T18:45:01.342038+0000","last_became_peered":"2024-09-13T18:45:01.342038+0000","last_unstale":"2024-09-13T18:45:05.330699+0000","last_undegraded":"2024-09-13T18:45:05.330699+0000","last_fullsized":"2024-09-13T18:45:05.330699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.863893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333149+0000","last_change":"2024-09-13T18:45:00.859879+0000","last_active":"2024-09-13T18:45:05.333149+0000","last_peered":"2024-09-13T18:45:05.333149+0000","last_clean":"2024-09-13T18:45:05.333149+0000","last_became_active":"2024-09-13T18:45:00.859621+0000","last_became_peered":"2024-09-13T18:45:00.859621+0000","last_unstale":"2024-09-13T18:45:05.333149+0000","last_undegraded":"2024-09-13T18:45:05.333149+0000","last_fullsized":"2024-09-13T18:45:05.333149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:17.771135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366813+0000","last_change":"2024-09-13T18:45:05.362604+0000","last_active":"2024-09-13T18:45:05.366813+0000","last_peered":"2024-09-13T18:45:05.366813+0000","last_clean":"2024-09-13T18:45:05.366813+0000","last_became_active":"2024-09-13T18:45:05.362142+0000","last_became_peered":"2024-09-13T18:45:05.362142+0000","last_unstale":"2024-09-13T18:45:05.366813+0000","last_undegraded":"2024-09-13T18:45:05.366813+0000","last_fullsized":"2024-09-13T18:45:05.366813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342162+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:45:05.342162+0000","last_peered":"2024-09-13T18:45:05.342162+0000","last_clean":"2024-09-13T18:45:05.342162+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:45:05.342162+0000","last_undegraded":"2024-09-13T18:45:05.342162+0000","last_fullsized":"2024-09-13T18:45:05.342162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333613+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:45:06.333613+0000","last_peered":"2024-09-13T18:45:06.333613+0000","last_clean":"2024-09-13T18:45:06.333613+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:45:06.333613+0000","last_undegraded":"2024-09-13T18:45:06.333613+0000","last_fullsized":"2024-09-13T18:45:06.333613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334610+0000","last_change":"2024-09-13T18:45:05.359310+0000","last_active":"2024-09-13T18:45:06.334610+0000","last_peered":"2024-09-13T18:45:06.334610+0000","last_clean":"2024-09-13T18:45:06.334610+0000","last_became_active":"2024-09-13T18:45:05.358824+0000","last_became_peered":"2024-09-13T18:45:05.358824+0000","last_unstale":"2024-09-13T18:45:06.334610+0000","last_undegraded":"2024-09-13T18:45:06.334610+0000","last_fullsized":"2024-09-13T18:45:06.334610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:24.283145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338768+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:45:05.338768+0000","last_peered":"2024-09-13T18:45:05.338768+0000","last_clean":"2024-09-13T18:45:05.338768+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:45:05.338768+0000","last_undegraded":"2024-09-13T18:45:05.338768+0000","last_fullsized":"2024-09-13T18:45:05.338768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333901+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:45:06.333901+0000","last_peered":"2024-09-13T18:45:06.333901+0000","last_clean":"2024-09-13T18:45:06.333901+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:45:06.333901+0000","last_undegraded":"2024-09-13T18:45:06.333901+0000","last_fullsized":"2024-09-13T18:45:06.333901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365485+0000","last_change":"2024-09-13T18:45:05.362240+0000","last_active":"2024-09-13T18:45:05.365485+0000","last_peered":"2024-09-13T18:45:05.365485+0000","last_clean":"2024-09-13T18:45:05.365485+0000","last_became_active":"2024-09-13T18:45:05.361810+0000","last_became_peered":"2024-09-13T18:45:05.361810+0000","last_unstale":"2024-09-13T18:45:05.365485+0000","last_undegraded":"2024-09-13T18:45:05.365485+0000","last_fullsized":"2024-09-13T18:45:05.365485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:38.083269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350837+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:45:05.350837+0000","last_peered":"2024-09-13T18:45:05.350837+0000","last_clean":"2024-09-13T18:45:05.350837+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:45:05.350837+0000","last_undegraded":"2024-09-13T18:45:05.350837+0000","last_fullsized":"2024-09-13T18:45:05.350837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.326163+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:45:06.326163+0000","last_peered":"2024-09-13T18:45:06.326163+0000","last_clean":"2024-09-13T18:45:06.326163+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:45:06.326163+0000","last_undegraded":"2024-09-13T18:45:06.326163+0000","last_fullsized":"2024-09-13T18:45:06.326163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370349+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:45:05.370349+0000","last_peered":"2024-09-13T18:45:05.370349+0000","last_clean":"2024-09-13T18:45:05.370349+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:45:05.370349+0000","last_undegraded":"2024-09-13T18:45:05.370349+0000","last_fullsized":"2024-09-13T18:45:05.370349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327734+0000","last_change":"2024-09-13T18:45:01.346791+0000","last_active":"2024-09-13T18:45:05.327734+0000","last_peered":"2024-09-13T18:45:05.327734+0000","last_clean":"2024-09-13T18:45:05.327734+0000","last_became_active":"2024-09-13T18:45:01.346515+0000","last_became_peered":"2024-09-13T18:45:01.346515+0000","last_unstale":"2024-09-13T18:45:05.327734+0000","last_undegraded":"2024-09-13T18:45:05.327734+0000","last_fullsized":"2024-09-13T18:45:05.327734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.337346+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:45:06.337346+0000","last_peered":"2024-09-13T18:45:06.337346+0000","last_clean":"2024-09-13T18:45:06.337346+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:45:06.337346+0000","last_undegraded":"2024-09-13T18:45:06.337346+0000","last_fullsized":"2024-09-13T18:45:06.337346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335188+0000","last_change":"2024-09-13T18:45:05.348324+0000","last_active":"2024-09-13T18:45:06.335188+0000","last_peered":"2024-09-13T18:45:06.335188+0000","last_clean":"2024-09-13T18:45:06.335188+0000","last_became_active":"2024-09-13T18:45:05.347908+0000","last_became_peered":"2024-09-13T18:45:05.347908+0000","last_unstale":"2024-09-13T18:45:06.335188+0000","last_undegraded":"2024-09-13T18:45:06.335188+0000","last_fullsized":"2024-09-13T18:45:06.335188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:29.155413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340979+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:45:05.340979+0000","last_peered":"2024-09-13T18:45:05.340979+0000","last_clean":"2024-09-13T18:45:05.340979+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:45:05.340979+0000","last_undegraded":"2024-09-13T18:45:05.340979+0000","last_fullsized":"2024-09-13T18:45:05.340979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336406+0000","last_change":"2024-09-13T18:45:00.866140+0000","last_active":"2024-09-13T18:45:05.336406+0000","last_peered":"2024-09-13T18:45:05.336406+0000","last_clean":"2024-09-13T18:45:05.336406+0000","last_became_active":"2024-09-13T18:45:00.865898+0000","last_became_peered":"2024-09-13T18:45:00.865898+0000","last_unstale":"2024-09-13T18:45:05.336406+0000","last_undegraded":"2024-09-13T18:45:05.336406+0000","last_fullsized":"2024-09-13T18:45:05.336406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:16.378417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335021+0000","last_change":"2024-09-13T18:45:05.359539+0000","last_active":"2024-09-13T18:45:06.335021+0000","last_peered":"2024-09-13T18:45:06.335021+0000","last_clean":"2024-09-13T18:45:06.335021+0000","last_became_active":"2024-09-13T18:45:05.358801+0000","last_became_peered":"2024-09-13T18:45:05.358801+0000","last_unstale":"2024-09-13T18:45:06.335021+0000","last_undegraded":"2024-09-13T18:45:06.335021+0000","last_fullsized":"2024-09-13T18:45:06.335021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:04.787244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328147+0000","last_change":"2024-09-13T18:45:01.347194+0000","last_active":"2024-09-13T18:45:05.328147+0000","last_peered":"2024-09-13T18:45:05.328147+0000","last_clean":"2024-09-13T18:45:05.328147+0000","last_became_active":"2024-09-13T18:45:01.346941+0000","last_became_peered":"2024-09-13T18:45:01.346941+0000","last_unstale":"2024-09-13T18:45:05.328147+0000","last_undegraded":"2024-09-13T18:45:05.328147+0000","last_fullsized":"2024-09-13T18:45:05.328147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:05.677969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328824+0000","last_change":"2024-09-13T18:45:00.858781+0000","last_active":"2024-09-13T18:45:05.328824+0000","last_peered":"2024-09-13T18:45:05.328824+0000","last_clean":"2024-09-13T18:45:05.328824+0000","last_became_active":"2024-09-13T18:45:00.858418+0000","last_became_peered":"2024-09-13T18:45:00.858418+0000","last_unstale":"2024-09-13T18:45:05.328824+0000","last_undegraded":"2024-09-13T18:45:05.328824+0000","last_fullsized":"2024-09-13T18:45:05.328824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:23.372534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602425+0000","last_change":"2024-09-13T18:45:05.354664+0000","last_active":"2024-09-13T18:45:06.602425+0000","last_peered":"2024-09-13T18:45:06.602425+0000","last_clean":"2024-09-13T18:45:06.602425+0000","last_became_active":"2024-09-13T18:45:05.354148+0000","last_became_peered":"2024-09-13T18:45:05.354148+0000","last_unstale":"2024-09-13T18:45:06.602425+0000","last_undegraded":"2024-09-13T18:45:06.602425+0000","last_fullsized":"2024-09-13T18:45:06.602425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332095+0000","last_change":"2024-09-13T18:45:01.339092+0000","last_active":"2024-09-13T18:45:05.332095+0000","last_peered":"2024-09-13T18:45:05.332095+0000","last_clean":"2024-09-13T18:45:05.332095+0000","last_became_active":"2024-09-13T18:45:01.338762+0000","last_became_peered":"2024-09-13T18:45:01.338762+0000","last_unstale":"2024-09-13T18:45:05.332095+0000","last_undegraded":"2024-09-13T18:45:05.332095+0000","last_fullsized":"2024-09-13T18:45:05.332095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:01.205580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330228+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:45:06.330228+0000","last_peered":"2024-09-13T18:45:06.330228+0000","last_clean":"2024-09-13T18:45:06.330228+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:45:06.330228+0000","last_undegraded":"2024-09-13T18:45:06.330228+0000","last_fullsized":"2024-09-13T18:45:06.330228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346254+0000","last_change":"2024-09-13T18:45:05.343560+0000","last_active":"2024-09-13T18:45:05.346254+0000","last_peered":"2024-09-13T18:45:05.346254+0000","last_clean":"2024-09-13T18:45:05.346254+0000","last_became_active":"2024-09-13T18:45:05.342971+0000","last_became_peered":"2024-09-13T18:45:05.342971+0000","last_unstale":"2024-09-13T18:45:05.346254+0000","last_undegraded":"2024-09-13T18:45:05.346254+0000","last_fullsized":"2024-09-13T18:45:05.346254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:35.432501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338671+0000","last_change":"2024-09-13T18:45:01.345151+0000","last_active":"2024-09-13T18:45:05.338671+0000","last_peered":"2024-09-13T18:45:05.338671+0000","last_clean":"2024-09-13T18:45:05.338671+0000","last_became_active":"2024-09-13T18:45:01.344621+0000","last_became_peered":"2024-09-13T18:45:01.344621+0000","last_unstale":"2024-09-13T18:45:05.338671+0000","last_undegraded":"2024-09-13T18:45:05.338671+0000","last_fullsized":"2024-09-13T18:45:05.338671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:08.938308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:15.780850+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:45:15.780850+0000","last_peered":"2024-09-13T18:45:15.780850+0000","last_clean":"2024-09-13T18:45:15.780850+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:45:15.780850+0000","last_undegraded":"2024-09-13T18:45:15.780850+0000","last_fullsized":"2024-09-13T18:45:15.780850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825851+0000","last_change":"2024-09-13T18:45:05.349290+0000","last_active":"2024-09-13T18:45:05.825851+0000","last_peered":"2024-09-13T18:45:05.825851+0000","last_clean":"2024-09-13T18:45:05.825851+0000","last_became_active":"2024-09-13T18:45:05.347388+0000","last_became_peered":"2024-09-13T18:45:05.347388+0000","last_unstale":"2024-09-13T18:45:05.825851+0000","last_undegraded":"2024-09-13T18:45:05.825851+0000","last_fullsized":"2024-09-13T18:45:05.825851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:22.040097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328132+0000","last_change":"2024-09-13T18:45:01.346055+0000","last_active":"2024-09-13T18:45:05.328132+0000","last_peered":"2024-09-13T18:45:05.328132+0000","last_clean":"2024-09-13T18:45:05.328132+0000","last_became_active":"2024-09-13T18:45:01.345837+0000","last_became_peered":"2024-09-13T18:45:01.345837+0000","last_unstale":"2024-09-13T18:45:05.328132+0000","last_undegraded":"2024-09-13T18:45:05.328132+0000","last_fullsized":"2024-09-13T18:45:05.328132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:49.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.331407+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:45:06.331407+0000","last_peered":"2024-09-13T18:45:06.331407+0000","last_clean":"2024-09-13T18:45:06.331407+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:45:06.331407+0000","last_undegraded":"2024-09-13T18:45:06.331407+0000","last_fullsized":"2024-09-13T18:45:06.331407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.374060+0000","last_change":"2024-09-13T18:45:05.372988+0000","last_active":"2024-09-13T18:45:05.374060+0000","last_peered":"2024-09-13T18:45:05.374060+0000","last_clean":"2024-09-13T18:45:05.374060+0000","last_became_active":"2024-09-13T18:45:05.372512+0000","last_became_peered":"2024-09-13T18:45:05.372512+0000","last_unstale":"2024-09-13T18:45:05.374060+0000","last_undegraded":"2024-09-13T18:45:05.374060+0000","last_fullsized":"2024-09-13T18:45:05.374060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:34.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341638+0000","last_change":"2024-09-13T18:45:01.338401+0000","last_active":"2024-09-13T18:45:05.341638+0000","last_peered":"2024-09-13T18:45:05.341638+0000","last_clean":"2024-09-13T18:45:05.341638+0000","last_became_active":"2024-09-13T18:45:01.338030+0000","last_became_peered":"2024-09-13T18:45:01.338030+0000","last_unstale":"2024-09-13T18:45:05.341638+0000","last_undegraded":"2024-09-13T18:45:05.341638+0000","last_fullsized":"2024-09-13T18:45:05.341638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:37.030900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339846+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:45:05.339846+0000","last_peered":"2024-09-13T18:45:05.339846+0000","last_clean":"2024-09-13T18:45:05.339846+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:45:05.339846+0000","last_undegraded":"2024-09-13T18:45:05.339846+0000","last_fullsized":"2024-09-13T18:45:05.339846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.823921+0000","last_change":"2024-09-13T18:45:05.359747+0000","last_active":"2024-09-13T18:45:05.823921+0000","last_peered":"2024-09-13T18:45:05.823921+0000","last_clean":"2024-09-13T18:45:05.823921+0000","last_became_active":"2024-09-13T18:45:05.359227+0000","last_became_peered":"2024-09-13T18:45:05.359227+0000","last_unstale":"2024-09-13T18:45:05.823921+0000","last_undegraded":"2024-09-13T18:45:05.823921+0000","last_fullsized":"2024-09-13T18:45:05.823921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:13.356194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350743+0000","last_change":"2024-09-13T18:45:01.330522+0000","last_active":"2024-09-13T18:45:05.350743+0000","last_peered":"2024-09-13T18:45:05.350743+0000","last_clean":"2024-09-13T18:45:05.350743+0000","last_became_active":"2024-09-13T18:45:01.330292+0000","last_became_peered":"2024-09-13T18:45:01.330292+0000","last_unstale":"2024-09-13T18:45:05.350743+0000","last_undegraded":"2024-09-13T18:45:05.350743+0000","last_fullsized":"2024-09-13T18:45:05.350743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.819826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345469+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:45:05.345469+0000","last_peered":"2024-09-13T18:45:05.345469+0000","last_clean":"2024-09-13T18:45:05.345469+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:45:05.345469+0000","last_undegraded":"2024-09-13T18:45:05.345469+0000","last_fullsized":"2024-09-13T18:45:05.345469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825026+0000","last_change":"2024-09-13T18:45:05.345124+0000","last_active":"2024-09-13T18:45:05.825026+0000","last_peered":"2024-09-13T18:45:05.825026+0000","last_clean":"2024-09-13T18:45:05.825026+0000","last_became_active":"2024-09-13T18:45:05.344585+0000","last_became_peered":"2024-09-13T18:45:05.344585+0000","last_unstale":"2024-09-13T18:45:05.825026+0000","last_undegraded":"2024-09-13T18:45:05.825026+0000","last_fullsized":"2024-09-13T18:45:05.825026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.627036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826452+0000","last_change":"2024-09-13T18:45:05.354450+0000","last_active":"2024-09-13T18:45:05.826452+0000","last_peered":"2024-09-13T18:45:05.826452+0000","last_clean":"2024-09-13T18:45:05.826452+0000","last_became_active":"2024-09-13T18:45:05.354125+0000","last_became_peered":"2024-09-13T18:45:05.354125+0000","last_unstale":"2024-09-13T18:45:05.826452+0000","last_undegraded":"2024-09-13T18:45:05.826452+0000","last_fullsized":"2024-09-13T18:45:05.826452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:40.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335038+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:45:05.335038+0000","last_peered":"2024-09-13T18:45:05.335038+0000","last_clean":"2024-09-13T18:45:05.335038+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:45:05.335038+0000","last_undegraded":"2024-09-13T18:45:05.335038+0000","last_fullsized":"2024-09-13T18:45:05.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330036+0000","last_change":"2024-09-13T18:45:00.865663+0000","last_active":"2024-09-13T18:45:05.330036+0000","last_peered":"2024-09-13T18:45:05.330036+0000","last_clean":"2024-09-13T18:45:05.330036+0000","last_became_active":"2024-09-13T18:45:00.864827+0000","last_became_peered":"2024-09-13T18:45:00.864827+0000","last_unstale":"2024-09-13T18:45:05.330036+0000","last_undegraded":"2024-09-13T18:45:05.330036+0000","last_fullsized":"2024-09-13T18:45:05.330036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:17.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.360954+0000","last_change":"2024-09-13T18:45:05.358868+0000","last_active":"2024-09-13T18:45:05.360954+0000","last_peered":"2024-09-13T18:45:05.360954+0000","last_clean":"2024-09-13T18:45:05.360954+0000","last_became_active":"2024-09-13T18:45:05.358265+0000","last_became_peered":"2024-09-13T18:45:05.358265+0000","last_unstale":"2024-09-13T18:45:05.360954+0000","last_undegraded":"2024-09-13T18:45:05.360954+0000","last_fullsized":"2024-09-13T18:45:05.360954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:54.622499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339482+0000","last_change":"2024-09-13T18:45:01.331909+0000","last_active":"2024-09-13T18:45:05.339482+0000","last_peered":"2024-09-13T18:45:05.339482+0000","last_clean":"2024-09-13T18:45:05.339482+0000","last_became_active":"2024-09-13T18:45:01.331544+0000","last_became_peered":"2024-09-13T18:45:01.331544+0000","last_unstale":"2024-09-13T18:45:05.339482+0000","last_undegraded":"2024-09-13T18:45:05.339482+0000","last_fullsized":"2024-09-13T18:45:05.339482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:02.211129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330589+0000","last_change":"2024-09-13T18:45:00.860547+0000","last_active":"2024-09-13T18:45:05.330589+0000","last_peered":"2024-09-13T18:45:05.330589+0000","last_clean":"2024-09-13T18:45:05.330589+0000","last_became_active":"2024-09-13T18:45:00.860280+0000","last_became_peered":"2024-09-13T18:45:00.860280+0000","last_unstale":"2024-09-13T18:45:05.330589+0000","last_undegraded":"2024-09-13T18:45:05.330589+0000","last_fullsized":"2024-09-13T18:45:05.330589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.637492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328943+0000","last_change":"2024-09-13T18:45:00.868492+0000","last_active":"2024-09-13T18:45:06.328943+0000","last_peered":"2024-09-13T18:45:06.328943+0000","last_clean":"2024-09-13T18:45:06.328943+0000","last_became_active":"2024-09-13T18:45:00.867974+0000","last_became_peered":"2024-09-13T18:45:00.867974+0000","last_unstale":"2024-09-13T18:45:06.328943+0000","last_undegraded":"2024-09-13T18:45:06.328943+0000","last_fullsized":"2024-09-13T18:45:06.328943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:23.081313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335187+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:45:05.335187+0000","last_peered":"2024-09-13T18:45:05.335187+0000","last_clean":"2024-09-13T18:45:05.335187+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:45:05.335187+0000","last_undegraded":"2024-09-13T18:45:05.335187+0000","last_fullsized":"2024-09-13T18:45:05.335187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826337+0000","last_change":"2024-09-13T18:45:05.353000+0000","last_active":"2024-09-13T18:45:05.826337+0000","last_peered":"2024-09-13T18:45:05.826337+0000","last_clean":"2024-09-13T18:45:05.826337+0000","last_became_active":"2024-09-13T18:45:05.352517+0000","last_became_peered":"2024-09-13T18:45:05.352517+0000","last_unstale":"2024-09-13T18:45:05.826337+0000","last_undegraded":"2024-09-13T18:45:05.826337+0000","last_fullsized":"2024-09-13T18:45:05.826337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:55.468696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333615+0000","last_change":"2024-09-13T18:45:00.846090+0000","last_active":"2024-09-13T18:45:06.333615+0000","last_peered":"2024-09-13T18:45:06.333615+0000","last_clean":"2024-09-13T18:45:06.333615+0000","last_became_active":"2024-09-13T18:45:00.845817+0000","last_became_peered":"2024-09-13T18:45:00.845817+0000","last_unstale":"2024-09-13T18:45:06.333615+0000","last_undegraded":"2024-09-13T18:45:06.333615+0000","last_fullsized":"2024-09-13T18:45:06.333615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.183900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341132+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:45:05.341132+0000","last_peered":"2024-09-13T18:45:05.341132+0000","last_clean":"2024-09-13T18:45:05.341132+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:45:05.341132+0000","last_undegraded":"2024-09-13T18:45:05.341132+0000","last_fullsized":"2024-09-13T18:45:05.341132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826910+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:45:05.826910+0000","last_peered":"2024-09-13T18:45:05.826910+0000","last_clean":"2024-09-13T18:45:05.826910+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:45:05.826910+0000","last_undegraded":"2024-09-13T18:45:05.826910+0000","last_fullsized":"2024-09-13T18:45:05.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.344158+0000","last_change":"2024-09-13T18:45:01.333747+0000","last_active":"2024-09-13T18:45:05.344158+0000","last_peered":"2024-09-13T18:45:05.344158+0000","last_clean":"2024-09-13T18:45:05.344158+0000","last_became_active":"2024-09-13T18:45:01.332419+0000","last_became_peered":"2024-09-13T18:45:01.332419+0000","last_unstale":"2024-09-13T18:45:05.344158+0000","last_undegraded":"2024-09-13T18:45:05.344158+0000","last_fullsized":"2024-09-13T18:45:05.344158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:04.031786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341696+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:45:05.341696+0000","last_peered":"2024-09-13T18:45:05.341696+0000","last_clean":"2024-09-13T18:45:05.341696+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:45:05.341696+0000","last_undegraded":"2024-09-13T18:45:05.341696+0000","last_fullsized":"2024-09-13T18:45:05.341696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328563+0000","last_change":"2024-09-13T18:45:01.334186+0000","last_active":"2024-09-13T18:45:05.328563+0000","last_peered":"2024-09-13T18:45:05.328563+0000","last_clean":"2024-09-13T18:45:05.328563+0000","last_became_active":"2024-09-13T18:45:01.331220+0000","last_became_peered":"2024-09-13T18:45:01.331220+0000","last_unstale":"2024-09-13T18:45:05.328563+0000","last_undegraded":"2024-09-13T18:45:05.328563+0000","last_fullsized":"2024-09-13T18:45:05.328563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.221841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340277+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:45:05.340277+0000","last_peered":"2024-09-13T18:45:05.340277+0000","last_clean":"2024-09-13T18:45:05.340277+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:45:05.340277+0000","last_undegraded":"2024-09-13T18:45:05.340277+0000","last_fullsized":"2024-09-13T18:45:05.340277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332940+0000","last_change":"2024-09-13T18:45:01.345092+0000","last_active":"2024-09-13T18:45:05.332940+0000","last_peered":"2024-09-13T18:45:05.332940+0000","last_clean":"2024-09-13T18:45:05.332940+0000","last_became_active":"2024-09-13T18:45:01.344771+0000","last_became_peered":"2024-09-13T18:45:01.344771+0000","last_unstale":"2024-09-13T18:45:05.332940+0000","last_undegraded":"2024-09-13T18:45:05.332940+0000","last_fullsized":"2024-09-13T18:45:05.332940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.063948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332680+0000","last_change":"2024-09-13T18:45:01.331621+0000","last_active":"2024-09-13T18:45:05.332680+0000","last_peered":"2024-09-13T18:45:05.332680+0000","last_clean":"2024-09-13T18:45:05.332680+0000","last_became_active":"2024-09-13T18:45:01.331345+0000","last_became_peered":"2024-09-13T18:45:01.331345+0000","last_unstale":"2024-09-13T18:45:05.332680+0000","last_undegraded":"2024-09-13T18:45:05.332680+0000","last_fullsized":"2024-09-13T18:45:05.332680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.955367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350661+0000","last_change":"2024-09-13T18:45:01.339375+0000","last_active":"2024-09-13T18:45:05.350661+0000","last_peered":"2024-09-13T18:45:05.350661+0000","last_clean":"2024-09-13T18:45:05.350661+0000","last_became_active":"2024-09-13T18:45:01.339100+0000","last_became_peered":"2024-09-13T18:45:01.339100+0000","last_unstale":"2024-09-13T18:45:05.350661+0000","last_undegraded":"2024-09-13T18:45:05.350661+0000","last_fullsized":"2024-09-13T18:45:05.350661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:07.665938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341432+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:45:05.341432+0000","last_peered":"2024-09-13T18:45:05.341432+0000","last_clean":"2024-09-13T18:45:05.341432+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:45:05.341432+0000","last_undegraded":"2024-09-13T18:45:05.341432+0000","last_fullsized":"2024-09-13T18:45:05.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329413+0000","last_change":"2024-09-13T18:45:01.337763+0000","last_active":"2024-09-13T18:45:05.329413+0000","last_peered":"2024-09-13T18:45:05.329413+0000","last_clean":"2024-09-13T18:45:05.329413+0000","last_became_active":"2024-09-13T18:45:01.337436+0000","last_became_peered":"2024-09-13T18:45:01.337436+0000","last_unstale":"2024-09-13T18:45:05.329413+0000","last_undegraded":"2024-09-13T18:45:05.329413+0000","last_fullsized":"2024-09-13T18:45:05.329413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:24.283724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339364+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:45:05.339364+0000","last_peered":"2024-09-13T18:45:05.339364+0000","last_clean":"2024-09-13T18:45:05.339364+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:45:05.339364+0000","last_undegraded":"2024-09-13T18:45:05.339364+0000","last_fullsized":"2024-09-13T18:45:05.339364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341034+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:45:05.341034+0000","last_peered":"2024-09-13T18:45:05.341034+0000","last_clean":"2024-09-13T18:45:05.341034+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:45:05.341034+0000","last_undegraded":"2024-09-13T18:45:05.341034+0000","last_fullsized":"2024-09-13T18:45:05.341034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335095+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:45:05.335095+0000","last_peered":"2024-09-13T18:45:05.335095+0000","last_clean":"2024-09-13T18:45:05.335095+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:45:05.335095+0000","last_undegraded":"2024-09-13T18:45:05.335095+0000","last_fullsized":"2024-09-13T18:45:05.335095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342093+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:45:05.342093+0000","last_peered":"2024-09-13T18:45:05.342093+0000","last_clean":"2024-09-13T18:45:05.342093+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:45:05.342093+0000","last_undegraded":"2024-09-13T18:45:05.342093+0000","last_fullsized":"2024-09-13T18:45:05.342093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330753+0000","last_change":"2024-09-13T18:45:01.330449+0000","last_active":"2024-09-13T18:45:05.330753+0000","last_peered":"2024-09-13T18:45:05.330753+0000","last_clean":"2024-09-13T18:45:05.330753+0000","last_became_active":"2024-09-13T18:45:01.329169+0000","last_became_peered":"2024-09-13T18:45:01.329169+0000","last_unstale":"2024-09-13T18:45:05.330753+0000","last_undegraded":"2024-09-13T18:45:05.330753+0000","last_fullsized":"2024-09-13T18:45:05.330753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.348264+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:45:05.348264+0000","last_peered":"2024-09-13T18:45:05.348264+0000","last_clean":"2024-09-13T18:45:05.348264+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:45:05.348264+0000","last_undegraded":"2024-09-13T18:45:05.348264+0000","last_fullsized":"2024-09-13T18:45:05.348264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330371+0000","last_change":"2024-09-13T18:45:01.350125+0000","last_active":"2024-09-13T18:45:05.330371+0000","last_peered":"2024-09-13T18:45:05.330371+0000","last_clean":"2024-09-13T18:45:05.330371+0000","last_became_active":"2024-09-13T18:45:01.349938+0000","last_became_peered":"2024-09-13T18:45:01.349938+0000","last_unstale":"2024-09-13T18:45:05.330371+0000","last_undegraded":"2024-09-13T18:45:05.330371+0000","last_fullsized":"2024-09-13T18:45:05.330371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:31.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329585+0000","last_change":"2024-09-13T18:45:01.346136+0000","last_active":"2024-09-13T18:45:05.329585+0000","last_peered":"2024-09-13T18:45:05.329585+0000","last_clean":"2024-09-13T18:45:05.329585+0000","last_became_active":"2024-09-13T18:45:01.345857+0000","last_became_peered":"2024-09-13T18:45:01.345857+0000","last_unstale":"2024-09-13T18:45:05.329585+0000","last_undegraded":"2024-09-13T18:45:05.329585+0000","last_fullsized":"2024-09-13T18:45:05.329585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:54.067158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339025+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:45:05.339025+0000","last_peered":"2024-09-13T18:45:05.339025+0000","last_clean":"2024-09-13T18:45:05.339025+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:45:05.339025+0000","last_undegraded":"2024-09-13T18:45:05.339025+0000","last_fullsized":"2024-09-13T18:45:05.339025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.331987+0000","last_change":"2024-09-13T18:45:01.331111+0000","last_active":"2024-09-13T18:45:05.331987+0000","last_peered":"2024-09-13T18:45:05.331987+0000","last_clean":"2024-09-13T18:45:05.331987+0000","last_became_active":"2024-09-13T18:45:01.330778+0000","last_became_peered":"2024-09-13T18:45:01.330778+0000","last_unstale":"2024-09-13T18:45:05.331987+0000","last_undegraded":"2024-09-13T18:45:05.331987+0000","last_fullsized":"2024-09-13T18:45:05.331987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:32.014051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330546+0000","last_change":"2024-09-13T18:45:01.345047+0000","last_active":"2024-09-13T18:45:05.330546+0000","last_peered":"2024-09-13T18:45:05.330546+0000","last_clean":"2024-09-13T18:45:05.330546+0000","last_became_active":"2024-09-13T18:45:01.344779+0000","last_became_peered":"2024-09-13T18:45:01.344779+0000","last_unstale":"2024-09-13T18:45:05.330546+0000","last_undegraded":"2024-09-13T18:45:05.330546+0000","last_fullsized":"2024-09-13T18:45:05.330546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:17.412356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342014+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:45:05.342014+0000","last_peered":"2024-09-13T18:45:05.342014+0000","last_clean":"2024-09-13T18:45:05.342014+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:45:05.342014+0000","last_undegraded":"2024-09-13T18:45:05.342014+0000","last_fullsized":"2024-09-13T18:45:05.342014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338578+0000","last_change":"2024-09-13T18:45:01.353648+0000","last_active":"2024-09-13T18:45:05.338578+0000","last_peered":"2024-09-13T18:45:05.338578+0000","last_clean":"2024-09-13T18:45:05.338578+0000","last_became_active":"2024-09-13T18:45:01.353313+0000","last_became_peered":"2024-09-13T18:45:01.353313+0000","last_unstale":"2024-09-13T18:45:05.338578+0000","last_undegraded":"2024-09-13T18:45:05.338578+0000","last_fullsized":"2024-09-13T18:45:05.338578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:42.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339716+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:45:05.339716+0000","last_peered":"2024-09-13T18:45:05.339716+0000","last_clean":"2024-09-13T18:45:05.339716+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:45:05.339716+0000","last_undegraded":"2024-09-13T18:45:05.339716+0000","last_fullsized":"2024-09-13T18:45:05.339716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345424+0000","last_change":"2024-09-13T18:45:01.343394+0000","last_active":"2024-09-13T18:45:05.345424+0000","last_peered":"2024-09-13T18:45:05.345424+0000","last_clean":"2024-09-13T18:45:05.345424+0000","last_became_active":"2024-09-13T18:45:01.342835+0000","last_became_peered":"2024-09-13T18:45:01.342835+0000","last_unstale":"2024-09-13T18:45:05.345424+0000","last_undegraded":"2024-09-13T18:45:05.345424+0000","last_fullsized":"2024-09-13T18:45:05.345424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:02.097270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339302+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:45:05.339302+0000","last_peered":"2024-09-13T18:45:05.339302+0000","last_clean":"2024-09-13T18:45:05.339302+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:45:05.339302+0000","last_undegraded":"2024-09-13T18:45:05.339302+0000","last_fullsized":"2024-09-13T18:45:05.339302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336323+0000","last_change":"2024-09-13T18:45:01.336594+0000","last_active":"2024-09-13T18:45:05.336323+0000","last_peered":"2024-09-13T18:45:05.336323+0000","last_clean":"2024-09-13T18:45:05.336323+0000","last_became_active":"2024-09-13T18:45:01.331640+0000","last_became_peered":"2024-09-13T18:45:01.331640+0000","last_unstale":"2024-09-13T18:45:05.336323+0000","last_undegraded":"2024-09-13T18:45:05.336323+0000","last_fullsized":"2024-09-13T18:45:05.336323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346373+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:45:05.346373+0000","last_peered":"2024-09-13T18:45:05.346373+0000","last_clean":"2024-09-13T18:45:05.346373+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:45:05.346373+0000","last_undegraded":"2024-09-13T18:45:05.346373+0000","last_fullsized":"2024-09-13T18:45:05.346373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338544+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:45:05.338544+0000","last_peered":"2024-09-13T18:45:05.338544+0000","last_clean":"2024-09-13T18:45:05.338544+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:45:05.338544+0000","last_undegraded":"2024-09-13T18:45:05.338544+0000","last_fullsized":"2024-09-13T18:45:05.338544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.347239+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:45:05.347239+0000","last_peered":"2024-09-13T18:45:05.347239+0000","last_clean":"2024-09-13T18:45:05.347239+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:45:05.347239+0000","last_undegraded":"2024-09-13T18:45:05.347239+0000","last_fullsized":"2024-09-13T18:45:05.347239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340614+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:45:05.340614+0000","last_peered":"2024-09-13T18:45:05.340614+0000","last_clean":"2024-09-13T18:45:05.340614+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:45:05.340614+0000","last_undegraded":"2024-09-13T18:45:05.340614+0000","last_fullsized":"2024-09-13T18:45:05.340614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341414+0000","last_change":"2024-09-13T18:45:01.331882+0000","last_active":"2024-09-13T18:45:05.341414+0000","last_peered":"2024-09-13T18:45:05.341414+0000","last_clean":"2024-09-13T18:45:05.341414+0000","last_became_active":"2024-09-13T18:45:01.331547+0000","last_became_peered":"2024-09-13T18:45:01.331547+0000","last_unstale":"2024-09-13T18:45:05.341414+0000","last_undegraded":"2024-09-13T18:45:05.341414+0000","last_fullsized":"2024-09-13T18:45:05.341414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:58.736123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338749+0000","last_change":"2024-09-13T18:45:01.354801+0000","last_active":"2024-09-13T18:45:05.338749+0000","last_peered":"2024-09-13T18:45:05.338749+0000","last_clean":"2024-09-13T18:45:05.338749+0000","last_became_active":"2024-09-13T18:45:01.354525+0000","last_became_peered":"2024-09-13T18:45:01.354525+0000","last_unstale":"2024-09-13T18:45:05.338749+0000","last_undegraded":"2024-09-13T18:45:05.338749+0000","last_fullsized":"2024-09-13T18:45:05.338749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.153253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":106626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":696482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":106168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:26.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:27.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 Processor -- start 2024-09-13T18:45:27.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 -- start start 2024-09-13T18:45:27.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0c7890 0x7f779c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f779c0c6d00 0x7f779c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0c5d90 con 0x7f779c0cb860 2024-09-13T18:45:27.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0c5a00 con 0x7f779c0c6d00 2024-09-13T18:45:27.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0c6110 con 0x7f779c0c7890 2024-09-13T18:45:27.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f779c0c6d00 0x7f779c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a0a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0c7890 0x7f779c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f779c0c6d00 0x7f779c15e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49538/0 (socket says 172.21.15.32:49538) 2024-09-13T18:45:27.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 -- 172.21.15.32:0/159276898 learned_addr learned my addr 172.21.15.32:0/159276898 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:27.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 -- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0c7890 msgr2=0x7f779c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 --2- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0c7890 0x7f779c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 -- 172.21.15.32:0/159276898 >> v1:172.21.15.32:6789/0 conn(0x7f779c0cb860 legacy=0x7f779c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.113+0000 7f77a1400700 1 -- 172.21.15.32:0/159276898 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0c81b0 con 0x7f779c0c6d00 2024-09-13T18:45:27.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1400700 1 --2- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c6d00 0x7f779c15e270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7794009e50 tx=0x7f779400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78d0668d90b9d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f779b400700 1 -- 172.21.15.32:0/159276898 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400e070 con 0x7f779c0c6d00 2024-09-13T18:45:27.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f779b400700 1 -- 172.21.15.32:0/159276898 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400b910 con 0x7f779c0c6d00 2024-09-13T18:45:27.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f779b400700 1 -- 172.21.15.32:0/159276898 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400bc80 con 0x7f779c0c6d00 2024-09-13T18:45:27.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 -- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c6d00 msgr2=0x7f779c15e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 --2- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c6d00 0x7f779c15e270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7794009e50 tx=0x7f779400b330 comp rx=0 tx=0).stop 2024-09-13T18:45:27.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 -- 172.21.15.32:0/159276898 shutdown_connections 2024-09-13T18:45:27.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 --2- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c6d00 0x7f779c15e270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 --2- 172.21.15.32:0/159276898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0c7890 0x7f779c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 -- 172.21.15.32:0/159276898 >> 172.21.15.32:0/159276898 conn(0x7f779c0cad40 msgr2=0x7f779c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 -- 172.21.15.32:0/159276898 shutdown_connections 2024-09-13T18:45:27.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.117+0000 7f77a1e00700 1 -- 172.21.15.32:0/159276898 wait complete. 2024-09-13T18:45:27.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 Processor -- start 2024-09-13T18:45:27.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 -- start start 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 0x7f779c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c7890 0x7f779c0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0cb860 0x7f779c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c154f60 con 0x7f779c0c6d00 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0ad8e0 con 0x7f779c0c7890 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0c41f0 con 0x7f779c0cb860 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 0x7f779c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 0x7f779c154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43128/0 (socket says 172.21.15.32:43128) 2024-09-13T18:45:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 -- 172.21.15.32:0/855283952 learned_addr learned my addr 172.21.15.32:0/855283952 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1400700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0cb860 0x7f779c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f779be00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c7890 0x7f779c0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 -- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0cb860 msgr2=0x7f779c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0cb860 0x7f779c0aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 -- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c7890 msgr2=0x7f779c0aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c7890 0x7f779c0aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 -- 172.21.15.32:0/855283952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009b30 con 0x7f779c0c6d00 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a0a00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 0x7f779c154a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f779000ea00 tx=0x7f779000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790009720 con 0x7f779c0c6d00 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000c7f0 con 0x7f779c0c6d00 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000cb60 con 0x7f779c0c6d00 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c0ad640 con 0x7f779c0c6d00 2024-09-13T18:45:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.121+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c0c3f10 con 0x7f779c0c6d00 2024-09-13T18:45:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.125+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c0aa500 con 0x7f779c0c6d00 2024-09-13T18:45:27.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.125+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f779000ccc0 con 0x7f779c0c6d00 2024-09-13T18:45:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.129+0000 7f7798c00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f777c066730 0x7f777c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.129+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77900847b0 con 0x7f779c0c6d00 2024-09-13T18:45:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.129+0000 7f779be00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f777c066730 0x7f777c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.129+0000 7f779be00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f777c066730 0x7f777c068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f779c1f7a80 tx=0x7f7788009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.137+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7790051820 con 0x7f779c0c6d00 2024-09-13T18:45:27.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.325+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f779c072910 con 0x7f777c066730 2024-09-13T18:45:27.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.345+0000 7f7798c00700 1 -- 172.21.15.32:0/855283952 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345149 (secure 0 0 0) 0x7f77880050d0 con 0x7f777c066730 2024-09-13T18:45:27.357 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f777c066730 msgr2=0x7f777c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f777c066730 0x7f777c068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f779c1f7a80 tx=0x7f7788009040 comp rx=0 tx=0).stop 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 msgr2=0x7f779c154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 0x7f779c154a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f779000ea00 tx=0x7f779000ed10 comp rx=0 tx=0).stop 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 shutdown_connections 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f777c066730 0x7f777c068bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f779c0cb860 0x7f779c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f779c0c7890 0x7f779c0aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 --2- 172.21.15.32:0/855283952 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f779c0c6d00 0x7f779c154a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 >> 172.21.15.32:0/855283952 conn(0x7f779c0cad40 msgr2=0x7f779c0c00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 shutdown_connections 2024-09-13T18:45:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.353+0000 7f77a1e00700 1 -- 172.21.15.32:0/855283952 wait complete. 2024-09-13T18:45:27.360 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:45:27.382 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-13T18:45:26.070565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3416064,"data_stored":2038274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004398"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.332147+0000","last_change":"2024-09-13T18:45:00.864148+0000","last_active":"2024-09-13T18:45:06.332147+0000","last_peered":"2024-09-13T18:45:06.332147+0000","last_clean":"2024-09-13T18:45:06.332147+0000","last_became_active":"2024-09-13T18:45:00.863883+0000","last_became_peered":"2024-09-13T18:45:00.863883+0000","last_unstale":"2024-09-13T18:45:06.332147+0000","last_undegraded":"2024-09-13T18:45:06.332147+0000","last_fullsized":"2024-09-13T18:45:06.332147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:45:05.341525+0000","last_peered":"2024-09-13T18:45:05.341525+0000","last_clean":"2024-09-13T18:45:05.341525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:45:05.341525+0000","last_undegraded":"2024-09-13T18:45:05.341525+0000","last_fullsized":"2024-09-13T18:45:05.341525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824414+0000","last_change":"2024-09-13T18:45:05.359268+0000","last_active":"2024-09-13T18:45:05.824414+0000","last_peered":"2024-09-13T18:45:05.824414+0000","last_clean":"2024-09-13T18:45:05.824414+0000","last_became_active":"2024-09-13T18:45:05.358933+0000","last_became_peered":"2024-09-13T18:45:05.358933+0000","last_unstale":"2024-09-13T18:45:05.824414+0000","last_undegraded":"2024-09-13T18:45:05.824414+0000","last_fullsized":"2024-09-13T18:45:05.824414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:00.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330857+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:45:06.330857+0000","last_peered":"2024-09-13T18:45:06.330857+0000","last_clean":"2024-09-13T18:45:06.330857+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:45:06.330857+0000","last_undegraded":"2024-09-13T18:45:06.330857+0000","last_fullsized":"2024-09-13T18:45:06.330857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341543+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:45:05.341543+0000","last_peered":"2024-09-13T18:45:05.341543+0000","last_clean":"2024-09-13T18:45:05.341543+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:45:05.341543+0000","last_undegraded":"2024-09-13T18:45:05.341543+0000","last_fullsized":"2024-09-13T18:45:05.341543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.357301+0000","last_change":"2024-09-13T18:45:05.351838+0000","last_active":"2024-09-13T18:45:05.357301+0000","last_peered":"2024-09-13T18:45:05.357301+0000","last_clean":"2024-09-13T18:45:05.357301+0000","last_became_active":"2024-09-13T18:45:05.351437+0000","last_became_peered":"2024-09-13T18:45:05.351437+0000","last_unstale":"2024-09-13T18:45:05.357301+0000","last_undegraded":"2024-09-13T18:45:05.357301+0000","last_fullsized":"2024-09-13T18:45:05.357301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:46.755054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328767+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:45:06.328767+0000","last_peered":"2024-09-13T18:45:06.328767+0000","last_clean":"2024-09-13T18:45:06.328767+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:45:06.328767+0000","last_undegraded":"2024-09-13T18:45:06.328767+0000","last_fullsized":"2024-09-13T18:45:06.328767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341864+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:45:05.341864+0000","last_peered":"2024-09-13T18:45:05.341864+0000","last_clean":"2024-09-13T18:45:05.341864+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:45:05.341864+0000","last_undegraded":"2024-09-13T18:45:05.341864+0000","last_fullsized":"2024-09-13T18:45:05.341864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366911+0000","last_change":"2024-09-13T18:45:05.363274+0000","last_active":"2024-09-13T18:45:05.366911+0000","last_peered":"2024-09-13T18:45:05.366911+0000","last_clean":"2024-09-13T18:45:05.366911+0000","last_became_active":"2024-09-13T18:45:05.362870+0000","last_became_peered":"2024-09-13T18:45:05.362870+0000","last_unstale":"2024-09-13T18:45:05.366911+0000","last_undegraded":"2024-09-13T18:45:05.366911+0000","last_fullsized":"2024-09-13T18:45:05.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:54.494396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327442+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:45:06.327442+0000","last_peered":"2024-09-13T18:45:06.327442+0000","last_clean":"2024-09-13T18:45:06.327442+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:45:06.327442+0000","last_undegraded":"2024-09-13T18:45:06.327442+0000","last_fullsized":"2024-09-13T18:45:06.327442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330635+0000","last_change":"2024-09-13T18:45:01.355711+0000","last_active":"2024-09-13T18:45:05.330635+0000","last_peered":"2024-09-13T18:45:05.330635+0000","last_clean":"2024-09-13T18:45:05.330635+0000","last_became_active":"2024-09-13T18:45:01.355463+0000","last_became_peered":"2024-09-13T18:45:01.355463+0000","last_unstale":"2024-09-13T18:45:05.330635+0000","last_undegraded":"2024-09-13T18:45:05.330635+0000","last_fullsized":"2024-09-13T18:45:05.330635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365664+0000","last_change":"2024-09-13T18:45:05.360940+0000","last_active":"2024-09-13T18:45:05.365664+0000","last_peered":"2024-09-13T18:45:05.365664+0000","last_clean":"2024-09-13T18:45:05.365664+0000","last_became_active":"2024-09-13T18:45:05.360491+0000","last_became_peered":"2024-09-13T18:45:05.360491+0000","last_unstale":"2024-09-13T18:45:05.365664+0000","last_undegraded":"2024-09-13T18:45:05.365664+0000","last_fullsized":"2024-09-13T18:45:05.365664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:26.565354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328208+0000","last_change":"2024-09-13T18:45:01.345265+0000","last_active":"2024-09-13T18:45:05.328208+0000","last_peered":"2024-09-13T18:45:05.328208+0000","last_clean":"2024-09-13T18:45:05.328208+0000","last_became_active":"2024-09-13T18:45:01.344996+0000","last_became_peered":"2024-09-13T18:45:01.344996+0000","last_unstale":"2024-09-13T18:45:05.328208+0000","last_undegraded":"2024-09-13T18:45:05.328208+0000","last_fullsized":"2024-09-13T18:45:05.328208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:11.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327878+0000","last_change":"2024-09-13T18:45:00.867459+0000","last_active":"2024-09-13T18:45:06.327878+0000","last_peered":"2024-09-13T18:45:06.327878+0000","last_clean":"2024-09-13T18:45:06.327878+0000","last_became_active":"2024-09-13T18:45:00.867028+0000","last_became_peered":"2024-09-13T18:45:00.867028+0000","last_unstale":"2024-09-13T18:45:06.327878+0000","last_undegraded":"2024-09-13T18:45:06.327878+0000","last_fullsized":"2024-09-13T18:45:06.327878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.262031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370686+0000","last_change":"2024-09-13T18:45:05.368886+0000","last_active":"2024-09-13T18:45:05.370686+0000","last_peered":"2024-09-13T18:45:05.370686+0000","last_clean":"2024-09-13T18:45:05.370686+0000","last_became_active":"2024-09-13T18:45:05.368510+0000","last_became_peered":"2024-09-13T18:45:05.368510+0000","last_unstale":"2024-09-13T18:45:05.370686+0000","last_undegraded":"2024-09-13T18:45:05.370686+0000","last_fullsized":"2024-09-13T18:45:05.370686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:26.194694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341816+0000","last_change":"2024-09-13T18:45:01.332274+0000","last_active":"2024-09-13T18:45:05.341816+0000","last_peered":"2024-09-13T18:45:05.341816+0000","last_clean":"2024-09-13T18:45:05.341816+0000","last_became_active":"2024-09-13T18:45:01.331671+0000","last_became_peered":"2024-09-13T18:45:01.331671+0000","last_unstale":"2024-09-13T18:45:05.341816+0000","last_undegraded":"2024-09-13T18:45:05.341816+0000","last_fullsized":"2024-09-13T18:45:05.341816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:38.214360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332230+0000","last_change":"2024-09-13T18:45:00.843856+0000","last_active":"2024-09-13T18:45:05.332230+0000","last_peered":"2024-09-13T18:45:05.332230+0000","last_clean":"2024-09-13T18:45:05.332230+0000","last_became_active":"2024-09-13T18:45:00.843456+0000","last_became_peered":"2024-09-13T18:45:00.843456+0000","last_unstale":"2024-09-13T18:45:05.332230+0000","last_undegraded":"2024-09-13T18:45:05.332230+0000","last_fullsized":"2024-09-13T18:45:05.332230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:52.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.353284+0000","last_change":"2024-09-13T18:45:05.349810+0000","last_active":"2024-09-13T18:45:05.353284+0000","last_peered":"2024-09-13T18:45:05.353284+0000","last_clean":"2024-09-13T18:45:05.353284+0000","last_became_active":"2024-09-13T18:45:05.348815+0000","last_became_peered":"2024-09-13T18:45:05.348815+0000","last_unstale":"2024-09-13T18:45:05.353284+0000","last_undegraded":"2024-09-13T18:45:05.353284+0000","last_fullsized":"2024-09-13T18:45:05.353284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:20.676172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336422+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:45:05.336422+0000","last_peered":"2024-09-13T18:45:05.336422+0000","last_clean":"2024-09-13T18:45:05.336422+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:45:05.336422+0000","last_undegraded":"2024-09-13T18:45:05.336422+0000","last_fullsized":"2024-09-13T18:45:05.336422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336648+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:45:05.336648+0000","last_peered":"2024-09-13T18:45:05.336648+0000","last_clean":"2024-09-13T18:45:05.336648+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:45:05.336648+0000","last_undegraded":"2024-09-13T18:45:05.336648+0000","last_fullsized":"2024-09-13T18:45:05.336648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.827311+0000","last_change":"2024-09-13T18:45:05.357361+0000","last_active":"2024-09-13T18:45:05.827311+0000","last_peered":"2024-09-13T18:45:05.827311+0000","last_clean":"2024-09-13T18:45:05.827311+0000","last_became_active":"2024-09-13T18:45:05.357036+0000","last_became_peered":"2024-09-13T18:45:05.357036+0000","last_unstale":"2024-09-13T18:45:05.827311+0000","last_undegraded":"2024-09-13T18:45:05.827311+0000","last_fullsized":"2024-09-13T18:45:05.827311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:00.105880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327853+0000","last_change":"2024-09-13T18:45:01.329048+0000","last_active":"2024-09-13T18:45:05.327853+0000","last_peered":"2024-09-13T18:45:05.327853+0000","last_clean":"2024-09-13T18:45:05.327853+0000","last_became_active":"2024-09-13T18:45:01.328762+0000","last_became_peered":"2024-09-13T18:45:01.328762+0000","last_unstale":"2024-09-13T18:45:05.327853+0000","last_undegraded":"2024-09-13T18:45:05.327853+0000","last_fullsized":"2024-09-13T18:45:05.327853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:21.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336115+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:45:05.336115+0000","last_peered":"2024-09-13T18:45:05.336115+0000","last_clean":"2024-09-13T18:45:05.336115+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:45:05.336115+0000","last_undegraded":"2024-09-13T18:45:05.336115+0000","last_fullsized":"2024-09-13T18:45:05.336115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366976+0000","last_change":"2024-09-13T18:45:05.364829+0000","last_active":"2024-09-13T18:45:05.366976+0000","last_peered":"2024-09-13T18:45:05.366976+0000","last_clean":"2024-09-13T18:45:05.366976+0000","last_became_active":"2024-09-13T18:45:05.364538+0000","last_became_peered":"2024-09-13T18:45:05.364538+0000","last_unstale":"2024-09-13T18:45:05.366976+0000","last_undegraded":"2024-09-13T18:45:05.366976+0000","last_fullsized":"2024-09-13T18:45:05.366976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.945041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336737+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:45:05.336737+0000","last_peered":"2024-09-13T18:45:05.336737+0000","last_clean":"2024-09-13T18:45:05.336737+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:45:05.336737+0000","last_undegraded":"2024-09-13T18:45:05.336737+0000","last_fullsized":"2024-09-13T18:45:05.336737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327578+0000","last_change":"2024-09-13T18:45:00.863206+0000","last_active":"2024-09-13T18:45:06.327578+0000","last_peered":"2024-09-13T18:45:06.327578+0000","last_clean":"2024-09-13T18:45:06.327578+0000","last_became_active":"2024-09-13T18:45:00.862917+0000","last_became_peered":"2024-09-13T18:45:00.862917+0000","last_unstale":"2024-09-13T18:45:06.327578+0000","last_undegraded":"2024-09-13T18:45:06.327578+0000","last_fullsized":"2024-09-13T18:45:06.327578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.289662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.367010+0000","last_change":"2024-09-13T18:45:05.364598+0000","last_active":"2024-09-13T18:45:05.367010+0000","last_peered":"2024-09-13T18:45:05.367010+0000","last_clean":"2024-09-13T18:45:05.367010+0000","last_became_active":"2024-09-13T18:45:05.364194+0000","last_became_peered":"2024-09-13T18:45:05.364194+0000","last_unstale":"2024-09-13T18:45:05.367010+0000","last_undegraded":"2024-09-13T18:45:05.367010+0000","last_fullsized":"2024-09-13T18:45:05.367010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.594403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336439+0000","last_change":"2024-09-13T18:45:01.333827+0000","last_active":"2024-09-13T18:45:05.336439+0000","last_peered":"2024-09-13T18:45:05.336439+0000","last_clean":"2024-09-13T18:45:05.336439+0000","last_became_active":"2024-09-13T18:45:01.333500+0000","last_became_peered":"2024-09-13T18:45:01.333500+0000","last_unstale":"2024-09-13T18:45:05.336439+0000","last_undegraded":"2024-09-13T18:45:05.336439+0000","last_fullsized":"2024-09-13T18:45:05.336439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:37.963424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826853+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:45:05.826853+0000","last_peered":"2024-09-13T18:45:05.826853+0000","last_clean":"2024-09-13T18:45:05.826853+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:45:05.826853+0000","last_undegraded":"2024-09-13T18:45:05.826853+0000","last_fullsized":"2024-09-13T18:45:05.826853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824166+0000","last_change":"2024-09-13T18:45:05.349605+0000","last_active":"2024-09-13T18:45:05.824166+0000","last_peered":"2024-09-13T18:45:05.824166+0000","last_clean":"2024-09-13T18:45:05.824166+0000","last_became_active":"2024-09-13T18:45:05.349213+0000","last_became_peered":"2024-09-13T18:45:05.349213+0000","last_unstale":"2024-09-13T18:45:05.824166+0000","last_undegraded":"2024-09-13T18:45:05.824166+0000","last_fullsized":"2024-09-13T18:45:05.824166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:17.638750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333067+0000","last_change":"2024-09-13T18:45:01.331576+0000","last_active":"2024-09-13T18:45:05.333067+0000","last_peered":"2024-09-13T18:45:05.333067+0000","last_clean":"2024-09-13T18:45:05.333067+0000","last_became_active":"2024-09-13T18:45:01.331313+0000","last_became_peered":"2024-09-13T18:45:01.331313+0000","last_unstale":"2024-09-13T18:45:05.333067+0000","last_undegraded":"2024-09-13T18:45:05.333067+0000","last_fullsized":"2024-09-13T18:45:05.333067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:15.549020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330831+0000","last_change":"2024-09-13T18:45:00.856368+0000","last_active":"2024-09-13T18:45:05.330831+0000","last_peered":"2024-09-13T18:45:05.330831+0000","last_clean":"2024-09-13T18:45:05.330831+0000","last_became_active":"2024-09-13T18:45:00.856067+0000","last_became_peered":"2024-09-13T18:45:00.856067+0000","last_unstale":"2024-09-13T18:45:05.330831+0000","last_undegraded":"2024-09-13T18:45:05.330831+0000","last_fullsized":"2024-09-13T18:45:05.330831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:29.141185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602069+0000","last_change":"2024-09-13T18:45:05.358233+0000","last_active":"2024-09-13T18:45:06.602069+0000","last_peered":"2024-09-13T18:45:06.602069+0000","last_clean":"2024-09-13T18:45:06.602069+0000","last_became_active":"2024-09-13T18:45:05.357819+0000","last_became_peered":"2024-09-13T18:45:05.357819+0000","last_unstale":"2024-09-13T18:45:06.602069+0000","last_undegraded":"2024-09-13T18:45:06.602069+0000","last_fullsized":"2024-09-13T18:45:06.602069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:06.840619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.349889+0000","last_change":"2024-09-13T18:45:01.323768+0000","last_active":"2024-09-13T18:45:05.349889+0000","last_peered":"2024-09-13T18:45:05.349889+0000","last_clean":"2024-09-13T18:45:05.349889+0000","last_became_active":"2024-09-13T18:45:01.323449+0000","last_became_peered":"2024-09-13T18:45:01.323449+0000","last_unstale":"2024-09-13T18:45:05.349889+0000","last_undegraded":"2024-09-13T18:45:05.349889+0000","last_fullsized":"2024-09-13T18:45:05.349889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:32.782226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340579+0000","last_change":"2024-09-13T18:45:00.848001+0000","last_active":"2024-09-13T18:45:05.340579+0000","last_peered":"2024-09-13T18:45:05.340579+0000","last_clean":"2024-09-13T18:45:05.340579+0000","last_became_active":"2024-09-13T18:45:00.847720+0000","last_became_peered":"2024-09-13T18:45:00.847720+0000","last_unstale":"2024-09-13T18:45:05.340579+0000","last_undegraded":"2024-09-13T18:45:05.340579+0000","last_fullsized":"2024-09-13T18:45:05.340579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.566248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.601658+0000","last_change":"2024-09-13T18:45:05.344571+0000","last_active":"2024-09-13T18:45:06.601658+0000","last_peered":"2024-09-13T18:45:06.601658+0000","last_clean":"2024-09-13T18:45:06.601658+0000","last_became_active":"2024-09-13T18:45:05.344171+0000","last_became_peered":"2024-09-13T18:45:05.344171+0000","last_unstale":"2024-09-13T18:45:06.601658+0000","last_undegraded":"2024-09-13T18:45:06.601658+0000","last_fullsized":"2024-09-13T18:45:06.601658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:15.473898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338368+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:45:05.338368+0000","last_peered":"2024-09-13T18:45:05.338368+0000","last_clean":"2024-09-13T18:45:05.338368+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:45:05.338368+0000","last_undegraded":"2024-09-13T18:45:05.338368+0000","last_fullsized":"2024-09-13T18:45:05.338368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329231+0000","last_change":"2024-09-13T18:45:00.861944+0000","last_active":"2024-09-13T18:45:05.329231+0000","last_peered":"2024-09-13T18:45:05.329231+0000","last_clean":"2024-09-13T18:45:05.329231+0000","last_became_active":"2024-09-13T18:45:00.861249+0000","last_became_peered":"2024-09-13T18:45:00.861249+0000","last_unstale":"2024-09-13T18:45:05.329231+0000","last_undegraded":"2024-09-13T18:45:05.329231+0000","last_fullsized":"2024-09-13T18:45:05.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:09.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602419+0000","last_change":"2024-09-13T18:45:05.351737+0000","last_active":"2024-09-13T18:45:06.602419+0000","last_peered":"2024-09-13T18:45:06.602419+0000","last_clean":"2024-09-13T18:45:06.602419+0000","last_became_active":"2024-09-13T18:45:05.351311+0000","last_became_peered":"2024-09-13T18:45:05.351311+0000","last_unstale":"2024-09-13T18:45:06.602419+0000","last_undegraded":"2024-09-13T18:45:06.602419+0000","last_fullsized":"2024-09-13T18:45:06.602419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.229616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340831+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:45:05.340831+0000","last_peered":"2024-09-13T18:45:05.340831+0000","last_clean":"2024-09-13T18:45:05.340831+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:45:05.340831+0000","last_undegraded":"2024-09-13T18:45:05.340831+0000","last_fullsized":"2024-09-13T18:45:05.340831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341794+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:45:05.341794+0000","last_peered":"2024-09-13T18:45:05.341794+0000","last_clean":"2024-09-13T18:45:05.341794+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:45:05.341794+0000","last_undegraded":"2024-09-13T18:45:05.341794+0000","last_fullsized":"2024-09-13T18:45:05.341794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602617+0000","last_change":"2024-09-13T18:45:05.354392+0000","last_active":"2024-09-13T18:45:06.602617+0000","last_peered":"2024-09-13T18:45:06.602617+0000","last_clean":"2024-09-13T18:45:06.602617+0000","last_became_active":"2024-09-13T18:45:05.354022+0000","last_became_peered":"2024-09-13T18:45:05.354022+0000","last_unstale":"2024-09-13T18:45:06.602617+0000","last_undegraded":"2024-09-13T18:45:06.602617+0000","last_fullsized":"2024-09-13T18:45:06.602617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.160746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330365+0000","last_change":"2024-09-13T18:45:01.342993+0000","last_active":"2024-09-13T18:45:05.330365+0000","last_peered":"2024-09-13T18:45:05.330365+0000","last_clean":"2024-09-13T18:45:05.330365+0000","last_became_active":"2024-09-13T18:45:01.342730+0000","last_became_peered":"2024-09-13T18:45:01.342730+0000","last_unstale":"2024-09-13T18:45:05.330365+0000","last_undegraded":"2024-09-13T18:45:05.330365+0000","last_fullsized":"2024-09-13T18:45:05.330365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:53.451442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330417+0000","last_change":"2024-09-13T18:45:00.861710+0000","last_active":"2024-09-13T18:45:05.330417+0000","last_peered":"2024-09-13T18:45:05.330417+0000","last_clean":"2024-09-13T18:45:05.330417+0000","last_became_active":"2024-09-13T18:45:00.861091+0000","last_became_peered":"2024-09-13T18:45:00.861091+0000","last_unstale":"2024-09-13T18:45:05.330417+0000","last_undegraded":"2024-09-13T18:45:05.330417+0000","last_fullsized":"2024-09-13T18:45:05.330417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:30.431815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334987+0000","last_change":"2024-09-13T18:45:05.349312+0000","last_active":"2024-09-13T18:45:06.334987+0000","last_peered":"2024-09-13T18:45:06.334987+0000","last_clean":"2024-09-13T18:45:06.334987+0000","last_became_active":"2024-09-13T18:45:05.348858+0000","last_became_peered":"2024-09-13T18:45:05.348858+0000","last_unstale":"2024-09-13T18:45:06.334987+0000","last_undegraded":"2024-09-13T18:45:06.334987+0000","last_fullsized":"2024-09-13T18:45:06.334987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:09.955609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336475+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:45:05.336475+0000","last_peered":"2024-09-13T18:45:05.336475+0000","last_clean":"2024-09-13T18:45:05.336475+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:45:05.336475+0000","last_undegraded":"2024-09-13T18:45:05.336475+0000","last_fullsized":"2024-09-13T18:45:05.336475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328614+0000","last_change":"2024-09-13T18:45:00.870886+0000","last_active":"2024-09-13T18:45:05.328614+0000","last_peered":"2024-09-13T18:45:05.328614+0000","last_clean":"2024-09-13T18:45:05.328614+0000","last_became_active":"2024-09-13T18:45:00.870563+0000","last_became_peered":"2024-09-13T18:45:00.870563+0000","last_unstale":"2024-09-13T18:45:05.328614+0000","last_undegraded":"2024-09-13T18:45:05.328614+0000","last_fullsized":"2024-09-13T18:45:05.328614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341074+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:45:05.341074+0000","last_peered":"2024-09-13T18:45:05.341074+0000","last_clean":"2024-09-13T18:45:05.341074+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:45:05.341074+0000","last_undegraded":"2024-09-13T18:45:05.341074+0000","last_fullsized":"2024-09-13T18:45:05.341074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.371253+0000","last_change":"2024-09-13T18:45:05.369616+0000","last_active":"2024-09-13T18:45:05.371253+0000","last_peered":"2024-09-13T18:45:05.371253+0000","last_clean":"2024-09-13T18:45:05.371253+0000","last_became_active":"2024-09-13T18:45:05.368904+0000","last_became_peered":"2024-09-13T18:45:05.368904+0000","last_unstale":"2024-09-13T18:45:05.371253+0000","last_undegraded":"2024-09-13T18:45:05.371253+0000","last_fullsized":"2024-09-13T18:45:05.371253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:55.985326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330699+0000","last_change":"2024-09-13T18:45:01.342548+0000","last_active":"2024-09-13T18:45:05.330699+0000","last_peered":"2024-09-13T18:45:05.330699+0000","last_clean":"2024-09-13T18:45:05.330699+0000","last_became_active":"2024-09-13T18:45:01.342038+0000","last_became_peered":"2024-09-13T18:45:01.342038+0000","last_unstale":"2024-09-13T18:45:05.330699+0000","last_undegraded":"2024-09-13T18:45:05.330699+0000","last_fullsized":"2024-09-13T18:45:05.330699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.863893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333149+0000","last_change":"2024-09-13T18:45:00.859879+0000","last_active":"2024-09-13T18:45:05.333149+0000","last_peered":"2024-09-13T18:45:05.333149+0000","last_clean":"2024-09-13T18:45:05.333149+0000","last_became_active":"2024-09-13T18:45:00.859621+0000","last_became_peered":"2024-09-13T18:45:00.859621+0000","last_unstale":"2024-09-13T18:45:05.333149+0000","last_undegraded":"2024-09-13T18:45:05.333149+0000","last_fullsized":"2024-09-13T18:45:05.333149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:17.771135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366813+0000","last_change":"2024-09-13T18:45:05.362604+0000","last_active":"2024-09-13T18:45:05.366813+0000","last_peered":"2024-09-13T18:45:05.366813+0000","last_clean":"2024-09-13T18:45:05.366813+0000","last_became_active":"2024-09-13T18:45:05.362142+0000","last_became_peered":"2024-09-13T18:45:05.362142+0000","last_unstale":"2024-09-13T18:45:05.366813+0000","last_undegraded":"2024-09-13T18:45:05.366813+0000","last_fullsized":"2024-09-13T18:45:05.366813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342162+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:45:05.342162+0000","last_peered":"2024-09-13T18:45:05.342162+0000","last_clean":"2024-09-13T18:45:05.342162+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:45:05.342162+0000","last_undegraded":"2024-09-13T18:45:05.342162+0000","last_fullsized":"2024-09-13T18:45:05.342162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333613+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:45:06.333613+0000","last_peered":"2024-09-13T18:45:06.333613+0000","last_clean":"2024-09-13T18:45:06.333613+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:45:06.333613+0000","last_undegraded":"2024-09-13T18:45:06.333613+0000","last_fullsized":"2024-09-13T18:45:06.333613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334610+0000","last_change":"2024-09-13T18:45:05.359310+0000","last_active":"2024-09-13T18:45:06.334610+0000","last_peered":"2024-09-13T18:45:06.334610+0000","last_clean":"2024-09-13T18:45:06.334610+0000","last_became_active":"2024-09-13T18:45:05.358824+0000","last_became_peered":"2024-09-13T18:45:05.358824+0000","last_unstale":"2024-09-13T18:45:06.334610+0000","last_undegraded":"2024-09-13T18:45:06.334610+0000","last_fullsized":"2024-09-13T18:45:06.334610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:24.283145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338768+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:45:05.338768+0000","last_peered":"2024-09-13T18:45:05.338768+0000","last_clean":"2024-09-13T18:45:05.338768+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:45:05.338768+0000","last_undegraded":"2024-09-13T18:45:05.338768+0000","last_fullsized":"2024-09-13T18:45:05.338768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333901+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:45:06.333901+0000","last_peered":"2024-09-13T18:45:06.333901+0000","last_clean":"2024-09-13T18:45:06.333901+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:45:06.333901+0000","last_undegraded":"2024-09-13T18:45:06.333901+0000","last_fullsized":"2024-09-13T18:45:06.333901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365485+0000","last_change":"2024-09-13T18:45:05.362240+0000","last_active":"2024-09-13T18:45:05.365485+0000","last_peered":"2024-09-13T18:45:05.365485+0000","last_clean":"2024-09-13T18:45:05.365485+0000","last_became_active":"2024-09-13T18:45:05.361810+0000","last_became_peered":"2024-09-13T18:45:05.361810+0000","last_unstale":"2024-09-13T18:45:05.365485+0000","last_undegraded":"2024-09-13T18:45:05.365485+0000","last_fullsized":"2024-09-13T18:45:05.365485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:38.083269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350837+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:45:05.350837+0000","last_peered":"2024-09-13T18:45:05.350837+0000","last_clean":"2024-09-13T18:45:05.350837+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:45:05.350837+0000","last_undegraded":"2024-09-13T18:45:05.350837+0000","last_fullsized":"2024-09-13T18:45:05.350837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.326163+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:45:06.326163+0000","last_peered":"2024-09-13T18:45:06.326163+0000","last_clean":"2024-09-13T18:45:06.326163+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:45:06.326163+0000","last_undegraded":"2024-09-13T18:45:06.326163+0000","last_fullsized":"2024-09-13T18:45:06.326163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370349+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:45:05.370349+0000","last_peered":"2024-09-13T18:45:05.370349+0000","last_clean":"2024-09-13T18:45:05.370349+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:45:05.370349+0000","last_undegraded":"2024-09-13T18:45:05.370349+0000","last_fullsized":"2024-09-13T18:45:05.370349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327734+0000","last_change":"2024-09-13T18:45:01.346791+0000","last_active":"2024-09-13T18:45:05.327734+0000","last_peered":"2024-09-13T18:45:05.327734+0000","last_clean":"2024-09-13T18:45:05.327734+0000","last_became_active":"2024-09-13T18:45:01.346515+0000","last_became_peered":"2024-09-13T18:45:01.346515+0000","last_unstale":"2024-09-13T18:45:05.327734+0000","last_undegraded":"2024-09-13T18:45:05.327734+0000","last_fullsized":"2024-09-13T18:45:05.327734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.337346+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:45:06.337346+0000","last_peered":"2024-09-13T18:45:06.337346+0000","last_clean":"2024-09-13T18:45:06.337346+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:45:06.337346+0000","last_undegraded":"2024-09-13T18:45:06.337346+0000","last_fullsized":"2024-09-13T18:45:06.337346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335188+0000","last_change":"2024-09-13T18:45:05.348324+0000","last_active":"2024-09-13T18:45:06.335188+0000","last_peered":"2024-09-13T18:45:06.335188+0000","last_clean":"2024-09-13T18:45:06.335188+0000","last_became_active":"2024-09-13T18:45:05.347908+0000","last_became_peered":"2024-09-13T18:45:05.347908+0000","last_unstale":"2024-09-13T18:45:06.335188+0000","last_undegraded":"2024-09-13T18:45:06.335188+0000","last_fullsized":"2024-09-13T18:45:06.335188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:29.155413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340979+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:45:05.340979+0000","last_peered":"2024-09-13T18:45:05.340979+0000","last_clean":"2024-09-13T18:45:05.340979+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:45:05.340979+0000","last_undegraded":"2024-09-13T18:45:05.340979+0000","last_fullsized":"2024-09-13T18:45:05.340979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336406+0000","last_change":"2024-09-13T18:45:00.866140+0000","last_active":"2024-09-13T18:45:05.336406+0000","last_peered":"2024-09-13T18:45:05.336406+0000","last_clean":"2024-09-13T18:45:05.336406+0000","last_became_active":"2024-09-13T18:45:00.865898+0000","last_became_peered":"2024-09-13T18:45:00.865898+0000","last_unstale":"2024-09-13T18:45:05.336406+0000","last_undegraded":"2024-09-13T18:45:05.336406+0000","last_fullsized":"2024-09-13T18:45:05.336406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:16.378417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335021+0000","last_change":"2024-09-13T18:45:05.359539+0000","last_active":"2024-09-13T18:45:06.335021+0000","last_peered":"2024-09-13T18:45:06.335021+0000","last_clean":"2024-09-13T18:45:06.335021+0000","last_became_active":"2024-09-13T18:45:05.358801+0000","last_became_peered":"2024-09-13T18:45:05.358801+0000","last_unstale":"2024-09-13T18:45:06.335021+0000","last_undegraded":"2024-09-13T18:45:06.335021+0000","last_fullsized":"2024-09-13T18:45:06.335021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:04.787244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328147+0000","last_change":"2024-09-13T18:45:01.347194+0000","last_active":"2024-09-13T18:45:05.328147+0000","last_peered":"2024-09-13T18:45:05.328147+0000","last_clean":"2024-09-13T18:45:05.328147+0000","last_became_active":"2024-09-13T18:45:01.346941+0000","last_became_peered":"2024-09-13T18:45:01.346941+0000","last_unstale":"2024-09-13T18:45:05.328147+0000","last_undegraded":"2024-09-13T18:45:05.328147+0000","last_fullsized":"2024-09-13T18:45:05.328147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:05.677969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328824+0000","last_change":"2024-09-13T18:45:00.858781+0000","last_active":"2024-09-13T18:45:05.328824+0000","last_peered":"2024-09-13T18:45:05.328824+0000","last_clean":"2024-09-13T18:45:05.328824+0000","last_became_active":"2024-09-13T18:45:00.858418+0000","last_became_peered":"2024-09-13T18:45:00.858418+0000","last_unstale":"2024-09-13T18:45:05.328824+0000","last_undegraded":"2024-09-13T18:45:05.328824+0000","last_fullsized":"2024-09-13T18:45:05.328824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:23.372534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602425+0000","last_change":"2024-09-13T18:45:05.354664+0000","last_active":"2024-09-13T18:45:06.602425+0000","last_peered":"2024-09-13T18:45:06.602425+0000","last_clean":"2024-09-13T18:45:06.602425+0000","last_became_active":"2024-09-13T18:45:05.354148+0000","last_became_peered":"2024-09-13T18:45:05.354148+0000","last_unstale":"2024-09-13T18:45:06.602425+0000","last_undegraded":"2024-09-13T18:45:06.602425+0000","last_fullsized":"2024-09-13T18:45:06.602425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332095+0000","last_change":"2024-09-13T18:45:01.339092+0000","last_active":"2024-09-13T18:45:05.332095+0000","last_peered":"2024-09-13T18:45:05.332095+0000","last_clean":"2024-09-13T18:45:05.332095+0000","last_became_active":"2024-09-13T18:45:01.338762+0000","last_became_peered":"2024-09-13T18:45:01.338762+0000","last_unstale":"2024-09-13T18:45:05.332095+0000","last_undegraded":"2024-09-13T18:45:05.332095+0000","last_fullsized":"2024-09-13T18:45:05.332095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:01.205580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330228+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:45:06.330228+0000","last_peered":"2024-09-13T18:45:06.330228+0000","last_clean":"2024-09-13T18:45:06.330228+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:45:06.330228+0000","last_undegraded":"2024-09-13T18:45:06.330228+0000","last_fullsized":"2024-09-13T18:45:06.330228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346254+0000","last_change":"2024-09-13T18:45:05.343560+0000","last_active":"2024-09-13T18:45:05.346254+0000","last_peered":"2024-09-13T18:45:05.346254+0000","last_clean":"2024-09-13T18:45:05.346254+0000","last_became_active":"2024-09-13T18:45:05.342971+0000","last_became_peered":"2024-09-13T18:45:05.342971+0000","last_unstale":"2024-09-13T18:45:05.346254+0000","last_undegraded":"2024-09-13T18:45:05.346254+0000","last_fullsized":"2024-09-13T18:45:05.346254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:35.432501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338671+0000","last_change":"2024-09-13T18:45:01.345151+0000","last_active":"2024-09-13T18:45:05.338671+0000","last_peered":"2024-09-13T18:45:05.338671+0000","last_clean":"2024-09-13T18:45:05.338671+0000","last_became_active":"2024-09-13T18:45:01.344621+0000","last_became_peered":"2024-09-13T18:45:01.344621+0000","last_unstale":"2024-09-13T18:45:05.338671+0000","last_undegraded":"2024-09-13T18:45:05.338671+0000","last_fullsized":"2024-09-13T18:45:05.338671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:08.938308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:15.780850+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:45:15.780850+0000","last_peered":"2024-09-13T18:45:15.780850+0000","last_clean":"2024-09-13T18:45:15.780850+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:45:15.780850+0000","last_undegraded":"2024-09-13T18:45:15.780850+0000","last_fullsized":"2024-09-13T18:45:15.780850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825851+0000","last_change":"2024-09-13T18:45:05.349290+0000","last_active":"2024-09-13T18:45:05.825851+0000","last_peered":"2024-09-13T18:45:05.825851+0000","last_clean":"2024-09-13T18:45:05.825851+0000","last_became_active":"2024-09-13T18:45:05.347388+0000","last_became_peered":"2024-09-13T18:45:05.347388+0000","last_unstale":"2024-09-13T18:45:05.825851+0000","last_undegraded":"2024-09-13T18:45:05.825851+0000","last_fullsized":"2024-09-13T18:45:05.825851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:22.040097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328132+0000","last_change":"2024-09-13T18:45:01.346055+0000","last_active":"2024-09-13T18:45:05.328132+0000","last_peered":"2024-09-13T18:45:05.328132+0000","last_clean":"2024-09-13T18:45:05.328132+0000","last_became_active":"2024-09-13T18:45:01.345837+0000","last_became_peered":"2024-09-13T18:45:01.345837+0000","last_unstale":"2024-09-13T18:45:05.328132+0000","last_undegraded":"2024-09-13T18:45:05.328132+0000","last_fullsized":"2024-09-13T18:45:05.328132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:49.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.331407+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:45:06.331407+0000","last_peered":"2024-09-13T18:45:06.331407+0000","last_clean":"2024-09-13T18:45:06.331407+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:45:06.331407+0000","last_undegraded":"2024-09-13T18:45:06.331407+0000","last_fullsized":"2024-09-13T18:45:06.331407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.374060+0000","last_change":"2024-09-13T18:45:05.372988+0000","last_active":"2024-09-13T18:45:05.374060+0000","last_peered":"2024-09-13T18:45:05.374060+0000","last_clean":"2024-09-13T18:45:05.374060+0000","last_became_active":"2024-09-13T18:45:05.372512+0000","last_became_peered":"2024-09-13T18:45:05.372512+0000","last_unstale":"2024-09-13T18:45:05.374060+0000","last_undegraded":"2024-09-13T18:45:05.374060+0000","last_fullsized":"2024-09-13T18:45:05.374060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:34.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341638+0000","last_change":"2024-09-13T18:45:01.338401+0000","last_active":"2024-09-13T18:45:05.341638+0000","last_peered":"2024-09-13T18:45:05.341638+0000","last_clean":"2024-09-13T18:45:05.341638+0000","last_became_active":"2024-09-13T18:45:01.338030+0000","last_became_peered":"2024-09-13T18:45:01.338030+0000","last_unstale":"2024-09-13T18:45:05.341638+0000","last_undegraded":"2024-09-13T18:45:05.341638+0000","last_fullsized":"2024-09-13T18:45:05.341638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:37.030900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339846+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:45:05.339846+0000","last_peered":"2024-09-13T18:45:05.339846+0000","last_clean":"2024-09-13T18:45:05.339846+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:45:05.339846+0000","last_undegraded":"2024-09-13T18:45:05.339846+0000","last_fullsized":"2024-09-13T18:45:05.339846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.823921+0000","last_change":"2024-09-13T18:45:05.359747+0000","last_active":"2024-09-13T18:45:05.823921+0000","last_peered":"2024-09-13T18:45:05.823921+0000","last_clean":"2024-09-13T18:45:05.823921+0000","last_became_active":"2024-09-13T18:45:05.359227+0000","last_became_peered":"2024-09-13T18:45:05.359227+0000","last_unstale":"2024-09-13T18:45:05.823921+0000","last_undegraded":"2024-09-13T18:45:05.823921+0000","last_fullsized":"2024-09-13T18:45:05.823921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:13.356194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350743+0000","last_change":"2024-09-13T18:45:01.330522+0000","last_active":"2024-09-13T18:45:05.350743+0000","last_peered":"2024-09-13T18:45:05.350743+0000","last_clean":"2024-09-13T18:45:05.350743+0000","last_became_active":"2024-09-13T18:45:01.330292+0000","last_became_peered":"2024-09-13T18:45:01.330292+0000","last_unstale":"2024-09-13T18:45:05.350743+0000","last_undegraded":"2024-09-13T18:45:05.350743+0000","last_fullsized":"2024-09-13T18:45:05.350743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.819826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345469+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:45:05.345469+0000","last_peered":"2024-09-13T18:45:05.345469+0000","last_clean":"2024-09-13T18:45:05.345469+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:45:05.345469+0000","last_undegraded":"2024-09-13T18:45:05.345469+0000","last_fullsized":"2024-09-13T18:45:05.345469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825026+0000","last_change":"2024-09-13T18:45:05.345124+0000","last_active":"2024-09-13T18:45:05.825026+0000","last_peered":"2024-09-13T18:45:05.825026+0000","last_clean":"2024-09-13T18:45:05.825026+0000","last_became_active":"2024-09-13T18:45:05.344585+0000","last_became_peered":"2024-09-13T18:45:05.344585+0000","last_unstale":"2024-09-13T18:45:05.825026+0000","last_undegraded":"2024-09-13T18:45:05.825026+0000","last_fullsized":"2024-09-13T18:45:05.825026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.627036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826452+0000","last_change":"2024-09-13T18:45:05.354450+0000","last_active":"2024-09-13T18:45:05.826452+0000","last_peered":"2024-09-13T18:45:05.826452+0000","last_clean":"2024-09-13T18:45:05.826452+0000","last_became_active":"2024-09-13T18:45:05.354125+0000","last_became_peered":"2024-09-13T18:45:05.354125+0000","last_unstale":"2024-09-13T18:45:05.826452+0000","last_undegraded":"2024-09-13T18:45:05.826452+0000","last_fullsized":"2024-09-13T18:45:05.826452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:40.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335038+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:45:05.335038+0000","last_peered":"2024-09-13T18:45:05.335038+0000","last_clean":"2024-09-13T18:45:05.335038+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:45:05.335038+0000","last_undegraded":"2024-09-13T18:45:05.335038+0000","last_fullsized":"2024-09-13T18:45:05.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330036+0000","last_change":"2024-09-13T18:45:00.865663+0000","last_active":"2024-09-13T18:45:05.330036+0000","last_peered":"2024-09-13T18:45:05.330036+0000","last_clean":"2024-09-13T18:45:05.330036+0000","last_became_active":"2024-09-13T18:45:00.864827+0000","last_became_peered":"2024-09-13T18:45:00.864827+0000","last_unstale":"2024-09-13T18:45:05.330036+0000","last_undegraded":"2024-09-13T18:45:05.330036+0000","last_fullsized":"2024-09-13T18:45:05.330036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:17.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.360954+0000","last_change":"2024-09-13T18:45:05.358868+0000","last_active":"2024-09-13T18:45:05.360954+0000","last_peered":"2024-09-13T18:45:05.360954+0000","last_clean":"2024-09-13T18:45:05.360954+0000","last_became_active":"2024-09-13T18:45:05.358265+0000","last_became_peered":"2024-09-13T18:45:05.358265+0000","last_unstale":"2024-09-13T18:45:05.360954+0000","last_undegraded":"2024-09-13T18:45:05.360954+0000","last_fullsized":"2024-09-13T18:45:05.360954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:54.622499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339482+0000","last_change":"2024-09-13T18:45:01.331909+0000","last_active":"2024-09-13T18:45:05.339482+0000","last_peered":"2024-09-13T18:45:05.339482+0000","last_clean":"2024-09-13T18:45:05.339482+0000","last_became_active":"2024-09-13T18:45:01.331544+0000","last_became_peered":"2024-09-13T18:45:01.331544+0000","last_unstale":"2024-09-13T18:45:05.339482+0000","last_undegraded":"2024-09-13T18:45:05.339482+0000","last_fullsized":"2024-09-13T18:45:05.339482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:02.211129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330589+0000","last_change":"2024-09-13T18:45:00.860547+0000","last_active":"2024-09-13T18:45:05.330589+0000","last_peered":"2024-09-13T18:45:05.330589+0000","last_clean":"2024-09-13T18:45:05.330589+0000","last_became_active":"2024-09-13T18:45:00.860280+0000","last_became_peered":"2024-09-13T18:45:00.860280+0000","last_unstale":"2024-09-13T18:45:05.330589+0000","last_undegraded":"2024-09-13T18:45:05.330589+0000","last_fullsized":"2024-09-13T18:45:05.330589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.637492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328943+0000","last_change":"2024-09-13T18:45:00.868492+0000","last_active":"2024-09-13T18:45:06.328943+0000","last_peered":"2024-09-13T18:45:06.328943+0000","last_clean":"2024-09-13T18:45:06.328943+0000","last_became_active":"2024-09-13T18:45:00.867974+0000","last_became_peered":"2024-09-13T18:45:00.867974+0000","last_unstale":"2024-09-13T18:45:06.328943+0000","last_undegraded":"2024-09-13T18:45:06.328943+0000","last_fullsized":"2024-09-13T18:45:06.328943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:23.081313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335187+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:45:05.335187+0000","last_peered":"2024-09-13T18:45:05.335187+0000","last_clean":"2024-09-13T18:45:05.335187+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:45:05.335187+0000","last_undegraded":"2024-09-13T18:45:05.335187+0000","last_fullsized":"2024-09-13T18:45:05.335187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826337+0000","last_change":"2024-09-13T18:45:05.353000+0000","last_active":"2024-09-13T18:45:05.826337+0000","last_peered":"2024-09-13T18:45:05.826337+0000","last_clean":"2024-09-13T18:45:05.826337+0000","last_became_active":"2024-09-13T18:45:05.352517+0000","last_became_peered":"2024-09-13T18:45:05.352517+0000","last_unstale":"2024-09-13T18:45:05.826337+0000","last_undegraded":"2024-09-13T18:45:05.826337+0000","last_fullsized":"2024-09-13T18:45:05.826337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:55.468696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333615+0000","last_change":"2024-09-13T18:45:00.846090+0000","last_active":"2024-09-13T18:45:06.333615+0000","last_peered":"2024-09-13T18:45:06.333615+0000","last_clean":"2024-09-13T18:45:06.333615+0000","last_became_active":"2024-09-13T18:45:00.845817+0000","last_became_peered":"2024-09-13T18:45:00.845817+0000","last_unstale":"2024-09-13T18:45:06.333615+0000","last_undegraded":"2024-09-13T18:45:06.333615+0000","last_fullsized":"2024-09-13T18:45:06.333615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.183900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341132+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:45:05.341132+0000","last_peered":"2024-09-13T18:45:05.341132+0000","last_clean":"2024-09-13T18:45:05.341132+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:45:05.341132+0000","last_undegraded":"2024-09-13T18:45:05.341132+0000","last_fullsized":"2024-09-13T18:45:05.341132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826910+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:45:05.826910+0000","last_peered":"2024-09-13T18:45:05.826910+0000","last_clean":"2024-09-13T18:45:05.826910+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:45:05.826910+0000","last_undegraded":"2024-09-13T18:45:05.826910+0000","last_fullsized":"2024-09-13T18:45:05.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.344158+0000","last_change":"2024-09-13T18:45:01.333747+0000","last_active":"2024-09-13T18:45:05.344158+0000","last_peered":"2024-09-13T18:45:05.344158+0000","last_clean":"2024-09-13T18:45:05.344158+0000","last_became_active":"2024-09-13T18:45:01.332419+0000","last_became_peered":"2024-09-13T18:45:01.332419+0000","last_unstale":"2024-09-13T18:45:05.344158+0000","last_undegraded":"2024-09-13T18:45:05.344158+0000","last_fullsized":"2024-09-13T18:45:05.344158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:04.031786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341696+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:45:05.341696+0000","last_peered":"2024-09-13T18:45:05.341696+0000","last_clean":"2024-09-13T18:45:05.341696+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:45:05.341696+0000","last_undegraded":"2024-09-13T18:45:05.341696+0000","last_fullsized":"2024-09-13T18:45:05.341696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328563+0000","last_change":"2024-09-13T18:45:01.334186+0000","last_active":"2024-09-13T18:45:05.328563+0000","last_peered":"2024-09-13T18:45:05.328563+0000","last_clean":"2024-09-13T18:45:05.328563+0000","last_became_active":"2024-09-13T18:45:01.331220+0000","last_became_peered":"2024-09-13T18:45:01.331220+0000","last_unstale":"2024-09-13T18:45:05.328563+0000","last_undegraded":"2024-09-13T18:45:05.328563+0000","last_fullsized":"2024-09-13T18:45:05.328563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.221841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340277+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:45:05.340277+0000","last_peered":"2024-09-13T18:45:05.340277+0000","last_clean":"2024-09-13T18:45:05.340277+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:45:05.340277+0000","last_undegraded":"2024-09-13T18:45:05.340277+0000","last_fullsized":"2024-09-13T18:45:05.340277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332940+0000","last_change":"2024-09-13T18:45:01.345092+0000","last_active":"2024-09-13T18:45:05.332940+0000","last_peered":"2024-09-13T18:45:05.332940+0000","last_clean":"2024-09-13T18:45:05.332940+0000","last_became_active":"2024-09-13T18:45:01.344771+0000","last_became_peered":"2024-09-13T18:45:01.344771+0000","last_unstale":"2024-09-13T18:45:05.332940+0000","last_undegraded":"2024-09-13T18:45:05.332940+0000","last_fullsized":"2024-09-13T18:45:05.332940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.063948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332680+0000","last_change":"2024-09-13T18:45:01.331621+0000","last_active":"2024-09-13T18:45:05.332680+0000","last_peered":"2024-09-13T18:45:05.332680+0000","last_clean":"2024-09-13T18:45:05.332680+0000","last_became_active":"2024-09-13T18:45:01.331345+0000","last_became_peered":"2024-09-13T18:45:01.331345+0000","last_unstale":"2024-09-13T18:45:05.332680+0000","last_undegraded":"2024-09-13T18:45:05.332680+0000","last_fullsized":"2024-09-13T18:45:05.332680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.955367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350661+0000","last_change":"2024-09-13T18:45:01.339375+0000","last_active":"2024-09-13T18:45:05.350661+0000","last_peered":"2024-09-13T18:45:05.350661+0000","last_clean":"2024-09-13T18:45:05.350661+0000","last_became_active":"2024-09-13T18:45:01.339100+0000","last_became_peered":"2024-09-13T18:45:01.339100+0000","last_unstale":"2024-09-13T18:45:05.350661+0000","last_undegraded":"2024-09-13T18:45:05.350661+0000","last_fullsized":"2024-09-13T18:45:05.350661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:07.665938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341432+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:45:05.341432+0000","last_peered":"2024-09-13T18:45:05.341432+0000","last_clean":"2024-09-13T18:45:05.341432+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:45:05.341432+0000","last_undegraded":"2024-09-13T18:45:05.341432+0000","last_fullsized":"2024-09-13T18:45:05.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329413+0000","last_change":"2024-09-13T18:45:01.337763+0000","last_active":"2024-09-13T18:45:05.329413+0000","last_peered":"2024-09-13T18:45:05.329413+0000","last_clean":"2024-09-13T18:45:05.329413+0000","last_became_active":"2024-09-13T18:45:01.337436+0000","last_became_peered":"2024-09-13T18:45:01.337436+0000","last_unstale":"2024-09-13T18:45:05.329413+0000","last_undegraded":"2024-09-13T18:45:05.329413+0000","last_fullsized":"2024-09-13T18:45:05.329413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:24.283724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339364+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:45:05.339364+0000","last_peered":"2024-09-13T18:45:05.339364+0000","last_clean":"2024-09-13T18:45:05.339364+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:45:05.339364+0000","last_undegraded":"2024-09-13T18:45:05.339364+0000","last_fullsized":"2024-09-13T18:45:05.339364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341034+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:45:05.341034+0000","last_peered":"2024-09-13T18:45:05.341034+0000","last_clean":"2024-09-13T18:45:05.341034+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:45:05.341034+0000","last_undegraded":"2024-09-13T18:45:05.341034+0000","last_fullsized":"2024-09-13T18:45:05.341034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335095+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:45:05.335095+0000","last_peered":"2024-09-13T18:45:05.335095+0000","last_clean":"2024-09-13T18:45:05.335095+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:45:05.335095+0000","last_undegraded":"2024-09-13T18:45:05.335095+0000","last_fullsized":"2024-09-13T18:45:05.335095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342093+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:45:05.342093+0000","last_peered":"2024-09-13T18:45:05.342093+0000","last_clean":"2024-09-13T18:45:05.342093+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:45:05.342093+0000","last_undegraded":"2024-09-13T18:45:05.342093+0000","last_fullsized":"2024-09-13T18:45:05.342093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330753+0000","last_change":"2024-09-13T18:45:01.330449+0000","last_active":"2024-09-13T18:45:05.330753+0000","last_peered":"2024-09-13T18:45:05.330753+0000","last_clean":"2024-09-13T18:45:05.330753+0000","last_became_active":"2024-09-13T18:45:01.329169+0000","last_became_peered":"2024-09-13T18:45:01.329169+0000","last_unstale":"2024-09-13T18:45:05.330753+0000","last_undegraded":"2024-09-13T18:45:05.330753+0000","last_fullsized":"2024-09-13T18:45:05.330753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.348264+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:45:05.348264+0000","last_peered":"2024-09-13T18:45:05.348264+0000","last_clean":"2024-09-13T18:45:05.348264+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:45:05.348264+0000","last_undegraded":"2024-09-13T18:45:05.348264+0000","last_fullsized":"2024-09-13T18:45:05.348264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330371+0000","last_change":"2024-09-13T18:45:01.350125+0000","last_active":"2024-09-13T18:45:05.330371+0000","last_peered":"2024-09-13T18:45:05.330371+0000","last_clean":"2024-09-13T18:45:05.330371+0000","last_became_active":"2024-09-13T18:45:01.349938+0000","last_became_peered":"2024-09-13T18:45:01.349938+0000","last_unstale":"2024-09-13T18:45:05.330371+0000","last_undegraded":"2024-09-13T18:45:05.330371+0000","last_fullsized":"2024-09-13T18:45:05.330371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:31.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329585+0000","last_change":"2024-09-13T18:45:01.346136+0000","last_active":"2024-09-13T18:45:05.329585+0000","last_peered":"2024-09-13T18:45:05.329585+0000","last_clean":"2024-09-13T18:45:05.329585+0000","last_became_active":"2024-09-13T18:45:01.345857+0000","last_became_peered":"2024-09-13T18:45:01.345857+0000","last_unstale":"2024-09-13T18:45:05.329585+0000","last_undegraded":"2024-09-13T18:45:05.329585+0000","last_fullsized":"2024-09-13T18:45:05.329585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:54.067158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339025+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:45:05.339025+0000","last_peered":"2024-09-13T18:45:05.339025+0000","last_clean":"2024-09-13T18:45:05.339025+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:45:05.339025+0000","last_undegraded":"2024-09-13T18:45:05.339025+0000","last_fullsized":"2024-09-13T18:45:05.339025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.331987+0000","last_change":"2024-09-13T18:45:01.331111+0000","last_active":"2024-09-13T18:45:05.331987+0000","last_peered":"2024-09-13T18:45:05.331987+0000","last_clean":"2024-09-13T18:45:05.331987+0000","last_became_active":"2024-09-13T18:45:01.330778+0000","last_became_peered":"2024-09-13T18:45:01.330778+0000","last_unstale":"2024-09-13T18:45:05.331987+0000","last_undegraded":"2024-09-13T18:45:05.331987+0000","last_fullsized":"2024-09-13T18:45:05.331987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:32.014051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330546+0000","last_change":"2024-09-13T18:45:01.345047+0000","last_active":"2024-09-13T18:45:05.330546+0000","last_peered":"2024-09-13T18:45:05.330546+0000","last_clean":"2024-09-13T18:45:05.330546+0000","last_became_active":"2024-09-13T18:45:01.344779+0000","last_became_peered":"2024-09-13T18:45:01.344779+0000","last_unstale":"2024-09-13T18:45:05.330546+0000","last_undegraded":"2024-09-13T18:45:05.330546+0000","last_fullsized":"2024-09-13T18:45:05.330546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:17.412356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342014+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:45:05.342014+0000","last_peered":"2024-09-13T18:45:05.342014+0000","last_clean":"2024-09-13T18:45:05.342014+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:45:05.342014+0000","last_undegraded":"2024-09-13T18:45:05.342014+0000","last_fullsized":"2024-09-13T18:45:05.342014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338578+0000","last_change":"2024-09-13T18:45:01.353648+0000","last_active":"2024-09-13T18:45:05.338578+0000","last_peered":"2024-09-13T18:45:05.338578+0000","last_clean":"2024-09-13T18:45:05.338578+0000","last_became_active":"2024-09-13T18:45:01.353313+0000","last_became_peered":"2024-09-13T18:45:01.353313+0000","last_unstale":"2024-09-13T18:45:05.338578+0000","last_undegraded":"2024-09-13T18:45:05.338578+0000","last_fullsized":"2024-09-13T18:45:05.338578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:42.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339716+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:45:05.339716+0000","last_peered":"2024-09-13T18:45:05.339716+0000","last_clean":"2024-09-13T18:45:05.339716+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:45:05.339716+0000","last_undegraded":"2024-09-13T18:45:05.339716+0000","last_fullsized":"2024-09-13T18:45:05.339716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345424+0000","last_change":"2024-09-13T18:45:01.343394+0000","last_active":"2024-09-13T18:45:05.345424+0000","last_peered":"2024-09-13T18:45:05.345424+0000","last_clean":"2024-09-13T18:45:05.345424+0000","last_became_active":"2024-09-13T18:45:01.342835+0000","last_became_peered":"2024-09-13T18:45:01.342835+0000","last_unstale":"2024-09-13T18:45:05.345424+0000","last_undegraded":"2024-09-13T18:45:05.345424+0000","last_fullsized":"2024-09-13T18:45:05.345424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:02.097270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339302+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:45:05.339302+0000","last_peered":"2024-09-13T18:45:05.339302+0000","last_clean":"2024-09-13T18:45:05.339302+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:45:05.339302+0000","last_undegraded":"2024-09-13T18:45:05.339302+0000","last_fullsized":"2024-09-13T18:45:05.339302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336323+0000","last_change":"2024-09-13T18:45:01.336594+0000","last_active":"2024-09-13T18:45:05.336323+0000","last_peered":"2024-09-13T18:45:05.336323+0000","last_clean":"2024-09-13T18:45:05.336323+0000","last_became_active":"2024-09-13T18:45:01.331640+0000","last_became_peered":"2024-09-13T18:45:01.331640+0000","last_unstale":"2024-09-13T18:45:05.336323+0000","last_undegraded":"2024-09-13T18:45:05.336323+0000","last_fullsized":"2024-09-13T18:45:05.336323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346373+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:45:05.346373+0000","last_peered":"2024-09-13T18:45:05.346373+0000","last_clean":"2024-09-13T18:45:05.346373+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:45:05.346373+0000","last_undegraded":"2024-09-13T18:45:05.346373+0000","last_fullsized":"2024-09-13T18:45:05.346373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338544+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:45:05.338544+0000","last_peered":"2024-09-13T18:45:05.338544+0000","last_clean":"2024-09-13T18:45:05.338544+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:45:05.338544+0000","last_undegraded":"2024-09-13T18:45:05.338544+0000","last_fullsized":"2024-09-13T18:45:05.338544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.347239+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:45:05.347239+0000","last_peered":"2024-09-13T18:45:05.347239+0000","last_clean":"2024-09-13T18:45:05.347239+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:45:05.347239+0000","last_undegraded":"2024-09-13T18:45:05.347239+0000","last_fullsized":"2024-09-13T18:45:05.347239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340614+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:45:05.340614+0000","last_peered":"2024-09-13T18:45:05.340614+0000","last_clean":"2024-09-13T18:45:05.340614+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:45:05.340614+0000","last_undegraded":"2024-09-13T18:45:05.340614+0000","last_fullsized":"2024-09-13T18:45:05.340614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341414+0000","last_change":"2024-09-13T18:45:01.331882+0000","last_active":"2024-09-13T18:45:05.341414+0000","last_peered":"2024-09-13T18:45:05.341414+0000","last_clean":"2024-09-13T18:45:05.341414+0000","last_became_active":"2024-09-13T18:45:01.331547+0000","last_became_peered":"2024-09-13T18:45:01.331547+0000","last_unstale":"2024-09-13T18:45:05.341414+0000","last_undegraded":"2024-09-13T18:45:05.341414+0000","last_fullsized":"2024-09-13T18:45:05.341414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:58.736123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338749+0000","last_change":"2024-09-13T18:45:01.354801+0000","last_active":"2024-09-13T18:45:05.338749+0000","last_peered":"2024-09-13T18:45:05.338749+0000","last_clean":"2024-09-13T18:45:05.338749+0000","last_became_active":"2024-09-13T18:45:01.354525+0000","last_became_peered":"2024-09-13T18:45:01.354525+0000","last_unstale":"2024-09-13T18:45:05.338749+0000","last_undegraded":"2024-09-13T18:45:05.338749+0000","last_fullsized":"2024-09-13T18:45:05.338749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.153253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":106626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":696482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":106168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:45:27.387 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:45:27.387 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:45:27.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:45:27.388 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:45:27.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.589+0000 7f67f7200700 1 Processor -- start 2024-09-13T18:45:27.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.589+0000 7f67f7200700 1 -- start start 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f7200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67f814f8f0 0x7f67f8156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f7200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f67f806ad90 0x7f67f80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f7200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f8158c90 con 0x7f67f81599c0 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f7200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f8159530 con 0x7f67f806ad90 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f7200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f8156660 con 0x7f67f814f8f0 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f67f814f8f0 0x7f67f8156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f67f81599c0 0x7f67f80c6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45122/0 (socket says 172.21.15.32:45122) 2024-09-13T18:45:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5400700 1 -- 172.21.15.32:0/1294081776 learned_addr learned my addr 172.21.15.32:0/1294081776 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f6800700 1 --2- 172.21.15.32:0/1294081776 >> v2:172.21.15.32:3300/0 conn(0x7f67f806ad90 0x7f67f80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f4a00700 1 -- 172.21.15.32:0/1294081776 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939313811 0 0) 0x7f67f8158c90 con 0x7f67f81599c0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f4a00700 1 -- 172.21.15.32:0/1294081776 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67dc0035d0 con 0x7f67f81599c0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5e00700 1 -- 172.21.15.32:0/1294081776 >> v2:172.21.15.32:3300/0 conn(0x7f67f806ad90 msgr2=0x7f67f80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5e00700 1 --2- 172.21.15.32:0/1294081776 >> v2:172.21.15.32:3300/0 conn(0x7f67f806ad90 0x7f67f80cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5e00700 1 -- 172.21.15.32:0/1294081776 >> v1:172.21.15.86:6789/0 conn(0x7f67f81599c0 legacy=0x7f67f80c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5e00700 1 -- 172.21.15.32:0/1294081776 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80c52a0 con 0x7f67f814f8f0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f6800700 1 --2- 172.21.15.32:0/1294081776 >> v2:172.21.15.32:3300/0 conn(0x7f67f806ad90 0x7f67f80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.593+0000 7f67f5e00700 1 --2- 172.21.15.32:0/1294081776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f814f8f0 0x7f67f8156120 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67f80c8d60 tx=0x7f67e800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bee58822a306141f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f4a00700 1 -- 172.21.15.32:0/1294081776 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8010070 con 0x7f67f814f8f0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f4a00700 1 -- 172.21.15.32:0/1294081776 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e800b2e0 con 0x7f67f814f8f0 2024-09-13T18:45:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f4a00700 1 -- 172.21.15.32:0/1294081776 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e800dbd0 con 0x7f67f814f8f0 2024-09-13T18:45:27.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 -- 172.21.15.32:0/1294081776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f814f8f0 msgr2=0x7f67f8156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 --2- 172.21.15.32:0/1294081776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f814f8f0 0x7f67f8156120 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67f80c8d60 tx=0x7f67e800d330 comp rx=0 tx=0).stop 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 -- 172.21.15.32:0/1294081776 shutdown_connections 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 --2- 172.21.15.32:0/1294081776 >> v2:172.21.15.32:3300/0 conn(0x7f67f806ad90 0x7f67f80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 --2- 172.21.15.32:0/1294081776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f814f8f0 0x7f67f8156120 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 -- 172.21.15.32:0/1294081776 >> 172.21.15.32:0/1294081776 conn(0x7f67f8070fc0 msgr2=0x7f67f80713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 -- 172.21.15.32:0/1294081776 shutdown_connections 2024-09-13T18:45:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.597+0000 7f67f7200700 1 -- 172.21.15.32:0/1294081776 wait complete. 2024-09-13T18:45:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 Processor -- start 2024-09-13T18:45:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 -- start start 2024-09-13T18:45:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 0x7f67f81e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67f814f8f0 0x7f67f80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f81599c0 0x7f67f80c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81ef110 con 0x7f67f806ad90 2024-09-13T18:45:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81eff90 con 0x7f67f81599c0 2024-09-13T18:45:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81ef380 con 0x7f67f814f8f0 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 0x7f67f81e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 0x7f67f81e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43150/0 (socket says 172.21.15.32:43150) 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 -- 172.21.15.32:0/1648341629 learned_addr learned my addr 172.21.15.32:0/1648341629 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f6800700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f81599c0 0x7f67f80c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5400700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67f814f8f0 0x7f67f80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 -- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67f814f8f0 msgr2=0x7f67f80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67f814f8f0 0x7f67f80c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 -- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f81599c0 msgr2=0x7f67f80c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f81599c0 0x7f67f80c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.601+0000 7f67f5e00700 1 -- 172.21.15.32:0/1648341629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00094b0 con 0x7f67f806ad90 2024-09-13T18:45:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67f5e00700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 0x7f67f81e9180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d370 tx=0x7f67e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8004450 con 0x7f67f806ad90 2024-09-13T18:45:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e80045d0 con 0x7f67f806ad90 2024-09-13T18:45:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8004980 con 0x7f67f806ad90 2024-09-13T18:45:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e800bc80 con 0x7f67f806ad90 2024-09-13T18:45:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f81ef940 con 0x7f67f806ad90 2024-09-13T18:45:27.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f806c9a0 con 0x7f67f806ad90 2024-09-13T18:45:27.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.605+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f67e801d420 con 0x7f67f806ad90 2024-09-13T18:45:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.609+0000 7f67ee000700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f67d8066760 0x7f67d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.609+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f67e8085dd0 con 0x7f67f806ad90 2024-09-13T18:45:27.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.609+0000 7f67f5400700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f67d8066760 0x7f67d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:27.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.609+0000 7f67f5400700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f67d8066760 0x7f67d8068c20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67f81f3710 tx=0x7f67e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:27.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.617+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67e8052e40 con 0x7f67f806ad90 2024-09-13T18:45:27.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.845+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f67f806a390 con 0x7f67f806ad90 2024-09-13T18:45:27.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.853+0000 7f67ee000700 1 -- 172.21.15.32:0/1648341629 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164896 (secure 0 0 0) 0x7f67e8056460 con 0x7f67f806ad90 2024-09-13T18:45:27.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f67d8066760 msgr2=0x7f67d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f67d8066760 0x7f67d8068c20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67f81f3710 tx=0x7f67e4009040 comp rx=0 tx=0).stop 2024-09-13T18:45:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 msgr2=0x7f67f81e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 0x7f67f81e9180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d370 tx=0x7f67e8004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 shutdown_connections 2024-09-13T18:45:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f67d8066760 0x7f67d8068c20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f81599c0 0x7f67f80c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67f814f8f0 0x7f67f80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 --2- 172.21.15.32:0/1648341629 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f67f806ad90 0x7f67f81e9180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 >> 172.21.15.32:0/1648341629 conn(0x7f67f8070fc0 msgr2=0x7f67f806d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 shutdown_connections 2024-09-13T18:45:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:27.861+0000 7f67f7200700 1 -- 172.21.15.32:0/1648341629 wait complete. 2024-09-13T18:45:27.890 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":184658639},{"type":"v1","addr":"172.21.15.86:6833","nonce":184658639}]},"active_addr":"172.21.15.86:6833/184658639","active_change":"2024-09-13T18:44:44.044269+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":991612787}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3215691737}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1262662990}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3734351997}]}]} 2024-09-13T18:45:27.894 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:45:27.894 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:45:27.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:28.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.053+0000 7fc067c00700 1 Processor -- start 2024-09-13T18:45:28.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.053+0000 7fc067c00700 1 -- start start 2024-09-13T18:45:28.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc067c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 0x7fc0600cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc067c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0600caa20 0x7fc060071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc067c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0600c9420 con 0x7fc0600aa610 2024-09-13T18:45:28.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc067c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0600c9140 con 0x7fc0600caa20 2024-09-13T18:45:28.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc067c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600a95c0 con 0x7fc0600aa230 2024-09-13T18:45:28.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 0x7fc0600cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc05fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc0600caa20 0x7fc060071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 0x7fc0600cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:60044/0 (socket says 172.21.15.32:60044) 2024-09-13T18:45:28.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 -- 172.21.15.32:0/2347324097 learned_addr learned my addr 172.21.15.32:0/2347324097 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:28.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 -- 172.21.15.32:0/2347324097 >> v2:172.21.15.86:3300/0 conn(0x7fc0600caa20 msgr2=0x7fc060071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 --2- 172.21.15.32:0/2347324097 >> v2:172.21.15.86:3300/0 conn(0x7fc0600caa20 0x7fc060071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 -- 172.21.15.32:0/2347324097 >> v1:172.21.15.32:6789/0 conn(0x7fc0600aa610 legacy=0x7fc06015b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 -- 172.21.15.32:0/2347324097 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600a98a0 con 0x7fc0600aa230 2024-09-13T18:45:28.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc065200700 1 --2- 172.21.15.32:0/2347324097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 0x7fc0600cb770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc054009e50 tx=0x7fc05400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265d7e49eea70a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc05f400700 1 -- 172.21.15.32:0/2347324097 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400e070 con 0x7fc0600aa230 2024-09-13T18:45:28.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc05f400700 1 -- 172.21.15.32:0/2347324097 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400b910 con 0x7fc0600aa230 2024-09-13T18:45:28.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.057+0000 7fc05f400700 1 -- 172.21.15.32:0/2347324097 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400bcc0 con 0x7fc0600aa230 2024-09-13T18:45:28.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 -- 172.21.15.32:0/2347324097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 msgr2=0x7fc0600cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 --2- 172.21.15.32:0/2347324097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 0x7fc0600cb770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc054009e50 tx=0x7fc05400b330 comp rx=0 tx=0).stop 2024-09-13T18:45:28.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 -- 172.21.15.32:0/2347324097 shutdown_connections 2024-09-13T18:45:28.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 --2- 172.21.15.32:0/2347324097 >> v2:172.21.15.86:3300/0 conn(0x7fc0600caa20 0x7fc060071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 --2- 172.21.15.32:0/2347324097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600aa230 0x7fc0600cb770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 -- 172.21.15.32:0/2347324097 >> 172.21.15.32:0/2347324097 conn(0x7fc060071240 msgr2=0x7fc06006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 -- 172.21.15.32:0/2347324097 shutdown_connections 2024-09-13T18:45:28.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.061+0000 7fc067c00700 1 -- 172.21.15.32:0/2347324097 wait complete. 2024-09-13T18:45:28.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.065+0000 7fc067c00700 1 Processor -- start 2024-09-13T18:45:28.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.065+0000 7fc067c00700 1 -- start start 2024-09-13T18:45:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 0x7fc06006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0600aa610 0x7fc06006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600caa20 0x7fc06006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601e13b0 con 0x7fc0600aa230 2024-09-13T18:45:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06006d140 con 0x7fc0600aa610 2024-09-13T18:45:28.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601eeeb0 con 0x7fc0600caa20 2024-09-13T18:45:28.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 0x7fc06006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 0x7fc06006d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43160/0 (socket says 172.21.15.32:43160) 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 -- 172.21.15.32:0/115528630 learned_addr learned my addr 172.21.15.32:0/115528630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc05fe00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0600aa610 0x7fc06006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600caa20 0x7fc06006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 -- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600caa20 msgr2=0x7fc06006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600caa20 0x7fc06006ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 -- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0600aa610 msgr2=0x7fc06006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0600aa610 0x7fc06006e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 -- 172.21.15.32:0/115528630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009b30 con 0x7fc0600aa230 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600caa20 0x7fc06006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:28.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc065200700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 0x7fc06006d5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0600a9700 tx=0x7fc054004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540048b0 con 0x7fc0600aa230 2024-09-13T18:45:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0540092e0 con 0x7fc0600aa230 2024-09-13T18:45:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05401c680 con 0x7fc0600aa230 2024-09-13T18:45:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0601ef150 con 0x7fc0600aa230 2024-09-13T18:45:28.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.069+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06006c810 con 0x7fc0600aa230 2024-09-13T18:45:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.073+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0600cb0c0 con 0x7fc0600aa230 2024-09-13T18:45:28.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.073+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc05401c7e0 con 0x7fc0600aa230 2024-09-13T18:45:28.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.073+0000 7fc05cc00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc040066730 0x7fc040068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.073+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0540860b0 con 0x7fc0600aa230 2024-09-13T18:45:28.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.077+0000 7fc05fe00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc040066730 0x7fc040068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.077+0000 7fc05fe00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc040066730 0x7fc040068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0600c0b40 tx=0x7fc04c009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.081+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc0540530a0 con 0x7fc0600aa230 2024-09-13T18:45:28.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.289+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0600c8d00 con 0x7fc0600aa230 2024-09-13T18:45:28.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.289+0000 7fc05cc00700 1 -- 172.21.15.32:0/115528630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fc0540566c0 con 0x7fc0600aa230 2024-09-13T18:45:28.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:28.297 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:28.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc040066730 msgr2=0x7fc040068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc040066730 0x7fc040068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0600c0b40 tx=0x7fc04c009240 comp rx=0 tx=0).stop 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 msgr2=0x7fc06006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 0x7fc06006d5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0600a9700 tx=0x7fc054004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 shutdown_connections 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc040066730 0x7fc040068bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0600caa20 0x7fc06006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0600aa610 0x7fc06006e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 --2- 172.21.15.32:0/115528630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0600aa230 0x7fc06006d5d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 >> 172.21.15.32:0/115528630 conn(0x7fc060071240 msgr2=0x7fc0600bff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 shutdown_connections 2024-09-13T18:45:28.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.293+0000 7fc067c00700 1 -- 172.21.15.32:0/115528630 wait complete. 2024-09-13T18:45:28.323 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:45:28.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:28.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.489+0000 7f732d000700 1 Processor -- start 2024-09-13T18:45:28.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f732d000700 1 -- start start 2024-09-13T18:45:28.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f732d000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73280c92c0 0x7f73280c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f732d000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c8120 0x7f732815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f732d000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732815a7e0 con 0x7f732815d2c0 2024-09-13T18:45:28.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f732d000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280c8960 con 0x7f73280c92c0 2024-09-13T18:45:28.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f732d000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328159810 con 0x7f73280c8120 2024-09-13T18:45:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73280c92c0 0x7f73280c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73280c92c0 0x7f73280c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43170/0 (socket says 172.21.15.32:43170) 2024-09-13T18:45:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 -- 172.21.15.32:0/3584637630 learned_addr learned my addr 172.21.15.32:0/3584637630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325400700 1 --2- 172.21.15.32:0/3584637630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c8120 0x7f732815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 -- 172.21.15.32:0/3584637630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c8120 msgr2=0x7f732815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 --2- 172.21.15.32:0/3584637630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c8120 0x7f732815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 -- 172.21.15.32:0/3584637630 >> v1:172.21.15.32:6789/0 conn(0x7f732815d2c0 legacy=0x7f73280719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.493+0000 7f7325e00700 1 -- 172.21.15.32:0/3584637630 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732815a350 con 0x7f73280c92c0 2024-09-13T18:45:28.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f7325e00700 1 --2- 172.21.15.32:0/3584637630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73280c92c0 0x7f73280c76d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7318009910 tx=0x7f7318009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eb6a1a355a0077 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f7324a00700 1 -- 172.21.15.32:0/3584637630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011830 con 0x7f73280c92c0 2024-09-13T18:45:28.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f7324a00700 1 -- 172.21.15.32:0/3584637630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318011990 con 0x7f73280c92c0 2024-09-13T18:45:28.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f7324a00700 1 -- 172.21.15.32:0/3584637630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011d40 con 0x7f73280c92c0 2024-09-13T18:45:28.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 -- 172.21.15.32:0/3584637630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73280c92c0 msgr2=0x7f73280c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 --2- 172.21.15.32:0/3584637630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73280c92c0 0x7f73280c76d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7318009910 tx=0x7f7318009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:28.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 -- 172.21.15.32:0/3584637630 shutdown_connections 2024-09-13T18:45:28.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 --2- 172.21.15.32:0/3584637630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c8120 0x7f732815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 --2- 172.21.15.32:0/3584637630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73280c92c0 0x7f73280c76d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 -- 172.21.15.32:0/3584637630 >> 172.21.15.32:0/3584637630 conn(0x7f7328071240 msgr2=0x7f732806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 -- 172.21.15.32:0/3584637630 shutdown_connections 2024-09-13T18:45:28.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.497+0000 7f732d000700 1 -- 172.21.15.32:0/3584637630 wait complete. 2024-09-13T18:45:28.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 Processor -- start 2024-09-13T18:45:28.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 -- start start 2024-09-13T18:45:28.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73280c8120 0x7f73280c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c92c0 0x7f73280acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 0x7f73280c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c3de0 con 0x7f732815d2c0 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c4eb0 con 0x7f73280c8120 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f732d000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c3fc0 con 0x7f73280c92c0 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f7326800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 0x7f73280c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f7325400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c92c0 0x7f73280acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f7325e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73280c8120 0x7f73280c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f7326800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 0x7f73280c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43184/0 (socket says 172.21.15.32:43184) 2024-09-13T18:45:28.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.501+0000 7f7326800700 1 -- 172.21.15.32:0/2366042377 learned_addr learned my addr 172.21.15.32:0/2366042377 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7326800700 1 -- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c92c0 msgr2=0x7f73280acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7326800700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c92c0 0x7f73280acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7326800700 1 -- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73280c8120 msgr2=0x7f73280c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7326800700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73280c8120 0x7f73280c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7326800700 1 -- 172.21.15.32:0/2366042377 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318009570 con 0x7f732815d2c0 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7325e00700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73280c8120 0x7f73280c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:28.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7325400700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c92c0 0x7f73280acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f7326800700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 0x7f73280c2d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f732000cbc0 tx=0x7f732000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320003c20 con 0x7f732815d2c0 2024-09-13T18:45:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320003d80 con 0x7f732815d2c0 2024-09-13T18:45:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000aa20 con 0x7f732815d2c0 2024-09-13T18:45:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73280c42a0 con 0x7f732815d2c0 2024-09-13T18:45:28.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73280c4860 con 0x7f732815d2c0 2024-09-13T18:45:28.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.505+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73280c2a50 con 0x7f732815d2c0 2024-09-13T18:45:28.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.509+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f732000ab80 con 0x7f732815d2c0 2024-09-13T18:45:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.509+0000 7f731e000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f73080667b0 0x7f7308068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.509+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73200843f0 con 0x7f732815d2c0 2024-09-13T18:45:28.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.509+0000 7f7325e00700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f73080667b0 0x7f7308068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.509+0000 7f7325e00700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f73080667b0 0x7f7308068c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7318009c60 tx=0x7f7318008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.517+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f73280c2a50 con 0x7f732815d2c0 2024-09-13T18:45:28.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.701+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73280c2a50 con 0x7f732815d2c0 2024-09-13T18:45:28.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.701+0000 7f731e000700 1 -- 172.21.15.32:0/2366042377 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f73280c2a50 con 0x7f732815d2c0 2024-09-13T18:45:28.710 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:28.710 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:28.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f73080667b0 msgr2=0x7f7308068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f73080667b0 0x7f7308068c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7318009c60 tx=0x7f7318008030 comp rx=0 tx=0).stop 2024-09-13T18:45:28.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 msgr2=0x7f73280c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 0x7f73280c2d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f732000cbc0 tx=0x7f732000ced0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 shutdown_connections 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f73080667b0 0x7f7308068c70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f732815d2c0 0x7f73280c2d30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73280c92c0 0x7f73280acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 --2- 172.21.15.32:0/2366042377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73280c8120 0x7f73280c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 >> 172.21.15.32:0/2366042377 conn(0x7f7328071240 msgr2=0x7f732815c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 shutdown_connections 2024-09-13T18:45:28.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.709+0000 7f732d000700 1 -- 172.21.15.32:0/2366042377 wait complete. 2024-09-13T18:45:28.742 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:45:28.742 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:45:28.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:45:28.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:45:28.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:45:28.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:45:28.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:45:28.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:45:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.977+0000 7fbdc3000700 1 Processor -- start 2024-09-13T18:45:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.977+0000 7fbdc3000700 1 -- start start 2024-09-13T18:45:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.977+0000 7f72c7a00700 1 Processor -- start 2024-09-13T18:45:28.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.977+0000 7f72c7a00700 1 -- start start 2024-09-13T18:45:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.977+0000 7f365b200700 1 Processor -- start 2024-09-13T18:45:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f365b200700 1 -- start start 2024-09-13T18:45:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdc3000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbdbc06ae20 0x7fbdbc06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c7a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f72c00c4ce0 0x7f72c015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdc3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc0cd0e0 0x7fbdbc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c7a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00b2660 0x7f72c015e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c7a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00b4890 con 0x7f72c00c4900 2024-09-13T18:45:28.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c7a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c00b3ff0 con 0x7f72c00c4ce0 2024-09-13T18:45:28.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c7a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00b42d0 con 0x7f72c00b2660 2024-09-13T18:45:28.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdc3000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0c28d0 con 0x7fbdbc151ab0 2024-09-13T18:45:28.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdc3000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0c4150 con 0x7fbdbc06ae20 2024-09-13T18:45:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdbbe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbdbc151ab0 0x7fbdbc0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51230/0 (socket says 172.21.15.32:51230) 2024-09-13T18:45:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdbbe00700 1 -- 172.21.15.32:0/3828772570 learned_addr learned my addr 172.21.15.32:0/3828772570 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdc1000700 1 --2- 172.21.15.32:0/3828772570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc0cd0e0 0x7fbdbc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdc3000700 1 -- 172.21.15.32:0/3828772570 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0c2310 con 0x7fbdbc0cd0e0 2024-09-13T18:45:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7ff85d400700 1 Processor -- start 2024-09-13T18:45:28.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdbb400700 1 --2- 172.21.15.32:0/3828772570 >> v2:172.21.15.32:3300/0 conn(0x7fbdbc06ae20 0x7fbdbc06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbafea00700 1 Processor -- start 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7ff85d400700 1 -- start start 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c5000700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f72c00c4900 0x7f72c00c5830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55556/0 (socket says 172.21.15.32:55556) 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c5000700 1 -- 172.21.15.32:0/1358763991 learned_addr learned my addr 172.21.15.32:0/1358763991 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:28.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72bfe00700 1 --2- 172.21.15.32:0/1358763991 >> v2:172.21.15.32:3300/0 conn(0x7f72c00c4ce0 0x7f72c015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f72c5a00700 1 --2- 172.21.15.32:0/1358763991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00b2660 0x7f72c015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbafea00700 1 -- start start 2024-09-13T18:45:28.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f365b200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f365c155bf0 0x7f365c160df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f3659400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f365c06fc10 0x7f365c1554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51242/0 (socket says 172.21.15.32:51242) 2024-09-13T18:45:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7f3659e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f365c072570 0x7f365c0c7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55572/0 (socket says 172.21.15.32:55572) 2024-09-13T18:45:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdbaa00700 1 -- 172.21.15.32:0/3828772570 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512798900 0 0) 0x7fbdbc0c28d0 con 0x7fbdbc151ab0 2024-09-13T18:45:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.981+0000 7fbdbaa00700 1 -- 172.21.15.32:0/3828772570 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda00035d0 con 0x7fbdbc151ab0 2024-09-13T18:45:28.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc1000700 1 -- 172.21.15.32:0/3828772570 >> v2:172.21.15.32:3300/0 conn(0x7fbdbc06ae20 msgr2=0x7fbdbc06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c5a00700 1 -- 172.21.15.32:0/1358763991 >> v2:172.21.15.32:3300/0 conn(0x7f72c00c4ce0 msgr2=0x7f72c015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c5a00700 1 --2- 172.21.15.32:0/1358763991 >> v2:172.21.15.32:3300/0 conn(0x7f72c00c4ce0 0x7f72c015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c5a00700 1 -- 172.21.15.32:0/1358763991 >> v1:172.21.15.32:6789/0 conn(0x7f72c00c4900 legacy=0x7f72c00c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c5a00700 1 -- 172.21.15.32:0/1358763991 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00b45b0 con 0x7f72c00b2660 2024-09-13T18:45:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3659e00700 1 -- 172.21.15.32:0/3975938532 learned_addr learned my addr 172.21.15.32:0/3975938532 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0caa10 con 0x7f365c072570 2024-09-13T18:45:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdbaa00700 1 -- 172.21.15.32:0/3828772570 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 824944700 0 0) 0x7fbda00035d0 con 0x7fbdbc151ab0 2024-09-13T18:45:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c5a00700 1 --2- 172.21.15.32:0/1358763991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00b2660 0x7f72c015e970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009d90 tx=0x7f72b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=367a00572d719af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc1000700 1 --2- 172.21.15.32:0/3828772570 >> v2:172.21.15.32:3300/0 conn(0x7fbdbc06ae20 0x7fbdbc06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc1000700 1 -- 172.21.15.32:0/3828772570 >> v1:172.21.15.86:6789/0 conn(0x7fbdbc151ab0 legacy=0x7fbdbc0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc1000700 1 -- 172.21.15.32:0/3828772570 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0c25f0 con 0x7fbdbc0cd0e0 2024-09-13T18:45:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc1000700 1 --2- 172.21.15.32:0/3828772570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc0cd0e0 0x7fbdbc0cd570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009850 tx=0x7fbda8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c20d948d8af4b0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0c9cc0 con 0x7f365c06fc10 2024-09-13T18:45:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0c67b0 con 0x7f365c155bf0 2024-09-13T18:45:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f365a800700 1 --2- 172.21.15.32:0/3975938532 >> v2:172.21.15.32:3300/0 conn(0x7f365c155bf0 0x7f365c160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205504430 0 0) 0x7f365c0c9cc0 con 0x7f365c06fc10 2024-09-13T18:45:28.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36400079e0 con 0x7f365c06fc10 2024-09-13T18:45:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72bf400700 1 -- 172.21.15.32:0/1358763991 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800e070 con 0x7f72c00b2660 2024-09-13T18:45:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72bf400700 1 -- 172.21.15.32:0/1358763991 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b800bb20 con 0x7f72c00b2660 2024-09-13T18:45:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72bf400700 1 -- 172.21.15.32:0/1358763991 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8012430 con 0x7f72c00b2660 2024-09-13T18:45:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbafea00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbaf80c4900 0x7fbaf80c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbaf7400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbaf80c5d70 0x7fbaf815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55576/0 (socket says 172.21.15.32:55576) 2024-09-13T18:45:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85d400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff8500df1d0 0x7ff8500455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 0x7ff850045b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85d400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500df6a0 con 0x7ff8500d8bc0 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85d400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85004ba10 con 0x7ff8500df1d0 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85d400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85004c070 con 0x7ff8500062a0 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdbaa00700 1 -- 172.21.15.32:0/3828772570 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40019f0 con 0x7fbdbc0cd0e0 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3160054134 0 0) 0x7f36400079e0 con 0x7f365c06fc10 2024-09-13T18:45:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 >> v2:172.21.15.32:3300/0 conn(0x7f365c155bf0 msgr2=0x7f365c160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 --2- 172.21.15.32:0/3975938532 >> v2:172.21.15.32:3300/0 conn(0x7f365c155bf0 0x7f365c160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 >> v1:172.21.15.32:6789/0 conn(0x7f365c072570 legacy=0x7f365c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c072950 con 0x7f365c06fc10 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 <== mon.1 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7f3648001650 con 0x7f365c06fc10 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 >> v1:172.21.15.86:6789/0 conn(0x7f365c06fc10 legacy=0x7f365c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3640007e50 0x7f3640008290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3640008c80 0x7f3640009100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3640009760 0x7f364000fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3640010600 con 0x7f3640009760 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3640010770 con 0x7f3640007e50 2024-09-13T18:45:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3640010930 con 0x7f3640008c80 2024-09-13T18:45:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85ca00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 0x7ff850045b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff857400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff8500df1d0 0x7ff8500455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85ca00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 0x7ff850045b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57074/0 (socket says 172.21.15.32:57074) 2024-09-13T18:45:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85ca00700 1 -- 172.21.15.32:0/1928707539 learned_addr learned my addr 172.21.15.32:0/1928707539 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:28.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdbaa00700 1 -- 172.21.15.32:0/3828772570 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8004030 con 0x7fbdbc0cd0e0 2024-09-13T18:45:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdbaa00700 1 -- 172.21.15.32:0/3828772570 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80043c0 con 0x7fbdbc0cd0e0 2024-09-13T18:45:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3659e00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3640007e50 0x7f3640008290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c7a00700 1 -- 172.21.15.32:0/1358763991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00b2660 msgr2=0x7f72c015e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c7a00700 1 --2- 172.21.15.32:0/1358763991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00b2660 0x7f72c015e970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009d90 tx=0x7f72b800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f3659400700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3640008c80 0x7f3640009100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbaf7400700 1 -- 172.21.15.32:0/4097230661 learned_addr learned my addr 172.21.15.32:0/4097230661 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80b4890 con 0x7fbaf80c5d70 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80b3ff0 con 0x7fbaf815eb40 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80b42d0 con 0x7fbaf80c4900 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbaf7e00700 1 --2- 172.21.15.32:0/4097230661 >> v2:172.21.15.32:3300/0 conn(0x7fbaf80c4900 0x7fbaf80c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735129794 0 0) 0x7fbaf80b3ff0 con 0x7fbaf815eb40 2024-09-13T18:45:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc3000700 1 -- 172.21.15.32:0/3828772570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc0cd0e0 msgr2=0x7fbdbc0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbdc3000700 1 --2- 172.21.15.32:0/3828772570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc0cd0e0 0x7fbdbc0cd570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009850 tx=0x7fbda8009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c7a00700 1 -- 172.21.15.32:0/1358763991 shutdown_connections 2024-09-13T18:45:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c7a00700 1 --2- 172.21.15.32:0/1358763991 >> v2:172.21.15.32:3300/0 conn(0x7f72c00c4ce0 0x7f72c015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c7a00700 1 --2- 172.21.15.32:0/1358763991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00b2660 0x7f72c015e970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7f72c7a00700 1 -- 172.21.15.32:0/1358763991 >> 172.21.15.32:0/1358763991 conn(0x7f72c0070180 msgr2=0x7f72c0070590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbadc0035d0 con 0x7fbaf815eb40 2024-09-13T18:45:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85ca00700 1 -- 172.21.15.32:0/1928707539 >> v2:172.21.15.32:3300/0 conn(0x7ff8500df1d0 msgr2=0x7ff8500455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.985+0000 7ff85ca00700 1 --2- 172.21.15.32:0/1928707539 >> v2:172.21.15.32:3300/0 conn(0x7ff8500df1d0 0x7ff8500455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f72c7a00700 1 -- 172.21.15.32:0/1358763991 shutdown_connections 2024-09-13T18:45:29.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273279484 0 0) 0x7fbaf80b4890 con 0x7fbaf80c5d70 2024-09-13T18:45:29.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7ff85ca00700 1 -- 172.21.15.32:0/1928707539 >> v1:172.21.15.32:6789/0 conn(0x7ff8500d8bc0 legacy=0x7ff850005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7ff85ca00700 1 -- 172.21.15.32:0/1928707539 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85004c350 con 0x7ff8500062a0 2024-09-13T18:45:29.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365a800700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3640009760 0x7f364000fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f72c7a00700 1 -- 172.21.15.32:0/1358763991 wait complete. 2024-09-13T18:45:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf80b3ff0 con 0x7fbaf80c5d70 2024-09-13T18:45:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf7e00700 1 -- 172.21.15.32:0/4097230661 >> v1:172.21.15.86:6789/0 conn(0x7fbaf815eb40 legacy=0x7fbaf80cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf7e00700 1 -- 172.21.15.32:0/4097230661 >> v1:172.21.15.32:6789/0 conn(0x7fbaf80c5d70 legacy=0x7fbaf815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf7e00700 1 -- 172.21.15.32:0/4097230661 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80b45b0 con 0x7fbaf80c4900 2024-09-13T18:45:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 Processor -- start 2024-09-13T18:45:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 -- 172.21.15.32:0/3828772570 shutdown_connections 2024-09-13T18:45:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 --2- 172.21.15.32:0/3828772570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc0cd0e0 0x7fbdbc0cd570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 --2- 172.21.15.32:0/3828772570 >> v2:172.21.15.32:3300/0 conn(0x7fbdbc06ae20 0x7fbdbc06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 -- 172.21.15.32:0/3828772570 >> 172.21.15.32:0/3828772570 conn(0x7fbdbc06eae0 msgr2=0x7fbdbc06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659e00700 1 -- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3640008c80 msgr2=0x7f3640009100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659e00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3640008c80 0x7f3640009100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659e00700 1 -- 172.21.15.32:0/3975938532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3640009760 msgr2=0x7f364000fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659e00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3640009760 0x7f364000fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659e00700 1 -- 172.21.15.32:0/3975938532 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c072950 con 0x7f3640007e50 2024-09-13T18:45:29.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf7e00700 1 --2- 172.21.15.32:0/4097230661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c4900 0x7fbaf80c5830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009850 tx=0x7fbae4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55134b3b77148f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659400700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3640008c80 0x7f3640009100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:29.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365a800700 1 -- 172.21.15.32:0/3975938532 reap_dead start 2024-09-13T18:45:29.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 -- start start 2024-09-13T18:45:29.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7ff85ca00700 1 --2- 172.21.15.32:0/1928707539 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 0x7ff850045b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff858069cf0 tx=0x7ff858067160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8170eac3b2c83754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fe2c1600700 1 Processor -- start 2024-09-13T18:45:29.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 -- 172.21.15.32:0/3828772570 shutdown_connections 2024-09-13T18:45:29.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3659e00700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3640007e50 0x7f3640008290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f3640009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca5d2e7c2df324b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 -- 172.21.15.32:0/3828772570 wait complete. 2024-09-13T18:45:29.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011830 con 0x7fbaf80c4900 2024-09-13T18:45:29.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4011990 con 0x7fbaf80c4900 2024-09-13T18:45:29.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbaf6a00700 1 -- 172.21.15.32:0/4097230661 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011d40 con 0x7fbaf80c4900 2024-09-13T18:45:29.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fe2c1600700 1 -- start start 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c005b60 con 0x7f3640007e50 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f3658a00700 1 -- 172.21.15.32:0/3975938532 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c005cc0 con 0x7f3640007e50 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c4900 msgr2=0x7fbaf80c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 --2- 172.21.15.32:0/4097230661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c4900 0x7fbaf80c5830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009850 tx=0x7fbae4009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 shutdown_connections 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 --2- 172.21.15.32:0/4097230661 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c4900 0x7fbaf80c5830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 >> 172.21.15.32:0/4097230661 conn(0x7fbaf8070180 msgr2=0x7fbaf8070590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3640007e50 msgr2=0x7f3640008290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3640007e50 0x7f3640008290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f364c007fd0 tx=0x7f3640009cb0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f72c7a00700 1 Processor -- start 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7ec40e6320 0x7f7ec404bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 0x7f7ec40460c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec4005b00 con 0x7f7ec40e6700 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec4035710 con 0x7f7ec40e6320 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ed2400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4046600 con 0x7f7ec4045ce0 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 shutdown_connections 2024-09-13T18:45:29.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 shutdown_connections 2024-09-13T18:45:29.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 --2- 172.21.15.32:0/3975938532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3640007e50 0x7f3640008290 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 >> 172.21.15.32:0/3975938532 conn(0x7f365c0cac60 msgr2=0x7f365c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f72c7a00700 1 -- start start 2024-09-13T18:45:29.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 shutdown_connections 2024-09-13T18:45:29.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f365b200700 1 -- 172.21.15.32:0/3975938532 wait complete. 2024-09-13T18:45:29.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 Processor -- start 2024-09-13T18:45:29.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbdc3000700 1 Processor -- start 2024-09-13T18:45:29.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 -- start start 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83f40c7d90 0x7f83f40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f83f415e8a0 0x7f83f4070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40c6030 con 0x7f83f40c5ba0 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40c67b0 con 0x7f83f415e8a0 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f9000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4161dc0 con 0x7f83f40c7d90 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f83f3400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83f40c7d90 0x7f83f40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83f40c7d90 0x7f83f40c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37000/0 (socket says 172.21.15.32:37000) 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 -- 172.21.15.32:0/76324359 learned_addr learned my addr 172.21.15.32:0/76324359 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7ff856a00700 1 -- 172.21.15.32:0/1928707539 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858067520 con 0x7ff8500062a0 2024-09-13T18:45:29.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff856a00700 1 -- 172.21.15.32:0/1928707539 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858067680 con 0x7ff8500062a0 2024-09-13T18:45:29.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff856a00700 1 -- 172.21.15.32:0/1928707539 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858067c30 con 0x7ff8500062a0 2024-09-13T18:45:29.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7fbafea00700 1 -- 172.21.15.32:0/4097230661 wait complete. 2024-09-13T18:45:29.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 -- start start 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.989+0000 7f7ecbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 0x7f7ec40460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 0x7f7ec40460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57102/0 (socket says 172.21.15.32:57102) 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 -- 172.21.15.32:0/4204715961 learned_addr learned my addr 172.21.15.32:0/4204715961 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 -- 172.21.15.32:0/4204715961 >> v2:172.21.15.32:3300/0 conn(0x7f7ec40e6320 msgr2=0x7f7ec404bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 --2- 172.21.15.32:0/4204715961 >> v2:172.21.15.32:3300/0 conn(0x7f7ec40e6320 0x7f7ec404bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 -- 172.21.15.32:0/4204715961 >> v1:172.21.15.32:6789/0 conn(0x7f7ec40e6700 legacy=0x7f7ec40dc9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 -- 172.21.15.32:0/4204715961 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40e3560 con 0x7f7ec4045ce0 2024-09-13T18:45:29.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3e00700 1 --2- 172.21.15.32:0/76324359 >> v2:172.21.15.32:3300/0 conn(0x7f83f415e8a0 0x7f83f4070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72c00b2660 0x7f72c01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 -- 172.21.15.32:0/1928707539 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 msgr2=0x7ff850045b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 --2- 172.21.15.32:0/1928707539 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 0x7ff850045b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff858069cf0 tx=0x7ff858067160 comp rx=0 tx=0).stop 2024-09-13T18:45:29.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecbe00700 1 --2- 172.21.15.32:0/4204715961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 0x7f7ec40460c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0641b0 tx=0x7f7ecc067160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a16b8f22b4f8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72c00c4900 0x7f72c01563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 -- 172.21.15.32:0/1928707539 shutdown_connections 2024-09-13T18:45:29.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 --2- 172.21.15.32:0/1928707539 >> v2:172.21.15.32:3300/0 conn(0x7ff8500df1d0 0x7ff8500455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 --2- 172.21.15.32:0/1928707539 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500062a0 0x7ff850045b30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 -- 172.21.15.32:0/1928707539 >> 172.21.15.32:0/1928707539 conn(0x7ff85004fd00 msgr2=0x7ff850050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c7fa0 0x7fe2bc155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2bc0c8420 0x7fe2bc1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2bc158a80 con 0x7fe2bc0aa550 2024-09-13T18:45:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2bc159a10 con 0x7fe2bc0c8420 2024-09-13T18:45:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc159040 con 0x7fe2bc0c7fa0 2024-09-13T18:45:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 -- 172.21.15.32:0/76324359 >> v2:172.21.15.32:3300/0 conn(0x7f83f415e8a0 msgr2=0x7f83f4070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecb400700 1 -- 172.21.15.32:0/4204715961 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc04ece0 con 0x7f7ec4045ce0 2024-09-13T18:45:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 --2- 172.21.15.32:0/76324359 >> v2:172.21.15.32:3300/0 conn(0x7f83f415e8a0 0x7f83f4070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 -- 172.21.15.32:0/76324359 >> v1:172.21.15.86:6789/0 conn(0x7f83f40c5ba0 legacy=0x7f83f415e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecb400700 1 -- 172.21.15.32:0/4204715961 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc067520 con 0x7f7ec4045ce0 2024-09-13T18:45:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ecb400700 1 -- 172.21.15.32:0/4204715961 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0678f0 con 0x7f7ec4045ce0 2024-09-13T18:45:29.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 -- 172.21.15.32:0/1928707539 shutdown_connections 2024-09-13T18:45:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00c4ce0 0x7f72c0156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01f4330 con 0x7f72c00c4900 2024-09-13T18:45:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0155f60 con 0x7f72c00b2660 2024-09-13T18:45:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01f4090 con 0x7f72c00c4ce0 2024-09-13T18:45:29.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 -- 172.21.15.32:0/76324359 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f41611b0 con 0x7f83f40c7d90 2024-09-13T18:45:29.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 Processor -- start 2024-09-13T18:45:29.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 -- 172.21.15.32:0/1928707539 wait complete. 2024-09-13T18:45:29.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c5000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72c00b2660 0x7f72c01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72c00c4900 0x7f72c01563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72c00c4900 0x7f72c01563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48590/0 (socket says 172.21.15.32:48590) 2024-09-13T18:45:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 -- 172.21.15.32:0/920277535 learned_addr learned my addr 172.21.15.32:0/920277535 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2b3e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe2bc0aa550 0x7fe2bc155c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51254/0 (socket says 172.21.15.32:51254) 2024-09-13T18:45:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2b3e00700 1 -- 172.21.15.32:0/1240696069 learned_addr learned my addr 172.21.15.32:0/1240696069 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c0c00700 1 --2- 172.21.15.32:0/1240696069 >> v2:172.21.15.86:3300/0 conn(0x7fe2bc0c8420 0x7fe2bc1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c5a00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00c4ce0 0x7f72c0156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2bbe00700 1 --2- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c7fa0 0x7fe2bc155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 -- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00c4ce0 msgr2=0x7f72c0156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72c00c4ce0 0x7f72c0156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 -- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72c00b2660 msgr2=0x7f72c01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72c00b2660 0x7f72c01591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 -- 172.21.15.32:0/920277535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8009a70 con 0x7f72c00c4900 2024-09-13T18:45:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdbc06ae20 0x7fbdbc0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdbc0cd0e0 0x7fbdbc1ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c0c00700 1 -- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c7fa0 msgr2=0x7fe2bc155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c0c00700 1 --2- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c7fa0 0x7fe2bc155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c0c00700 1 -- 172.21.15.32:0/1240696069 >> v1:172.21.15.86:6789/0 conn(0x7fe2bc0aa550 legacy=0x7fe2bc155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c0c00700 1 -- 172.21.15.32:0/1240696069 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc06ed60 con 0x7fe2bc0c8420 2024-09-13T18:45:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 Processor -- start 2024-09-13T18:45:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c5000700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72c00b2660 0x7f72c01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bfe00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72c00c4900 0x7f72c01563f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009fd0 tx=0x7f72ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc151ab0 0x7fbdbc1ee920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc150b60 con 0x7fbdbc0cd0e0 2024-09-13T18:45:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc142850 con 0x7fbdbc06ae20 2024-09-13T18:45:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc1eefd0 con 0x7fbdbc151ab0 2024-09-13T18:45:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f3400700 1 --2- 172.21.15.32:0/76324359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f40c5660 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f83f406ea50 tx=0x7f83ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be15620be35d4ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbb400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdbc0cd0e0 0x7fbdbc1ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdbc06ae20 0x7fbdbc0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0095a0 con 0x7f72c00c4900 2024-09-13T18:45:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f2000700 1 -- 172.21.15.32:0/76324359 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00e070 con 0x7f83f40c7d90 2024-09-13T18:45:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 -- 172.21.15.32:0/4204715961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 msgr2=0x7f7ec40460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 -- start start 2024-09-13T18:45:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f2000700 1 -- 172.21.15.32:0/76324359 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec003a40 con 0x7f83f40c7d90 2024-09-13T18:45:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 --2- 172.21.15.32:0/4204715961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 0x7f7ec40460c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0641b0 tx=0x7f7ecc067160 comp rx=0 tx=0).stop 2024-09-13T18:45:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdbc06ae20 0x7fbdbc0b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37030/0 (socket says 172.21.15.32:37030) 2024-09-13T18:45:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 -- 172.21.15.32:0/3863085577 learned_addr learned my addr 172.21.15.32:0/3863085577 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f2000700 1 -- 172.21.15.32:0/76324359 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00e070 con 0x7f83f40c7d90 2024-09-13T18:45:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc1000700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc151ab0 0x7fbdbc1ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 -- 172.21.15.32:0/4204715961 shutdown_connections 2024-09-13T18:45:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 --2- 172.21.15.32:0/4204715961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec4045ce0 0x7f7ec40460c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 --2- 172.21.15.32:0/4204715961 >> v2:172.21.15.32:3300/0 conn(0x7f7ec40e6320 0x7f7ec404bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 -- 172.21.15.32:0/4204715961 >> 172.21.15.32:0/4204715961 conn(0x7f7ec404fd00 msgr2=0x7f7ec4050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c0c00700 1 --2- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc0c8420 0x7fe2bc1594d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009850 tx=0x7fe2b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b61e23b79100018a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 -- 172.21.15.32:0/4204715961 shutdown_connections 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac013680 con 0x7f72c00c4900 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac013a10 con 0x7f72c00c4900 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0155c30 con 0x7f72c00c4900 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c0155190 con 0x7f72c00c4900 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c5d70 0x7fbaf81e5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf815eb40 0x7fbaf81e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf815dc00 0x7fbaf81f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c6b40 con 0x7fbaf80c5d70 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf81e4f70 con 0x7fbaf815dc00 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafea00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf8159aa0 con 0x7fbaf815eb40 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 Processor -- start 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7ff85d400700 1 -- start start 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 -- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc151ab0 msgr2=0x7fbdbc1ee920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdbc151ab0 0x7fbdbc1ee920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 -- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdbc0cd0e0 msgr2=0x7fbdbc1ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdbc0cd0e0 0x7fbdbc1ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 -- 172.21.15.32:0/3863085577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80094b0 con 0x7fbdbc06ae20 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdbbe00700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdbc06ae20 0x7fbdbc0b1340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400cc70 tx=0x7fbdb400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f9000700 1 -- 172.21.15.32:0/76324359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 msgr2=0x7f83f40c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f9000700 1 --2- 172.21.15.32:0/76324359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f40c5660 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f83f406ea50 tx=0x7f83ec00b330 comp rx=0 tx=0).stop 2024-09-13T18:45:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2bb400700 1 -- 172.21.15.32:0/1240696069 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011830 con 0x7fe2bc0c8420 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2bb400700 1 -- 172.21.15.32:0/1240696069 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4011990 con 0x7fe2bc0c8420 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2bb400700 1 -- 172.21.15.32:0/1240696069 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4011d20 con 0x7fe2bc0c8420 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 -- start start 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f365c150230 0x7f365c14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f365c14db00 0x7f365c14c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f365c150610 0x7f365c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0aa7f0 con 0x7f365c150230 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c147f60 con 0x7f365c150610 2024-09-13T18:45:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f365b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0aaa40 con 0x7f365c14db00 2024-09-13T18:45:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f365c150230 0x7f365c14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f365c14db00 0x7f365c14c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f365c150230 0x7f365c14c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48600/0 (socket says 172.21.15.32:48600) 2024-09-13T18:45:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 -- 172.21.15.32:0/3027570289 learned_addr learned my addr 172.21.15.32:0/3027570289 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f7ed2400700 1 -- 172.21.15.32:0/4204715961 wait complete. 2024-09-13T18:45:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 -- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f365c14db00 msgr2=0x7f365c14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f365c14db00 0x7f365c14c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 -- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f365c150610 msgr2=0x7f365c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f365c150610 0x7f365c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 -- 172.21.15.32:0/3027570289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c06e050 con 0x7f365c150230 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f3659e00700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f365c150230 0x7f365c14c460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f364c005820 tx=0x7f364c004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400ade0 con 0x7fbdbc06ae20 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb400ce70 con 0x7fbdbc06ae20 2024-09-13T18:45:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40072f0 con 0x7fbdbc06ae20 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f9000700 1 -- 172.21.15.32:0/76324359 shutdown_connections 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f9000700 1 --2- 172.21.15.32:0/76324359 >> v2:172.21.15.32:3300/0 conn(0x7f83f415e8a0 0x7f83f4070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f9000700 1 --2- 172.21.15.32:0/76324359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f40c5660 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7f83f9000700 1 -- 172.21.15.32:0/76324359 >> 172.21.15.32:0/76324359 conn(0x7f83f40cac60 msgr2=0x7f83f40cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafca00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf815dc00 0x7fbaf81f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbaf7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf815eb40 0x7fbaf81e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafca00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf815dc00 0x7fbaf81f7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37048/0 (socket says 172.21.15.32:37048) 2024-09-13T18:45:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbafca00700 1 -- 172.21.15.32:0/812165705 learned_addr learned my addr 172.21.15.32:0/812165705 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 -- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc0c8420 msgr2=0x7fe2bc1594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 --2- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc0c8420 0x7fe2bc1594d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009850 tx=0x7fe2b4009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:29.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc14fee0 con 0x7fbdbc06ae20 2024-09-13T18:45:29.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7298000fc0 con 0x7f72c00c4900 2024-09-13T18:45:29.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:28.997+0000 7fe2c1600700 1 -- 172.21.15.32:0/1240696069 shutdown_connections 2024-09-13T18:45:29.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fe2c1600700 1 --2- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc0c8420 0x7fe2bc1594d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fe2c1600700 1 --2- 172.21.15.32:0/1240696069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c7fa0 0x7fe2bc155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fe2c1600700 1 -- 172.21.15.32:0/1240696069 >> 172.21.15.32:0/1240696069 conn(0x7fe2bc0cac60 msgr2=0x7fe2bc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbafca00700 1 -- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf815eb40 msgr2=0x7fbaf81e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbafca00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf815eb40 0x7fbaf81e5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbafca00700 1 -- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c5d70 msgr2=0x7fbaf81e5730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:29.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc1504a0 con 0x7fbdbc06ae20 2024-09-13T18:45:29.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0078c0 con 0x7f365c150230 2024-09-13T18:45:29.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c005ae0 con 0x7f365c150230 2024-09-13T18:45:29.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c005e70 con 0x7f365c150230 2024-09-13T18:45:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f83f9000700 1 -- 172.21.15.32:0/76324359 shutdown_connections 2024-09-13T18:45:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c06e330 con 0x7f365c150230 2024-09-13T18:45:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85d400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8500062a0 0x7ff850047120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbafca00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf80c5d70 0x7fbaf81e5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbafca00700 1 -- 172.21.15.32:0/812165705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40094b0 con 0x7fbaf815dc00 2024-09-13T18:45:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500d8bc0 0x7ff8500de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8500df1d0 0x7ff8500d1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0aad20 con 0x7f365c150230 2024-09-13T18:45:29.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f7ed2400700 1 Processor -- start 2024-09-13T18:45:29.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdbc0c3e10 con 0x7fbdbc06ae20 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85d400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500d5b00 con 0x7ff8500df1d0 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85d400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500d11d0 con 0x7ff8500062a0 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85d400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500d5d50 con 0x7ff8500d8bc0 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff857e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8500062a0 0x7ff850047120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff857e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8500062a0 0x7ff850047120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37062/0 (socket says 172.21.15.32:37062) 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff857e00700 1 -- 172.21.15.32:0/2489510469 learned_addr learned my addr 172.21.15.32:0/2489510469 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8500df1d0 0x7ff8500d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff857400700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500d8bc0 0x7ff8500de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 -- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500d8bc0 msgr2=0x7ff8500de4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8500d8bc0 0x7ff8500de4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 -- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8500062a0 msgr2=0x7ff850047120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8500062a0 0x7ff850047120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 -- 172.21.15.32:0/2489510469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580758d0 con 0x7ff8500df1d0 2024-09-13T18:45:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f365c0c9670 con 0x7f365c150230 2024-09-13T18:45:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbafca00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf815dc00 0x7fbaf81f7120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000cbc0 tx=0x7fbaf000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f83f9000700 1 -- 172.21.15.32:0/76324359 wait complete. 2024-09-13T18:45:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72ac013b70 con 0x7f72c00c4900 2024-09-13T18:45:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0003c20 con 0x7fbaf815dc00 2024-09-13T18:45:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0003d80 con 0x7fbaf815dc00 2024-09-13T18:45:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000aae0 con 0x7fbaf815dc00 2024-09-13T18:45:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f83f9000700 1 Processor -- start 2024-09-13T18:45:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f83f9000700 1 -- start start 2024-09-13T18:45:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7ff85ca00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8500df1d0 0x7ff8500d1660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff858063990 tx=0x7ff8580757c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72bcc00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f72a0066730 0x7f72a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f9000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f4070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f9000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f415e8a0 0x7f83f41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83f4127270 0x7f83f41586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f9000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41ff150 con 0x7f83f415e8a0 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f9000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41528c0 con 0x7f83f40c7d90 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f9000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4127e80 con 0x7f83f4127270 2024-09-13T18:45:29.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72ac084840 con 0x7f72c00c4900 2024-09-13T18:45:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f4070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72bcc00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f72a006fcf0 0x7f72a0072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72a0072800 con 0x7f72a006fcf0 2024-09-13T18:45:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72ac086e20 con 0x7f72c00c4900 2024-09-13T18:45:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72c5000700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f72a0066730 0x7f72a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f4070100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37072/0 (socket says 172.21.15.32:37072) 2024-09-13T18:45:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 -- 172.21.15.32:0/253229271 learned_addr learned my addr 172.21.15.32:0/253229271 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3e00700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83f4127270 0x7f83f41586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f2a00700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f415e8a0 0x7f83f41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f7ed2400700 1 -- start start 2024-09-13T18:45:29.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72c5a00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f72a006fcf0 0x7f72a0072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ec4045ce0 0x7f7ec40d4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdb4007450 con 0x7fbdbc06ae20 2024-09-13T18:45:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f364c019070 con 0x7f365c150230 2024-09-13T18:45:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 -- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83f4127270 msgr2=0x7f83f41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83f4127270 0x7f83f41586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 -- 172.21.15.32:0/253229271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f415e8a0 msgr2=0x7f83f41581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f83f415e8a0 0x7f83f41581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ec40e6320 0x7f7ec4006530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec40e6700 0x7f7ec4006a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ec4045ce0 0x7f7ec40d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f83f3400700 1 -- 172.21.15.32:0/253229271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009b30 con 0x7f83f40c7d90 2024-09-13T18:45:29.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ec4045ce0 0x7f7ec40d4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37074/0 (socket says 172.21.15.32:37074) 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858067520 con 0x7ff8500df1d0 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858068040 con 0x7ff8500df1d0 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580722e0 con 0x7ff8500df1d0 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500cf860 con 0x7ff8500df1d0 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500d0e60 con 0x7ff8500df1d0 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1000700 1 -- 172.21.15.32:0/821927676 learned_addr learned my addr 172.21.15.32:0/821927676 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec416e130 con 0x7f7ec40e6320 2024-09-13T18:45:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fe2c1600700 1 -- 172.21.15.32:0/1240696069 shutdown_connections 2024-09-13T18:45:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40d47d0 con 0x7f7ec4045ce0 2024-09-13T18:45:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.001+0000 7fe2c1600700 1 -- 172.21.15.32:0/1240696069 wait complete. 2024-09-13T18:45:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41784f0 con 0x7f7ec40e6700 2024-09-13T18:45:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1a00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec40e6700 0x7f7ec4006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdb3e00700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd9c066760 0x7fbd9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72c5a00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f72a006fcf0 0x7f72a0072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdb4084630 con 0x7fbdbc06ae20 2024-09-13T18:45:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f72c5000700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f72a0066730 0x7f72a0068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72b0007fd0 tx=0x7f72b0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ecbe00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ec40e6320 0x7f7ec4006530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fe2c1600700 1 Processor -- start 2024-09-13T18:45:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdb3e00700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd9c06fd20 0x7fbd9c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd9c072830 con 0x7fbd9c06fd20 2024-09-13T18:45:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdb40849a0 con 0x7fbdbc06ae20 2024-09-13T18:45:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf81568e0 con 0x7fbaf815dc00 2024-09-13T18:45:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf81e5210 con 0x7fbaf815dc00 2024-09-13T18:45:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7fbdbb400700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd9c066760 0x7fbd9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f3652000700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f363c066830 0x7f363c068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f364c0855f0 con 0x7f365c150230 2024-09-13T18:45:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1a00700 1 -- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ec4045ce0 msgr2=0x7f7ec40d4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1a00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ec4045ce0 0x7f7ec40d4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.005+0000 7f7ed1a00700 1 -- 172.21.15.32:0/821927676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ec40e6320 msgr2=0x7f7ec4006530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fbdc1000700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd9c06fd20 0x7fbd9c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 -- start start 2024-09-13T18:45:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f3659400700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f363c066830 0x7f363c068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f3652000700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f363c06fe70 0x7f363c0722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f363c072980 con 0x7f363c06fe70 2024-09-13T18:45:29.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f364c0859a0 con 0x7f365c150230 2024-09-13T18:45:29.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ed1a00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ec40e6320 0x7f7ec4006530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ed1a00700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0758d0 con 0x7f7ec40e6700 2024-09-13T18:45:29.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ecbe00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ec40e6320 0x7f7ec4006530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:29.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f72a0072800 con 0x7f72a006fcf0 2024-09-13T18:45:29.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f83f3400700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f4070100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009850 tx=0x7f83ec004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ed1a00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec40e6700 0x7f7ec4006a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000b440 tx=0x7f7ec000b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f365a800700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f363c06fe70 0x7f363c0722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff850005b90 con 0x7ff8500df1d0 2024-09-13T18:45:29.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00e070 con 0x7f83f40c7d90 2024-09-13T18:45:29.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec0092e0 con 0x7f83f40c7d90 2024-09-13T18:45:29.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0094f0 con 0x7f83f40c7d90 2024-09-13T18:45:29.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0011830 con 0x7f7ec40e6700 2024-09-13T18:45:29.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fbdc1000700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd9c06fd20 0x7fbd9c072160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2bc0aa550 0x7fe2bc06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c8420 0x7fe2bc0aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc157e80 0x7fe2bc0ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0abb60 con 0x7fe2bc0aa550 2024-09-13T18:45:29.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc1fc440 con 0x7fe2bc157e80 2024-09-13T18:45:29.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c1600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc06e7e0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0011990 con 0x7f7ec40e6700 2024-09-13T18:45:29.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0011d40 con 0x7f7ec40e6700 2024-09-13T18:45:29.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec41787b0 con 0x7f7ec40e6700 2024-09-13T18:45:29.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec4178d70 con 0x7f7ec40e6700 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c8420 0x7fe2bc0aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c8420 0x7fe2bc0aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57186/0 (socket says 172.21.15.32:57186) 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3497770569 learned_addr learned my addr 172.21.15.32:0/3497770569 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2c0c00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc157e80 0x7fe2bc0ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc157e80 msgr2=0x7fe2bc0ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2bc157e80 0x7fe2bc0ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3497770569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2bc0aa550 msgr2=0x7fe2bc06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2bc0aa550 0x7fe2bc06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3497770569 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40094b0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ec4045850 con 0x7f7ec40e6700 2024-09-13T18:45:29.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd9c072830 con 0x7fbd9c06fd20 2024-09-13T18:45:29.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.009+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff85809a020 con 0x7ff8500df1d0 2024-09-13T18:45:29.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f41ff3a0 con 0x7f83f40c7d90 2024-09-13T18:45:29.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f3659400700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f363c066830 0x7f363c068cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f365c0c8bf0 tx=0x7f36480078e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f365a800700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f363c06fe70 0x7f363c0722b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2b3e00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c8420 0x7fe2bc0aacc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4001eb0 tx=0x7fe2a400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fbdbb400700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd9c066760 0x7fbd9c068c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0cbb10 tx=0x7fbdac008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f41ff960 con 0x7f83f40c7d90 2024-09-13T18:45:29.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbaf80cb4e0 con 0x7fbaf815dc00 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4005d90 con 0x7fe2bc0c8420 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a40070d0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4007440 con 0x7fe2bc0c8420 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc0ad050 con 0x7fe2bc0c8420 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc0ad610 con 0x7fe2bc0c8420 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff84be00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff8380667b0 0x7ff838068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff858100000 con 0x7ff8500df1d0 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff84be00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff83806fdf0 0x7ff838072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff838072900 con 0x7ff83806fdf0 2024-09-13T18:45:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8581004a0 con 0x7ff8500df1d0 2024-09-13T18:45:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff857e00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff8380667b0 0x7ff838068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f363c072980 con 0x7f363c06fe70 2024-09-13T18:45:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff857400700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff83806fdf0 0x7ff838072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbaf000ac40 con 0x7fbaf815dc00 2024-09-13T18:45:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7ff857400700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff83806fdf0 0x7ff838072230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff838072900 con 0x7ff83806fdf0 2024-09-13T18:45:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7ff857e00700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff8380667b0 0x7ff838068c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0018f0 tx=0x7ff84c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83f4161a50 con 0x7f83f40c7d90 2024-09-13T18:45:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2bc158cd0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.013+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ec001a400 con 0x7f7ec40e6700 2024-09-13T18:45:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f7ec8c00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7eac0667b0 0x7f7eac068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83ec019030 con 0x7f83f40c7d90 2024-09-13T18:45:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ec00848d0 con 0x7f7ec40e6700 2024-09-13T18:45:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaefe00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbad8066800 0x7fbad8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbaf0084450 con 0x7fbaf815dc00 2024-09-13T18:45:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f7ec8c00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7eac06fdf0 0x7f7eac072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7eac072900 con 0x7f7eac06fdf0 2024-09-13T18:45:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ec0084c40 con 0x7f7ec40e6700 2024-09-13T18:45:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaefe00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbad806fdc0 0x7fbad8072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbad80728d0 con 0x7fbad806fdc0 2024-09-13T18:45:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf0001c10 con 0x7fbaf815dc00 2024-09-13T18:45:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f7ed1000700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7eac0667b0 0x7f7eac068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2a40075a0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaf7e00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbad8066800 0x7fbad8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f83eb400700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f83d0066830 0x7f83d0068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83ec085b60 con 0x7f83f40c7d90 2024-09-13T18:45:29.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.017+0000 7fbaf7400700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbad806fdc0 0x7fbad8072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f7ecbe00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7eac06fdf0 0x7f7eac072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83eb400700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f83d006fe70 0x7f83d00722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83d0072980 con 0x7f83d006fe70 2024-09-13T18:45:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f7ecbe00700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7eac06fdf0 0x7f7eac072230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83ec085f10 con 0x7f83f40c7d90 2024-09-13T18:45:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83f3e00700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f83d006fe70 0x7f83d00722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2b8c00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe298066730 0x7fe298068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2a40843f0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2b8c00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fe29806fd70 0x7fe2980721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe298072880 con 0x7fe29806fd70 2024-09-13T18:45:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2bbe00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe298066730 0x7fe298068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2a40847a0 con 0x7fe2bc0c8420 2024-09-13T18:45:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fbaf7e00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbad8066800 0x7fbad8068cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbaf808c610 tx=0x7fbae4010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fbaf7400700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbad806fdc0 0x7fbad8072200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f7ed1000700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7eac0667b0 0x7f7eac068c70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009af0 tx=0x7f7eb8009290 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2c0c00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fe29806fd70 0x7fe2980721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83f2a00700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f83d0066830 0x7f83d0068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2bbe00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe298066730 0x7fe298068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0070b0 tx=0x7fe2ac007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83f3e00700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f83d006fe70 0x7f83d00722b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbad80728d0 con 0x7fbad806fdc0 2024-09-13T18:45:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7fe2c0c00700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fe29806fd70 0x7fe2980721b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f83f2a00700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f83d0066830 0x7f83d0068cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83f415c6f0 tx=0x7f83e4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.021+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7eac072900 con 0x7f7eac06fdf0 2024-09-13T18:45:29.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.025+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f83d0072980 con 0x7f83d006fe70 2024-09-13T18:45:29.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.025+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe298072880 con 0x7fe29806fd70 2024-09-13T18:45:29.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.033+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbdbc1575b0 con 0x7fbd9c06fd20 2024-09-13T18:45:29.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.037+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7298002d60 con 0x7f72a006fcf0 2024-09-13T18:45:29.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.037+0000 7fbdb3e00700 1 -- 172.21.15.32:0/3863085577 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbda8021040 con 0x7fbd9c06fd20 2024-09-13T18:45:29.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd9c06fd20 msgr2=0x7fbd9c072160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc3000700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd9c06fd20 0x7fbd9c072160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72bcc00700 1 -- 172.21.15.32:0/920277535 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7298002d60 con 0x7f72a006fcf0 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f72a006fcf0 msgr2=0x7f72a0072130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f72a006fcf0 0x7f72a0072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd9c066760 msgr2=0x7fbd9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc3000700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd9c066760 0x7fbd9c068c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0cbb10 tx=0x7fbdac008040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdbc06ae20 msgr2=0x7fbdbc0b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc3000700 1 --2- 172.21.15.32:0/3863085577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdbc06ae20 0x7fbdbc0b1340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400cc70 tx=0x7fbdb400a340 comp rx=0 tx=0).stop 2024-09-13T18:45:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7fbdc1000700 1 -- 172.21.15.32:0/3863085577 reap_dead start 2024-09-13T18:45:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f72a0066730 msgr2=0x7f72a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f72a0066730 0x7f72a0068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72b0007fd0 tx=0x7f72b0009040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72c00c4900 msgr2=0x7f72c01563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 --2- 172.21.15.32:0/920277535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f72c00c4900 0x7f72c01563f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009fd0 tx=0x7f72ac00ebd0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c5a00700 1 -- 172.21.15.32:0/920277535 reap_dead start 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 shutdown_connections 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 >> 172.21.15.32:0/920277535 conn(0x7f72c0070180 msgr2=0x7f72c00c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 shutdown_connections 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.041+0000 7f72c7a00700 1 -- 172.21.15.32:0/920277535 wait complete. 2024-09-13T18:45:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.045+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 shutdown_connections 2024-09-13T18:45:29.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.045+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 >> 172.21.15.32:0/3863085577 conn(0x7fbdbc06eae0 msgr2=0x7fbdbc1e09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.045+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 shutdown_connections 2024-09-13T18:45:29.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.045+0000 7fbdc3000700 1 -- 172.21.15.32:0/3863085577 wait complete. 2024-09-13T18:45:29.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.049+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f365c0ca730 con 0x7f363c06fe70 2024-09-13T18:45:29.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.049+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8500d1310 con 0x7ff83806fdf0 2024-09-13T18:45:29.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.049+0000 7ff84be00700 1 -- 172.21.15.32:0/2489510469 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff8500d1310 con 0x7ff83806fdf0 2024-09-13T18:45:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff83806fdf0 msgr2=0x7ff838072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff83806fdf0 0x7ff838072230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff8380667b0 msgr2=0x7ff838068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff8380667b0 0x7ff838068c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0018f0 tx=0x7ff84c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8500df1d0 msgr2=0x7ff8500d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 --2- 172.21.15.32:0/2489510469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff8500df1d0 0x7ff8500d1660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff858063990 tx=0x7ff8580757c0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f3652000700 1 -- 172.21.15.32:0/3027570289 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3654007a50 con 0x7f363c06fe70 2024-09-13T18:45:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbaf80cafc0 con 0x7fbad806fdc0 2024-09-13T18:45:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ec404c510 con 0x7f7eac06fdf0 2024-09-13T18:45:29.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85ca00700 1 -- 172.21.15.32:0/2489510469 reap_dead start 2024-09-13T18:45:29.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 shutdown_connections 2024-09-13T18:45:29.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 >> 172.21.15.32:0/2489510469 conn(0x7ff85004fd00 msgr2=0x7ff85004ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f363c06fe70 msgr2=0x7f363c0722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f363c06fe70 0x7f363c0722b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 shutdown_connections 2024-09-13T18:45:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7ff85d400700 1 -- 172.21.15.32:0/2489510469 wait complete. 2024-09-13T18:45:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f363c066830 msgr2=0x7f363c068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f363c066830 0x7f363c068cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f365c0c8bf0 tx=0x7f36480078e0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f365c150230 msgr2=0x7f365c14c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 --2- 172.21.15.32:0/3027570289 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f365c150230 0x7f365c14c460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f364c005820 tx=0x7f364c004a30 comp rx=0 tx=0).stop 2024-09-13T18:45:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365a800700 1 -- 172.21.15.32:0/3027570289 reap_dead start 2024-09-13T18:45:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 shutdown_connections 2024-09-13T18:45:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 >> 172.21.15.32:0/3027570289 conn(0x7f365c0cac60 msgr2=0x7f365c071670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 shutdown_connections 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f365b200700 1 -- 172.21.15.32:0/3027570289 wait complete. 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbaefe00700 1 -- 172.21.15.32:0/812165705 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbae8006bf0 con 0x7fbad806fdc0 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbad806fdc0 msgr2=0x7fbad8072200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbad806fdc0 0x7fbad8072200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbad8066800 msgr2=0x7fbad8068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbad8066800 0x7fbad8068cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbaf808c610 tx=0x7fbae4010000 comp rx=0 tx=0).stop 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf815dc00 msgr2=0x7fbaf81f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 --2- 172.21.15.32:0/812165705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf815dc00 0x7fbaf81f7120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000cbc0 tx=0x7fbaf000ced0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafca00700 1 -- 172.21.15.32:0/812165705 reap_dead start 2024-09-13T18:45:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 shutdown_connections 2024-09-13T18:45:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 >> 172.21.15.32:0/812165705 conn(0x7fbaf8070180 msgr2=0x7fbaf80b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.053+0000 7f7ec8c00700 1 -- 172.21.15.32:0/821927676 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ecc067690 con 0x7f7eac06fdf0 2024-09-13T18:45:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 shutdown_connections 2024-09-13T18:45:29.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7fbafea00700 1 -- 172.21.15.32:0/812165705 wait complete. 2024-09-13T18:45:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2bc0c63f0 con 0x7fe29806fd70 2024-09-13T18:45:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7eac06fdf0 msgr2=0x7f7eac072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7eac06fdf0 0x7f7eac072230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7eac0667b0 msgr2=0x7f7eac068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7eac0667b0 0x7f7eac068c70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009af0 tx=0x7f7eb8009290 comp rx=0 tx=0).stop 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec40e6700 msgr2=0x7f7ec4006a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 --2- 172.21.15.32:0/821927676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7ec40e6700 0x7f7ec4006a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000b440 tx=0x7f7ec000b750 comp rx=0 tx=0).stop 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed1a00700 1 -- 172.21.15.32:0/821927676 reap_dead start 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 shutdown_connections 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 >> 172.21.15.32:0/821927676 conn(0x7f7ec404fd00 msgr2=0x7f7ec40e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 shutdown_connections 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7f7ed2400700 1 -- 172.21.15.32:0/821927676 wait complete. 2024-09-13T18:45:29.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.057+0000 7fe2b8c00700 1 -- 172.21.15.32:0/3497770569 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2b4006ca0 con 0x7fe29806fd70 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.061+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fe29806fd70 msgr2=0x7fe2980721b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.061+0000 7fe2c1600700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fe29806fd70 0x7fe2980721b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe298066730 msgr2=0x7fe298068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe298066730 0x7fe298068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0070b0 tx=0x7fe2ac007040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c8420 msgr2=0x7fe2bc0aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 --2- 172.21.15.32:0/3497770569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2bc0c8420 0x7fe2bc0aacc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4001eb0 tx=0x7fe2a400c7b0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c0c00700 1 -- 172.21.15.32:0/3497770569 reap_dead start 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 shutdown_connections 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 >> 172.21.15.32:0/3497770569 conn(0x7fe2bc0cac60 msgr2=0x7fe2bc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 shutdown_connections 2024-09-13T18:45:29.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7fe2c1600700 1 -- 172.21.15.32:0/3497770569 wait complete. 2024-09-13T18:45:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83f4161770 con 0x7f83d006fe70 2024-09-13T18:45:29.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.065+0000 7f83eb400700 1 -- 172.21.15.32:0/253229271 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83dc00b590 con 0x7f83d006fe70 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f83d006fe70 msgr2=0x7f83d00722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f83d006fe70 0x7f83d00722b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f83d0066830 msgr2=0x7f83d0068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f83d0066830 0x7f83d0068cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83f415c6f0 tx=0x7f83e4008040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 msgr2=0x7f83f4070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 --2- 172.21.15.32:0/253229271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83f40c7d90 0x7f83f4070100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009850 tx=0x7f83ec004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f3e00700 1 -- 172.21.15.32:0/253229271 reap_dead start 2024-09-13T18:45:29.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:45:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 shutdown_connections 2024-09-13T18:45:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 >> 172.21.15.32:0/253229271 conn(0x7f83f40cac60 msgr2=0x7f83f415b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 shutdown_connections 2024-09-13T18:45:29.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.073+0000 7f83f9000700 1 -- 172.21.15.32:0/253229271 wait complete. 2024-09-13T18:45:29.115 INFO:teuthology.orchestra.run.smithi032.stdout:64424509449 2024-09-13T18:45:29.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:45:29.116 INFO:teuthology.orchestra.run.smithi032.stdout:64424509452 2024-09-13T18:45:29.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:45:29.117 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-09-13T18:45:29.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:45:29.118 INFO:teuthology.orchestra.run.smithi032.stdout:60129542153 2024-09-13T18:45:29.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:45:29.119 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2024-09-13T18:45:29.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:45:29.120 INFO:teuthology.orchestra.run.smithi032.stdout:60129542153 2024-09-13T18:45:29.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:45:29.121 INFO:teuthology.orchestra.run.smithi032.stdout:60129542155 2024-09-13T18:45:29.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:45:29.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 Processor -- start 2024-09-13T18:45:29.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 -- start start 2024-09-13T18:45:29.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9744072530 0x7f974406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 0x7f9744159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97440c60e0 con 0x7f974406e720 2024-09-13T18:45:29.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974415da80 con 0x7f9744072530 2024-09-13T18:45:29.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.389+0000 7f9749400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c65b0 con 0x7f9744159880 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9743200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 0x7f9744159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9743200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 0x7f9744159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57202/0 (socket says 172.21.15.32:57202) 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9743200700 1 -- 172.21.15.32:0/3146888034 learned_addr learned my addr 172.21.15.32:0/3146888034 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9742800700 1 --2- 172.21.15.32:0/3146888034 >> v2:172.21.15.86:3300/0 conn(0x7f9744072530 0x7f974406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197555144 0 0) 0x7f97440c60e0 con 0x7f974406e720 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97280145e0 con 0x7f974406e720 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087118409 0 0) 0x7f97280145e0 con 0x7f974406e720 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 msgr2=0x7f9744159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 0x7f9744159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 >> v2:172.21.15.86:3300/0 conn(0x7f9744072530 msgr2=0x7f974406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 --2- 172.21.15.32:0/3146888034 >> v2:172.21.15.86:3300/0 conn(0x7f9744072530 0x7f974406fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974415a210 con 0x7f974406e720 2024-09-13T18:45:29.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7f973c0019d0 con 0x7f974406e720 2024-09-13T18:45:29.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f8606000700 1 Processor -- start 2024-09-13T18:45:29.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 >> v1:172.21.15.32:6789/0 conn(0x7f974406e720 legacy=0x7f97440c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f8606000700 1 -- start start 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728014a30 0x7f9728014e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 0x7f9728015880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9728015dc0 0x7f9728016240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974415da80 con 0x7f9728015dc0 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972801cb80 con 0x7f9728014a30 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972801cd40 con 0x7f9744159880 2024-09-13T18:45:29.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.393+0000 7f9743200700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9728015dc0 0x7f9728016240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9742800700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728014a30 0x7f9728014e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9743200700 1 -- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 msgr2=0x7f9728015880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9743200700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9744159880 0x7f9728015880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9743200700 1 -- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728014a30 msgr2=0x7f9728014e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9743200700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728014a30 0x7f9728014e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9743200700 1 -- 172.21.15.32:0/3146888034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280145e0 con 0x7f9728015dc0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9743200700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9728015dc0 0x7f9728016240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f973400fd90 tx=0x7f97280168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf64c5abe44af93b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400c070 con 0x7f9728015dc0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734012ba0 con 0x7f9728015dc0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.397+0000 7f9741400700 1 -- 172.21.15.32:0/3146888034 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734005a40 con 0x7f9728015dc0 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9749400700 1 -- 172.21.15.32:0/3146888034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9728015dc0 msgr2=0x7f9728016240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9749400700 1 --2- 172.21.15.32:0/3146888034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9728015dc0 0x7f9728016240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f973400fd90 tx=0x7f97280168b0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9743200700 1 -- 172.21.15.32:0/3146888034 reap_dead start 2024-09-13T18:45:29.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8606000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8045e10 0x7f85f8034b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8606000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 0x7f85f8035070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8606000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80d5a20 con 0x7f85f80d5640 2024-09-13T18:45:29.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8606000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80dbe40 con 0x7f85f8050820 2024-09-13T18:45:29.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8606000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80dc120 con 0x7f85f8045e10 2024-09-13T18:45:29.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9749400700 1 -- 172.21.15.32:0/3146888034 shutdown_connections 2024-09-13T18:45:29.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9749400700 1 -- 172.21.15.32:0/3146888034 >> 172.21.15.32:0/3146888034 conn(0x7f97440cac60 msgr2=0x7f97440cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8605600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 0x7f85f8035070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8605600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 0x7f85f8035070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48680/0 (socket says 172.21.15.32:48680) 2024-09-13T18:45:29.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8605600700 1 -- 172.21.15.32:0/4040886099 learned_addr learned my addr 172.21.15.32:0/4040886099 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8604c00700 1 --1- 172.21.15.32:0/4040886099 >> v1:172.21.15.86:6789/0 conn(0x7f85f80d5640 0x7f85f8045700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51268/0 (socket says 172.21.15.32:51268) 2024-09-13T18:45:29.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f7fcf000700 1 Processor -- start 2024-09-13T18:45:29.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ffe00700 1 --2- 172.21.15.32:0/4040886099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8045e10 0x7f85f8034b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f7fcf000700 1 -- start start 2024-09-13T18:45:29.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9749400700 1 -- 172.21.15.32:0/3146888034 shutdown_connections 2024-09-13T18:45:29.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7fe995400700 1 Processor -- start 2024-09-13T18:45:29.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ff400700 1 -- 172.21.15.32:0/4040886099 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049687440 0 0) 0x7f85f80d5a20 con 0x7f85f80d5640 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ff400700 1 -- 172.21.15.32:0/4040886099 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e80035d0 con 0x7f85f80d5640 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ffe00700 1 -- 172.21.15.32:0/4040886099 >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 msgr2=0x7f85f8035070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ffe00700 1 --2- 172.21.15.32:0/4040886099 >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 0x7f85f8035070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ffe00700 1 -- 172.21.15.32:0/4040886099 >> v1:172.21.15.86:6789/0 conn(0x7f85f80d5640 legacy=0x7f85f8045700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f85ffe00700 1 -- 172.21.15.32:0/4040886099 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8005b00 con 0x7f85f8045e10 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f8605600700 1 --2- 172.21.15.32:0/4040886099 >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 0x7f85f8035070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe995400700 1 -- start start 2024-09-13T18:45:29.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.401+0000 7f9749400700 1 -- 172.21.15.32:0/3146888034 wait complete. 2024-09-13T18:45:29.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f85ffe00700 1 --2- 172.21.15.32:0/4040886099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8045e10 0x7f85f8034b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009850 tx=0x7f85f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2e033f60f693f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f85ff400700 1 -- 172.21.15.32:0/4040886099 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4011830 con 0x7f85f8045e10 2024-09-13T18:45:29.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fcf000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f7fc81596e0 0x7f7fc80c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fcf000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80c70e0 con 0x7f7fc80c2a70 2024-09-13T18:45:29.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fcf000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc8150930 con 0x7f7fc8150550 2024-09-13T18:45:29.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fcf000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80c1ee0 con 0x7f7fc81596e0 2024-09-13T18:45:29.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f9749400700 1 Processor -- start 2024-09-13T18:45:29.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f9749400700 1 -- start start 2024-09-13T18:45:29.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f9749400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728015dc0 0x7f97440ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fcdc00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7fc8150550 0x7f7fc80c69d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51278/0 (socket says 172.21.15.32:51278) 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fcdc00700 1 -- 172.21.15.32:0/2901768483 learned_addr learned my addr 172.21.15.32:0/2901768483 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481796067 0 0) 0x7f7fc8150930 con 0x7f7fc8150550 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb00035d0 con 0x7f7fc8150550 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258568511 0 0) 0x7f7fc80c70e0 con 0x7f7fc80c2a70 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc8150930 con 0x7f7fc80c2a70 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe995400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9880d8b40 0x7fe988049090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe995400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe98804f220 0x7fe9880e2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe995400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe988050390 con 0x7fe988007430 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe995400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880508e0 con 0x7fe98804f220 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe995400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880df6f0 con 0x7fe9880d8b40 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7fe994a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe98804f220 0x7fe9880e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe98804f220 0x7fe9880e2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48692/0 (socket says 172.21.15.32:48692) 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650015718 0 0) 0x7f7fb00035d0 con 0x7f7fc8150550 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 >> v2:172.21.15.86:3300/0 conn(0x7f7fc81596e0 msgr2=0x7f7fc80c2530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 --2- 172.21.15.32:0/2901768483 >> v2:172.21.15.86:3300/0 conn(0x7f7fc81596e0 0x7f7fc80c2530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 >> v1:172.21.15.32:6789/0 conn(0x7f7fc80c2a70 legacy=0x7f7fc806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8159c40 con 0x7f7fc8150550 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.1 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7f7fbc0019f0 con 0x7f7fc8150550 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 >> v1:172.21.15.86:6789/0 conn(0x7f7fc8150550 legacy=0x7f7fc80c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb0003c00 0x7f7fb0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fb0004870 0x7f7fb0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fb0014240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0001160 con 0x7f7fb0004870 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00149e0 con 0x7f7fb0005350 2024-09-13T18:45:29.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0014ba0 con 0x7f7fb0003c00 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 -- 172.21.15.32:0/2141596114 learned_addr learned my addr 172.21.15.32:0/2141596114 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 -- 172.21.15.32:0/2141596114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9880d8b40 msgr2=0x7fe988049090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 --2- 172.21.15.32:0/2141596114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9880d8b40 0x7fe988049090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 -- 172.21.15.32:0/2141596114 >> v1:172.21.15.32:6789/0 conn(0x7fe988007430 legacy=0x7fe9880e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 -- 172.21.15.32:0/2141596114 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988055030 con 0x7fe98804f220 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe994a00700 1 --2- 172.21.15.32:0/2141596114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe98804f220 0x7fe9880e2360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009910 tx=0x7fe97c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02098e517ad29a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f85ff400700 1 -- 172.21.15.32:0/4040886099 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4011990 con 0x7f85f8045e10 2024-09-13T18:45:29.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f85ff400700 1 -- 172.21.15.32:0/4040886099 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4011d40 con 0x7f85f8045e10 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f8606000700 1 -- 172.21.15.32:0/4040886099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8045e10 msgr2=0x7f85f8034b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f8606000700 1 --2- 172.21.15.32:0/4040886099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8045e10 0x7f85f8034b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009850 tx=0x7f85f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f8606000700 1 -- 172.21.15.32:0/4040886099 shutdown_connections 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f8606000700 1 --2- 172.21.15.32:0/4040886099 >> v2:172.21.15.32:3300/0 conn(0x7f85f8050820 0x7f85f8035070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f8606000700 1 --2- 172.21.15.32:0/4040886099 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8045e10 0x7f85f8034b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.405+0000 7f8606000700 1 -- 172.21.15.32:0/4040886099 >> 172.21.15.32:0/4040886099 conn(0x7f85f804fd00 msgr2=0x7f85f8050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f8606000700 1 -- 172.21.15.32:0/4040886099 shutdown_connections 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f8606000700 1 -- 172.21.15.32:0/4040886099 wait complete. 2024-09-13T18:45:29.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9749400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 0x7f974406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9749400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97441eea10 0x7f97441eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9749400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744155ae0 con 0x7f97441eea10 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9749400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440ad830 con 0x7f9728015dc0 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9749400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440af690 con 0x7f97440afdb0 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 0x7f974406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 0x7f974406d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57228/0 (socket says 172.21.15.32:57228) 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 -- 172.21.15.32:0/710933131 learned_addr learned my addr 172.21.15.32:0/710933131 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9742800700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728015dc0 0x7f97440ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9743200700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97441eea10 0x7f97441eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fb0014240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe98ea00700 1 -- 172.21.15.32:0/2141596114 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c004230 con 0x7fe98804f220 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe98ea00700 1 -- 172.21.15.32:0/2141596114 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c004390 con 0x7fe98804f220 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe98ea00700 1 -- 172.21.15.32:0/2141596114 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c009e60 con 0x7fe98804f220 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 -- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728015dc0 msgr2=0x7f97440ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728015dc0 0x7f97440ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 -- 172.21.15.32:0/710933131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97441eea10 msgr2=0x7f97441eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97441eea10 0x7f97441eaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 -- 172.21.15.32:0/710933131 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440aeb50 con 0x7f97440afdb0 2024-09-13T18:45:29.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fcd200700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fb0004870 0x7f7fb0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fcdc00700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb0003c00 0x7f7fb0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 -- 172.21.15.32:0/2141596114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe98804f220 msgr2=0x7fe9880e2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 --2- 172.21.15.32:0/2141596114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe98804f220 0x7fe9880e2360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009910 tx=0x7fe97c009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:29.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f0b3b200700 1 Processor -- start 2024-09-13T18:45:29.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f9741e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 0x7f974406d6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f973c00caa0 tx=0x7f973c00cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 -- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb0003c00 msgr2=0x7f7fb0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fb0003c00 0x7f7fb0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 -- 172.21.15.32:0/2901768483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fb0004870 msgr2=0x7f7fb0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fb0004870 0x7f7fb0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 -- 172.21.15.32:0/2901768483 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00035d0 con 0x7f7fb0005350 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 -- 172.21.15.32:0/2141596114 shutdown_connections 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 --2- 172.21.15.32:0/2141596114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe98804f220 0x7fe9880e2360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 --2- 172.21.15.32:0/2141596114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9880d8b40 0x7fe988049090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 -- 172.21.15.32:0/2141596114 >> 172.21.15.32:0/2141596114 conn(0x7fe988054110 msgr2=0x7fe988054520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f0b3b200700 1 -- start start 2024-09-13T18:45:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fcd200700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fb0004870 0x7f7fb0004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 -- 172.21.15.32:0/2901768483 reap_dead start 2024-09-13T18:45:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 -- 172.21.15.32:0/2141596114 shutdown_connections 2024-09-13T18:45:29.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7fe995400700 1 -- 172.21.15.32:0/2141596114 wait complete. 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 Processor -- start 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f7fce600700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fb0014240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007f10 tx=0x7f7fb00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86bb55a24efafc92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00052d0 con 0x7f7fb0005350 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0005430 con 0x7f7fb0005350 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fc7e00700 1 -- 172.21.15.32:0/2901768483 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000cbf0 con 0x7f7fb0005350 2024-09-13T18:45:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7ff48de00700 1 Processor -- start 2024-09-13T18:45:29.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.409+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c005070 con 0x7f97440afdb0 2024-09-13T18:45:29.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c0051d0 con 0x7f97440afdb0 2024-09-13T18:45:29.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c005540 con 0x7f97440afdb0 2024-09-13T18:45:29.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 -- start start 2024-09-13T18:45:29.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f9749400700 1 -- 172.21.15.32:0/710933131 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97441eef30 con 0x7f97440afdb0 2024-09-13T18:45:29.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fcf000700 1 -- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 msgr2=0x7f7fb0014240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fcf000700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fb0014240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007f10 tx=0x7f7fb00058a0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f9749400700 1 -- 172.21.15.32:0/710933131 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97440af0d0 con 0x7f97440afdb0 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fcf000700 1 -- 172.21.15.32:0/2901768483 shutdown_connections 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fcf000700 1 --2- 172.21.15.32:0/2901768483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fb0014240 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fcf000700 1 -- 172.21.15.32:0/2901768483 >> 172.21.15.32:0/2901768483 conn(0x7f7fc80c8ad0 msgr2=0x7f7fc80c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7ff48de00700 1 -- start start 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85f8045e10 0x7f85f80dcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8050820 0x7f85f80cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.439 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 0x7f85f8047610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80dd030 con 0x7f85f8045e10 2024-09-13T18:45:29.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8049c40 con 0x7f85f80d5640 2024-09-13T18:45:29.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8606000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8035970 con 0x7f85f8050820 2024-09-13T18:45:29.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f0b3b200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0b2c0d6ac0 0x7f0b2c0dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7fe995400700 1 Processor -- start 2024-09-13T18:45:29.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7fd89cc00700 1 Processor -- start 2024-09-13T18:45:29.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f0b33400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0b2c0d66e0 0x7f0b2c044d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51294/0 (socket says 172.21.15.32:51294) 2024-09-13T18:45:29.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f0b33400700 1 -- 172.21.15.32:0/2762712514 learned_addr learned my addr 172.21.15.32:0/2762712514 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:29.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8605600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 0x7f85f8047610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f85ffe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8050820 0x7f85f80cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8605600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 0x7f85f8047610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37112/0 (socket says 172.21.15.32:37112) 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f85ffe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8050820 0x7f85f80cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57248/0 (socket says 172.21.15.32:57248) 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8605600700 1 -- 172.21.15.32:0/135647151 learned_addr learned my addr 172.21.15.32:0/135647151 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7ff48de00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff4881534a0 0x7ff488153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7ff48de00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff488159570 con 0x7ff488072740 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7ff48de00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4881597c0 con 0x7ff4880c4bd0 2024-09-13T18:45:29.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7ff48de00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880c40a0 con 0x7ff4881534a0 2024-09-13T18:45:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f0b3b200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2c0dd4f0 con 0x7f0b2c04bd10 2024-09-13T18:45:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2c04b880 con 0x7f0b2c0d66e0 2024-09-13T18:45:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2c035dd0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97440c1eb0 con 0x7f97440afdb0 2024-09-13T18:45:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f8604c00700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85f8045e10 0x7f85f80dcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7fe995400700 1 -- start start 2024-09-13T18:45:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b39c00700 1 --2- 172.21.15.32:0/2762712514 >> v2:172.21.15.32:3300/0 conn(0x7f0b2c0d6ac0 0x7f0b2c0dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff488072740 0x7ff4880c44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55628/0 (socket says 172.21.15.32:55628) 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487e00700 1 -- 172.21.15.32:0/3750206162 learned_addr learned my addr 172.21.15.32:0/3750206162 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8605600700 1 -- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8050820 msgr2=0x7f85f80cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8605600700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8050820 0x7f85f80cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8605600700 1 -- 172.21.15.32:0/135647151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85f8045e10 msgr2=0x7f85f80dcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8605600700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85f8045e10 0x7f85f80dcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8605600700 1 -- 172.21.15.32:0/135647151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000758d0 con 0x7f85f80d5640 2024-09-13T18:45:29.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7f7fcf000700 1 -- 172.21.15.32:0/2901768483 shutdown_connections 2024-09-13T18:45:29.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.413+0000 7fd89cc00700 1 -- start start 2024-09-13T18:45:29.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8605600700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 0x7f85f8047610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f860004f480 tx=0x7f860004f700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd457e00700 1 Processor -- start 2024-09-13T18:45:29.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd457e00700 1 -- start start 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff48ca00700 1 --2- 172.21.15.32:0/3750206162 >> v2:172.21.15.86:3300/0 conn(0x7ff4881534a0 0x7ff488153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fe995400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 0x7fe9880d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd89cc00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8981534a0 0x7fd898153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd89cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8980c4bd0 0x7fd898070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd89cc00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd898159570 con 0x7fd898072740 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd89cc00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980c40a0 con 0x7fd8981534a0 2024-09-13T18:45:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd89cc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8981597c0 con 0x7fd8980c4bd0 2024-09-13T18:45:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f7fcf000700 1 -- 172.21.15.32:0/2901768483 wait complete. 2024-09-13T18:45:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487400700 1 -- 172.21.15.32:0/3750206162 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410312731 0 0) 0x7ff488159570 con 0x7ff488072740 2024-09-13T18:45:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487400700 1 -- 172.21.15.32:0/3750206162 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4700035d0 con 0x7ff488072740 2024-09-13T18:45:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8981534a0 0x7fd898153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b32a00700 1 -- 172.21.15.32:0/2762712514 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390717516 0 0) 0x7f0b2c04b880 con 0x7f0b2c0d66e0 2024-09-13T18:45:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487400700 1 -- 172.21.15.32:0/3750206162 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474155188 0 0) 0x7ff4881597c0 con 0x7ff4880c4bd0 2024-09-13T18:45:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff48ca00700 1 -- 172.21.15.32:0/3750206162 >> v1:172.21.15.86:6789/0 conn(0x7ff4880c4bd0 legacy=0x7ff488070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860006f730 con 0x7f85f80d5640 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860006f890 con 0x7f85f80d5640 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860006fc00 con 0x7f85f80d5640 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff48ca00700 1 -- 172.21.15.32:0/3750206162 >> v1:172.21.15.32:6789/0 conn(0x7ff488072740 legacy=0x7ff4880c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff48ca00700 1 -- 172.21.15.32:0/3750206162 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488159aa0 con 0x7ff4881534a0 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8981534a0 0x7fd898153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48744/0 (socket says 172.21.15.32:48744) 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 -- 172.21.15.32:0/2948716012 learned_addr learned my addr 172.21.15.32:0/2948716012 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897e00700 1 --2- 172.21.15.32:0/2948716012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8980c4bd0 0x7fd898070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fe995400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe98804f220 0x7fe988049470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f40094b0 con 0x7f85f80d5640 2024-09-13T18:45:29.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8035690 con 0x7f85f80d5640 2024-09-13T18:45:29.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fe98fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 0x7fe9880d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fe98fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 0x7fe9880d57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37136/0 (socket says 172.21.15.32:37136) 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff48ca00700 1 --2- 172.21.15.32:0/3750206162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4881534a0 0x7ff488153880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009850 tx=0x7ff47c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fd515c9ddc2f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487400700 1 -- 172.21.15.32:0/3750206162 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c011830 con 0x7ff4881534a0 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487400700 1 -- 172.21.15.32:0/3750206162 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c011990 con 0x7ff4881534a0 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7ff487400700 1 -- 172.21.15.32:0/3750206162 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c011d00 con 0x7ff4881534a0 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 -- 172.21.15.32:0/2948716012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8980c4bd0 msgr2=0x7fd898070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 --2- 172.21.15.32:0/2948716012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8980c4bd0 0x7fd898070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 -- 172.21.15.32:0/2948716012 >> v1:172.21.15.32:6789/0 conn(0x7fd898072740 legacy=0x7fd8980c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 -- 172.21.15.32:0/2948716012 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898159aa0 con 0x7fd8981534a0 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd457e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd45815e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd457e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd45815e6d0 0x7fd458070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd457e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580c6030 con 0x7fd4580c7d90 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd457e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4580c67b0 con 0x7fd45815e6d0 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b32a00700 1 -- 172.21.15.32:0/2762712514 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1c0035d0 con 0x7f0b2c0d66e0 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b32a00700 1 -- 172.21.15.32:0/2762712514 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835242268 0 0) 0x7f0b28001490 con 0x7f0b2c04bd10 2024-09-13T18:45:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b32a00700 1 -- 172.21.15.32:0/2762712514 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b2c04b880 con 0x7f0b2c04bd10 2024-09-13T18:45:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b39c00700 1 -- 172.21.15.32:0/2762712514 >> v1:172.21.15.86:6789/0 conn(0x7f0b2c0d66e0 legacy=0x7f0b2c044d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b39c00700 1 -- 172.21.15.32:0/2762712514 >> v1:172.21.15.32:6789/0 conn(0x7f0b2c04bd10 legacy=0x7f0b2c04c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f0b39c00700 1 -- 172.21.15.32:0/2762712514 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c050ab0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fe98fe00700 1 -- 172.21.15.32:0/851522958 learned_addr learned my addr 172.21.15.32:0/851522958 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8047330 con 0x7f85f80d5640 2024-09-13T18:45:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.417+0000 7fd897400700 1 --2- 172.21.15.32:0/2948716012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8981534a0 0x7fd898153880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd888009910 tx=0x7fd888009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4a43d0e42efed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880d8b40 0x7fe9880ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880d93b0 con 0x7fe9880d8b40 2024-09-13T18:45:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880da590 con 0x7fe988007430 2024-09-13T18:45:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe988053a50 con 0x7fe98804f220 2024-09-13T18:45:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 -- 172.21.15.32:0/3750206162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4881534a0 msgr2=0x7ff488153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 --2- 172.21.15.32:0/3750206162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4881534a0 0x7ff488153880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009850 tx=0x7ff47c009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b39c00700 1 --2- 172.21.15.32:0/2762712514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c0dcfb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0b34064060 tx=0x7f0b34067160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ae4c0f235161f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd457e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45815eb80 con 0x7fd4580c8170 2024-09-13T18:45:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd896000700 1 -- 172.21.15.32:0/2948716012 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888004230 con 0x7fd8981534a0 2024-09-13T18:45:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd456a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd4580c7d90 0x7fd4580c5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55642/0 (socket says 172.21.15.32:55642) 2024-09-13T18:45:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd456a00700 1 -- 172.21.15.32:0/1093965262 learned_addr learned my addr 172.21.15.32:0/1093965262 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 -- 172.21.15.32:0/3750206162 shutdown_connections 2024-09-13T18:45:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 --2- 172.21.15.32:0/3750206162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4881534a0 0x7ff488153880 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 -- 172.21.15.32:0/3750206162 >> 172.21.15.32:0/3750206162 conn(0x7ff488073d50 msgr2=0x7ff488071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd896000700 1 -- 172.21.15.32:0/2948716012 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888004390 con 0x7fd8981534a0 2024-09-13T18:45:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe994a00700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880d8b40 0x7fe9880ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98f400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe98804f220 0x7fe988049470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd457400700 1 --2- 172.21.15.32:0/1093965262 >> v2:172.21.15.32:3300/0 conn(0x7fd45815e6d0 0x7fd458070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd896000700 1 -- 172.21.15.32:0/2948716012 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880036c0 con 0x7fd8981534a0 2024-09-13T18:45:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd44e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd45815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b32a00700 1 -- 172.21.15.32:0/2762712514 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3404ece0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b32a00700 1 -- 172.21.15.32:0/2762712514 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34075af0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c0d6ac0 msgr2=0x7f0b2c0dcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b3b200700 1 --2- 172.21.15.32:0/2762712514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c0dcfb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0b34064060 tx=0x7f0b34067160 comp rx=0 tx=0).stop 2024-09-13T18:45:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f973c0056a0 con 0x7f97440afdb0 2024-09-13T18:45:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f7fcf000700 1 Processor -- start 2024-09-13T18:45:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f7fcf000700 1 -- start start 2024-09-13T18:45:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98fe00700 1 -- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe98804f220 msgr2=0x7fe988049470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98fe00700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe98804f220 0x7fe988049470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98fe00700 1 -- 172.21.15.32:0/851522958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880d8b40 msgr2=0x7fe9880ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98fe00700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880d8b40 0x7fe9880ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98fe00700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c009570 con 0x7fe988007430 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 -- 172.21.15.32:0/3750206162 shutdown_connections 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7ff48de00700 1 -- 172.21.15.32:0/3750206162 wait complete. 2024-09-13T18:45:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 -- 172.21.15.32:0/2948716012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8981534a0 msgr2=0x7fd898153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 --2- 172.21.15.32:0/2948716012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8981534a0 0x7fd898153880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd888009910 tx=0x7fd888009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 -- 172.21.15.32:0/2948716012 shutdown_connections 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 --2- 172.21.15.32:0/2948716012 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8980c4bd0 0x7fd898070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 --2- 172.21.15.32:0/2948716012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8981534a0 0x7fd898153880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 -- 172.21.15.32:0/2948716012 >> 172.21.15.32:0/2948716012 conn(0x7fd898073d50 msgr2=0x7fd898071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 -- 172.21.15.32:0/2948716012 shutdown_connections 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd89cc00700 1 -- 172.21.15.32:0/2948716012 wait complete. 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd456000700 1 -- 172.21.15.32:0/1093965262 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159824966 0 0) 0x7fd4580c6030 con 0x7fd4580c7d90 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd456000700 1 -- 172.21.15.32:0/1093965262 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd43c0035d0 con 0x7fd4580c7d90 2024-09-13T18:45:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd44e000700 1 -- 172.21.15.32:0/1093965262 >> v2:172.21.15.32:3300/0 conn(0x7fd45815e6d0 msgr2=0x7fd458070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd44e000700 1 --2- 172.21.15.32:0/1093965262 >> v2:172.21.15.32:3300/0 conn(0x7fd45815e6d0 0x7fd458070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd44e000700 1 -- 172.21.15.32:0/1093965262 >> v1:172.21.15.32:6789/0 conn(0x7fd4580c7d90 legacy=0x7fd4580c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd44e000700 1 -- 172.21.15.32:0/1093965262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458161dc0 con 0x7fd4580c8170 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fd44e000700 1 --2- 172.21.15.32:0/1093965262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd45815e190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd440009850 tx=0x7fd440009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a066cd2cf8bca57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f973aa00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f973c084530 con 0x7f97440afdb0 2024-09-13T18:45:29.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86000720c0 con 0x7f85f80d5640 2024-09-13T18:45:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 shutdown_connections 2024-09-13T18:45:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b3b200700 1 --2- 172.21.15.32:0/2762712514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c0dcfb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 >> 172.21.15.32:0/2762712514 conn(0x7f0b2c04feb0 msgr2=0x7f0b2c0502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.421+0000 7fe98fe00700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 0x7fe9880d57a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe990068dc0 tx=0x7fe990075dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcf000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fc814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 shutdown_connections 2024-09-13T18:45:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcf000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fc814b320 0x7f7fc8146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcf000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc81eadb0 0x7f7fc81eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcf000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc814dd70 con 0x7f7fc814b320 2024-09-13T18:45:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcf000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc814c8b0 con 0x7f7fb0005350 2024-09-13T18:45:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcf000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc81ea680 con 0x7f7fc81eadb0 2024-09-13T18:45:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 -- 172.21.15.32:0/2762712514 wait complete. 2024-09-13T18:45:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcdc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fc814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcdc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fc814a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37142/0 (socket says 172.21.15.32:37142) 2024-09-13T18:45:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcdc00700 1 -- 172.21.15.32:0/951169143 learned_addr learned my addr 172.21.15.32:0/951169143 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f9742800700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc81eadb0 0x7f7fc81eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fcd200700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fc814b320 0x7f7fc8146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f85fcc00700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f85e0066800 0x7f85e0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86000ffe30 con 0x7f85f80d5640 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 -- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 msgr2=0x7f7fc814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fc814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 -- 172.21.15.32:0/951169143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fc814b320 msgr2=0x7f7fc8146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fc814b320 0x7f7fc8146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 -- 172.21.15.32:0/951169143 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc814c010 con 0x7f7fc81eadb0 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f8604c00700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f85e0066800 0x7f85e0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd89cc00700 1 Processor -- start 2024-09-13T18:45:29.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7ff48de00700 1 Processor -- start 2024-09-13T18:45:29.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fce600700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc81eadb0 0x7f7fc81eb230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80c9b90 tx=0x7f7fc0001680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f9742800700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f972c004490 tx=0x7f972c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd89cc00700 1 -- start start 2024-09-13T18:45:29.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7ff48de00700 1 -- start start 2024-09-13T18:45:29.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f8604c00700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f85e0066800 0x7f85e0068cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85ec007fd0 tx=0x7f85ec007c20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 Processor -- start 2024-09-13T18:45:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 -- start start 2024-09-13T18:45:29.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7ff48de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff488072740 0x7ff48814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd89cc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd898072740 0x7fd898157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd89cc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 0x7fd898158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd89cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8981534a0 0x7fd8981f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7ff48de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4880c4bd0 0x7ff4881f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7ff48de00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 0x7ff488155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c04bd10 0x7f0b2c02fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2c0d66e0 0x7f0b2c048380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c049e60 con 0x7f0b2c04bd10 2024-09-13T18:45:29.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd896a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 0x7fd898158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7fd896a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 0x7fd898158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37150/0 (socket says 172.21.15.32:37150) 2024-09-13T18:45:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c030400 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f0b3b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0488c0 con 0x7f0b2c0d66e0 2024-09-13T18:45:29.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.425+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00038a0 con 0x7f7fc81eadb0 2024-09-13T18:45:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd89cc00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89806a490 con 0x7fd898072740 2024-09-13T18:45:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd89cc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89815ca20 con 0x7fd8980c4bd0 2024-09-13T18:45:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd89cc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89815ccc0 con 0x7fd8981534a0 2024-09-13T18:45:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8981534a0 0x7fd8981f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd896a00700 1 -- 172.21.15.32:0/42254345 learned_addr learned my addr 172.21.15.32:0/42254345 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd456000700 1 -- 172.21.15.32:0/1093965262 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011830 con 0x7fd4580c8170 2024-09-13T18:45:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff487e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4880c4bd0 0x7ff4881f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff487e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4880c4bd0 0x7ff4881f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37158/0 (socket says 172.21.15.32:37158) 2024-09-13T18:45:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd898072740 0x7fd898157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c004bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b39c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2c0d66e0 0x7f0b2c048380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c04bd10 0x7f0b2c02fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c004bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37172/0 (socket says 172.21.15.32:37172) 2024-09-13T18:45:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 -- 172.21.15.32:0/1636403171 learned_addr learned my addr 172.21.15.32:0/1636403171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0003a00 con 0x7f7fc81eadb0 2024-09-13T18:45:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0003db0 con 0x7f7fc81eadb0 2024-09-13T18:45:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc814c2f0 con 0x7f7fc81eadb0 2024-09-13T18:45:29.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd456000700 1 -- 172.21.15.32:0/1093965262 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440011990 con 0x7fd4580c8170 2024-09-13T18:45:29.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f973c0516d0 con 0x7f97440afdb0 2024-09-13T18:45:29.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc81ea890 con 0x7f7fc81eadb0 2024-09-13T18:45:29.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48ca00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff488072740 0x7ff48814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 0x7ff488155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48ca00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff488072740 0x7ff48814e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57282/0 (socket says 172.21.15.32:57282) 2024-09-13T18:45:29.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 0x7ff488155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48792/0 (socket says 172.21.15.32:48792) 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff487e00700 1 -- 172.21.15.32:0/148161362 learned_addr learned my addr 172.21.15.32:0/148161362 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815d0e0 con 0x7ff4881534a0 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881f5cd0 con 0x7ff4880c4bd0 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815d920 con 0x7ff488072740 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 -- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8981534a0 msgr2=0x7fd8981f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8981534a0 0x7fd8981f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 -- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 msgr2=0x7fd898158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 0x7fd898158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 -- 172.21.15.32:0/42254345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009570 con 0x7fd898072740 2024-09-13T18:45:29.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd896a00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 0x7fd898158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:29.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd897400700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd898072740 0x7fd898157fc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd888015000 tx=0x7fd888004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 -- 172.21.15.32:0/1093965262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 msgr2=0x7fd45815e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 --2- 172.21.15.32:0/1093965262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd45815e190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd440009850 tx=0x7fd440009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:29.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 -- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2c0d66e0 msgr2=0x7f0b2c048380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2c0d66e0 0x7f0b2c048380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 -- 172.21.15.32:0/1636403171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c04bd10 msgr2=0x7f0b2c02fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c04bd10 0x7f0b2c02fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 -- 172.21.15.32:0/1636403171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340758d0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b33e00700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c004bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800cca0 tx=0x7f0b2800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 -- 172.21.15.32:0/1093965262 shutdown_connections 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 --2- 172.21.15.32:0/1093965262 >> v2:172.21.15.32:3300/0 conn(0x7fd45815e6d0 0x7fd458070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880045c0 con 0x7fd898072740 2024-09-13T18:45:29.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 --2- 172.21.15.32:0/1093965262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd45815e190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 -- 172.21.15.32:0/1093965262 >> 172.21.15.32:0/1093965262 conn(0x7fd4580cac60 msgr2=0x7fd4580cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f86000ccf20 con 0x7f85f80d5640 2024-09-13T18:45:29.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc806dd30 con 0x7f7fc81eadb0 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900671d0 con 0x7fe988007430 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99006f530 con 0x7fe988007430 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99006f900 con 0x7fe988007430 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 -- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff488072740 msgr2=0x7ff48814e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff488072740 0x7ff48814e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 -- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4880c4bd0 msgr2=0x7ff4881f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4880c4bd0 0x7ff4881f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7ff48d400700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0094b0 con 0x7ff4881534a0 2024-09-13T18:45:29.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89815cfa0 con 0x7fd898072740 2024-09-13T18:45:29.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8981f4220 con 0x7fd898072740 2024-09-13T18:45:29.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 -- 172.21.15.32:0/1093965262 shutdown_connections 2024-09-13T18:45:29.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28015e90 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b28003a20 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c174270 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c006f60 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28003db0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7ff48d400700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 0x7ff488155d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff48000cac0 tx=0x7ff48000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd457e00700 1 -- 172.21.15.32:0/1093965262 wait complete. 2024-09-13T18:45:29.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe988053770 con 0x7fe988007430 2024-09-13T18:45:29.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880531f0 con 0x7fe988007430 2024-09-13T18:45:29.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888011630 con 0x7fd898072740 2024-09-13T18:45:29.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.429+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880119a0 con 0x7fd898072740 2024-09-13T18:45:29.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd870005310 con 0x7fd898072740 2024-09-13T18:45:29.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fd457e00700 1 Processor -- start 2024-09-13T18:45:29.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b10005310 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fd457e00700 1 -- start start 2024-09-13T18:45:29.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480003e50 con 0x7ff4881534a0 2024-09-13T18:45:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9880492c0 con 0x7fe988007430 2024-09-13T18:45:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480005070 con 0x7ff4881534a0 2024-09-13T18:45:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488155000 con 0x7ff4881534a0 2024-09-13T18:45:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480005400 con 0x7ff4881534a0 2024-09-13T18:45:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fd457e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4580c7d90 0x7fd45815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fd457e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd4580c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881555c0 con 0x7ff4881534a0 2024-09-13T18:45:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.433+0000 7fd457e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd45815e6d0 0x7fd4580bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b280050d0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd456a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4580c7d90 0x7fd45815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd456a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4580c7d90 0x7fd45815b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48808/0 (socket says 172.21.15.32:48808) 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd4580c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd4580c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57302/0 (socket says 172.21.15.32:57302) 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45815c7f0 con 0x7fd4580c7d90 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c4b90 con 0x7fd45815e6d0 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580ca340 con 0x7fd4580c8170 2024-09-13T18:45:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd456a00700 1 -- 172.21.15.32:0/3436361013 learned_addr learned my addr 172.21.15.32:0/3436361013 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464005310 con 0x7ff4881534a0 2024-09-13T18:45:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd457400700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd45815e6d0 0x7fd4580bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f0b27e00700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0b14066760 0x7f0b14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fc0012400 con 0x7f7fc81eadb0 2024-09-13T18:45:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd888021070 con 0x7fd898072740 2024-09-13T18:45:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 -- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd45815e6d0 msgr2=0x7fd4580bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd45815e6d0 0x7fd4580bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 -- 172.21.15.32:0/3436361013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4580c7d90 msgr2=0x7fd45815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4580c7d90 0x7fd45815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400094b0 con 0x7fd4580c8170 2024-09-13T18:45:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b2808c400 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f0b33400700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0b14066760 0x7f0b14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe99006fa60 con 0x7fe988007430 2024-09-13T18:45:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd88f400700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd878066760 0x7fd878068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f0b33400700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0b14066760 0x7f0b14068c20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b20007fd0 tx=0x7f0b20007d80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7f7fc5600700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7fa8066730 0x7f7fa8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd44e000700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd4580c1c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd45806ea50 tx=0x7fd440004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.437+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd888085dd0 con 0x7fd898072740 2024-09-13T18:45:29.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fd896a00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd878066760 0x7fd878068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fe983e00700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe970066730 0x7fe970068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7fc0084bc0 con 0x7f7fc81eadb0 2024-09-13T18:45:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9900ff040 con 0x7fe988007430 2024-09-13T18:45:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fd896a00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd878066760 0x7fd878068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd898154400 tx=0x7fd884009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fe98f400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe970066730 0x7fe970068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fe98f400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe970066730 0x7fe970068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe9880dc0c0 tx=0x7fe984007ee0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7f7fcdc00700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7fa8066730 0x7f7fa8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011ea0 con 0x7fd4580c8170 2024-09-13T18:45:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44001abb0 con 0x7fd4580c8170 2024-09-13T18:45:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440024420 con 0x7fd4580c8170 2024-09-13T18:45:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4580c09b0 con 0x7fd4580c8170 2024-09-13T18:45:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7f7fcdc00700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7fa8066730 0x7f7fa8068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0013d0 tx=0x7f7fbc006040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580c44d0 con 0x7fd4580c8170 2024-09-13T18:45:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fc0051c30 con 0x7f7fc81eadb0 2024-09-13T18:45:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.441+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b280593e0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff480005560 con 0x7ff4881534a0 2024-09-13T18:45:29.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd888052db0 con 0x7fd898072740 2024-09-13T18:45:29.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7ff484c00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff468066800 0x7ff468068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4580c4cd0 con 0x7fd4580c8170 2024-09-13T18:45:29.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff480084d80 con 0x7ff4881534a0 2024-09-13T18:45:29.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7ff48ca00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff468066800 0x7ff468068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd440022070 con 0x7fd4580c8170 2024-09-13T18:45:29.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7fd44f400700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd434066780 0x7fd434068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:29.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4400855c0 con 0x7fd4580c8170 2024-09-13T18:45:29.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7fd456a00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd434066780 0x7fd434068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:29.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7ff48ca00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff468066800 0x7ff468068cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0090b0 tx=0x7ff47c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff480051de0 con 0x7ff4881534a0 2024-09-13T18:45:29.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.445+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9900cc110 con 0x7fe988007430 2024-09-13T18:45:29.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.449+0000 7fd456a00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd434066780 0x7fd434068c40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4480011e0 tx=0x7fd448009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:29.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.457+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4400526b0 con 0x7fd4580c8170 2024-09-13T18:45:29.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.789+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9744072910 con 0x7f97440afdb0 2024-09-13T18:45:29.797 INFO:teuthology.orchestra.run.smithi032.stdout:64424509448 2024-09-13T18:45:29.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.789+0000 7f973aa00700 1 -- 172.21.15.32:0/710933131 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f973c021020 con 0x7f97440afdb0 2024-09-13T18:45:29.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 msgr2=0x7f9720068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f972c004490 tx=0x7f972c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 msgr2=0x7f974406d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 0x7f974406d6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f973c00caa0 tx=0x7f973c00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 shutdown_connections 2024-09-13T18:45:29.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97441eea10 0x7f97441eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97440afdb0 0x7f974406d6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 --2- 172.21.15.32:0/710933131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9728015dc0 0x7f97440ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 >> 172.21.15.32:0/710933131 conn(0x7f97440cac60 msgr2=0x7f97440c7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 shutdown_connections 2024-09-13T18:45:29.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.793+0000 7f9733e00700 1 -- 172.21.15.32:0/710933131 wait complete. 2024-09-13T18:45:29.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.801+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0b100055c0 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.805+0000 7f0b27e00700 1 -- 172.21.15.32:0/1636403171 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b2805ca00 con 0x7f0b2c0d6ac0 2024-09-13T18:45:29.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.805+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85f8047330 con 0x7f85f80d5640 2024-09-13T18:45:29.810 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2024-09-13T18:45:29.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.805+0000 7f85fcc00700 1 -- 172.21.15.32:0/135647151 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85f8047330 con 0x7f85f80d5640 2024-09-13T18:45:29.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.805+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd870005890 con 0x7fd898072740 2024-09-13T18:45:29.813 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-09-13T18:45:29.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.805+0000 7fd88f400700 1 -- 172.21.15.32:0/42254345 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8880563d0 con 0x7fd898072740 2024-09-13T18:45:29.813 INFO:teuthology.orchestra.run.smithi032.stdout:60129542153 2024-09-13T18:45:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0b14066760 msgr2=0x7f0b14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0b14066760 0x7f0b14068c20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b20007fd0 tx=0x7f0b20007d80 comp rx=0 tx=0).stop 2024-09-13T18:45:29.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 msgr2=0x7f0b2c004bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c004bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800cca0 tx=0x7f0b2800a060 comp rx=0 tx=0).stop 2024-09-13T18:45:29.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 shutdown_connections 2024-09-13T18:45:29.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0b14066760 0x7f0b14068c20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0b2c0d6ac0 0x7f0b2c004bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0b2c0d66e0 0x7f0b2c048380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f85e0066800 msgr2=0x7f85e0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f85e0066800 0x7f85e0068cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85ec007fd0 tx=0x7f85ec007c20 comp rx=0 tx=0).stop 2024-09-13T18:45:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 --2- 172.21.15.32:0/1636403171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0b2c04bd10 0x7f0b2c02fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 >> 172.21.15.32:0/1636403171 conn(0x7f0b2c04feb0 msgr2=0x7f0b2c0d4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 msgr2=0x7f85f8047610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 0x7f85f8047610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f860004f480 tx=0x7f860004f700 comp rx=0 tx=0).stop 2024-09-13T18:45:29.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 shutdown_connections 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f85e0066800 0x7f85e0068cc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f80d5640 0x7f85f8047610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85f8050820 0x7f85f80cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 --2- 172.21.15.32:0/135647151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85f8045e10 0x7f85f80dcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 >> 172.21.15.32:0/135647151 conn(0x7f85f804fd00 msgr2=0x7f85f8034a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff464005890 con 0x7ff4881534a0 2024-09-13T18:45:29.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 shutdown_connections 2024-09-13T18:45:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7ff484c00700 1 -- 172.21.15.32:0/148161362 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff480005810 con 0x7ff4881534a0 2024-09-13T18:45:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.809+0000 7f8606000700 1 -- 172.21.15.32:0/135647151 wait complete. 2024-09-13T18:45:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd878066760 msgr2=0x7fd878068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd878066760 0x7fd878068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd898154400 tx=0x7fd884009190 comp rx=0 tx=0).stop 2024-09-13T18:45:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd898072740 msgr2=0x7fd898157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd898072740 0x7fd898157fc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd888015000 tx=0x7fd888004770 comp rx=0 tx=0).stop 2024-09-13T18:45:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 shutdown_connections 2024-09-13T18:45:29.822 INFO:teuthology.orchestra.run.smithi032.stdout:60129542152 2024-09-13T18:45:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 shutdown_connections 2024-09-13T18:45:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd878066760 0x7fd878068c20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8981534a0 0x7fd8981f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8980c4bd0 0x7fd898158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 --2- 172.21.15.32:0/42254345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd898072740 0x7fd898157fc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 >> 172.21.15.32:0/42254345 conn(0x7fd898073d50 msgr2=0x7fd898071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7f0b3b200700 1 -- 172.21.15.32:0/1636403171 wait complete. 2024-09-13T18:45:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 shutdown_connections 2024-09-13T18:45:29.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd89cc00700 1 -- 172.21.15.32:0/42254345 wait complete. 2024-09-13T18:45:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd4580c4cd0 con 0x7fd4580c8170 2024-09-13T18:45:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7fc814fd50 con 0x7f7fc81eadb0 2024-09-13T18:45:29.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fd44f400700 1 -- 172.21.15.32:0/3436361013 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4580c4cd0 con 0x7fd4580c8170 2024-09-13T18:45:29.825 INFO:teuthology.orchestra.run.smithi032.stdout:60129542152 2024-09-13T18:45:29.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe988053380 con 0x7fe988007430 2024-09-13T18:45:29.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.813+0000 7fe983e00700 1 -- 172.21.15.32:0/851522958 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9900cf730 con 0x7fe988007430 2024-09-13T18:45:29.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7f7fc5600700 1 -- 172.21.15.32:0/951169143 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fc0023070 con 0x7f7fc81eadb0 2024-09-13T18:45:29.826 INFO:teuthology.orchestra.run.smithi032.stdout:64424509449 2024-09-13T18:45:29.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-09-13T18:45:29.827 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff468066800 msgr2=0x7ff468068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff468066800 0x7ff468068cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0090b0 tx=0x7ff47c008030 comp rx=0 tx=0).stop 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 msgr2=0x7ff488155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 0x7ff488155d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff48000cac0 tx=0x7ff48000cdd0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 shutdown_connections 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff468066800 0x7ff468068cc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4881534a0 0x7ff488155d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4880c4bd0 0x7ff4881f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 --2- 172.21.15.32:0/148161362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff488072740 0x7ff48814e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 >> 172.21.15.32:0/148161362 conn(0x7ff488073d50 msgr2=0x7ff488070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd434066780 msgr2=0x7fd434068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd434066780 0x7fd434068c40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4480011e0 tx=0x7fd448009040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 msgr2=0x7fd4580c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd4580c1c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd45806ea50 tx=0x7fd440004770 comp rx=0 tx=0).stop 2024-09-13T18:45:29.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 shutdown_connections 2024-09-13T18:45:29.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7ff48de00700 1 -- 172.21.15.32:0/148161362 wait complete. 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 shutdown_connections 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd434066780 0x7fd434068c40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd45815e6d0 0x7fd4580bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4580c8170 0x7fd4580c1c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 --2- 172.21.15.32:0/3436361013 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4580c7d90 0x7fd45815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.817+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 >> 172.21.15.32:0/3436361013 conn(0x7fd4580cac60 msgr2=0x7fd45815fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 shutdown_connections 2024-09-13T18:45:29.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fd457e00700 1 -- 172.21.15.32:0/3436361013 wait complete. 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe970066730 msgr2=0x7fe970068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe970066730 0x7fe970068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe9880dc0c0 tx=0x7fe984007ee0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 msgr2=0x7fe9880d57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 0x7fe9880d57a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe990068dc0 tx=0x7fe990075dd0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 shutdown_connections 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe970066730 0x7fe970068bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9880d8b40 0x7fe9880ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe98804f220 0x7fe988049470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 --2- 172.21.15.32:0/851522958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe988007430 0x7fe9880d57a0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe990068dc0 tx=0x7fe990075dd0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 >> 172.21.15.32:0/851522958 conn(0x7fe988054110 msgr2=0x7fe98816a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7fa8066730 msgr2=0x7f7fa8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7fa8066730 0x7f7fa8068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0013d0 tx=0x7f7fbc006040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc81eadb0 msgr2=0x7f7fc81eb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc81eadb0 0x7f7fc81eb230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80c9b90 tx=0x7f7fc0001680 comp rx=0 tx=0).stop 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 shutdown_connections 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7fa8066730 0x7f7fa8068bf0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0013d0 tx=0x7f7fbc006040 comp rx=0 tx=0).stop 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc81eadb0 0x7f7fc81eb230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fc814b320 0x7f7fc8146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 --2- 172.21.15.32:0/951169143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fb0005350 0x7f7fc814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:29.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 >> 172.21.15.32:0/951169143 conn(0x7f7fc80c8ad0 msgr2=0x7f7fc80c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:29.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 shutdown_connections 2024-09-13T18:45:29.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7fe995400700 1 -- 172.21.15.32:0/851522958 wait complete. 2024-09-13T18:45:29.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 shutdown_connections 2024-09-13T18:45:29.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:29.821+0000 7f7fcf000700 1 -- 172.21.15.32:0/951169143 wait complete. 2024-09-13T18:45:29.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.4 2024-09-13T18:45:29.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-09-13T18:45:29.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-09-13T18:45:29.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2024-09-13T18:45:29.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-09-13T18:45:29.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2024-09-13T18:45:29.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2024-09-13T18:45:30.828 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:45:30.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:45:30.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:45:30.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:45:30.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:45:30.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:45:30.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:45:30.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:45:31.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.061+0000 7fa8d6600700 1 Processor -- start 2024-09-13T18:45:31.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.061+0000 7fa8d6600700 1 -- start start 2024-09-13T18:45:31.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d6600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d6600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8c80db120 0x7fa8c8044be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d6600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c8006f90 con 0x7fa8c8045120 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d6600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c8007420 con 0x7fa8c80db120 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d6600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80060e0 con 0x7fa8c80d4950 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8cfe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa8c80db120 0x7fa8c8044be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d5c00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8c8045120 0x7fa8c804aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55648/0 (socket says 172.21.15.32:55648) 2024-09-13T18:45:31.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d5c00700 1 -- 172.21.15.32:0/896120416 learned_addr learned my addr 172.21.15.32:0/896120416 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:31.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.065+0000 7fa8d5200700 1 --2- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cfe00700 1 -- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 msgr2=0x7fa8c8005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cfe00700 1 --2- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cfe00700 1 -- 172.21.15.32:0/896120416 >> v1:172.21.15.32:6789/0 conn(0x7fa8c8045120 legacy=0x7fa8c804aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cfe00700 1 -- 172.21.15.32:0/896120416 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8006380 con 0x7fa8c80db120 2024-09-13T18:45:31.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cfe00700 1 --2- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c8044be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00bdc0 tx=0x7fa8bc00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce1a03fae391fb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cf400700 1 -- 172.21.15.32:0/896120416 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc010070 con 0x7fa8c80db120 2024-09-13T18:45:31.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cf400700 1 -- 172.21.15.32:0/896120416 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00daa0 con 0x7fa8c80db120 2024-09-13T18:45:31.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.069+0000 7fa8cf400700 1 -- 172.21.15.32:0/896120416 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00de50 con 0x7fa8c80db120 2024-09-13T18:45:31.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 -- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 msgr2=0x7fa8c8044be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 --2- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c8044be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00bdc0 tx=0x7fa8bc00d330 comp rx=0 tx=0).stop 2024-09-13T18:45:31.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 -- 172.21.15.32:0/896120416 shutdown_connections 2024-09-13T18:45:31.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 --2- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c8044be0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 --2- 172.21.15.32:0/896120416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8005b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 -- 172.21.15.32:0/896120416 >> 172.21.15.32:0/896120416 conn(0x7fa8c804fd00 msgr2=0x7fa8c8050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 -- 172.21.15.32:0/896120416 shutdown_connections 2024-09-13T18:45:31.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 -- 172.21.15.32:0/896120416 wait complete. 2024-09-13T18:45:31.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 Processor -- start 2024-09-13T18:45:31.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.073+0000 7fa8d6600700 1 -- start start 2024-09-13T18:45:31.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d6600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c8045120 0x7fa8c80dd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d6600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8170f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d6600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c80d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d6600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80dce40 con 0x7fa8c8045120 2024-09-13T18:45:31.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d6600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80dda00 con 0x7fa8c80db120 2024-09-13T18:45:31.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8cfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8170f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c80d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d5c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c80d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37202/0 (socket says 172.21.15.32:37202) 2024-09-13T18:45:31.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d5c00700 1 -- 172.21.15.32:0/1755487506 learned_addr learned my addr 172.21.15.32:0/1755487506 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d6600700 1 -- 172.21.15.32:0/1755487506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8171490 con 0x7fa8c80d4950 2024-09-13T18:45:31.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8cfe00700 1 -- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 msgr2=0x7fa8c80d2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8cfe00700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c80d2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8cfe00700 1 -- 172.21.15.32:0/1755487506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c8045120 msgr2=0x7fa8c80dd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8cfe00700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c8045120 0x7fa8c80dd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8cfe00700 1 -- 172.21.15.32:0/1755487506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc00ba70 con 0x7fa8c80d4950 2024-09-13T18:45:31.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.077+0000 7fa8d5c00700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c80d2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:31.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8cfe00700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8170f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc017000 tx=0x7fa8bc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc005e50 con 0x7fa8c80d4950 2024-09-13T18:45:31.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0038f0 con 0x7fa8c80d4950 2024-09-13T18:45:31.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc003ca0 con 0x7fa8c80d4950 2024-09-13T18:45:31.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8d6600700 1 -- 172.21.15.32:0/1755487506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c80dd720 con 0x7fa8c80d4950 2024-09-13T18:45:31.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8d6600700 1 -- 172.21.15.32:0/1755487506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c804e900 con 0x7fa8c80d4950 2024-09-13T18:45:31.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.081+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a4005310 con 0x7fa8c80d4950 2024-09-13T18:45:31.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.089+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8bc0217b0 con 0x7fa8c80d4950 2024-09-13T18:45:31.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.089+0000 7fa8ccc00700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa8b0066730 0x7fa8b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.089+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8bc089e20 con 0x7fa8c80d4950 2024-09-13T18:45:31.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.093+0000 7fa8d5200700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa8b0066730 0x7fa8b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.097+0000 7fa8d5200700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa8b0066730 0x7fa8b0068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4006b40 tx=0x7fa8c4006ad0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8241200700 1 Processor -- start 2024-09-13T18:45:31.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8bc057030 con 0x7fa8c80d4950 2024-09-13T18:45:31.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8241200700 1 -- start start 2024-09-13T18:45:31.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8241200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f823c0c6b90 0x7f823c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8241200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0c78c0 con 0x7f823c1509a0 2024-09-13T18:45:31.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8241200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0709d0 con 0x7f823c06ecd0 2024-09-13T18:45:31.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8241200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c070cb0 con 0x7f823c0c6b90 2024-09-13T18:45:31.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8239e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f823c1509a0 0x7f823c159ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55660/0 (socket says 172.21.15.32:55660) 2024-09-13T18:45:31.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.101+0000 7f8239e00700 1 -- 172.21.15.32:0/1157733525 learned_addr learned my addr 172.21.15.32:0/1157733525 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:31.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8239400700 1 --2- 172.21.15.32:0/1157733525 >> v2:172.21.15.86:3300/0 conn(0x7f823c0c6b90 0x7f823c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8238a00700 1 -- 172.21.15.32:0/1157733525 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189163530 0 0) 0x7f823c0c78c0 con 0x7f823c1509a0 2024-09-13T18:45:31.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8238a00700 1 -- 172.21.15.32:0/1157733525 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82200035d0 con 0x7f823c1509a0 2024-09-13T18:45:31.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 Processor -- start 2024-09-13T18:45:31.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 -- start start 2024-09-13T18:45:31.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8239400700 1 -- 172.21.15.32:0/1157733525 >> v1:172.21.15.86:6789/0 conn(0x7f823c06ecd0 legacy=0x7f823c06fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8239400700 1 -- 172.21.15.32:0/1157733525 >> v1:172.21.15.32:6789/0 conn(0x7f823c1509a0 legacy=0x7f823c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8239400700 1 -- 172.21.15.32:0/1157733525 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0c7270 con 0x7f823c0c6b90 2024-09-13T18:45:31.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 Processor -- start 2024-09-13T18:45:31.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 -- start start 2024-09-13T18:45:31.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8239400700 1 --2- 172.21.15.32:0/1157733525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c0c6b90 0x7f823c0c6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8228009800 tx=0x7f8228009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765f3110eda1a394 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8238a00700 1 -- 172.21.15.32:0/1157733525 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822800f8a0 con 0x7f823c0c6b90 2024-09-13T18:45:31.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8238a00700 1 -- 172.21.15.32:0/1157733525 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822800fa00 con 0x7f823c0c6b90 2024-09-13T18:45:31.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f8238a00700 1 -- 172.21.15.32:0/1157733525 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822800f8a0 con 0x7f823c0c6b90 2024-09-13T18:45:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0800d6630 0x7fe08004c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b68157fb0 0x7f4b68070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68071360 0x7f4b6815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b681620d0 con 0x7f4b6815e140 2024-09-13T18:45:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b680c5fa0 con 0x7f4b68157fb0 2024-09-13T18:45:31.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7f4b67e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680cb990 con 0x7f4b68071360 2024-09-13T18:45:31.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe080044be0 0x7fe080005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08004a6f0 con 0x7fe0800dc4c0 2024-09-13T18:45:31.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800dd4a0 con 0x7fe0800d6630 2024-09-13T18:45:31.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.105+0000 7fe08ec00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800dcee0 con 0x7fe080044be0 2024-09-13T18:45:31.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe080044be0 0x7fe080005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08d800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe0800d6630 0x7fe08004c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe080044be0 0x7fe080005b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37220/0 (socket says 172.21.15.32:37220) 2024-09-13T18:45:31.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 -- 172.21.15.32:0/2310077650 learned_addr learned my addr 172.21.15.32:0/2310077650 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b68157fb0 0x7f4b68070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68071360 0x7f4b6815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4b68157fb0 0x7f4b68070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37208/0 (socket says 172.21.15.32:37208) 2024-09-13T18:45:31.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 -- 172.21.15.32:0/37397100 learned_addr learned my addr 172.21.15.32:0/37397100 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 -- 172.21.15.32:0/2310077650 >> v2:172.21.15.32:3300/0 conn(0x7fe0800d6630 msgr2=0x7fe08004c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 --2- 172.21.15.32:0/2310077650 >> v2:172.21.15.32:3300/0 conn(0x7fe0800d6630 0x7fe08004c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 -- 172.21.15.32:0/2310077650 >> v1:172.21.15.86:6789/0 conn(0x7fe0800dc4c0 legacy=0x7fe080034f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:45:31.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 -- 172.21.15.32:0/2310077650 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800dd1c0 con 0x7fe080044be0 2024-09-13T18:45:31.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 -- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68071360 msgr2=0x7f4b6815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 --2- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68071360 0x7f4b6815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 -- 172.21.15.32:0/37397100 >> v1:172.21.15.32:6789/0 conn(0x7f4b6815e140 legacy=0x7f4b68071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 Processor -- start 2024-09-13T18:45:31.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe08ce00700 1 --2- 172.21.15.32:0/2310077650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080044be0 0x7fe080005b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe080007380 tx=0x7fe074009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b6622ae6f6726e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 -- start start 2024-09-13T18:45:31.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f71e8400700 1 Processor -- start 2024-09-13T18:45:31.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 -- 172.21.15.32:0/37397100 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680b46a0 con 0x7f4b68157fb0 2024-09-13T18:45:31.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 -- 172.21.15.32:0/1157733525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c0c6b90 msgr2=0x7f823c0c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 --2- 172.21.15.32:0/1157733525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c0c6b90 0x7f823c0c6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8228009800 tx=0x7f8228009b10 comp rx=0 tx=0).stop 2024-09-13T18:45:31.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f71e8400700 1 -- start start 2024-09-13T18:45:31.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 -- 172.21.15.32:0/1157733525 shutdown_connections 2024-09-13T18:45:31.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 --2- 172.21.15.32:0/1157733525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c0c6b90 0x7f823c0c6070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 -- 172.21.15.32:0/1157733525 >> 172.21.15.32:0/1157733525 conn(0x7f823c0c8bd0 msgr2=0x7f823c0c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 -- 172.21.15.32:0/1157733525 shutdown_connections 2024-09-13T18:45:31.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b66a00700 1 --2- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68157fb0 0x7f4b68070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009910 tx=0x7f4b58009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=738bf34203f0d5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f8241200700 1 -- 172.21.15.32:0/1157733525 wait complete. 2024-09-13T18:45:31.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fe087e00700 1 -- 172.21.15.32:0/2310077650 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074004230 con 0x7fe080044be0 2024-09-13T18:45:31.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe087e00700 1 -- 172.21.15.32:0/2310077650 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074004390 con 0x7fe080044be0 2024-09-13T18:45:31.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d7806f530 0x7f6d7806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7815a780 con 0x7f6d78159c90 2024-09-13T18:45:31.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d780c71f0 con 0x7f6d7806f530 2024-09-13T18:45:31.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f6d7ec00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c88f0 con 0x7f6d780c6860 2024-09-13T18:45:31.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7fb60c600700 1 Processor -- start 2024-09-13T18:45:31.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe087e00700 1 -- 172.21.15.32:0/2310077650 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740036c0 con 0x7fe080044be0 2024-09-13T18:45:31.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d7806f530 0x7f6d7806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d7cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6d7806f530 0x7f6d7806f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37232/0 (socket says 172.21.15.32:37232) 2024-09-13T18:45:31.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d7cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57342/0 (socket says 172.21.15.32:57342) 2024-09-13T18:45:31.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d7cc00700 1 -- 172.21.15.32:0/102710687 learned_addr learned my addr 172.21.15.32:0/102710687 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e8400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71e0151ab0 0x7f71e006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e8400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e00c28d0 con 0x7f71e006ae20 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e8400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e00c4150 con 0x7f71e00cd0e0 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e8400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e0071550 con 0x7f71e0151ab0 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e6400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f71e00cd0e0 0x7f71e0161ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51334/0 (socket says 172.21.15.32:51334) 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e6400700 1 -- 172.21.15.32:0/1135909826 learned_addr learned my addr 172.21.15.32:0/1135909826 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:31.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e5a00700 1 --2- 172.21.15.32:0/1135909826 >> v2:172.21.15.32:3300/0 conn(0x7f71e0151ab0 0x7f71e006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 -- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 msgr2=0x7f6d780c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 --2- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 -- 172.21.15.32:0/102710687 >> v1:172.21.15.32:6789/0 conn(0x7f6d78159c90 legacy=0x7f6d7815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 -- 172.21.15.32:0/102710687 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780c7850 con 0x7f6d7806f530 2024-09-13T18:45:31.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d6f400700 1 --2- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d7806f960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009d90 tx=0x7f6d6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525e59f89751866b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.109+0000 7f4b65600700 1 -- 172.21.15.32:0/37397100 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011830 con 0x7f4b68157fb0 2024-09-13T18:45:31.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b65600700 1 -- 172.21.15.32:0/37397100 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b58011990 con 0x7f4b68157fb0 2024-09-13T18:45:31.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b65600700 1 -- 172.21.15.32:0/37397100 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011d40 con 0x7f4b68157fb0 2024-09-13T18:45:31.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f8241200700 1 Processor -- start 2024-09-13T18:45:31.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60c600700 1 -- start start 2024-09-13T18:45:31.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d77400700 1 -- 172.21.15.32:0/102710687 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800e070 con 0x7f6d7806f530 2024-09-13T18:45:31.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e5a00700 1 -- 172.21.15.32:0/1135909826 >> v1:172.21.15.86:6789/0 conn(0x7f71e00cd0e0 legacy=0x7f71e0161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f1c8be00700 1 Processor -- start 2024-09-13T18:45:31.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 -- 172.21.15.32:0/2310077650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080044be0 msgr2=0x7fe080005b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 --2- 172.21.15.32:0/2310077650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080044be0 0x7fe080005b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe080007380 tx=0x7fe074009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f1c8be00700 1 -- start start 2024-09-13T18:45:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e5a00700 1 -- 172.21.15.32:0/1135909826 >> v1:172.21.15.32:6789/0 conn(0x7f71e006ae20 legacy=0x7f71e00ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e5a00700 1 -- 172.21.15.32:0/1135909826 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00c2310 con 0x7f71e0151ab0 2024-09-13T18:45:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71dfe00700 1 -- 172.21.15.32:0/1135909826 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261969104 0 0) 0x7f71e00c28d0 con 0x7f71e006ae20 2024-09-13T18:45:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60c600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb6040c83f0 0x7fb604070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60c600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb6041556a0 0x7fb60414f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60c600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6041590a0 con 0x7fb6040cb860 2024-09-13T18:45:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60c600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6040ca500 con 0x7fb6040c83f0 2024-09-13T18:45:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60c600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb604155b30 con 0x7fb6041556a0 2024-09-13T18:45:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 -- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68157fb0 msgr2=0x7f4b68070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 --2- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68157fb0 0x7f4b68070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009910 tx=0x7f4b58009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:31.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f8241200700 1 -- start start 2024-09-13T18:45:31.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 -- 172.21.15.32:0/2310077650 shutdown_connections 2024-09-13T18:45:31.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 --2- 172.21.15.32:0/2310077650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080044be0 0x7fe080005b00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 --2- 172.21.15.32:0/2310077650 >> v2:172.21.15.32:3300/0 conn(0x7fe0800d6630 0x7fe08004c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 -- 172.21.15.32:0/2310077650 >> 172.21.15.32:0/2310077650 conn(0x7fe08004fd00 msgr2=0x7fe080050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb609200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb6040c83f0 0x7fb604070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb609c00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb6040cb860 0x7fb60414f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51346/0 (socket says 172.21.15.32:51346) 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb609c00700 1 -- 172.21.15.32:0/2729262075 learned_addr learned my addr 172.21.15.32:0/2729262075 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 -- 172.21.15.32:0/37397100 shutdown_connections 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 --2- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68071360 0x7f4b6815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 --2- 172.21.15.32:0/37397100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b68157fb0 0x7f4b68070560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 -- 172.21.15.32:0/37397100 >> 172.21.15.32:0/37397100 conn(0x7f4b680cbfe0 msgr2=0x7f4b680cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fb60a600700 1 --2- 172.21.15.32:0/2729262075 >> v2:172.21.15.86:3300/0 conn(0x7fb6041556a0 0x7fb60414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f71e5a00700 1 --2- 172.21.15.32:0/1135909826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e006b980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097d0 tx=0x7f71d4009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1615f43c1e53a5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 -- 172.21.15.32:0/2310077650 shutdown_connections 2024-09-13T18:45:31.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d77400700 1 -- 172.21.15.32:0/102710687 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6800bbd0 con 0x7f6d7806f530 2024-09-13T18:45:31.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d77400700 1 -- 172.21.15.32:0/102710687 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68012430 con 0x7f6d7806f530 2024-09-13T18:45:31.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d7ec00700 1 -- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 msgr2=0x7f6d7806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d7806f960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009d90 tx=0x7f6d6800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:31.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7f4b67e00700 1 -- 172.21.15.32:0/37397100 shutdown_connections 2024-09-13T18:45:31.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.113+0000 7fe08ec00700 1 -- 172.21.15.32:0/2310077650 wait complete. 2024-09-13T18:45:31.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f4b67e00700 1 -- 172.21.15.32:0/37397100 wait complete. 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 -- 172.21.15.32:0/102710687 shutdown_connections 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d7806f960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/102710687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 -- 172.21.15.32:0/102710687 >> 172.21.15.32:0/102710687 conn(0x7f6d780c8a60 msgr2=0x7f6d780c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71dfe00700 1 -- 172.21.15.32:0/1135909826 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004230 con 0x7f71e0151ab0 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71dfe00700 1 -- 172.21.15.32:0/1135909826 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4004390 con 0x7f71e0151ab0 2024-09-13T18:45:31.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71dfe00700 1 -- 172.21.15.32:0/1135909826 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40036c0 con 0x7f71e0151ab0 2024-09-13T18:45:31.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 -- 172.21.15.32:0/102710687 shutdown_connections 2024-09-13T18:45:31.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0c4bd0 0x7f1c8c153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8be00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c159570 con 0x7f1c8c1534a0 2024-09-13T18:45:31.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 -- 172.21.15.32:0/102710687 wait complete. 2024-09-13T18:45:31.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb609200700 1 -- 172.21.15.32:0/2729262075 >> v2:172.21.15.86:3300/0 conn(0x7fb6041556a0 msgr2=0x7fb60414f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb609200700 1 --2- 172.21.15.32:0/2729262075 >> v2:172.21.15.86:3300/0 conn(0x7fb6041556a0 0x7fb60414f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb609200700 1 -- 172.21.15.32:0/2729262075 >> v1:172.21.15.86:6789/0 conn(0x7fb6040cb860 legacy=0x7fb60414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb609200700 1 -- 172.21.15.32:0/2729262075 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604155d30 con 0x7fb6040c83f0 2024-09-13T18:45:31.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8be00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c1597c0 con 0x7f1c8c072740 2024-09-13T18:45:31.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0c40a0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f8241200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c06ecd0 0x7f823c0c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f8241200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f823c0c6b90 0x7f823c0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f8241200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 0x7f823c0c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f8241200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1f53e0 con 0x7f823c1509a0 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f8241200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1f7ef0 con 0x7f823c06ecd0 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f8241200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1f7c50 con 0x7f823c0c6b90 2024-09-13T18:45:31.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fe08ec00700 1 Processor -- start 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8a000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1c8c072740 0x7f1c8c070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51358/0 (socket says 172.21.15.32:51358) 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8a000700 1 -- 172.21.15.32:0/1097092072 learned_addr learned my addr 172.21.15.32:0/1097092072 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8b400700 1 --2- 172.21.15.32:0/1097092072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0c4bd0 0x7f1c8c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8b400700 1 -- 172.21.15.32:0/1097092072 >> v1:172.21.15.86:6789/0 conn(0x7f1c8c072740 legacy=0x7f1c8c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8b400700 1 -- 172.21.15.32:0/1097092072 >> v1:172.21.15.32:6789/0 conn(0x7f1c8c1534a0 legacy=0x7f1c8c0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8b400700 1 -- 172.21.15.32:0/1097092072 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c159aa0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb609200700 1 --2- 172.21.15.32:0/2729262075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6040c83f0 0x7fb604070520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb6040c82d0 tx=0x7fb5f0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e20284a29f25a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb603e00700 1 -- 172.21.15.32:0/2729262075 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0004230 con 0x7fb6040c83f0 2024-09-13T18:45:31.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb603e00700 1 -- 172.21.15.32:0/2729262075 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0004390 con 0x7fb6040c83f0 2024-09-13T18:45:31.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fb603e00700 1 -- 172.21.15.32:0/2729262075 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00036c0 con 0x7fb6040c83f0 2024-09-13T18:45:31.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7fe08ec00700 1 -- start start 2024-09-13T18:45:31.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c8b400700 1 --2- 172.21.15.32:0/1097092072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0c4bd0 0x7f1c8c153880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009880 tx=0x7f1c7c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b5d1a83ad7caae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 -- 172.21.15.32:0/1135909826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 msgr2=0x7f71e006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 --2- 172.21.15.32:0/1135909826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e006b980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097d0 tx=0x7f71d4009ae0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 Processor -- start 2024-09-13T18:45:31.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 -- 172.21.15.32:0/1135909826 shutdown_connections 2024-09-13T18:45:31.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c89600700 1 -- 172.21.15.32:0/1097092072 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c004230 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c89600700 1 -- 172.21.15.32:0/1097092072 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c004390 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f1c89600700 1 -- 172.21.15.32:0/1097092072 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0036c0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 --2- 172.21.15.32:0/1135909826 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e006b980 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 -- 172.21.15.32:0/1135909826 >> 172.21.15.32:0/1135909826 conn(0x7f71e006eae0 msgr2=0x7f71e006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 -- 172.21.15.32:0/1135909826 shutdown_connections 2024-09-13T18:45:31.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f4b67e00700 1 Processor -- start 2024-09-13T18:45:31.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 0x7f823c0c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 0x7f823c0c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48846/0 (socket says 172.21.15.32:48846) 2024-09-13T18:45:31.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 -- 172.21.15.32:0/3569989521 learned_addr learned my addr 172.21.15.32:0/3569989521 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f6d7ec00700 1 -- start start 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 -- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f823c0c6b90 msgr2=0x7f823c0c0a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f823c0c6b90 0x7f823c0c0a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 -- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c06ecd0 msgr2=0x7f823c0c0500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c06ecd0 0x7f823c0c0500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 -- 172.21.15.32:0/3569989521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280094b0 con 0x7f823c1509a0 2024-09-13T18:45:31.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f823a800700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 0x7f823c0c0f80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f823400cca0 tx=0x7f823400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ec00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe080044be0 0x7fe0800c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 -- start start 2024-09-13T18:45:31.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ec00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 0x7fe080033710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ec00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800dc4c0 0x7fe0800db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ec00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800344e0 con 0x7fe080044be0 2024-09-13T18:45:31.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ec00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080033280 con 0x7fe0800dc4c0 2024-09-13T18:45:31.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 -- 172.21.15.32:0/2729262075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6040c83f0 msgr2=0x7fb604070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 --2- 172.21.15.32:0/2729262075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6040c83f0 0x7fb604070520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb6040c82d0 tx=0x7fb5f0009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:31.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ec00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c7a70 con 0x7fe0800d6630 2024-09-13T18:45:31.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 0x7fe080033710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 0x7fe080033710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57366/0 (socket says 172.21.15.32:57366) 2024-09-13T18:45:31.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 -- 172.21.15.32:0/3676785480 learned_addr learned my addr 172.21.15.32:0/3676785480 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.117+0000 7f71e8400700 1 -- 172.21.15.32:0/1135909826 wait complete. 2024-09-13T18:45:31.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7ec00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d781fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 -- 172.21.15.32:0/1097092072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0c4bd0 msgr2=0x7f1c8c153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 --2- 172.21.15.32:0/1097092072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0c4bd0 0x7f1c8c153880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009880 tx=0x7f1c7c009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:31.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7ec00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 -- 172.21.15.32:0/1097092072 shutdown_connections 2024-09-13T18:45:31.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7ec00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d78159c90 0x7f6d78153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 --2- 172.21.15.32:0/1097092072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c0c4bd0 0x7f1c8c153880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 -- 172.21.15.32:0/1097092072 >> 172.21.15.32:0/1097092072 conn(0x7f1c8c073d50 msgr2=0x7f1c8c071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 -- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800dc4c0 msgr2=0x7fe0800db5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:31.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800dc4c0 0x7fe0800db5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 -- 172.21.15.32:0/3676785480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe080044be0 msgr2=0x7fe0800c70b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:31.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe080044be0 0x7fe0800c70b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 -- 172.21.15.32:0/3676785480 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074009570 con 0x7fe0800d6630 2024-09-13T18:45:31.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 -- 172.21.15.32:0/1097092072 shutdown_connections 2024-09-13T18:45:31.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400cea0 con 0x7f823c1509a0 2024-09-13T18:45:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d781fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d6f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d6f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57380/0 (socket says 172.21.15.32:57380) 2024-09-13T18:45:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d781fbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37258/0 (socket says 172.21.15.32:37258) 2024-09-13T18:45:31.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8234003e50 con 0x7f823c1509a0 2024-09-13T18:45:31.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 -- 172.21.15.32:0/1097092072 wait complete. 2024-09-13T18:45:31.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 -- 172.21.15.32:0/2729262075 shutdown_connections 2024-09-13T18:45:31.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 --2- 172.21.15.32:0/2729262075 >> v2:172.21.15.86:3300/0 conn(0x7fb6041556a0 0x7fb60414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 --2- 172.21.15.32:0/2729262075 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6040c83f0 0x7fb604070520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 -- 172.21.15.32:0/2729262075 >> 172.21.15.32:0/2729262075 conn(0x7fb6040cad40 msgr2=0x7fb6040cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c1f5090 con 0x7f823c1509a0 2024-09-13T18:45:31.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c0c54c0 con 0x7f823c1509a0 2024-09-13T18:45:31.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f71e8400700 1 Processor -- start 2024-09-13T18:45:31.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f71e8400700 1 -- start start 2024-09-13T18:45:31.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400abd0 con 0x7f823c1509a0 2024-09-13T18:45:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 -- 172.21.15.32:0/2729262075 shutdown_connections 2024-09-13T18:45:31.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fb60c600700 1 -- 172.21.15.32:0/2729262075 wait complete. 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781fc270 con 0x7f6d78159c90 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d781fe8a0 con 0x7f6d7806f530 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d6f400700 1 -- 172.21.15.32:0/2646338879 learned_addr learned my addr 172.21.15.32:0/2646338879 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78155440 con 0x7f6d780c6860 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7cc00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d78159c90 0x7f6d78153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 -- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 msgr2=0x7f6d780bef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780bef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 -- 172.21.15.32:0/2646338879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d78159c90 msgr2=0x7f6d78153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d78159c90 0x7f6d78153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68009a70 con 0x7f6d7806f530 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b68071360 0x7f4b680c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d7cc00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d78159c90 0x7f6d78153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f6d77e00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d781fbd30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c480 tx=0x7f6d6000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7fe08ce00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 0x7fe080033710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe08000d440 tx=0x7fe074004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c1e1310 con 0x7f823c1509a0 2024-09-13T18:45:31.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f1c8be00700 1 Processor -- start 2024-09-13T18:45:31.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f71e8400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71e006ae20 0x7f71e01f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f71e8400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 0x7f71e0149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e8400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e0149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e8400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e014a7b0 con 0x7f71e0151ab0 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 0x7f4b680c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b6815e140 0x7f4b681fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b681fcb60 con 0x7f4b68071360 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68157370 con 0x7f4b6815e140 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.121+0000 7f4b67e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680c8510 con 0x7f4b68157fb0 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 0x7f4b680c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 0x7f4b680c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57394/0 (socket says 172.21.15.32:57394) 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 -- 172.21.15.32:0/464254545 learned_addr learned my addr 172.21.15.32:0/464254545 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f1c8be00700 1 -- start start 2024-09-13T18:45:31.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66a00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b68071360 0x7f4b680c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600052d0 con 0x7f6d7806f530 2024-09-13T18:45:31.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60005430 con 0x7f6d7806f530 2024-09-13T18:45:31.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600055a0 con 0x7f6d7806f530 2024-09-13T18:45:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b67400700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b6815e140 0x7f4b681fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 0x7f71e0149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 0x7f71e0149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57396/0 (socket says 172.21.15.32:57396) 2024-09-13T18:45:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 -- 172.21.15.32:0/3196779606 learned_addr learned my addr 172.21.15.32:0/3196779606 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5a00700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71e006ae20 0x7f71e01f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e014a0b0 con 0x7f71e006ae20 2024-09-13T18:45:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 -- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b6815e140 msgr2=0x7f4b681fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b6815e140 0x7f4b681fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 -- 172.21.15.32:0/464254545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b68071360 msgr2=0x7f4b680c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b68071360 0x7f4b680c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 -- 172.21.15.32:0/464254545 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58009570 con 0x7f4b68157fb0 2024-09-13T18:45:31.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e01f3830 con 0x7f71e00cd0e0 2024-09-13T18:45:31.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 Processor -- start 2024-09-13T18:45:31.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b66000700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 0x7f4b680c8aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ea00 tx=0x7f4b5400ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e6400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e0149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 -- start start 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d78154e80 con 0x7f6d7806f530 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d78154720 con 0x7f6d7806f530 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400b860 con 0x7fe0800d6630 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07400b9c0 con 0x7fe0800d6630 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400bd70 con 0x7fe0800d6630 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54009720 con 0x7f4b68157fb0 2024-09-13T18:45:31.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400c850 con 0x7f4b68157fb0 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400cbc0 con 0x7f4b68157fb0 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe080034a80 con 0x7fe0800d6630 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe080032f10 con 0x7fe0800d6630 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 -- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71e006ae20 msgr2=0x7f71e01f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71e006ae20 0x7f71e01f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 -- 172.21.15.32:0/3196779606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 msgr2=0x7f71e0149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e0149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f71e5000700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40094b0 con 0x7f71e00cd0e0 2024-09-13T18:45:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b680c6640 con 0x7f4b68157fb0 2024-09-13T18:45:31.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b680b1a50 con 0x7f4b68157fb0 2024-09-13T18:45:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6040c83f0 0x7fb60414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6040cb860 0x7fb604151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080034fa0 con 0x7fe0800d6630 2024-09-13T18:45:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 0x7fb6040c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60414db50 con 0x7fb6041556a0 2024-09-13T18:45:31.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60414d360 con 0x7fb6040cb860 2024-09-13T18:45:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7fb60c600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60414ea50 con 0x7fb6040c83f0 2024-09-13T18:45:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d780c39d0 con 0x7f6d7806f530 2024-09-13T18:45:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f1c8be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8c072740 0x7f1c8c0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.125+0000 7f1c8be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 0x7f1c8c14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f71e5000700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 0x7f71e0149630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c750 tx=0x7f71cc00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b680c64a0 con 0x7f4b68157fb0 2024-09-13T18:45:31.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c1534a0 0x7f1c8c14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 0x7f1c8c14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 0x7fb6040c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 0x7fb6040c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48880/0 (socket says 172.21.15.32:48880) 2024-09-13T18:45:31.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 -- 172.21.15.32:0/2675383859 learned_addr learned my addr 172.21.15.32:0/2675383859 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f823400ad30 con 0x7f823c1509a0 2024-09-13T18:45:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 0x7f1c8c14e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37296/0 (socket says 172.21.15.32:37296) 2024-09-13T18:45:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8be00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1eef30 con 0x7f1c8c072740 2024-09-13T18:45:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c14dc20 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0cf490 con 0x7f1c8c1534a0 2024-09-13T18:45:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8aa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8c072740 0x7f1c8c0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c1534a0 0x7f1c8c14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 -- 172.21.15.32:0/2554709308 learned_addr learned my addr 172.21.15.32:0/2554709308 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe074021070 con 0x7fe0800d6630 2024-09-13T18:45:31.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f8232000700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f821c0667c0 0x7f821c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8234084a90 con 0x7f823c1509a0 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f8239e00700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f821c0667c0 0x7f821c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 -- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6040c83f0 msgr2=0x7fb60414e510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6040c83f0 0x7fb60414e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 -- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6040cb860 msgr2=0x7fb604151ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6040cb860 0x7fb604151ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 -- 172.21.15.32:0/2675383859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00094b0 con 0x7fb6041556a0 2024-09-13T18:45:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 -- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c1534a0 msgr2=0x7f1c8c14ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c1534a0 0x7f1c8c14ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 -- 172.21.15.32:0/2554709308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8c072740 msgr2=0x7f1c8c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8c072740 0x7f1c8c0cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 -- 172.21.15.32:0/2554709308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0094b0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f1c8a000700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 0x7f1c8c14e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c500 tx=0x7f1c7800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d600038e0 con 0x7f6d7806f530 2024-09-13T18:45:31.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fb60a600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 0x7fb6040c3150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009d30 tx=0x7fb5fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fe085600700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe068066800 0x7fe068068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe074085f00 con 0x7fe0800d6630 2024-09-13T18:45:31.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f8239e00700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f821c0667c0 0x7f821c068c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f822c0011e0 tx=0x7f822c001110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b5400cd20 con 0x7f4b68157fb0 2024-09-13T18:45:31.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.129+0000 7fe08d800700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe068066800 0x7fe068068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fe08d800700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe068066800 0x7fe068068cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009810 tx=0x7fe07c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f6d74c00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d54066730 0x7f6d54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d60083cc0 con 0x7f6d7806f530 2024-09-13T18:45:31.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f4b5ea00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b48066830 0x7f4b48068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b54084a90 con 0x7f4b68157fb0 2024-09-13T18:45:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f4b66a00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b48066830 0x7f4b48068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f6d6f400700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d54066730 0x7f6d54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc009ba0 con 0x7fb6041556a0 2024-09-13T18:45:31.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6040c6490 con 0x7fb6041556a0 2024-09-13T18:45:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f6d6f400700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d54066730 0x7f6d54068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d78165100 tx=0x7f6d68011000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00f040 con 0x7fb6041556a0 2024-09-13T18:45:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc014480 con 0x7fb6041556a0 2024-09-13T18:45:31.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60414d590 con 0x7fb6041556a0 2024-09-13T18:45:31.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8234051bb0 con 0x7f823c1509a0 2024-09-13T18:45:31.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7f4b66a00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b48066830 0x7f4b48068cf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009c60 tx=0x7f4b58008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.133+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb604074d00 con 0x7fb6041556a0 2024-09-13T18:45:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5fc0145e0 con 0x7fb6041556a0 2024-09-13T18:45:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7fb601600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5e4066730 0x7fb5e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5fc084df0 con 0x7fb6041556a0 2024-09-13T18:45:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7fb609c00700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5e4066730 0x7fb5e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78005d90 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe074052ff0 con 0x7fe0800d6630 2024-09-13T18:45:31.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0054e0 con 0x7f71e00cd0e0 2024-09-13T18:45:31.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c780070d0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78007440 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c0cf730 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e00c7440 con 0x7f71e00cd0e0 2024-09-13T18:45:31.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c0cfcf0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.137+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e00c7160 con 0x7f71e00cd0e0 2024-09-13T18:45:31.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.141+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d60050db0 con 0x7f6d7806f530 2024-09-13T18:45:31.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.141+0000 7fb609c00700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5e4066730 0x7fb5e4068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8001760 tx=0x7fb5f8007a50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.141+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0149350 con 0x7f71e00cd0e0 2024-09-13T18:45:31.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.141+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc0036a0 con 0x7f71e00cd0e0 2024-09-13T18:45:31.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.141+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc003a10 con 0x7f71e00cd0e0 2024-09-13T18:45:31.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b54051b80 con 0x7f4b68157fb0 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.141+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c780075a0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c1ef070 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f1c82a00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1c6c0667b0 0x7f1c6c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c780544c0 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f1c8aa00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1c6c0667b0 0x7f1c6c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f1c8aa00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1c6c0667b0 0x7f1c6c068c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c84001fa0 tx=0x7f1c84009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.145+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71cc003b70 con 0x7f71e00cd0e0 2024-09-13T18:45:31.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.149+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5fc051de0 con 0x7fb6041556a0 2024-09-13T18:45:31.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.149+0000 7f71dd600700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f71c0066760 0x7f71c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.149+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71cc083dc0 con 0x7f71e00cd0e0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.149+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c78050f90 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.149+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71cc0841a0 con 0x7f71e00cd0e0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.157+0000 7f71e5a00700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f71c0066760 0x7f71c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.157+0000 7f71e5a00700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f71c0066760 0x7f71c0068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097d0 tx=0x7f71d4010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.449+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8a4005890 con 0x7fa8c80d4950 2024-09-13T18:45:31.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.449+0000 7fa8ccc00700 1 -- 172.21.15.32:0/1755487506 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8bc05a650 con 0x7fa8c80d4950 2024-09-13T18:45:31.456 INFO:teuthology.orchestra.run.smithi032.stdout:64424509449 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa8b0066730 msgr2=0x7fa8b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa8b0066730 0x7fa8b0068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4006b40 tx=0x7fa8c4006ad0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 msgr2=0x7fa8c8170f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8170f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc017000 tx=0x7fa8bc004770 comp rx=0 tx=0).stop 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 shutdown_connections 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa8b0066730 0x7fa8b0068bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c80db120 0x7fa8c80d2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa8c80d4950 0x7fa8c8170f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 --2- 172.21.15.32:0/1755487506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8c8045120 0x7fa8c80dd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.453+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 >> 172.21.15.32:0/1755487506 conn(0x7fa8c804fd00 msgr2=0x7fa8c80500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.457+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 shutdown_connections 2024-09-13T18:45:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.457+0000 7fa8c2000700 1 -- 172.21.15.32:0/1755487506 wait complete. 2024-09-13T18:45:31.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-13T18:45:31.487 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.485+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe080033430 con 0x7fe0800d6630 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.485+0000 7fe085600700 1 -- 172.21.15.32:0/3676785480 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe080033430 con 0x7fe0800d6630 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.485+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f823c1f5220 con 0x7f823c1509a0 2024-09-13T18:45:31.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.485+0000 7f8232000700 1 -- 172.21.15.32:0/3569989521 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f823c1f5220 con 0x7f823c1509a0 2024-09-13T18:45:31.492 INFO:teuthology.orchestra.run.smithi032.stdout:64424509451 2024-09-13T18:45:31.494 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2024-09-13T18:45:31.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f821c0667c0 msgr2=0x7f821c068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f821c0667c0 0x7f821c068c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f822c0011e0 tx=0x7f822c001110 comp rx=0 tx=0).stop 2024-09-13T18:45:31.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 msgr2=0x7f823c0c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 0x7f823c0c0f80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f823400cca0 tx=0x7f823400a340 comp rx=0 tx=0).stop 2024-09-13T18:45:31.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6d780c73d0 con 0x7f6d7806f530 2024-09-13T18:45:31.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 shutdown_connections 2024-09-13T18:45:31.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f821c0667c0 0x7f821c068c80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f823c1509a0 0x7f823c0c0f80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f823c0c6b90 0x7f823c0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 --2- 172.21.15.32:0/3569989521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f823c06ecd0 0x7f823c0c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 >> 172.21.15.32:0/3569989521 conn(0x7f823c0c8bd0 msgr2=0x7f823c06adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 shutdown_connections 2024-09-13T18:45:31.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f8241200700 1 -- 172.21.15.32:0/3569989521 wait complete. 2024-09-13T18:45:31.498 INFO:teuthology.orchestra.run.smithi032.stdout:60129542155 2024-09-13T18:45:31.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.489+0000 7f6d74c00700 1 -- 172.21.15.32:0/2646338879 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d60017090 con 0x7f6d7806f530 2024-09-13T18:45:31.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe068066800 msgr2=0x7fe068068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe068066800 0x7fe068068cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009810 tx=0x7fe07c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:31.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 msgr2=0x7fe080033710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 0x7fe080033710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe08000d440 tx=0x7fe074004770 comp rx=0 tx=0).stop 2024-09-13T18:45:31.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1c8c1ef070 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d54066730 msgr2=0x7f6d54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d54066730 0x7f6d54068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d78165100 tx=0x7f6d68011000 comp rx=0 tx=0).stop 2024-09-13T18:45:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 msgr2=0x7f6d781fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d781fbd30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c480 tx=0x7f6d6000c790 comp rx=0 tx=0).stop 2024-09-13T18:45:31.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f1c82a00700 1 -- 172.21.15.32:0/2554709308 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c78017030 con 0x7f1c8c0c4bd0 2024-09-13T18:45:31.501 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2024-09-13T18:45:31.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 shutdown_connections 2024-09-13T18:45:31.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe068066800 0x7fe068068cc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0800dc4c0 0x7fe0800db5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0800d6630 0x7fe080033710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 --2- 172.21.15.32:0/3676785480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe080044be0 0x7fe0800c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 >> 172.21.15.32:0/3676785480 conn(0x7fe08004fd00 msgr2=0x7fe0800d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb6040a9490 con 0x7fb6041556a0 2024-09-13T18:45:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 shutdown_connections 2024-09-13T18:45:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d54066730 0x7f6d54068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d78159c90 0x7f6d78153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d780c6860 0x7f6d780bef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 --2- 172.21.15.32:0/2646338879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7806f530 0x7f6d781fbd30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.493+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 >> 172.21.15.32:0/2646338879 conn(0x7f6d780c8a60 msgr2=0x7f6d7815a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4b680c64a0 con 0x7f4b68157fb0 2024-09-13T18:45:31.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 shutdown_connections 2024-09-13T18:45:31.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fe08ec00700 1 -- 172.21.15.32:0/3676785480 wait complete. 2024-09-13T18:45:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 shutdown_connections 2024-09-13T18:45:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fb601600700 1 -- 172.21.15.32:0/2675383859 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5fc051de0 con 0x7fb6041556a0 2024-09-13T18:45:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f6d7ec00700 1 -- 172.21.15.32:0/2646338879 wait complete. 2024-09-13T18:45:31.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f4b5ea00700 1 -- 172.21.15.32:0/464254545 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b680c64a0 con 0x7f4b68157fb0 2024-09-13T18:45:31.505 INFO:teuthology.orchestra.run.smithi032.stdout:64424509452 2024-09-13T18:45:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1c6c0667b0 msgr2=0x7f1c6c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1c6c0667b0 0x7f1c6c068c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c84001fa0 tx=0x7f1c84009040 comp rx=0 tx=0).stop 2024-09-13T18:45:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 msgr2=0x7f1c8c14e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 0x7f1c8c14e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c500 tx=0x7f1c7800c810 comp rx=0 tx=0).stop 2024-09-13T18:45:31.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 shutdown_connections 2024-09-13T18:45:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1c6c0667b0 0x7f1c6c068c70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1c8c1534a0 0x7f1c8c14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c8c0c4bd0 0x7f1c8c14e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 --2- 172.21.15.32:0/2554709308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c8c072740 0x7f1c8c0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 >> 172.21.15.32:0/2554709308 conn(0x7f1c8c073d50 msgr2=0x7f1c8c070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.506 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2024-09-13T18:45:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 shutdown_connections 2024-09-13T18:45:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7f1c8be00700 1 -- 172.21.15.32:0/2554709308 wait complete. 2024-09-13T18:45:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5e4066730 msgr2=0x7fb5e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fb60c600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5e4066730 0x7fb5e4068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8001760 tx=0x7fb5f8007a50 comp rx=0 tx=0).stop 2024-09-13T18:45:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 msgr2=0x7fb6040c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.497+0000 7fb60c600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 0x7fb6040c3150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009d30 tx=0x7fb5fc00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71e0067a00 con 0x7f71e00cd0e0 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 shutdown_connections 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5e4066730 0x7fb5e4068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6041556a0 0x7fb6040c3150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6040cb860 0x7fb604151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 --2- 172.21.15.32:0/2675383859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6040c83f0 0x7fb60414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 >> 172.21.15.32:0/2675383859 conn(0x7fb6040cad40 msgr2=0x7fb604153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 shutdown_connections 2024-09-13T18:45:31.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7fb60c600700 1 -- 172.21.15.32:0/2675383859 wait complete. 2024-09-13T18:45:31.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f71dd600700 1 -- 172.21.15.32:0/3196779606 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71cc017020 con 0x7f71e00cd0e0 2024-09-13T18:45:31.509 INFO:teuthology.orchestra.run.smithi032.stdout:64424509450 2024-09-13T18:45:31.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b48066830 msgr2=0x7f4b48068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f4b67e00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b48066830 0x7f4b48068cf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009c60 tx=0x7f4b58008030 comp rx=0 tx=0).stop 2024-09-13T18:45:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 msgr2=0x7f4b680c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f4b67e00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 0x7f4b680c8aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ea00 tx=0x7f4b5400ed10 comp rx=0 tx=0).stop 2024-09-13T18:45:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f71c0066760 msgr2=0x7f71c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f71e8400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f71c0066760 0x7f71c0068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097d0 tx=0x7f71d4010000 comp rx=0 tx=0).stop 2024-09-13T18:45:31.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 msgr2=0x7f71e0149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.501+0000 7f71e8400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 0x7f71e0149630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c750 tx=0x7f71cc00ca60 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 shutdown_connections 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f71c0066760 0x7f71c0068c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71e0151ab0 0x7f71e0149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f71e00cd0e0 0x7f71e0149630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 --2- 172.21.15.32:0/3196779606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71e006ae20 0x7f71e01f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 >> 172.21.15.32:0/3196779606 conn(0x7f71e006eae0 msgr2=0x7f71e00c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 shutdown_connections 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b48066830 0x7f4b48068cf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b6815e140 0x7f4b681fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b68157fb0 0x7f4b680c8aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 --2- 172.21.15.32:0/464254545 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b68071360 0x7f4b680c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 >> 172.21.15.32:0/464254545 conn(0x7f4b680cbfe0 msgr2=0x7f4b6815d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 shutdown_connections 2024-09-13T18:45:31.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f71e8400700 1 -- 172.21.15.32:0/3196779606 wait complete. 2024-09-13T18:45:31.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 shutdown_connections 2024-09-13T18:45:31.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.505+0000 7f4b67e00700 1 -- 172.21.15.32:0/464254545 wait complete. 2024-09-13T18:45:31.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2024-09-13T18:45:31.525 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.6 2024-09-13T18:45:31.527 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542156 for osd.4 2024-09-13T18:45:31.530 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.7 2024-09-13T18:45:31.532 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.5 2024-09-13T18:45:31.535 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.2 2024-09-13T18:45:31.538 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-09-13T18:45:31.539 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:31.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:45:31.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:31.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.741+0000 7f6415c00700 1 Processor -- start 2024-09-13T18:45:31.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.741+0000 7f6415c00700 1 -- start start 2024-09-13T18:45:31.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f64101539b0 0x7f64100c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64100c9c80 con 0x7f64100c9220 2024-09-13T18:45:31.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64101596e0 con 0x7f64101539b0 2024-09-13T18:45:31.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64100caae0 con 0x7f64100cd7f0 2024-09-13T18:45:31.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640ea00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f64101539b0 0x7f64100c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640e000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f64100c9220 0x7f64100cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51360/0 (socket says 172.21.15.32:51360) 2024-09-13T18:45:31.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640e000700 1 -- 172.21.15.32:0/1937152238 learned_addr learned my addr 172.21.15.32:0/1937152238 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:31.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640f400700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640d600700 1 -- 172.21.15.32:0/1937152238 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527680230 0 0) 0x7f64100c9c80 con 0x7f64100c9220 2024-09-13T18:45:31.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640d600700 1 -- 172.21.15.32:0/1937152238 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f40035d0 con 0x7f64100c9220 2024-09-13T18:45:31.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640ea00700 1 -- 172.21.15.32:0/1937152238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 msgr2=0x7f64100c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:31.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640ea00700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640ea00700 1 -- 172.21.15.32:0/1937152238 >> v1:172.21.15.86:6789/0 conn(0x7f64100c9220 legacy=0x7f64100cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640ea00700 1 -- 172.21.15.32:0/1937152238 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100c9f60 con 0x7f64101539b0 2024-09-13T18:45:31.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640f400700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:31.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640ea00700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64101539b0 0x7f64100c84a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6400009850 tx=0x7f6400009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8386531c415dac8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640d600700 1 -- 172.21.15.32:0/1937152238 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400011830 con 0x7f64101539b0 2024-09-13T18:45:31.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640d600700 1 -- 172.21.15.32:0/1937152238 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400011990 con 0x7f64101539b0 2024-09-13T18:45:31.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f640d600700 1 -- 172.21.15.32:0/1937152238 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400011d40 con 0x7f64101539b0 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- 172.21.15.32:0/1937152238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64101539b0 msgr2=0x7f64100c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64101539b0 0x7f64100c84a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6400009850 tx=0x7f6400009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- 172.21.15.32:0/1937152238 shutdown_connections 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 --2- 172.21.15.32:0/1937152238 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64101539b0 0x7f64100c84a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- 172.21.15.32:0/1937152238 >> 172.21.15.32:0/1937152238 conn(0x7f641006a740 msgr2=0x7f641006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- 172.21.15.32:0/1937152238 shutdown_connections 2024-09-13T18:45:31.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.749+0000 7f6415c00700 1 -- 172.21.15.32:0/1937152238 wait complete. 2024-09-13T18:45:31.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 Processor -- start 2024-09-13T18:45:31.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 -- start start 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 0x7f6410152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64101539b0 0x7f64100c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64100c5830 con 0x7f64100c9220 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64101e14c0 con 0x7f64101539b0 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f6415c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64101e16b0 con 0x7f64100cd7f0 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 0x7f6410152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 0x7f6410152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48908/0 (socket says 172.21.15.32:48908) 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 -- 172.21.15.32:0/2960878443 learned_addr learned my addr 172.21.15.32:0/2960878443 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640f400700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64101539b0 0x7f64100c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640e000700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 -- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 msgr2=0x7f64100c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 -- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64101539b0 msgr2=0x7f64100c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64101539b0 0x7f64100c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640ea00700 1 -- 172.21.15.32:0/2960878443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009a70 con 0x7f64100c9220 2024-09-13T18:45:31.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.753+0000 7f640e000700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f640ea00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 0x7f6410152710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f641006e360 tx=0x7f6400004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000045d0 con 0x7f64100c9220 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640001f070 con 0x7f64100c9220 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400003900 con 0x7f64100c9220 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000094b0 con 0x7f64100c9220 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64101e1c70 con 0x7f64100c9220 2024-09-13T18:45:31.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.757+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64100cd0e0 con 0x7f64100c9220 2024-09-13T18:45:31.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.761+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6400003a60 con 0x7f64100c9220 2024-09-13T18:45:31.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.761+0000 7f6406a00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f63f0066760 0x7f63f0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:31.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.761+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6400021070 con 0x7f64100c9220 2024-09-13T18:45:31.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.761+0000 7f640e000700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f63f0066760 0x7f63f0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:31.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.761+0000 7f640e000700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f63f0066760 0x7f63f0068c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f641004e9a0 tx=0x7f63fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:31.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.769+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64000525f0 con 0x7f64100c9220 2024-09-13T18:45:31.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.961+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64100ca800 con 0x7f63f0066760 2024-09-13T18:45:31.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.985+0000 7f6406a00700 1 -- 172.21.15.32:0/2960878443 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345033 (secure 0 0 0) 0x7f63fc001c30 con 0x7f63f0066760 2024-09-13T18:45:31.991 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:31.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f63f0066760 msgr2=0x7f63f0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f63f0066760 0x7f63f0068c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f641004e9a0 tx=0x7f63fc009040 comp rx=0 tx=0).stop 2024-09-13T18:45:31.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 msgr2=0x7f6410152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 0x7f6410152710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f641006e360 tx=0x7f6400004770 comp rx=0 tx=0).stop 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 shutdown_connections 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f63f0066760 0x7f63f0068c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64101539b0 0x7f64100c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f64100cd7f0 0x7f64100c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 --2- 172.21.15.32:0/2960878443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64100c9220 0x7f6410152710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 >> 172.21.15.32:0/2960878443 conn(0x7f641006a740 msgr2=0x7f6410158940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 shutdown_connections 2024-09-13T18:45:31.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:31.989+0000 7f6415c00700 1 -- 172.21.15.32:0/2960878443 wait complete. 2024-09-13T18:45:31.999 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:45:32.021 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-13T18:45:30.072279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3416064,"data_stored":2038274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004827"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.332147+0000","last_change":"2024-09-13T18:45:00.864148+0000","last_active":"2024-09-13T18:45:06.332147+0000","last_peered":"2024-09-13T18:45:06.332147+0000","last_clean":"2024-09-13T18:45:06.332147+0000","last_became_active":"2024-09-13T18:45:00.863883+0000","last_became_peered":"2024-09-13T18:45:00.863883+0000","last_unstale":"2024-09-13T18:45:06.332147+0000","last_undegraded":"2024-09-13T18:45:06.332147+0000","last_fullsized":"2024-09-13T18:45:06.332147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:45:05.341525+0000","last_peered":"2024-09-13T18:45:05.341525+0000","last_clean":"2024-09-13T18:45:05.341525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:45:05.341525+0000","last_undegraded":"2024-09-13T18:45:05.341525+0000","last_fullsized":"2024-09-13T18:45:05.341525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824414+0000","last_change":"2024-09-13T18:45:05.359268+0000","last_active":"2024-09-13T18:45:05.824414+0000","last_peered":"2024-09-13T18:45:05.824414+0000","last_clean":"2024-09-13T18:45:05.824414+0000","last_became_active":"2024-09-13T18:45:05.358933+0000","last_became_peered":"2024-09-13T18:45:05.358933+0000","last_unstale":"2024-09-13T18:45:05.824414+0000","last_undegraded":"2024-09-13T18:45:05.824414+0000","last_fullsized":"2024-09-13T18:45:05.824414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:00.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330857+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:45:06.330857+0000","last_peered":"2024-09-13T18:45:06.330857+0000","last_clean":"2024-09-13T18:45:06.330857+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:45:06.330857+0000","last_undegraded":"2024-09-13T18:45:06.330857+0000","last_fullsized":"2024-09-13T18:45:06.330857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341543+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:45:05.341543+0000","last_peered":"2024-09-13T18:45:05.341543+0000","last_clean":"2024-09-13T18:45:05.341543+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:45:05.341543+0000","last_undegraded":"2024-09-13T18:45:05.341543+0000","last_fullsized":"2024-09-13T18:45:05.341543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.357301+0000","last_change":"2024-09-13T18:45:05.351838+0000","last_active":"2024-09-13T18:45:05.357301+0000","last_peered":"2024-09-13T18:45:05.357301+0000","last_clean":"2024-09-13T18:45:05.357301+0000","last_became_active":"2024-09-13T18:45:05.351437+0000","last_became_peered":"2024-09-13T18:45:05.351437+0000","last_unstale":"2024-09-13T18:45:05.357301+0000","last_undegraded":"2024-09-13T18:45:05.357301+0000","last_fullsized":"2024-09-13T18:45:05.357301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:46.755054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328767+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:45:06.328767+0000","last_peered":"2024-09-13T18:45:06.328767+0000","last_clean":"2024-09-13T18:45:06.328767+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:45:06.328767+0000","last_undegraded":"2024-09-13T18:45:06.328767+0000","last_fullsized":"2024-09-13T18:45:06.328767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341864+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:45:05.341864+0000","last_peered":"2024-09-13T18:45:05.341864+0000","last_clean":"2024-09-13T18:45:05.341864+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:45:05.341864+0000","last_undegraded":"2024-09-13T18:45:05.341864+0000","last_fullsized":"2024-09-13T18:45:05.341864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366911+0000","last_change":"2024-09-13T18:45:05.363274+0000","last_active":"2024-09-13T18:45:05.366911+0000","last_peered":"2024-09-13T18:45:05.366911+0000","last_clean":"2024-09-13T18:45:05.366911+0000","last_became_active":"2024-09-13T18:45:05.362870+0000","last_became_peered":"2024-09-13T18:45:05.362870+0000","last_unstale":"2024-09-13T18:45:05.366911+0000","last_undegraded":"2024-09-13T18:45:05.366911+0000","last_fullsized":"2024-09-13T18:45:05.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:54.494396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327442+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:45:06.327442+0000","last_peered":"2024-09-13T18:45:06.327442+0000","last_clean":"2024-09-13T18:45:06.327442+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:45:06.327442+0000","last_undegraded":"2024-09-13T18:45:06.327442+0000","last_fullsized":"2024-09-13T18:45:06.327442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330635+0000","last_change":"2024-09-13T18:45:01.355711+0000","last_active":"2024-09-13T18:45:05.330635+0000","last_peered":"2024-09-13T18:45:05.330635+0000","last_clean":"2024-09-13T18:45:05.330635+0000","last_became_active":"2024-09-13T18:45:01.355463+0000","last_became_peered":"2024-09-13T18:45:01.355463+0000","last_unstale":"2024-09-13T18:45:05.330635+0000","last_undegraded":"2024-09-13T18:45:05.330635+0000","last_fullsized":"2024-09-13T18:45:05.330635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365664+0000","last_change":"2024-09-13T18:45:05.360940+0000","last_active":"2024-09-13T18:45:05.365664+0000","last_peered":"2024-09-13T18:45:05.365664+0000","last_clean":"2024-09-13T18:45:05.365664+0000","last_became_active":"2024-09-13T18:45:05.360491+0000","last_became_peered":"2024-09-13T18:45:05.360491+0000","last_unstale":"2024-09-13T18:45:05.365664+0000","last_undegraded":"2024-09-13T18:45:05.365664+0000","last_fullsized":"2024-09-13T18:45:05.365664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:26.565354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328208+0000","last_change":"2024-09-13T18:45:01.345265+0000","last_active":"2024-09-13T18:45:05.328208+0000","last_peered":"2024-09-13T18:45:05.328208+0000","last_clean":"2024-09-13T18:45:05.328208+0000","last_became_active":"2024-09-13T18:45:01.344996+0000","last_became_peered":"2024-09-13T18:45:01.344996+0000","last_unstale":"2024-09-13T18:45:05.328208+0000","last_undegraded":"2024-09-13T18:45:05.328208+0000","last_fullsized":"2024-09-13T18:45:05.328208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:11.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327878+0000","last_change":"2024-09-13T18:45:00.867459+0000","last_active":"2024-09-13T18:45:06.327878+0000","last_peered":"2024-09-13T18:45:06.327878+0000","last_clean":"2024-09-13T18:45:06.327878+0000","last_became_active":"2024-09-13T18:45:00.867028+0000","last_became_peered":"2024-09-13T18:45:00.867028+0000","last_unstale":"2024-09-13T18:45:06.327878+0000","last_undegraded":"2024-09-13T18:45:06.327878+0000","last_fullsized":"2024-09-13T18:45:06.327878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.262031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370686+0000","last_change":"2024-09-13T18:45:05.368886+0000","last_active":"2024-09-13T18:45:05.370686+0000","last_peered":"2024-09-13T18:45:05.370686+0000","last_clean":"2024-09-13T18:45:05.370686+0000","last_became_active":"2024-09-13T18:45:05.368510+0000","last_became_peered":"2024-09-13T18:45:05.368510+0000","last_unstale":"2024-09-13T18:45:05.370686+0000","last_undegraded":"2024-09-13T18:45:05.370686+0000","last_fullsized":"2024-09-13T18:45:05.370686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:26.194694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341816+0000","last_change":"2024-09-13T18:45:01.332274+0000","last_active":"2024-09-13T18:45:05.341816+0000","last_peered":"2024-09-13T18:45:05.341816+0000","last_clean":"2024-09-13T18:45:05.341816+0000","last_became_active":"2024-09-13T18:45:01.331671+0000","last_became_peered":"2024-09-13T18:45:01.331671+0000","last_unstale":"2024-09-13T18:45:05.341816+0000","last_undegraded":"2024-09-13T18:45:05.341816+0000","last_fullsized":"2024-09-13T18:45:05.341816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:38.214360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332230+0000","last_change":"2024-09-13T18:45:00.843856+0000","last_active":"2024-09-13T18:45:05.332230+0000","last_peered":"2024-09-13T18:45:05.332230+0000","last_clean":"2024-09-13T18:45:05.332230+0000","last_became_active":"2024-09-13T18:45:00.843456+0000","last_became_peered":"2024-09-13T18:45:00.843456+0000","last_unstale":"2024-09-13T18:45:05.332230+0000","last_undegraded":"2024-09-13T18:45:05.332230+0000","last_fullsized":"2024-09-13T18:45:05.332230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:52.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.353284+0000","last_change":"2024-09-13T18:45:05.349810+0000","last_active":"2024-09-13T18:45:05.353284+0000","last_peered":"2024-09-13T18:45:05.353284+0000","last_clean":"2024-09-13T18:45:05.353284+0000","last_became_active":"2024-09-13T18:45:05.348815+0000","last_became_peered":"2024-09-13T18:45:05.348815+0000","last_unstale":"2024-09-13T18:45:05.353284+0000","last_undegraded":"2024-09-13T18:45:05.353284+0000","last_fullsized":"2024-09-13T18:45:05.353284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:20.676172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336422+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:45:05.336422+0000","last_peered":"2024-09-13T18:45:05.336422+0000","last_clean":"2024-09-13T18:45:05.336422+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:45:05.336422+0000","last_undegraded":"2024-09-13T18:45:05.336422+0000","last_fullsized":"2024-09-13T18:45:05.336422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336648+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:45:05.336648+0000","last_peered":"2024-09-13T18:45:05.336648+0000","last_clean":"2024-09-13T18:45:05.336648+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:45:05.336648+0000","last_undegraded":"2024-09-13T18:45:05.336648+0000","last_fullsized":"2024-09-13T18:45:05.336648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.827311+0000","last_change":"2024-09-13T18:45:05.357361+0000","last_active":"2024-09-13T18:45:05.827311+0000","last_peered":"2024-09-13T18:45:05.827311+0000","last_clean":"2024-09-13T18:45:05.827311+0000","last_became_active":"2024-09-13T18:45:05.357036+0000","last_became_peered":"2024-09-13T18:45:05.357036+0000","last_unstale":"2024-09-13T18:45:05.827311+0000","last_undegraded":"2024-09-13T18:45:05.827311+0000","last_fullsized":"2024-09-13T18:45:05.827311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:00.105880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327853+0000","last_change":"2024-09-13T18:45:01.329048+0000","last_active":"2024-09-13T18:45:05.327853+0000","last_peered":"2024-09-13T18:45:05.327853+0000","last_clean":"2024-09-13T18:45:05.327853+0000","last_became_active":"2024-09-13T18:45:01.328762+0000","last_became_peered":"2024-09-13T18:45:01.328762+0000","last_unstale":"2024-09-13T18:45:05.327853+0000","last_undegraded":"2024-09-13T18:45:05.327853+0000","last_fullsized":"2024-09-13T18:45:05.327853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:21.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336115+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:45:05.336115+0000","last_peered":"2024-09-13T18:45:05.336115+0000","last_clean":"2024-09-13T18:45:05.336115+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:45:05.336115+0000","last_undegraded":"2024-09-13T18:45:05.336115+0000","last_fullsized":"2024-09-13T18:45:05.336115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366976+0000","last_change":"2024-09-13T18:45:05.364829+0000","last_active":"2024-09-13T18:45:05.366976+0000","last_peered":"2024-09-13T18:45:05.366976+0000","last_clean":"2024-09-13T18:45:05.366976+0000","last_became_active":"2024-09-13T18:45:05.364538+0000","last_became_peered":"2024-09-13T18:45:05.364538+0000","last_unstale":"2024-09-13T18:45:05.366976+0000","last_undegraded":"2024-09-13T18:45:05.366976+0000","last_fullsized":"2024-09-13T18:45:05.366976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.945041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336737+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:45:05.336737+0000","last_peered":"2024-09-13T18:45:05.336737+0000","last_clean":"2024-09-13T18:45:05.336737+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:45:05.336737+0000","last_undegraded":"2024-09-13T18:45:05.336737+0000","last_fullsized":"2024-09-13T18:45:05.336737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327578+0000","last_change":"2024-09-13T18:45:00.863206+0000","last_active":"2024-09-13T18:45:06.327578+0000","last_peered":"2024-09-13T18:45:06.327578+0000","last_clean":"2024-09-13T18:45:06.327578+0000","last_became_active":"2024-09-13T18:45:00.862917+0000","last_became_peered":"2024-09-13T18:45:00.862917+0000","last_unstale":"2024-09-13T18:45:06.327578+0000","last_undegraded":"2024-09-13T18:45:06.327578+0000","last_fullsized":"2024-09-13T18:45:06.327578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.289662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.367010+0000","last_change":"2024-09-13T18:45:05.364598+0000","last_active":"2024-09-13T18:45:05.367010+0000","last_peered":"2024-09-13T18:45:05.367010+0000","last_clean":"2024-09-13T18:45:05.367010+0000","last_became_active":"2024-09-13T18:45:05.364194+0000","last_became_peered":"2024-09-13T18:45:05.364194+0000","last_unstale":"2024-09-13T18:45:05.367010+0000","last_undegraded":"2024-09-13T18:45:05.367010+0000","last_fullsized":"2024-09-13T18:45:05.367010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.594403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336439+0000","last_change":"2024-09-13T18:45:01.333827+0000","last_active":"2024-09-13T18:45:05.336439+0000","last_peered":"2024-09-13T18:45:05.336439+0000","last_clean":"2024-09-13T18:45:05.336439+0000","last_became_active":"2024-09-13T18:45:01.333500+0000","last_became_peered":"2024-09-13T18:45:01.333500+0000","last_unstale":"2024-09-13T18:45:05.336439+0000","last_undegraded":"2024-09-13T18:45:05.336439+0000","last_fullsized":"2024-09-13T18:45:05.336439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:37.963424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826853+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:45:05.826853+0000","last_peered":"2024-09-13T18:45:05.826853+0000","last_clean":"2024-09-13T18:45:05.826853+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:45:05.826853+0000","last_undegraded":"2024-09-13T18:45:05.826853+0000","last_fullsized":"2024-09-13T18:45:05.826853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824166+0000","last_change":"2024-09-13T18:45:05.349605+0000","last_active":"2024-09-13T18:45:05.824166+0000","last_peered":"2024-09-13T18:45:05.824166+0000","last_clean":"2024-09-13T18:45:05.824166+0000","last_became_active":"2024-09-13T18:45:05.349213+0000","last_became_peered":"2024-09-13T18:45:05.349213+0000","last_unstale":"2024-09-13T18:45:05.824166+0000","last_undegraded":"2024-09-13T18:45:05.824166+0000","last_fullsized":"2024-09-13T18:45:05.824166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:17.638750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333067+0000","last_change":"2024-09-13T18:45:01.331576+0000","last_active":"2024-09-13T18:45:05.333067+0000","last_peered":"2024-09-13T18:45:05.333067+0000","last_clean":"2024-09-13T18:45:05.333067+0000","last_became_active":"2024-09-13T18:45:01.331313+0000","last_became_peered":"2024-09-13T18:45:01.331313+0000","last_unstale":"2024-09-13T18:45:05.333067+0000","last_undegraded":"2024-09-13T18:45:05.333067+0000","last_fullsized":"2024-09-13T18:45:05.333067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:15.549020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330831+0000","last_change":"2024-09-13T18:45:00.856368+0000","last_active":"2024-09-13T18:45:05.330831+0000","last_peered":"2024-09-13T18:45:05.330831+0000","last_clean":"2024-09-13T18:45:05.330831+0000","last_became_active":"2024-09-13T18:45:00.856067+0000","last_became_peered":"2024-09-13T18:45:00.856067+0000","last_unstale":"2024-09-13T18:45:05.330831+0000","last_undegraded":"2024-09-13T18:45:05.330831+0000","last_fullsized":"2024-09-13T18:45:05.330831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:29.141185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602069+0000","last_change":"2024-09-13T18:45:05.358233+0000","last_active":"2024-09-13T18:45:06.602069+0000","last_peered":"2024-09-13T18:45:06.602069+0000","last_clean":"2024-09-13T18:45:06.602069+0000","last_became_active":"2024-09-13T18:45:05.357819+0000","last_became_peered":"2024-09-13T18:45:05.357819+0000","last_unstale":"2024-09-13T18:45:06.602069+0000","last_undegraded":"2024-09-13T18:45:06.602069+0000","last_fullsized":"2024-09-13T18:45:06.602069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:06.840619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.349889+0000","last_change":"2024-09-13T18:45:01.323768+0000","last_active":"2024-09-13T18:45:05.349889+0000","last_peered":"2024-09-13T18:45:05.349889+0000","last_clean":"2024-09-13T18:45:05.349889+0000","last_became_active":"2024-09-13T18:45:01.323449+0000","last_became_peered":"2024-09-13T18:45:01.323449+0000","last_unstale":"2024-09-13T18:45:05.349889+0000","last_undegraded":"2024-09-13T18:45:05.349889+0000","last_fullsized":"2024-09-13T18:45:05.349889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:32.782226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340579+0000","last_change":"2024-09-13T18:45:00.848001+0000","last_active":"2024-09-13T18:45:05.340579+0000","last_peered":"2024-09-13T18:45:05.340579+0000","last_clean":"2024-09-13T18:45:05.340579+0000","last_became_active":"2024-09-13T18:45:00.847720+0000","last_became_peered":"2024-09-13T18:45:00.847720+0000","last_unstale":"2024-09-13T18:45:05.340579+0000","last_undegraded":"2024-09-13T18:45:05.340579+0000","last_fullsized":"2024-09-13T18:45:05.340579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.566248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.601658+0000","last_change":"2024-09-13T18:45:05.344571+0000","last_active":"2024-09-13T18:45:06.601658+0000","last_peered":"2024-09-13T18:45:06.601658+0000","last_clean":"2024-09-13T18:45:06.601658+0000","last_became_active":"2024-09-13T18:45:05.344171+0000","last_became_peered":"2024-09-13T18:45:05.344171+0000","last_unstale":"2024-09-13T18:45:06.601658+0000","last_undegraded":"2024-09-13T18:45:06.601658+0000","last_fullsized":"2024-09-13T18:45:06.601658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:15.473898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338368+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:45:05.338368+0000","last_peered":"2024-09-13T18:45:05.338368+0000","last_clean":"2024-09-13T18:45:05.338368+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:45:05.338368+0000","last_undegraded":"2024-09-13T18:45:05.338368+0000","last_fullsized":"2024-09-13T18:45:05.338368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329231+0000","last_change":"2024-09-13T18:45:00.861944+0000","last_active":"2024-09-13T18:45:05.329231+0000","last_peered":"2024-09-13T18:45:05.329231+0000","last_clean":"2024-09-13T18:45:05.329231+0000","last_became_active":"2024-09-13T18:45:00.861249+0000","last_became_peered":"2024-09-13T18:45:00.861249+0000","last_unstale":"2024-09-13T18:45:05.329231+0000","last_undegraded":"2024-09-13T18:45:05.329231+0000","last_fullsized":"2024-09-13T18:45:05.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:09.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602419+0000","last_change":"2024-09-13T18:45:05.351737+0000","last_active":"2024-09-13T18:45:06.602419+0000","last_peered":"2024-09-13T18:45:06.602419+0000","last_clean":"2024-09-13T18:45:06.602419+0000","last_became_active":"2024-09-13T18:45:05.351311+0000","last_became_peered":"2024-09-13T18:45:05.351311+0000","last_unstale":"2024-09-13T18:45:06.602419+0000","last_undegraded":"2024-09-13T18:45:06.602419+0000","last_fullsized":"2024-09-13T18:45:06.602419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.229616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340831+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:45:05.340831+0000","last_peered":"2024-09-13T18:45:05.340831+0000","last_clean":"2024-09-13T18:45:05.340831+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:45:05.340831+0000","last_undegraded":"2024-09-13T18:45:05.340831+0000","last_fullsized":"2024-09-13T18:45:05.340831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341794+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:45:05.341794+0000","last_peered":"2024-09-13T18:45:05.341794+0000","last_clean":"2024-09-13T18:45:05.341794+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:45:05.341794+0000","last_undegraded":"2024-09-13T18:45:05.341794+0000","last_fullsized":"2024-09-13T18:45:05.341794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602617+0000","last_change":"2024-09-13T18:45:05.354392+0000","last_active":"2024-09-13T18:45:06.602617+0000","last_peered":"2024-09-13T18:45:06.602617+0000","last_clean":"2024-09-13T18:45:06.602617+0000","last_became_active":"2024-09-13T18:45:05.354022+0000","last_became_peered":"2024-09-13T18:45:05.354022+0000","last_unstale":"2024-09-13T18:45:06.602617+0000","last_undegraded":"2024-09-13T18:45:06.602617+0000","last_fullsized":"2024-09-13T18:45:06.602617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.160746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330365+0000","last_change":"2024-09-13T18:45:01.342993+0000","last_active":"2024-09-13T18:45:05.330365+0000","last_peered":"2024-09-13T18:45:05.330365+0000","last_clean":"2024-09-13T18:45:05.330365+0000","last_became_active":"2024-09-13T18:45:01.342730+0000","last_became_peered":"2024-09-13T18:45:01.342730+0000","last_unstale":"2024-09-13T18:45:05.330365+0000","last_undegraded":"2024-09-13T18:45:05.330365+0000","last_fullsized":"2024-09-13T18:45:05.330365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:53.451442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330417+0000","last_change":"2024-09-13T18:45:00.861710+0000","last_active":"2024-09-13T18:45:05.330417+0000","last_peered":"2024-09-13T18:45:05.330417+0000","last_clean":"2024-09-13T18:45:05.330417+0000","last_became_active":"2024-09-13T18:45:00.861091+0000","last_became_peered":"2024-09-13T18:45:00.861091+0000","last_unstale":"2024-09-13T18:45:05.330417+0000","last_undegraded":"2024-09-13T18:45:05.330417+0000","last_fullsized":"2024-09-13T18:45:05.330417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:30.431815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334987+0000","last_change":"2024-09-13T18:45:05.349312+0000","last_active":"2024-09-13T18:45:06.334987+0000","last_peered":"2024-09-13T18:45:06.334987+0000","last_clean":"2024-09-13T18:45:06.334987+0000","last_became_active":"2024-09-13T18:45:05.348858+0000","last_became_peered":"2024-09-13T18:45:05.348858+0000","last_unstale":"2024-09-13T18:45:06.334987+0000","last_undegraded":"2024-09-13T18:45:06.334987+0000","last_fullsized":"2024-09-13T18:45:06.334987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:09.955609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336475+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:45:05.336475+0000","last_peered":"2024-09-13T18:45:05.336475+0000","last_clean":"2024-09-13T18:45:05.336475+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:45:05.336475+0000","last_undegraded":"2024-09-13T18:45:05.336475+0000","last_fullsized":"2024-09-13T18:45:05.336475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328614+0000","last_change":"2024-09-13T18:45:00.870886+0000","last_active":"2024-09-13T18:45:05.328614+0000","last_peered":"2024-09-13T18:45:05.328614+0000","last_clean":"2024-09-13T18:45:05.328614+0000","last_became_active":"2024-09-13T18:45:00.870563+0000","last_became_peered":"2024-09-13T18:45:00.870563+0000","last_unstale":"2024-09-13T18:45:05.328614+0000","last_undegraded":"2024-09-13T18:45:05.328614+0000","last_fullsized":"2024-09-13T18:45:05.328614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341074+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:45:05.341074+0000","last_peered":"2024-09-13T18:45:05.341074+0000","last_clean":"2024-09-13T18:45:05.341074+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:45:05.341074+0000","last_undegraded":"2024-09-13T18:45:05.341074+0000","last_fullsized":"2024-09-13T18:45:05.341074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.371253+0000","last_change":"2024-09-13T18:45:05.369616+0000","last_active":"2024-09-13T18:45:05.371253+0000","last_peered":"2024-09-13T18:45:05.371253+0000","last_clean":"2024-09-13T18:45:05.371253+0000","last_became_active":"2024-09-13T18:45:05.368904+0000","last_became_peered":"2024-09-13T18:45:05.368904+0000","last_unstale":"2024-09-13T18:45:05.371253+0000","last_undegraded":"2024-09-13T18:45:05.371253+0000","last_fullsized":"2024-09-13T18:45:05.371253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:55.985326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330699+0000","last_change":"2024-09-13T18:45:01.342548+0000","last_active":"2024-09-13T18:45:05.330699+0000","last_peered":"2024-09-13T18:45:05.330699+0000","last_clean":"2024-09-13T18:45:05.330699+0000","last_became_active":"2024-09-13T18:45:01.342038+0000","last_became_peered":"2024-09-13T18:45:01.342038+0000","last_unstale":"2024-09-13T18:45:05.330699+0000","last_undegraded":"2024-09-13T18:45:05.330699+0000","last_fullsized":"2024-09-13T18:45:05.330699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.863893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333149+0000","last_change":"2024-09-13T18:45:00.859879+0000","last_active":"2024-09-13T18:45:05.333149+0000","last_peered":"2024-09-13T18:45:05.333149+0000","last_clean":"2024-09-13T18:45:05.333149+0000","last_became_active":"2024-09-13T18:45:00.859621+0000","last_became_peered":"2024-09-13T18:45:00.859621+0000","last_unstale":"2024-09-13T18:45:05.333149+0000","last_undegraded":"2024-09-13T18:45:05.333149+0000","last_fullsized":"2024-09-13T18:45:05.333149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:17.771135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366813+0000","last_change":"2024-09-13T18:45:05.362604+0000","last_active":"2024-09-13T18:45:05.366813+0000","last_peered":"2024-09-13T18:45:05.366813+0000","last_clean":"2024-09-13T18:45:05.366813+0000","last_became_active":"2024-09-13T18:45:05.362142+0000","last_became_peered":"2024-09-13T18:45:05.362142+0000","last_unstale":"2024-09-13T18:45:05.366813+0000","last_undegraded":"2024-09-13T18:45:05.366813+0000","last_fullsized":"2024-09-13T18:45:05.366813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342162+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:45:05.342162+0000","last_peered":"2024-09-13T18:45:05.342162+0000","last_clean":"2024-09-13T18:45:05.342162+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:45:05.342162+0000","last_undegraded":"2024-09-13T18:45:05.342162+0000","last_fullsized":"2024-09-13T18:45:05.342162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333613+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:45:06.333613+0000","last_peered":"2024-09-13T18:45:06.333613+0000","last_clean":"2024-09-13T18:45:06.333613+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:45:06.333613+0000","last_undegraded":"2024-09-13T18:45:06.333613+0000","last_fullsized":"2024-09-13T18:45:06.333613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334610+0000","last_change":"2024-09-13T18:45:05.359310+0000","last_active":"2024-09-13T18:45:06.334610+0000","last_peered":"2024-09-13T18:45:06.334610+0000","last_clean":"2024-09-13T18:45:06.334610+0000","last_became_active":"2024-09-13T18:45:05.358824+0000","last_became_peered":"2024-09-13T18:45:05.358824+0000","last_unstale":"2024-09-13T18:45:06.334610+0000","last_undegraded":"2024-09-13T18:45:06.334610+0000","last_fullsized":"2024-09-13T18:45:06.334610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:24.283145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338768+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:45:05.338768+0000","last_peered":"2024-09-13T18:45:05.338768+0000","last_clean":"2024-09-13T18:45:05.338768+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:45:05.338768+0000","last_undegraded":"2024-09-13T18:45:05.338768+0000","last_fullsized":"2024-09-13T18:45:05.338768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333901+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:45:06.333901+0000","last_peered":"2024-09-13T18:45:06.333901+0000","last_clean":"2024-09-13T18:45:06.333901+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:45:06.333901+0000","last_undegraded":"2024-09-13T18:45:06.333901+0000","last_fullsized":"2024-09-13T18:45:06.333901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365485+0000","last_change":"2024-09-13T18:45:05.362240+0000","last_active":"2024-09-13T18:45:05.365485+0000","last_peered":"2024-09-13T18:45:05.365485+0000","last_clean":"2024-09-13T18:45:05.365485+0000","last_became_active":"2024-09-13T18:45:05.361810+0000","last_became_peered":"2024-09-13T18:45:05.361810+0000","last_unstale":"2024-09-13T18:45:05.365485+0000","last_undegraded":"2024-09-13T18:45:05.365485+0000","last_fullsized":"2024-09-13T18:45:05.365485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:38.083269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350837+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:45:05.350837+0000","last_peered":"2024-09-13T18:45:05.350837+0000","last_clean":"2024-09-13T18:45:05.350837+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:45:05.350837+0000","last_undegraded":"2024-09-13T18:45:05.350837+0000","last_fullsized":"2024-09-13T18:45:05.350837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.326163+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:45:06.326163+0000","last_peered":"2024-09-13T18:45:06.326163+0000","last_clean":"2024-09-13T18:45:06.326163+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:45:06.326163+0000","last_undegraded":"2024-09-13T18:45:06.326163+0000","last_fullsized":"2024-09-13T18:45:06.326163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370349+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:45:05.370349+0000","last_peered":"2024-09-13T18:45:05.370349+0000","last_clean":"2024-09-13T18:45:05.370349+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:45:05.370349+0000","last_undegraded":"2024-09-13T18:45:05.370349+0000","last_fullsized":"2024-09-13T18:45:05.370349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327734+0000","last_change":"2024-09-13T18:45:01.346791+0000","last_active":"2024-09-13T18:45:05.327734+0000","last_peered":"2024-09-13T18:45:05.327734+0000","last_clean":"2024-09-13T18:45:05.327734+0000","last_became_active":"2024-09-13T18:45:01.346515+0000","last_became_peered":"2024-09-13T18:45:01.346515+0000","last_unstale":"2024-09-13T18:45:05.327734+0000","last_undegraded":"2024-09-13T18:45:05.327734+0000","last_fullsized":"2024-09-13T18:45:05.327734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.337346+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:45:06.337346+0000","last_peered":"2024-09-13T18:45:06.337346+0000","last_clean":"2024-09-13T18:45:06.337346+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:45:06.337346+0000","last_undegraded":"2024-09-13T18:45:06.337346+0000","last_fullsized":"2024-09-13T18:45:06.337346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335188+0000","last_change":"2024-09-13T18:45:05.348324+0000","last_active":"2024-09-13T18:45:06.335188+0000","last_peered":"2024-09-13T18:45:06.335188+0000","last_clean":"2024-09-13T18:45:06.335188+0000","last_became_active":"2024-09-13T18:45:05.347908+0000","last_became_peered":"2024-09-13T18:45:05.347908+0000","last_unstale":"2024-09-13T18:45:06.335188+0000","last_undegraded":"2024-09-13T18:45:06.335188+0000","last_fullsized":"2024-09-13T18:45:06.335188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:29.155413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340979+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:45:05.340979+0000","last_peered":"2024-09-13T18:45:05.340979+0000","last_clean":"2024-09-13T18:45:05.340979+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:45:05.340979+0000","last_undegraded":"2024-09-13T18:45:05.340979+0000","last_fullsized":"2024-09-13T18:45:05.340979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336406+0000","last_change":"2024-09-13T18:45:00.866140+0000","last_active":"2024-09-13T18:45:05.336406+0000","last_peered":"2024-09-13T18:45:05.336406+0000","last_clean":"2024-09-13T18:45:05.336406+0000","last_became_active":"2024-09-13T18:45:00.865898+0000","last_became_peered":"2024-09-13T18:45:00.865898+0000","last_unstale":"2024-09-13T18:45:05.336406+0000","last_undegraded":"2024-09-13T18:45:05.336406+0000","last_fullsized":"2024-09-13T18:45:05.336406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:16.378417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335021+0000","last_change":"2024-09-13T18:45:05.359539+0000","last_active":"2024-09-13T18:45:06.335021+0000","last_peered":"2024-09-13T18:45:06.335021+0000","last_clean":"2024-09-13T18:45:06.335021+0000","last_became_active":"2024-09-13T18:45:05.358801+0000","last_became_peered":"2024-09-13T18:45:05.358801+0000","last_unstale":"2024-09-13T18:45:06.335021+0000","last_undegraded":"2024-09-13T18:45:06.335021+0000","last_fullsized":"2024-09-13T18:45:06.335021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:04.787244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328147+0000","last_change":"2024-09-13T18:45:01.347194+0000","last_active":"2024-09-13T18:45:05.328147+0000","last_peered":"2024-09-13T18:45:05.328147+0000","last_clean":"2024-09-13T18:45:05.328147+0000","last_became_active":"2024-09-13T18:45:01.346941+0000","last_became_peered":"2024-09-13T18:45:01.346941+0000","last_unstale":"2024-09-13T18:45:05.328147+0000","last_undegraded":"2024-09-13T18:45:05.328147+0000","last_fullsized":"2024-09-13T18:45:05.328147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:05.677969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328824+0000","last_change":"2024-09-13T18:45:00.858781+0000","last_active":"2024-09-13T18:45:05.328824+0000","last_peered":"2024-09-13T18:45:05.328824+0000","last_clean":"2024-09-13T18:45:05.328824+0000","last_became_active":"2024-09-13T18:45:00.858418+0000","last_became_peered":"2024-09-13T18:45:00.858418+0000","last_unstale":"2024-09-13T18:45:05.328824+0000","last_undegraded":"2024-09-13T18:45:05.328824+0000","last_fullsized":"2024-09-13T18:45:05.328824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:23.372534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602425+0000","last_change":"2024-09-13T18:45:05.354664+0000","last_active":"2024-09-13T18:45:06.602425+0000","last_peered":"2024-09-13T18:45:06.602425+0000","last_clean":"2024-09-13T18:45:06.602425+0000","last_became_active":"2024-09-13T18:45:05.354148+0000","last_became_peered":"2024-09-13T18:45:05.354148+0000","last_unstale":"2024-09-13T18:45:06.602425+0000","last_undegraded":"2024-09-13T18:45:06.602425+0000","last_fullsized":"2024-09-13T18:45:06.602425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332095+0000","last_change":"2024-09-13T18:45:01.339092+0000","last_active":"2024-09-13T18:45:05.332095+0000","last_peered":"2024-09-13T18:45:05.332095+0000","last_clean":"2024-09-13T18:45:05.332095+0000","last_became_active":"2024-09-13T18:45:01.338762+0000","last_became_peered":"2024-09-13T18:45:01.338762+0000","last_unstale":"2024-09-13T18:45:05.332095+0000","last_undegraded":"2024-09-13T18:45:05.332095+0000","last_fullsized":"2024-09-13T18:45:05.332095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:01.205580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330228+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:45:06.330228+0000","last_peered":"2024-09-13T18:45:06.330228+0000","last_clean":"2024-09-13T18:45:06.330228+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:45:06.330228+0000","last_undegraded":"2024-09-13T18:45:06.330228+0000","last_fullsized":"2024-09-13T18:45:06.330228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346254+0000","last_change":"2024-09-13T18:45:05.343560+0000","last_active":"2024-09-13T18:45:05.346254+0000","last_peered":"2024-09-13T18:45:05.346254+0000","last_clean":"2024-09-13T18:45:05.346254+0000","last_became_active":"2024-09-13T18:45:05.342971+0000","last_became_peered":"2024-09-13T18:45:05.342971+0000","last_unstale":"2024-09-13T18:45:05.346254+0000","last_undegraded":"2024-09-13T18:45:05.346254+0000","last_fullsized":"2024-09-13T18:45:05.346254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:35.432501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338671+0000","last_change":"2024-09-13T18:45:01.345151+0000","last_active":"2024-09-13T18:45:05.338671+0000","last_peered":"2024-09-13T18:45:05.338671+0000","last_clean":"2024-09-13T18:45:05.338671+0000","last_became_active":"2024-09-13T18:45:01.344621+0000","last_became_peered":"2024-09-13T18:45:01.344621+0000","last_unstale":"2024-09-13T18:45:05.338671+0000","last_undegraded":"2024-09-13T18:45:05.338671+0000","last_fullsized":"2024-09-13T18:45:05.338671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:08.938308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:15.780850+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:45:15.780850+0000","last_peered":"2024-09-13T18:45:15.780850+0000","last_clean":"2024-09-13T18:45:15.780850+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:45:15.780850+0000","last_undegraded":"2024-09-13T18:45:15.780850+0000","last_fullsized":"2024-09-13T18:45:15.780850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825851+0000","last_change":"2024-09-13T18:45:05.349290+0000","last_active":"2024-09-13T18:45:05.825851+0000","last_peered":"2024-09-13T18:45:05.825851+0000","last_clean":"2024-09-13T18:45:05.825851+0000","last_became_active":"2024-09-13T18:45:05.347388+0000","last_became_peered":"2024-09-13T18:45:05.347388+0000","last_unstale":"2024-09-13T18:45:05.825851+0000","last_undegraded":"2024-09-13T18:45:05.825851+0000","last_fullsized":"2024-09-13T18:45:05.825851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:22.040097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328132+0000","last_change":"2024-09-13T18:45:01.346055+0000","last_active":"2024-09-13T18:45:05.328132+0000","last_peered":"2024-09-13T18:45:05.328132+0000","last_clean":"2024-09-13T18:45:05.328132+0000","last_became_active":"2024-09-13T18:45:01.345837+0000","last_became_peered":"2024-09-13T18:45:01.345837+0000","last_unstale":"2024-09-13T18:45:05.328132+0000","last_undegraded":"2024-09-13T18:45:05.328132+0000","last_fullsized":"2024-09-13T18:45:05.328132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:49.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.331407+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:45:06.331407+0000","last_peered":"2024-09-13T18:45:06.331407+0000","last_clean":"2024-09-13T18:45:06.331407+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:45:06.331407+0000","last_undegraded":"2024-09-13T18:45:06.331407+0000","last_fullsized":"2024-09-13T18:45:06.331407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.374060+0000","last_change":"2024-09-13T18:45:05.372988+0000","last_active":"2024-09-13T18:45:05.374060+0000","last_peered":"2024-09-13T18:45:05.374060+0000","last_clean":"2024-09-13T18:45:05.374060+0000","last_became_active":"2024-09-13T18:45:05.372512+0000","last_became_peered":"2024-09-13T18:45:05.372512+0000","last_unstale":"2024-09-13T18:45:05.374060+0000","last_undegraded":"2024-09-13T18:45:05.374060+0000","last_fullsized":"2024-09-13T18:45:05.374060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:34.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341638+0000","last_change":"2024-09-13T18:45:01.338401+0000","last_active":"2024-09-13T18:45:05.341638+0000","last_peered":"2024-09-13T18:45:05.341638+0000","last_clean":"2024-09-13T18:45:05.341638+0000","last_became_active":"2024-09-13T18:45:01.338030+0000","last_became_peered":"2024-09-13T18:45:01.338030+0000","last_unstale":"2024-09-13T18:45:05.341638+0000","last_undegraded":"2024-09-13T18:45:05.341638+0000","last_fullsized":"2024-09-13T18:45:05.341638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:37.030900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339846+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:45:05.339846+0000","last_peered":"2024-09-13T18:45:05.339846+0000","last_clean":"2024-09-13T18:45:05.339846+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:45:05.339846+0000","last_undegraded":"2024-09-13T18:45:05.339846+0000","last_fullsized":"2024-09-13T18:45:05.339846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.823921+0000","last_change":"2024-09-13T18:45:05.359747+0000","last_active":"2024-09-13T18:45:05.823921+0000","last_peered":"2024-09-13T18:45:05.823921+0000","last_clean":"2024-09-13T18:45:05.823921+0000","last_became_active":"2024-09-13T18:45:05.359227+0000","last_became_peered":"2024-09-13T18:45:05.359227+0000","last_unstale":"2024-09-13T18:45:05.823921+0000","last_undegraded":"2024-09-13T18:45:05.823921+0000","last_fullsized":"2024-09-13T18:45:05.823921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:13.356194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350743+0000","last_change":"2024-09-13T18:45:01.330522+0000","last_active":"2024-09-13T18:45:05.350743+0000","last_peered":"2024-09-13T18:45:05.350743+0000","last_clean":"2024-09-13T18:45:05.350743+0000","last_became_active":"2024-09-13T18:45:01.330292+0000","last_became_peered":"2024-09-13T18:45:01.330292+0000","last_unstale":"2024-09-13T18:45:05.350743+0000","last_undegraded":"2024-09-13T18:45:05.350743+0000","last_fullsized":"2024-09-13T18:45:05.350743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.819826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345469+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:45:05.345469+0000","last_peered":"2024-09-13T18:45:05.345469+0000","last_clean":"2024-09-13T18:45:05.345469+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:45:05.345469+0000","last_undegraded":"2024-09-13T18:45:05.345469+0000","last_fullsized":"2024-09-13T18:45:05.345469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825026+0000","last_change":"2024-09-13T18:45:05.345124+0000","last_active":"2024-09-13T18:45:05.825026+0000","last_peered":"2024-09-13T18:45:05.825026+0000","last_clean":"2024-09-13T18:45:05.825026+0000","last_became_active":"2024-09-13T18:45:05.344585+0000","last_became_peered":"2024-09-13T18:45:05.344585+0000","last_unstale":"2024-09-13T18:45:05.825026+0000","last_undegraded":"2024-09-13T18:45:05.825026+0000","last_fullsized":"2024-09-13T18:45:05.825026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.627036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826452+0000","last_change":"2024-09-13T18:45:05.354450+0000","last_active":"2024-09-13T18:45:05.826452+0000","last_peered":"2024-09-13T18:45:05.826452+0000","last_clean":"2024-09-13T18:45:05.826452+0000","last_became_active":"2024-09-13T18:45:05.354125+0000","last_became_peered":"2024-09-13T18:45:05.354125+0000","last_unstale":"2024-09-13T18:45:05.826452+0000","last_undegraded":"2024-09-13T18:45:05.826452+0000","last_fullsized":"2024-09-13T18:45:05.826452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:40.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335038+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:45:05.335038+0000","last_peered":"2024-09-13T18:45:05.335038+0000","last_clean":"2024-09-13T18:45:05.335038+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:45:05.335038+0000","last_undegraded":"2024-09-13T18:45:05.335038+0000","last_fullsized":"2024-09-13T18:45:05.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330036+0000","last_change":"2024-09-13T18:45:00.865663+0000","last_active":"2024-09-13T18:45:05.330036+0000","last_peered":"2024-09-13T18:45:05.330036+0000","last_clean":"2024-09-13T18:45:05.330036+0000","last_became_active":"2024-09-13T18:45:00.864827+0000","last_became_peered":"2024-09-13T18:45:00.864827+0000","last_unstale":"2024-09-13T18:45:05.330036+0000","last_undegraded":"2024-09-13T18:45:05.330036+0000","last_fullsized":"2024-09-13T18:45:05.330036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:17.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.360954+0000","last_change":"2024-09-13T18:45:05.358868+0000","last_active":"2024-09-13T18:45:05.360954+0000","last_peered":"2024-09-13T18:45:05.360954+0000","last_clean":"2024-09-13T18:45:05.360954+0000","last_became_active":"2024-09-13T18:45:05.358265+0000","last_became_peered":"2024-09-13T18:45:05.358265+0000","last_unstale":"2024-09-13T18:45:05.360954+0000","last_undegraded":"2024-09-13T18:45:05.360954+0000","last_fullsized":"2024-09-13T18:45:05.360954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:54.622499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339482+0000","last_change":"2024-09-13T18:45:01.331909+0000","last_active":"2024-09-13T18:45:05.339482+0000","last_peered":"2024-09-13T18:45:05.339482+0000","last_clean":"2024-09-13T18:45:05.339482+0000","last_became_active":"2024-09-13T18:45:01.331544+0000","last_became_peered":"2024-09-13T18:45:01.331544+0000","last_unstale":"2024-09-13T18:45:05.339482+0000","last_undegraded":"2024-09-13T18:45:05.339482+0000","last_fullsized":"2024-09-13T18:45:05.339482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:02.211129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330589+0000","last_change":"2024-09-13T18:45:00.860547+0000","last_active":"2024-09-13T18:45:05.330589+0000","last_peered":"2024-09-13T18:45:05.330589+0000","last_clean":"2024-09-13T18:45:05.330589+0000","last_became_active":"2024-09-13T18:45:00.860280+0000","last_became_peered":"2024-09-13T18:45:00.860280+0000","last_unstale":"2024-09-13T18:45:05.330589+0000","last_undegraded":"2024-09-13T18:45:05.330589+0000","last_fullsized":"2024-09-13T18:45:05.330589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.637492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328943+0000","last_change":"2024-09-13T18:45:00.868492+0000","last_active":"2024-09-13T18:45:06.328943+0000","last_peered":"2024-09-13T18:45:06.328943+0000","last_clean":"2024-09-13T18:45:06.328943+0000","last_became_active":"2024-09-13T18:45:00.867974+0000","last_became_peered":"2024-09-13T18:45:00.867974+0000","last_unstale":"2024-09-13T18:45:06.328943+0000","last_undegraded":"2024-09-13T18:45:06.328943+0000","last_fullsized":"2024-09-13T18:45:06.328943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:23.081313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335187+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:45:05.335187+0000","last_peered":"2024-09-13T18:45:05.335187+0000","last_clean":"2024-09-13T18:45:05.335187+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:45:05.335187+0000","last_undegraded":"2024-09-13T18:45:05.335187+0000","last_fullsized":"2024-09-13T18:45:05.335187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826337+0000","last_change":"2024-09-13T18:45:05.353000+0000","last_active":"2024-09-13T18:45:05.826337+0000","last_peered":"2024-09-13T18:45:05.826337+0000","last_clean":"2024-09-13T18:45:05.826337+0000","last_became_active":"2024-09-13T18:45:05.352517+0000","last_became_peered":"2024-09-13T18:45:05.352517+0000","last_unstale":"2024-09-13T18:45:05.826337+0000","last_undegraded":"2024-09-13T18:45:05.826337+0000","last_fullsized":"2024-09-13T18:45:05.826337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:55.468696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333615+0000","last_change":"2024-09-13T18:45:00.846090+0000","last_active":"2024-09-13T18:45:06.333615+0000","last_peered":"2024-09-13T18:45:06.333615+0000","last_clean":"2024-09-13T18:45:06.333615+0000","last_became_active":"2024-09-13T18:45:00.845817+0000","last_became_peered":"2024-09-13T18:45:00.845817+0000","last_unstale":"2024-09-13T18:45:06.333615+0000","last_undegraded":"2024-09-13T18:45:06.333615+0000","last_fullsized":"2024-09-13T18:45:06.333615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.183900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341132+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:45:05.341132+0000","last_peered":"2024-09-13T18:45:05.341132+0000","last_clean":"2024-09-13T18:45:05.341132+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:45:05.341132+0000","last_undegraded":"2024-09-13T18:45:05.341132+0000","last_fullsized":"2024-09-13T18:45:05.341132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826910+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:45:05.826910+0000","last_peered":"2024-09-13T18:45:05.826910+0000","last_clean":"2024-09-13T18:45:05.826910+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:45:05.826910+0000","last_undegraded":"2024-09-13T18:45:05.826910+0000","last_fullsized":"2024-09-13T18:45:05.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.344158+0000","last_change":"2024-09-13T18:45:01.333747+0000","last_active":"2024-09-13T18:45:05.344158+0000","last_peered":"2024-09-13T18:45:05.344158+0000","last_clean":"2024-09-13T18:45:05.344158+0000","last_became_active":"2024-09-13T18:45:01.332419+0000","last_became_peered":"2024-09-13T18:45:01.332419+0000","last_unstale":"2024-09-13T18:45:05.344158+0000","last_undegraded":"2024-09-13T18:45:05.344158+0000","last_fullsized":"2024-09-13T18:45:05.344158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:04.031786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341696+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:45:05.341696+0000","last_peered":"2024-09-13T18:45:05.341696+0000","last_clean":"2024-09-13T18:45:05.341696+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:45:05.341696+0000","last_undegraded":"2024-09-13T18:45:05.341696+0000","last_fullsized":"2024-09-13T18:45:05.341696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328563+0000","last_change":"2024-09-13T18:45:01.334186+0000","last_active":"2024-09-13T18:45:05.328563+0000","last_peered":"2024-09-13T18:45:05.328563+0000","last_clean":"2024-09-13T18:45:05.328563+0000","last_became_active":"2024-09-13T18:45:01.331220+0000","last_became_peered":"2024-09-13T18:45:01.331220+0000","last_unstale":"2024-09-13T18:45:05.328563+0000","last_undegraded":"2024-09-13T18:45:05.328563+0000","last_fullsized":"2024-09-13T18:45:05.328563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.221841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340277+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:45:05.340277+0000","last_peered":"2024-09-13T18:45:05.340277+0000","last_clean":"2024-09-13T18:45:05.340277+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:45:05.340277+0000","last_undegraded":"2024-09-13T18:45:05.340277+0000","last_fullsized":"2024-09-13T18:45:05.340277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332940+0000","last_change":"2024-09-13T18:45:01.345092+0000","last_active":"2024-09-13T18:45:05.332940+0000","last_peered":"2024-09-13T18:45:05.332940+0000","last_clean":"2024-09-13T18:45:05.332940+0000","last_became_active":"2024-09-13T18:45:01.344771+0000","last_became_peered":"2024-09-13T18:45:01.344771+0000","last_unstale":"2024-09-13T18:45:05.332940+0000","last_undegraded":"2024-09-13T18:45:05.332940+0000","last_fullsized":"2024-09-13T18:45:05.332940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.063948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332680+0000","last_change":"2024-09-13T18:45:01.331621+0000","last_active":"2024-09-13T18:45:05.332680+0000","last_peered":"2024-09-13T18:45:05.332680+0000","last_clean":"2024-09-13T18:45:05.332680+0000","last_became_active":"2024-09-13T18:45:01.331345+0000","last_became_peered":"2024-09-13T18:45:01.331345+0000","last_unstale":"2024-09-13T18:45:05.332680+0000","last_undegraded":"2024-09-13T18:45:05.332680+0000","last_fullsized":"2024-09-13T18:45:05.332680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.955367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350661+0000","last_change":"2024-09-13T18:45:01.339375+0000","last_active":"2024-09-13T18:45:05.350661+0000","last_peered":"2024-09-13T18:45:05.350661+0000","last_clean":"2024-09-13T18:45:05.350661+0000","last_became_active":"2024-09-13T18:45:01.339100+0000","last_became_peered":"2024-09-13T18:45:01.339100+0000","last_unstale":"2024-09-13T18:45:05.350661+0000","last_undegraded":"2024-09-13T18:45:05.350661+0000","last_fullsized":"2024-09-13T18:45:05.350661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:07.665938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341432+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:45:05.341432+0000","last_peered":"2024-09-13T18:45:05.341432+0000","last_clean":"2024-09-13T18:45:05.341432+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:45:05.341432+0000","last_undegraded":"2024-09-13T18:45:05.341432+0000","last_fullsized":"2024-09-13T18:45:05.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329413+0000","last_change":"2024-09-13T18:45:01.337763+0000","last_active":"2024-09-13T18:45:05.329413+0000","last_peered":"2024-09-13T18:45:05.329413+0000","last_clean":"2024-09-13T18:45:05.329413+0000","last_became_active":"2024-09-13T18:45:01.337436+0000","last_became_peered":"2024-09-13T18:45:01.337436+0000","last_unstale":"2024-09-13T18:45:05.329413+0000","last_undegraded":"2024-09-13T18:45:05.329413+0000","last_fullsized":"2024-09-13T18:45:05.329413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:24.283724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339364+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:45:05.339364+0000","last_peered":"2024-09-13T18:45:05.339364+0000","last_clean":"2024-09-13T18:45:05.339364+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:45:05.339364+0000","last_undegraded":"2024-09-13T18:45:05.339364+0000","last_fullsized":"2024-09-13T18:45:05.339364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341034+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:45:05.341034+0000","last_peered":"2024-09-13T18:45:05.341034+0000","last_clean":"2024-09-13T18:45:05.341034+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:45:05.341034+0000","last_undegraded":"2024-09-13T18:45:05.341034+0000","last_fullsized":"2024-09-13T18:45:05.341034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335095+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:45:05.335095+0000","last_peered":"2024-09-13T18:45:05.335095+0000","last_clean":"2024-09-13T18:45:05.335095+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:45:05.335095+0000","last_undegraded":"2024-09-13T18:45:05.335095+0000","last_fullsized":"2024-09-13T18:45:05.335095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342093+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:45:05.342093+0000","last_peered":"2024-09-13T18:45:05.342093+0000","last_clean":"2024-09-13T18:45:05.342093+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:45:05.342093+0000","last_undegraded":"2024-09-13T18:45:05.342093+0000","last_fullsized":"2024-09-13T18:45:05.342093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330753+0000","last_change":"2024-09-13T18:45:01.330449+0000","last_active":"2024-09-13T18:45:05.330753+0000","last_peered":"2024-09-13T18:45:05.330753+0000","last_clean":"2024-09-13T18:45:05.330753+0000","last_became_active":"2024-09-13T18:45:01.329169+0000","last_became_peered":"2024-09-13T18:45:01.329169+0000","last_unstale":"2024-09-13T18:45:05.330753+0000","last_undegraded":"2024-09-13T18:45:05.330753+0000","last_fullsized":"2024-09-13T18:45:05.330753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.348264+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:45:05.348264+0000","last_peered":"2024-09-13T18:45:05.348264+0000","last_clean":"2024-09-13T18:45:05.348264+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:45:05.348264+0000","last_undegraded":"2024-09-13T18:45:05.348264+0000","last_fullsized":"2024-09-13T18:45:05.348264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330371+0000","last_change":"2024-09-13T18:45:01.350125+0000","last_active":"2024-09-13T18:45:05.330371+0000","last_peered":"2024-09-13T18:45:05.330371+0000","last_clean":"2024-09-13T18:45:05.330371+0000","last_became_active":"2024-09-13T18:45:01.349938+0000","last_became_peered":"2024-09-13T18:45:01.349938+0000","last_unstale":"2024-09-13T18:45:05.330371+0000","last_undegraded":"2024-09-13T18:45:05.330371+0000","last_fullsized":"2024-09-13T18:45:05.330371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:31.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329585+0000","last_change":"2024-09-13T18:45:01.346136+0000","last_active":"2024-09-13T18:45:05.329585+0000","last_peered":"2024-09-13T18:45:05.329585+0000","last_clean":"2024-09-13T18:45:05.329585+0000","last_became_active":"2024-09-13T18:45:01.345857+0000","last_became_peered":"2024-09-13T18:45:01.345857+0000","last_unstale":"2024-09-13T18:45:05.329585+0000","last_undegraded":"2024-09-13T18:45:05.329585+0000","last_fullsized":"2024-09-13T18:45:05.329585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:54.067158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339025+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:45:05.339025+0000","last_peered":"2024-09-13T18:45:05.339025+0000","last_clean":"2024-09-13T18:45:05.339025+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:45:05.339025+0000","last_undegraded":"2024-09-13T18:45:05.339025+0000","last_fullsized":"2024-09-13T18:45:05.339025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.331987+0000","last_change":"2024-09-13T18:45:01.331111+0000","last_active":"2024-09-13T18:45:05.331987+0000","last_peered":"2024-09-13T18:45:05.331987+0000","last_clean":"2024-09-13T18:45:05.331987+0000","last_became_active":"2024-09-13T18:45:01.330778+0000","last_became_peered":"2024-09-13T18:45:01.330778+0000","last_unstale":"2024-09-13T18:45:05.331987+0000","last_undegraded":"2024-09-13T18:45:05.331987+0000","last_fullsized":"2024-09-13T18:45:05.331987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:32.014051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330546+0000","last_change":"2024-09-13T18:45:01.345047+0000","last_active":"2024-09-13T18:45:05.330546+0000","last_peered":"2024-09-13T18:45:05.330546+0000","last_clean":"2024-09-13T18:45:05.330546+0000","last_became_active":"2024-09-13T18:45:01.344779+0000","last_became_peered":"2024-09-13T18:45:01.344779+0000","last_unstale":"2024-09-13T18:45:05.330546+0000","last_undegraded":"2024-09-13T18:45:05.330546+0000","last_fullsized":"2024-09-13T18:45:05.330546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:17.412356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342014+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:45:05.342014+0000","last_peered":"2024-09-13T18:45:05.342014+0000","last_clean":"2024-09-13T18:45:05.342014+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:45:05.342014+0000","last_undegraded":"2024-09-13T18:45:05.342014+0000","last_fullsized":"2024-09-13T18:45:05.342014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338578+0000","last_change":"2024-09-13T18:45:01.353648+0000","last_active":"2024-09-13T18:45:05.338578+0000","last_peered":"2024-09-13T18:45:05.338578+0000","last_clean":"2024-09-13T18:45:05.338578+0000","last_became_active":"2024-09-13T18:45:01.353313+0000","last_became_peered":"2024-09-13T18:45:01.353313+0000","last_unstale":"2024-09-13T18:45:05.338578+0000","last_undegraded":"2024-09-13T18:45:05.338578+0000","last_fullsized":"2024-09-13T18:45:05.338578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:42.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339716+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:45:05.339716+0000","last_peered":"2024-09-13T18:45:05.339716+0000","last_clean":"2024-09-13T18:45:05.339716+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:45:05.339716+0000","last_undegraded":"2024-09-13T18:45:05.339716+0000","last_fullsized":"2024-09-13T18:45:05.339716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345424+0000","last_change":"2024-09-13T18:45:01.343394+0000","last_active":"2024-09-13T18:45:05.345424+0000","last_peered":"2024-09-13T18:45:05.345424+0000","last_clean":"2024-09-13T18:45:05.345424+0000","last_became_active":"2024-09-13T18:45:01.342835+0000","last_became_peered":"2024-09-13T18:45:01.342835+0000","last_unstale":"2024-09-13T18:45:05.345424+0000","last_undegraded":"2024-09-13T18:45:05.345424+0000","last_fullsized":"2024-09-13T18:45:05.345424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:02.097270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339302+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:45:05.339302+0000","last_peered":"2024-09-13T18:45:05.339302+0000","last_clean":"2024-09-13T18:45:05.339302+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:45:05.339302+0000","last_undegraded":"2024-09-13T18:45:05.339302+0000","last_fullsized":"2024-09-13T18:45:05.339302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336323+0000","last_change":"2024-09-13T18:45:01.336594+0000","last_active":"2024-09-13T18:45:05.336323+0000","last_peered":"2024-09-13T18:45:05.336323+0000","last_clean":"2024-09-13T18:45:05.336323+0000","last_became_active":"2024-09-13T18:45:01.331640+0000","last_became_peered":"2024-09-13T18:45:01.331640+0000","last_unstale":"2024-09-13T18:45:05.336323+0000","last_undegraded":"2024-09-13T18:45:05.336323+0000","last_fullsized":"2024-09-13T18:45:05.336323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346373+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:45:05.346373+0000","last_peered":"2024-09-13T18:45:05.346373+0000","last_clean":"2024-09-13T18:45:05.346373+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:45:05.346373+0000","last_undegraded":"2024-09-13T18:45:05.346373+0000","last_fullsized":"2024-09-13T18:45:05.346373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338544+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:45:05.338544+0000","last_peered":"2024-09-13T18:45:05.338544+0000","last_clean":"2024-09-13T18:45:05.338544+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:45:05.338544+0000","last_undegraded":"2024-09-13T18:45:05.338544+0000","last_fullsized":"2024-09-13T18:45:05.338544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.347239+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:45:05.347239+0000","last_peered":"2024-09-13T18:45:05.347239+0000","last_clean":"2024-09-13T18:45:05.347239+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:45:05.347239+0000","last_undegraded":"2024-09-13T18:45:05.347239+0000","last_fullsized":"2024-09-13T18:45:05.347239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340614+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:45:05.340614+0000","last_peered":"2024-09-13T18:45:05.340614+0000","last_clean":"2024-09-13T18:45:05.340614+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:45:05.340614+0000","last_undegraded":"2024-09-13T18:45:05.340614+0000","last_fullsized":"2024-09-13T18:45:05.340614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341414+0000","last_change":"2024-09-13T18:45:01.331882+0000","last_active":"2024-09-13T18:45:05.341414+0000","last_peered":"2024-09-13T18:45:05.341414+0000","last_clean":"2024-09-13T18:45:05.341414+0000","last_became_active":"2024-09-13T18:45:01.331547+0000","last_became_peered":"2024-09-13T18:45:01.331547+0000","last_unstale":"2024-09-13T18:45:05.341414+0000","last_undegraded":"2024-09-13T18:45:05.341414+0000","last_fullsized":"2024-09-13T18:45:05.341414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:58.736123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338749+0000","last_change":"2024-09-13T18:45:01.354801+0000","last_active":"2024-09-13T18:45:05.338749+0000","last_peered":"2024-09-13T18:45:05.338749+0000","last_clean":"2024-09-13T18:45:05.338749+0000","last_became_active":"2024-09-13T18:45:01.354525+0000","last_became_peered":"2024-09-13T18:45:01.354525+0000","last_unstale":"2024-09-13T18:45:05.338749+0000","last_undegraded":"2024-09-13T18:45:05.338749+0000","last_fullsized":"2024-09-13T18:45:05.338749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.153253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":106626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":696482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8380000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":106168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:32.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:32.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 Processor -- start 2024-09-13T18:45:32.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 -- start start 2024-09-13T18:45:32.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b00c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f80b00c8120 0x7f80b015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b015a7e0 con 0x7f80b015d2c0 2024-09-13T18:45:32.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b00c8960 con 0x7f80b00c8120 2024-09-13T18:45:32.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.229+0000 7f80b6400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0159810 con 0x7f80b00c92c0 2024-09-13T18:45:32.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b00c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b00c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57448/0 (socket says 172.21.15.32:57448) 2024-09-13T18:45:32.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 -- 172.21.15.32:0/1664284835 learned_addr learned my addr 172.21.15.32:0/1664284835 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:32.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80aea00700 1 --2- 172.21.15.32:0/1664284835 >> v2:172.21.15.32:3300/0 conn(0x7f80b00c8120 0x7f80b015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 -- 172.21.15.32:0/1664284835 >> v2:172.21.15.32:3300/0 conn(0x7f80b00c8120 msgr2=0x7f80b015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:32.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 --2- 172.21.15.32:0/1664284835 >> v2:172.21.15.32:3300/0 conn(0x7f80b00c8120 0x7f80b015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 -- 172.21.15.32:0/1664284835 >> v1:172.21.15.32:6789/0 conn(0x7f80b015d2c0 legacy=0x7f80b00719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 -- 172.21.15.32:0/1664284835 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b015a350 con 0x7f80b00c92c0 2024-09-13T18:45:32.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80af400700 1 --2- 172.21.15.32:0/1664284835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b00c76d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009910 tx=0x7f80a0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b38abb67e785ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80ae000700 1 -- 172.21.15.32:0/1664284835 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011830 con 0x7f80b00c92c0 2024-09-13T18:45:32.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80ae000700 1 -- 172.21.15.32:0/1664284835 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a0011990 con 0x7f80b00c92c0 2024-09-13T18:45:32.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80ae000700 1 -- 172.21.15.32:0/1664284835 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011d40 con 0x7f80b00c92c0 2024-09-13T18:45:32.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 -- 172.21.15.32:0/1664284835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 msgr2=0x7f80b00c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 --2- 172.21.15.32:0/1664284835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b00c76d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009910 tx=0x7f80a0009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:32.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 -- 172.21.15.32:0/1664284835 shutdown_connections 2024-09-13T18:45:32.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 --2- 172.21.15.32:0/1664284835 >> v2:172.21.15.32:3300/0 conn(0x7f80b00c8120 0x7f80b015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 --2- 172.21.15.32:0/1664284835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b00c76d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 -- 172.21.15.32:0/1664284835 >> 172.21.15.32:0/1664284835 conn(0x7f80b0071240 msgr2=0x7f80b006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 -- 172.21.15.32:0/1664284835 shutdown_connections 2024-09-13T18:45:32.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.233+0000 7f80b6400700 1 -- 172.21.15.32:0/1664284835 wait complete. 2024-09-13T18:45:32.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 Processor -- start 2024-09-13T18:45:32.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 -- start start 2024-09-13T18:45:32.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80b00c8120 0x7f80b006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b01e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 0x7f80b00abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b01590c0 con 0x7f80b00c8120 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b01f03e0 con 0x7f80b015d2c0 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.237+0000 7f80b6400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b01e32c0 con 0x7f80b00c92c0 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 0x7f80b00abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80aea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b01e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 0x7f80b00abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37322/0 (socket says 172.21.15.32:37322) 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 -- 172.21.15.32:0/2997904791 learned_addr learned my addr 172.21.15.32:0/2997904791 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80aea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b01e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57464/0 (socket says 172.21.15.32:57464) 2024-09-13T18:45:32.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80af400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80b00c8120 0x7f80b006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 -- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 msgr2=0x7f80b01e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b01e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 -- 172.21.15.32:0/2997904791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80b00c8120 msgr2=0x7f80b006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80b00c8120 0x7f80b006dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 -- 172.21.15.32:0/2997904791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0009570 con 0x7f80b015d2c0 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80af400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80b00c8120 0x7f80b006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80aea00700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b01e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80afe00700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 0x7f80b00abd20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f80a800cbf0 tx=0x7f80a800cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8003c20 con 0x7f80b015d2c0 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8003d80 con 0x7f80b015d2c0 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b01e2d40 con 0x7f80b015d2c0 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a800aaa0 con 0x7f80b015d2c0 2024-09-13T18:45:32.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b01e2fe0 con 0x7f80b015d2c0 2024-09-13T18:45:32.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.241+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b0067c30 con 0x7f80b015d2c0 2024-09-13T18:45:32.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.245+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80a800ac00 con 0x7f80b015d2c0 2024-09-13T18:45:32.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.245+0000 7f80a7400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8090066730 0x7f8090068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.245+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80a80843b0 con 0x7f80b015d2c0 2024-09-13T18:45:32.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.245+0000 7f80af400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8090066730 0x7f8090068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.253+0000 7f80af400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8090066730 0x7f8090068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80a0000c00 tx=0x7f80a0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.261+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80a80513a0 con 0x7f80b015d2c0 2024-09-13T18:45:32.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.441+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80b00b01e0 con 0x7f8090066730 2024-09-13T18:45:32.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.465+0000 7f80a7400700 1 -- 172.21.15.32:0/2997904791 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345048 (secure 0 0 0) 0x7f80b00b01e0 con 0x7f8090066730 2024-09-13T18:45:32.475 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8090066730 msgr2=0x7f8090068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8090066730 0x7f8090068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80a0000c00 tx=0x7f80a0008030 comp rx=0 tx=0).stop 2024-09-13T18:45:32.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 msgr2=0x7f80b00abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 0x7f80b00abd20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f80a800cbf0 tx=0x7f80a800cf00 comp rx=0 tx=0).stop 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 shutdown_connections 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8090066730 0x7f8090068bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80b015d2c0 0x7f80b00abd20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f80b00c92c0 0x7f80b01e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 --2- 172.21.15.32:0/2997904791 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80b00c8120 0x7f80b006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 >> 172.21.15.32:0/2997904791 conn(0x7f80b0071240 msgr2=0x7f80b015c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 shutdown_connections 2024-09-13T18:45:32.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.477+0000 7f80b6400700 1 -- 172.21.15.32:0/2997904791 wait complete. 2024-09-13T18:45:32.481 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:45:32.500 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-13T18:45:32.073431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3416064,"data_stored":2038274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005343"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.332147+0000","last_change":"2024-09-13T18:45:00.864148+0000","last_active":"2024-09-13T18:45:06.332147+0000","last_peered":"2024-09-13T18:45:06.332147+0000","last_clean":"2024-09-13T18:45:06.332147+0000","last_became_active":"2024-09-13T18:45:00.863883+0000","last_became_peered":"2024-09-13T18:45:00.863883+0000","last_unstale":"2024-09-13T18:45:06.332147+0000","last_undegraded":"2024-09-13T18:45:06.332147+0000","last_fullsized":"2024-09-13T18:45:06.332147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:45:05.341525+0000","last_peered":"2024-09-13T18:45:05.341525+0000","last_clean":"2024-09-13T18:45:05.341525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:45:05.341525+0000","last_undegraded":"2024-09-13T18:45:05.341525+0000","last_fullsized":"2024-09-13T18:45:05.341525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824414+0000","last_change":"2024-09-13T18:45:05.359268+0000","last_active":"2024-09-13T18:45:05.824414+0000","last_peered":"2024-09-13T18:45:05.824414+0000","last_clean":"2024-09-13T18:45:05.824414+0000","last_became_active":"2024-09-13T18:45:05.358933+0000","last_became_peered":"2024-09-13T18:45:05.358933+0000","last_unstale":"2024-09-13T18:45:05.824414+0000","last_undegraded":"2024-09-13T18:45:05.824414+0000","last_fullsized":"2024-09-13T18:45:05.824414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:00.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330857+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:45:06.330857+0000","last_peered":"2024-09-13T18:45:06.330857+0000","last_clean":"2024-09-13T18:45:06.330857+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:45:06.330857+0000","last_undegraded":"2024-09-13T18:45:06.330857+0000","last_fullsized":"2024-09-13T18:45:06.330857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341543+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:45:05.341543+0000","last_peered":"2024-09-13T18:45:05.341543+0000","last_clean":"2024-09-13T18:45:05.341543+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:45:05.341543+0000","last_undegraded":"2024-09-13T18:45:05.341543+0000","last_fullsized":"2024-09-13T18:45:05.341543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.357301+0000","last_change":"2024-09-13T18:45:05.351838+0000","last_active":"2024-09-13T18:45:05.357301+0000","last_peered":"2024-09-13T18:45:05.357301+0000","last_clean":"2024-09-13T18:45:05.357301+0000","last_became_active":"2024-09-13T18:45:05.351437+0000","last_became_peered":"2024-09-13T18:45:05.351437+0000","last_unstale":"2024-09-13T18:45:05.357301+0000","last_undegraded":"2024-09-13T18:45:05.357301+0000","last_fullsized":"2024-09-13T18:45:05.357301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:46.755054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328767+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:45:06.328767+0000","last_peered":"2024-09-13T18:45:06.328767+0000","last_clean":"2024-09-13T18:45:06.328767+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:45:06.328767+0000","last_undegraded":"2024-09-13T18:45:06.328767+0000","last_fullsized":"2024-09-13T18:45:06.328767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341864+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:45:05.341864+0000","last_peered":"2024-09-13T18:45:05.341864+0000","last_clean":"2024-09-13T18:45:05.341864+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:45:05.341864+0000","last_undegraded":"2024-09-13T18:45:05.341864+0000","last_fullsized":"2024-09-13T18:45:05.341864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366911+0000","last_change":"2024-09-13T18:45:05.363274+0000","last_active":"2024-09-13T18:45:05.366911+0000","last_peered":"2024-09-13T18:45:05.366911+0000","last_clean":"2024-09-13T18:45:05.366911+0000","last_became_active":"2024-09-13T18:45:05.362870+0000","last_became_peered":"2024-09-13T18:45:05.362870+0000","last_unstale":"2024-09-13T18:45:05.366911+0000","last_undegraded":"2024-09-13T18:45:05.366911+0000","last_fullsized":"2024-09-13T18:45:05.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:54.494396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327442+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:45:06.327442+0000","last_peered":"2024-09-13T18:45:06.327442+0000","last_clean":"2024-09-13T18:45:06.327442+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:45:06.327442+0000","last_undegraded":"2024-09-13T18:45:06.327442+0000","last_fullsized":"2024-09-13T18:45:06.327442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330635+0000","last_change":"2024-09-13T18:45:01.355711+0000","last_active":"2024-09-13T18:45:05.330635+0000","last_peered":"2024-09-13T18:45:05.330635+0000","last_clean":"2024-09-13T18:45:05.330635+0000","last_became_active":"2024-09-13T18:45:01.355463+0000","last_became_peered":"2024-09-13T18:45:01.355463+0000","last_unstale":"2024-09-13T18:45:05.330635+0000","last_undegraded":"2024-09-13T18:45:05.330635+0000","last_fullsized":"2024-09-13T18:45:05.330635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365664+0000","last_change":"2024-09-13T18:45:05.360940+0000","last_active":"2024-09-13T18:45:05.365664+0000","last_peered":"2024-09-13T18:45:05.365664+0000","last_clean":"2024-09-13T18:45:05.365664+0000","last_became_active":"2024-09-13T18:45:05.360491+0000","last_became_peered":"2024-09-13T18:45:05.360491+0000","last_unstale":"2024-09-13T18:45:05.365664+0000","last_undegraded":"2024-09-13T18:45:05.365664+0000","last_fullsized":"2024-09-13T18:45:05.365664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:26.565354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328208+0000","last_change":"2024-09-13T18:45:01.345265+0000","last_active":"2024-09-13T18:45:05.328208+0000","last_peered":"2024-09-13T18:45:05.328208+0000","last_clean":"2024-09-13T18:45:05.328208+0000","last_became_active":"2024-09-13T18:45:01.344996+0000","last_became_peered":"2024-09-13T18:45:01.344996+0000","last_unstale":"2024-09-13T18:45:05.328208+0000","last_undegraded":"2024-09-13T18:45:05.328208+0000","last_fullsized":"2024-09-13T18:45:05.328208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:11.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327878+0000","last_change":"2024-09-13T18:45:00.867459+0000","last_active":"2024-09-13T18:45:06.327878+0000","last_peered":"2024-09-13T18:45:06.327878+0000","last_clean":"2024-09-13T18:45:06.327878+0000","last_became_active":"2024-09-13T18:45:00.867028+0000","last_became_peered":"2024-09-13T18:45:00.867028+0000","last_unstale":"2024-09-13T18:45:06.327878+0000","last_undegraded":"2024-09-13T18:45:06.327878+0000","last_fullsized":"2024-09-13T18:45:06.327878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.262031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370686+0000","last_change":"2024-09-13T18:45:05.368886+0000","last_active":"2024-09-13T18:45:05.370686+0000","last_peered":"2024-09-13T18:45:05.370686+0000","last_clean":"2024-09-13T18:45:05.370686+0000","last_became_active":"2024-09-13T18:45:05.368510+0000","last_became_peered":"2024-09-13T18:45:05.368510+0000","last_unstale":"2024-09-13T18:45:05.370686+0000","last_undegraded":"2024-09-13T18:45:05.370686+0000","last_fullsized":"2024-09-13T18:45:05.370686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:26.194694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341816+0000","last_change":"2024-09-13T18:45:01.332274+0000","last_active":"2024-09-13T18:45:05.341816+0000","last_peered":"2024-09-13T18:45:05.341816+0000","last_clean":"2024-09-13T18:45:05.341816+0000","last_became_active":"2024-09-13T18:45:01.331671+0000","last_became_peered":"2024-09-13T18:45:01.331671+0000","last_unstale":"2024-09-13T18:45:05.341816+0000","last_undegraded":"2024-09-13T18:45:05.341816+0000","last_fullsized":"2024-09-13T18:45:05.341816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:38.214360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332230+0000","last_change":"2024-09-13T18:45:00.843856+0000","last_active":"2024-09-13T18:45:05.332230+0000","last_peered":"2024-09-13T18:45:05.332230+0000","last_clean":"2024-09-13T18:45:05.332230+0000","last_became_active":"2024-09-13T18:45:00.843456+0000","last_became_peered":"2024-09-13T18:45:00.843456+0000","last_unstale":"2024-09-13T18:45:05.332230+0000","last_undegraded":"2024-09-13T18:45:05.332230+0000","last_fullsized":"2024-09-13T18:45:05.332230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:52.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.353284+0000","last_change":"2024-09-13T18:45:05.349810+0000","last_active":"2024-09-13T18:45:05.353284+0000","last_peered":"2024-09-13T18:45:05.353284+0000","last_clean":"2024-09-13T18:45:05.353284+0000","last_became_active":"2024-09-13T18:45:05.348815+0000","last_became_peered":"2024-09-13T18:45:05.348815+0000","last_unstale":"2024-09-13T18:45:05.353284+0000","last_undegraded":"2024-09-13T18:45:05.353284+0000","last_fullsized":"2024-09-13T18:45:05.353284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:20.676172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336422+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:45:05.336422+0000","last_peered":"2024-09-13T18:45:05.336422+0000","last_clean":"2024-09-13T18:45:05.336422+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:45:05.336422+0000","last_undegraded":"2024-09-13T18:45:05.336422+0000","last_fullsized":"2024-09-13T18:45:05.336422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336648+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:45:05.336648+0000","last_peered":"2024-09-13T18:45:05.336648+0000","last_clean":"2024-09-13T18:45:05.336648+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:45:05.336648+0000","last_undegraded":"2024-09-13T18:45:05.336648+0000","last_fullsized":"2024-09-13T18:45:05.336648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.827311+0000","last_change":"2024-09-13T18:45:05.357361+0000","last_active":"2024-09-13T18:45:05.827311+0000","last_peered":"2024-09-13T18:45:05.827311+0000","last_clean":"2024-09-13T18:45:05.827311+0000","last_became_active":"2024-09-13T18:45:05.357036+0000","last_became_peered":"2024-09-13T18:45:05.357036+0000","last_unstale":"2024-09-13T18:45:05.827311+0000","last_undegraded":"2024-09-13T18:45:05.827311+0000","last_fullsized":"2024-09-13T18:45:05.827311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:00.105880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327853+0000","last_change":"2024-09-13T18:45:01.329048+0000","last_active":"2024-09-13T18:45:05.327853+0000","last_peered":"2024-09-13T18:45:05.327853+0000","last_clean":"2024-09-13T18:45:05.327853+0000","last_became_active":"2024-09-13T18:45:01.328762+0000","last_became_peered":"2024-09-13T18:45:01.328762+0000","last_unstale":"2024-09-13T18:45:05.327853+0000","last_undegraded":"2024-09-13T18:45:05.327853+0000","last_fullsized":"2024-09-13T18:45:05.327853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:21.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336115+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:45:05.336115+0000","last_peered":"2024-09-13T18:45:05.336115+0000","last_clean":"2024-09-13T18:45:05.336115+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:45:05.336115+0000","last_undegraded":"2024-09-13T18:45:05.336115+0000","last_fullsized":"2024-09-13T18:45:05.336115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366976+0000","last_change":"2024-09-13T18:45:05.364829+0000","last_active":"2024-09-13T18:45:05.366976+0000","last_peered":"2024-09-13T18:45:05.366976+0000","last_clean":"2024-09-13T18:45:05.366976+0000","last_became_active":"2024-09-13T18:45:05.364538+0000","last_became_peered":"2024-09-13T18:45:05.364538+0000","last_unstale":"2024-09-13T18:45:05.366976+0000","last_undegraded":"2024-09-13T18:45:05.366976+0000","last_fullsized":"2024-09-13T18:45:05.366976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.945041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336737+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:45:05.336737+0000","last_peered":"2024-09-13T18:45:05.336737+0000","last_clean":"2024-09-13T18:45:05.336737+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:45:05.336737+0000","last_undegraded":"2024-09-13T18:45:05.336737+0000","last_fullsized":"2024-09-13T18:45:05.336737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327578+0000","last_change":"2024-09-13T18:45:00.863206+0000","last_active":"2024-09-13T18:45:06.327578+0000","last_peered":"2024-09-13T18:45:06.327578+0000","last_clean":"2024-09-13T18:45:06.327578+0000","last_became_active":"2024-09-13T18:45:00.862917+0000","last_became_peered":"2024-09-13T18:45:00.862917+0000","last_unstale":"2024-09-13T18:45:06.327578+0000","last_undegraded":"2024-09-13T18:45:06.327578+0000","last_fullsized":"2024-09-13T18:45:06.327578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.289662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.367010+0000","last_change":"2024-09-13T18:45:05.364598+0000","last_active":"2024-09-13T18:45:05.367010+0000","last_peered":"2024-09-13T18:45:05.367010+0000","last_clean":"2024-09-13T18:45:05.367010+0000","last_became_active":"2024-09-13T18:45:05.364194+0000","last_became_peered":"2024-09-13T18:45:05.364194+0000","last_unstale":"2024-09-13T18:45:05.367010+0000","last_undegraded":"2024-09-13T18:45:05.367010+0000","last_fullsized":"2024-09-13T18:45:05.367010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.594403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336439+0000","last_change":"2024-09-13T18:45:01.333827+0000","last_active":"2024-09-13T18:45:05.336439+0000","last_peered":"2024-09-13T18:45:05.336439+0000","last_clean":"2024-09-13T18:45:05.336439+0000","last_became_active":"2024-09-13T18:45:01.333500+0000","last_became_peered":"2024-09-13T18:45:01.333500+0000","last_unstale":"2024-09-13T18:45:05.336439+0000","last_undegraded":"2024-09-13T18:45:05.336439+0000","last_fullsized":"2024-09-13T18:45:05.336439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:37.963424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826853+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:45:05.826853+0000","last_peered":"2024-09-13T18:45:05.826853+0000","last_clean":"2024-09-13T18:45:05.826853+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:45:05.826853+0000","last_undegraded":"2024-09-13T18:45:05.826853+0000","last_fullsized":"2024-09-13T18:45:05.826853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824166+0000","last_change":"2024-09-13T18:45:05.349605+0000","last_active":"2024-09-13T18:45:05.824166+0000","last_peered":"2024-09-13T18:45:05.824166+0000","last_clean":"2024-09-13T18:45:05.824166+0000","last_became_active":"2024-09-13T18:45:05.349213+0000","last_became_peered":"2024-09-13T18:45:05.349213+0000","last_unstale":"2024-09-13T18:45:05.824166+0000","last_undegraded":"2024-09-13T18:45:05.824166+0000","last_fullsized":"2024-09-13T18:45:05.824166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:17.638750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333067+0000","last_change":"2024-09-13T18:45:01.331576+0000","last_active":"2024-09-13T18:45:05.333067+0000","last_peered":"2024-09-13T18:45:05.333067+0000","last_clean":"2024-09-13T18:45:05.333067+0000","last_became_active":"2024-09-13T18:45:01.331313+0000","last_became_peered":"2024-09-13T18:45:01.331313+0000","last_unstale":"2024-09-13T18:45:05.333067+0000","last_undegraded":"2024-09-13T18:45:05.333067+0000","last_fullsized":"2024-09-13T18:45:05.333067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:15.549020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330831+0000","last_change":"2024-09-13T18:45:00.856368+0000","last_active":"2024-09-13T18:45:05.330831+0000","last_peered":"2024-09-13T18:45:05.330831+0000","last_clean":"2024-09-13T18:45:05.330831+0000","last_became_active":"2024-09-13T18:45:00.856067+0000","last_became_peered":"2024-09-13T18:45:00.856067+0000","last_unstale":"2024-09-13T18:45:05.330831+0000","last_undegraded":"2024-09-13T18:45:05.330831+0000","last_fullsized":"2024-09-13T18:45:05.330831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:29.141185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602069+0000","last_change":"2024-09-13T18:45:05.358233+0000","last_active":"2024-09-13T18:45:06.602069+0000","last_peered":"2024-09-13T18:45:06.602069+0000","last_clean":"2024-09-13T18:45:06.602069+0000","last_became_active":"2024-09-13T18:45:05.357819+0000","last_became_peered":"2024-09-13T18:45:05.357819+0000","last_unstale":"2024-09-13T18:45:06.602069+0000","last_undegraded":"2024-09-13T18:45:06.602069+0000","last_fullsized":"2024-09-13T18:45:06.602069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:06.840619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.349889+0000","last_change":"2024-09-13T18:45:01.323768+0000","last_active":"2024-09-13T18:45:05.349889+0000","last_peered":"2024-09-13T18:45:05.349889+0000","last_clean":"2024-09-13T18:45:05.349889+0000","last_became_active":"2024-09-13T18:45:01.323449+0000","last_became_peered":"2024-09-13T18:45:01.323449+0000","last_unstale":"2024-09-13T18:45:05.349889+0000","last_undegraded":"2024-09-13T18:45:05.349889+0000","last_fullsized":"2024-09-13T18:45:05.349889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:32.782226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340579+0000","last_change":"2024-09-13T18:45:00.848001+0000","last_active":"2024-09-13T18:45:05.340579+0000","last_peered":"2024-09-13T18:45:05.340579+0000","last_clean":"2024-09-13T18:45:05.340579+0000","last_became_active":"2024-09-13T18:45:00.847720+0000","last_became_peered":"2024-09-13T18:45:00.847720+0000","last_unstale":"2024-09-13T18:45:05.340579+0000","last_undegraded":"2024-09-13T18:45:05.340579+0000","last_fullsized":"2024-09-13T18:45:05.340579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.566248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.601658+0000","last_change":"2024-09-13T18:45:05.344571+0000","last_active":"2024-09-13T18:45:06.601658+0000","last_peered":"2024-09-13T18:45:06.601658+0000","last_clean":"2024-09-13T18:45:06.601658+0000","last_became_active":"2024-09-13T18:45:05.344171+0000","last_became_peered":"2024-09-13T18:45:05.344171+0000","last_unstale":"2024-09-13T18:45:06.601658+0000","last_undegraded":"2024-09-13T18:45:06.601658+0000","last_fullsized":"2024-09-13T18:45:06.601658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:15.473898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338368+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:45:05.338368+0000","last_peered":"2024-09-13T18:45:05.338368+0000","last_clean":"2024-09-13T18:45:05.338368+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:45:05.338368+0000","last_undegraded":"2024-09-13T18:45:05.338368+0000","last_fullsized":"2024-09-13T18:45:05.338368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329231+0000","last_change":"2024-09-13T18:45:00.861944+0000","last_active":"2024-09-13T18:45:05.329231+0000","last_peered":"2024-09-13T18:45:05.329231+0000","last_clean":"2024-09-13T18:45:05.329231+0000","last_became_active":"2024-09-13T18:45:00.861249+0000","last_became_peered":"2024-09-13T18:45:00.861249+0000","last_unstale":"2024-09-13T18:45:05.329231+0000","last_undegraded":"2024-09-13T18:45:05.329231+0000","last_fullsized":"2024-09-13T18:45:05.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:09.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602419+0000","last_change":"2024-09-13T18:45:05.351737+0000","last_active":"2024-09-13T18:45:06.602419+0000","last_peered":"2024-09-13T18:45:06.602419+0000","last_clean":"2024-09-13T18:45:06.602419+0000","last_became_active":"2024-09-13T18:45:05.351311+0000","last_became_peered":"2024-09-13T18:45:05.351311+0000","last_unstale":"2024-09-13T18:45:06.602419+0000","last_undegraded":"2024-09-13T18:45:06.602419+0000","last_fullsized":"2024-09-13T18:45:06.602419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.229616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340831+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:45:05.340831+0000","last_peered":"2024-09-13T18:45:05.340831+0000","last_clean":"2024-09-13T18:45:05.340831+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:45:05.340831+0000","last_undegraded":"2024-09-13T18:45:05.340831+0000","last_fullsized":"2024-09-13T18:45:05.340831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341794+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:45:05.341794+0000","last_peered":"2024-09-13T18:45:05.341794+0000","last_clean":"2024-09-13T18:45:05.341794+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:45:05.341794+0000","last_undegraded":"2024-09-13T18:45:05.341794+0000","last_fullsized":"2024-09-13T18:45:05.341794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602617+0000","last_change":"2024-09-13T18:45:05.354392+0000","last_active":"2024-09-13T18:45:06.602617+0000","last_peered":"2024-09-13T18:45:06.602617+0000","last_clean":"2024-09-13T18:45:06.602617+0000","last_became_active":"2024-09-13T18:45:05.354022+0000","last_became_peered":"2024-09-13T18:45:05.354022+0000","last_unstale":"2024-09-13T18:45:06.602617+0000","last_undegraded":"2024-09-13T18:45:06.602617+0000","last_fullsized":"2024-09-13T18:45:06.602617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.160746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330365+0000","last_change":"2024-09-13T18:45:01.342993+0000","last_active":"2024-09-13T18:45:05.330365+0000","last_peered":"2024-09-13T18:45:05.330365+0000","last_clean":"2024-09-13T18:45:05.330365+0000","last_became_active":"2024-09-13T18:45:01.342730+0000","last_became_peered":"2024-09-13T18:45:01.342730+0000","last_unstale":"2024-09-13T18:45:05.330365+0000","last_undegraded":"2024-09-13T18:45:05.330365+0000","last_fullsized":"2024-09-13T18:45:05.330365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:53.451442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330417+0000","last_change":"2024-09-13T18:45:00.861710+0000","last_active":"2024-09-13T18:45:05.330417+0000","last_peered":"2024-09-13T18:45:05.330417+0000","last_clean":"2024-09-13T18:45:05.330417+0000","last_became_active":"2024-09-13T18:45:00.861091+0000","last_became_peered":"2024-09-13T18:45:00.861091+0000","last_unstale":"2024-09-13T18:45:05.330417+0000","last_undegraded":"2024-09-13T18:45:05.330417+0000","last_fullsized":"2024-09-13T18:45:05.330417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:30.431815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334987+0000","last_change":"2024-09-13T18:45:05.349312+0000","last_active":"2024-09-13T18:45:06.334987+0000","last_peered":"2024-09-13T18:45:06.334987+0000","last_clean":"2024-09-13T18:45:06.334987+0000","last_became_active":"2024-09-13T18:45:05.348858+0000","last_became_peered":"2024-09-13T18:45:05.348858+0000","last_unstale":"2024-09-13T18:45:06.334987+0000","last_undegraded":"2024-09-13T18:45:06.334987+0000","last_fullsized":"2024-09-13T18:45:06.334987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:09.955609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336475+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:45:05.336475+0000","last_peered":"2024-09-13T18:45:05.336475+0000","last_clean":"2024-09-13T18:45:05.336475+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:45:05.336475+0000","last_undegraded":"2024-09-13T18:45:05.336475+0000","last_fullsized":"2024-09-13T18:45:05.336475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328614+0000","last_change":"2024-09-13T18:45:00.870886+0000","last_active":"2024-09-13T18:45:05.328614+0000","last_peered":"2024-09-13T18:45:05.328614+0000","last_clean":"2024-09-13T18:45:05.328614+0000","last_became_active":"2024-09-13T18:45:00.870563+0000","last_became_peered":"2024-09-13T18:45:00.870563+0000","last_unstale":"2024-09-13T18:45:05.328614+0000","last_undegraded":"2024-09-13T18:45:05.328614+0000","last_fullsized":"2024-09-13T18:45:05.328614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341074+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:45:05.341074+0000","last_peered":"2024-09-13T18:45:05.341074+0000","last_clean":"2024-09-13T18:45:05.341074+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:45:05.341074+0000","last_undegraded":"2024-09-13T18:45:05.341074+0000","last_fullsized":"2024-09-13T18:45:05.341074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.371253+0000","last_change":"2024-09-13T18:45:05.369616+0000","last_active":"2024-09-13T18:45:05.371253+0000","last_peered":"2024-09-13T18:45:05.371253+0000","last_clean":"2024-09-13T18:45:05.371253+0000","last_became_active":"2024-09-13T18:45:05.368904+0000","last_became_peered":"2024-09-13T18:45:05.368904+0000","last_unstale":"2024-09-13T18:45:05.371253+0000","last_undegraded":"2024-09-13T18:45:05.371253+0000","last_fullsized":"2024-09-13T18:45:05.371253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:55.985326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330699+0000","last_change":"2024-09-13T18:45:01.342548+0000","last_active":"2024-09-13T18:45:05.330699+0000","last_peered":"2024-09-13T18:45:05.330699+0000","last_clean":"2024-09-13T18:45:05.330699+0000","last_became_active":"2024-09-13T18:45:01.342038+0000","last_became_peered":"2024-09-13T18:45:01.342038+0000","last_unstale":"2024-09-13T18:45:05.330699+0000","last_undegraded":"2024-09-13T18:45:05.330699+0000","last_fullsized":"2024-09-13T18:45:05.330699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.863893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333149+0000","last_change":"2024-09-13T18:45:00.859879+0000","last_active":"2024-09-13T18:45:05.333149+0000","last_peered":"2024-09-13T18:45:05.333149+0000","last_clean":"2024-09-13T18:45:05.333149+0000","last_became_active":"2024-09-13T18:45:00.859621+0000","last_became_peered":"2024-09-13T18:45:00.859621+0000","last_unstale":"2024-09-13T18:45:05.333149+0000","last_undegraded":"2024-09-13T18:45:05.333149+0000","last_fullsized":"2024-09-13T18:45:05.333149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:17.771135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366813+0000","last_change":"2024-09-13T18:45:05.362604+0000","last_active":"2024-09-13T18:45:05.366813+0000","last_peered":"2024-09-13T18:45:05.366813+0000","last_clean":"2024-09-13T18:45:05.366813+0000","last_became_active":"2024-09-13T18:45:05.362142+0000","last_became_peered":"2024-09-13T18:45:05.362142+0000","last_unstale":"2024-09-13T18:45:05.366813+0000","last_undegraded":"2024-09-13T18:45:05.366813+0000","last_fullsized":"2024-09-13T18:45:05.366813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342162+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:45:05.342162+0000","last_peered":"2024-09-13T18:45:05.342162+0000","last_clean":"2024-09-13T18:45:05.342162+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:45:05.342162+0000","last_undegraded":"2024-09-13T18:45:05.342162+0000","last_fullsized":"2024-09-13T18:45:05.342162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333613+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:45:06.333613+0000","last_peered":"2024-09-13T18:45:06.333613+0000","last_clean":"2024-09-13T18:45:06.333613+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:45:06.333613+0000","last_undegraded":"2024-09-13T18:45:06.333613+0000","last_fullsized":"2024-09-13T18:45:06.333613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334610+0000","last_change":"2024-09-13T18:45:05.359310+0000","last_active":"2024-09-13T18:45:06.334610+0000","last_peered":"2024-09-13T18:45:06.334610+0000","last_clean":"2024-09-13T18:45:06.334610+0000","last_became_active":"2024-09-13T18:45:05.358824+0000","last_became_peered":"2024-09-13T18:45:05.358824+0000","last_unstale":"2024-09-13T18:45:06.334610+0000","last_undegraded":"2024-09-13T18:45:06.334610+0000","last_fullsized":"2024-09-13T18:45:06.334610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:24.283145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338768+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:45:05.338768+0000","last_peered":"2024-09-13T18:45:05.338768+0000","last_clean":"2024-09-13T18:45:05.338768+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:45:05.338768+0000","last_undegraded":"2024-09-13T18:45:05.338768+0000","last_fullsized":"2024-09-13T18:45:05.338768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333901+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:45:06.333901+0000","last_peered":"2024-09-13T18:45:06.333901+0000","last_clean":"2024-09-13T18:45:06.333901+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:45:06.333901+0000","last_undegraded":"2024-09-13T18:45:06.333901+0000","last_fullsized":"2024-09-13T18:45:06.333901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365485+0000","last_change":"2024-09-13T18:45:05.362240+0000","last_active":"2024-09-13T18:45:05.365485+0000","last_peered":"2024-09-13T18:45:05.365485+0000","last_clean":"2024-09-13T18:45:05.365485+0000","last_became_active":"2024-09-13T18:45:05.361810+0000","last_became_peered":"2024-09-13T18:45:05.361810+0000","last_unstale":"2024-09-13T18:45:05.365485+0000","last_undegraded":"2024-09-13T18:45:05.365485+0000","last_fullsized":"2024-09-13T18:45:05.365485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:38.083269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350837+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:45:05.350837+0000","last_peered":"2024-09-13T18:45:05.350837+0000","last_clean":"2024-09-13T18:45:05.350837+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:45:05.350837+0000","last_undegraded":"2024-09-13T18:45:05.350837+0000","last_fullsized":"2024-09-13T18:45:05.350837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.326163+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:45:06.326163+0000","last_peered":"2024-09-13T18:45:06.326163+0000","last_clean":"2024-09-13T18:45:06.326163+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:45:06.326163+0000","last_undegraded":"2024-09-13T18:45:06.326163+0000","last_fullsized":"2024-09-13T18:45:06.326163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370349+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:45:05.370349+0000","last_peered":"2024-09-13T18:45:05.370349+0000","last_clean":"2024-09-13T18:45:05.370349+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:45:05.370349+0000","last_undegraded":"2024-09-13T18:45:05.370349+0000","last_fullsized":"2024-09-13T18:45:05.370349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327734+0000","last_change":"2024-09-13T18:45:01.346791+0000","last_active":"2024-09-13T18:45:05.327734+0000","last_peered":"2024-09-13T18:45:05.327734+0000","last_clean":"2024-09-13T18:45:05.327734+0000","last_became_active":"2024-09-13T18:45:01.346515+0000","last_became_peered":"2024-09-13T18:45:01.346515+0000","last_unstale":"2024-09-13T18:45:05.327734+0000","last_undegraded":"2024-09-13T18:45:05.327734+0000","last_fullsized":"2024-09-13T18:45:05.327734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.337346+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:45:06.337346+0000","last_peered":"2024-09-13T18:45:06.337346+0000","last_clean":"2024-09-13T18:45:06.337346+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:45:06.337346+0000","last_undegraded":"2024-09-13T18:45:06.337346+0000","last_fullsized":"2024-09-13T18:45:06.337346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335188+0000","last_change":"2024-09-13T18:45:05.348324+0000","last_active":"2024-09-13T18:45:06.335188+0000","last_peered":"2024-09-13T18:45:06.335188+0000","last_clean":"2024-09-13T18:45:06.335188+0000","last_became_active":"2024-09-13T18:45:05.347908+0000","last_became_peered":"2024-09-13T18:45:05.347908+0000","last_unstale":"2024-09-13T18:45:06.335188+0000","last_undegraded":"2024-09-13T18:45:06.335188+0000","last_fullsized":"2024-09-13T18:45:06.335188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:29.155413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340979+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:45:05.340979+0000","last_peered":"2024-09-13T18:45:05.340979+0000","last_clean":"2024-09-13T18:45:05.340979+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:45:05.340979+0000","last_undegraded":"2024-09-13T18:45:05.340979+0000","last_fullsized":"2024-09-13T18:45:05.340979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336406+0000","last_change":"2024-09-13T18:45:00.866140+0000","last_active":"2024-09-13T18:45:05.336406+0000","last_peered":"2024-09-13T18:45:05.336406+0000","last_clean":"2024-09-13T18:45:05.336406+0000","last_became_active":"2024-09-13T18:45:00.865898+0000","last_became_peered":"2024-09-13T18:45:00.865898+0000","last_unstale":"2024-09-13T18:45:05.336406+0000","last_undegraded":"2024-09-13T18:45:05.336406+0000","last_fullsized":"2024-09-13T18:45:05.336406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:16.378417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335021+0000","last_change":"2024-09-13T18:45:05.359539+0000","last_active":"2024-09-13T18:45:06.335021+0000","last_peered":"2024-09-13T18:45:06.335021+0000","last_clean":"2024-09-13T18:45:06.335021+0000","last_became_active":"2024-09-13T18:45:05.358801+0000","last_became_peered":"2024-09-13T18:45:05.358801+0000","last_unstale":"2024-09-13T18:45:06.335021+0000","last_undegraded":"2024-09-13T18:45:06.335021+0000","last_fullsized":"2024-09-13T18:45:06.335021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:04.787244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328147+0000","last_change":"2024-09-13T18:45:01.347194+0000","last_active":"2024-09-13T18:45:05.328147+0000","last_peered":"2024-09-13T18:45:05.328147+0000","last_clean":"2024-09-13T18:45:05.328147+0000","last_became_active":"2024-09-13T18:45:01.346941+0000","last_became_peered":"2024-09-13T18:45:01.346941+0000","last_unstale":"2024-09-13T18:45:05.328147+0000","last_undegraded":"2024-09-13T18:45:05.328147+0000","last_fullsized":"2024-09-13T18:45:05.328147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:05.677969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328824+0000","last_change":"2024-09-13T18:45:00.858781+0000","last_active":"2024-09-13T18:45:05.328824+0000","last_peered":"2024-09-13T18:45:05.328824+0000","last_clean":"2024-09-13T18:45:05.328824+0000","last_became_active":"2024-09-13T18:45:00.858418+0000","last_became_peered":"2024-09-13T18:45:00.858418+0000","last_unstale":"2024-09-13T18:45:05.328824+0000","last_undegraded":"2024-09-13T18:45:05.328824+0000","last_fullsized":"2024-09-13T18:45:05.328824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:23.372534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602425+0000","last_change":"2024-09-13T18:45:05.354664+0000","last_active":"2024-09-13T18:45:06.602425+0000","last_peered":"2024-09-13T18:45:06.602425+0000","last_clean":"2024-09-13T18:45:06.602425+0000","last_became_active":"2024-09-13T18:45:05.354148+0000","last_became_peered":"2024-09-13T18:45:05.354148+0000","last_unstale":"2024-09-13T18:45:06.602425+0000","last_undegraded":"2024-09-13T18:45:06.602425+0000","last_fullsized":"2024-09-13T18:45:06.602425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332095+0000","last_change":"2024-09-13T18:45:01.339092+0000","last_active":"2024-09-13T18:45:05.332095+0000","last_peered":"2024-09-13T18:45:05.332095+0000","last_clean":"2024-09-13T18:45:05.332095+0000","last_became_active":"2024-09-13T18:45:01.338762+0000","last_became_peered":"2024-09-13T18:45:01.338762+0000","last_unstale":"2024-09-13T18:45:05.332095+0000","last_undegraded":"2024-09-13T18:45:05.332095+0000","last_fullsized":"2024-09-13T18:45:05.332095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:01.205580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330228+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:45:06.330228+0000","last_peered":"2024-09-13T18:45:06.330228+0000","last_clean":"2024-09-13T18:45:06.330228+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:45:06.330228+0000","last_undegraded":"2024-09-13T18:45:06.330228+0000","last_fullsized":"2024-09-13T18:45:06.330228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346254+0000","last_change":"2024-09-13T18:45:05.343560+0000","last_active":"2024-09-13T18:45:05.346254+0000","last_peered":"2024-09-13T18:45:05.346254+0000","last_clean":"2024-09-13T18:45:05.346254+0000","last_became_active":"2024-09-13T18:45:05.342971+0000","last_became_peered":"2024-09-13T18:45:05.342971+0000","last_unstale":"2024-09-13T18:45:05.346254+0000","last_undegraded":"2024-09-13T18:45:05.346254+0000","last_fullsized":"2024-09-13T18:45:05.346254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:35.432501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338671+0000","last_change":"2024-09-13T18:45:01.345151+0000","last_active":"2024-09-13T18:45:05.338671+0000","last_peered":"2024-09-13T18:45:05.338671+0000","last_clean":"2024-09-13T18:45:05.338671+0000","last_became_active":"2024-09-13T18:45:01.344621+0000","last_became_peered":"2024-09-13T18:45:01.344621+0000","last_unstale":"2024-09-13T18:45:05.338671+0000","last_undegraded":"2024-09-13T18:45:05.338671+0000","last_fullsized":"2024-09-13T18:45:05.338671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:08.938308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:15.780850+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:45:15.780850+0000","last_peered":"2024-09-13T18:45:15.780850+0000","last_clean":"2024-09-13T18:45:15.780850+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:45:15.780850+0000","last_undegraded":"2024-09-13T18:45:15.780850+0000","last_fullsized":"2024-09-13T18:45:15.780850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825851+0000","last_change":"2024-09-13T18:45:05.349290+0000","last_active":"2024-09-13T18:45:05.825851+0000","last_peered":"2024-09-13T18:45:05.825851+0000","last_clean":"2024-09-13T18:45:05.825851+0000","last_became_active":"2024-09-13T18:45:05.347388+0000","last_became_peered":"2024-09-13T18:45:05.347388+0000","last_unstale":"2024-09-13T18:45:05.825851+0000","last_undegraded":"2024-09-13T18:45:05.825851+0000","last_fullsized":"2024-09-13T18:45:05.825851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:22.040097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328132+0000","last_change":"2024-09-13T18:45:01.346055+0000","last_active":"2024-09-13T18:45:05.328132+0000","last_peered":"2024-09-13T18:45:05.328132+0000","last_clean":"2024-09-13T18:45:05.328132+0000","last_became_active":"2024-09-13T18:45:01.345837+0000","last_became_peered":"2024-09-13T18:45:01.345837+0000","last_unstale":"2024-09-13T18:45:05.328132+0000","last_undegraded":"2024-09-13T18:45:05.328132+0000","last_fullsized":"2024-09-13T18:45:05.328132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:49.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.331407+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:45:06.331407+0000","last_peered":"2024-09-13T18:45:06.331407+0000","last_clean":"2024-09-13T18:45:06.331407+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:45:06.331407+0000","last_undegraded":"2024-09-13T18:45:06.331407+0000","last_fullsized":"2024-09-13T18:45:06.331407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.374060+0000","last_change":"2024-09-13T18:45:05.372988+0000","last_active":"2024-09-13T18:45:05.374060+0000","last_peered":"2024-09-13T18:45:05.374060+0000","last_clean":"2024-09-13T18:45:05.374060+0000","last_became_active":"2024-09-13T18:45:05.372512+0000","last_became_peered":"2024-09-13T18:45:05.372512+0000","last_unstale":"2024-09-13T18:45:05.374060+0000","last_undegraded":"2024-09-13T18:45:05.374060+0000","last_fullsized":"2024-09-13T18:45:05.374060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:34.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341638+0000","last_change":"2024-09-13T18:45:01.338401+0000","last_active":"2024-09-13T18:45:05.341638+0000","last_peered":"2024-09-13T18:45:05.341638+0000","last_clean":"2024-09-13T18:45:05.341638+0000","last_became_active":"2024-09-13T18:45:01.338030+0000","last_became_peered":"2024-09-13T18:45:01.338030+0000","last_unstale":"2024-09-13T18:45:05.341638+0000","last_undegraded":"2024-09-13T18:45:05.341638+0000","last_fullsized":"2024-09-13T18:45:05.341638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:37.030900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339846+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:45:05.339846+0000","last_peered":"2024-09-13T18:45:05.339846+0000","last_clean":"2024-09-13T18:45:05.339846+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:45:05.339846+0000","last_undegraded":"2024-09-13T18:45:05.339846+0000","last_fullsized":"2024-09-13T18:45:05.339846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.823921+0000","last_change":"2024-09-13T18:45:05.359747+0000","last_active":"2024-09-13T18:45:05.823921+0000","last_peered":"2024-09-13T18:45:05.823921+0000","last_clean":"2024-09-13T18:45:05.823921+0000","last_became_active":"2024-09-13T18:45:05.359227+0000","last_became_peered":"2024-09-13T18:45:05.359227+0000","last_unstale":"2024-09-13T18:45:05.823921+0000","last_undegraded":"2024-09-13T18:45:05.823921+0000","last_fullsized":"2024-09-13T18:45:05.823921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:13.356194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350743+0000","last_change":"2024-09-13T18:45:01.330522+0000","last_active":"2024-09-13T18:45:05.350743+0000","last_peered":"2024-09-13T18:45:05.350743+0000","last_clean":"2024-09-13T18:45:05.350743+0000","last_became_active":"2024-09-13T18:45:01.330292+0000","last_became_peered":"2024-09-13T18:45:01.330292+0000","last_unstale":"2024-09-13T18:45:05.350743+0000","last_undegraded":"2024-09-13T18:45:05.350743+0000","last_fullsized":"2024-09-13T18:45:05.350743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.819826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345469+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:45:05.345469+0000","last_peered":"2024-09-13T18:45:05.345469+0000","last_clean":"2024-09-13T18:45:05.345469+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:45:05.345469+0000","last_undegraded":"2024-09-13T18:45:05.345469+0000","last_fullsized":"2024-09-13T18:45:05.345469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825026+0000","last_change":"2024-09-13T18:45:05.345124+0000","last_active":"2024-09-13T18:45:05.825026+0000","last_peered":"2024-09-13T18:45:05.825026+0000","last_clean":"2024-09-13T18:45:05.825026+0000","last_became_active":"2024-09-13T18:45:05.344585+0000","last_became_peered":"2024-09-13T18:45:05.344585+0000","last_unstale":"2024-09-13T18:45:05.825026+0000","last_undegraded":"2024-09-13T18:45:05.825026+0000","last_fullsized":"2024-09-13T18:45:05.825026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.627036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826452+0000","last_change":"2024-09-13T18:45:05.354450+0000","last_active":"2024-09-13T18:45:05.826452+0000","last_peered":"2024-09-13T18:45:05.826452+0000","last_clean":"2024-09-13T18:45:05.826452+0000","last_became_active":"2024-09-13T18:45:05.354125+0000","last_became_peered":"2024-09-13T18:45:05.354125+0000","last_unstale":"2024-09-13T18:45:05.826452+0000","last_undegraded":"2024-09-13T18:45:05.826452+0000","last_fullsized":"2024-09-13T18:45:05.826452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:40.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335038+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:45:05.335038+0000","last_peered":"2024-09-13T18:45:05.335038+0000","last_clean":"2024-09-13T18:45:05.335038+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:45:05.335038+0000","last_undegraded":"2024-09-13T18:45:05.335038+0000","last_fullsized":"2024-09-13T18:45:05.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330036+0000","last_change":"2024-09-13T18:45:00.865663+0000","last_active":"2024-09-13T18:45:05.330036+0000","last_peered":"2024-09-13T18:45:05.330036+0000","last_clean":"2024-09-13T18:45:05.330036+0000","last_became_active":"2024-09-13T18:45:00.864827+0000","last_became_peered":"2024-09-13T18:45:00.864827+0000","last_unstale":"2024-09-13T18:45:05.330036+0000","last_undegraded":"2024-09-13T18:45:05.330036+0000","last_fullsized":"2024-09-13T18:45:05.330036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:17.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.360954+0000","last_change":"2024-09-13T18:45:05.358868+0000","last_active":"2024-09-13T18:45:05.360954+0000","last_peered":"2024-09-13T18:45:05.360954+0000","last_clean":"2024-09-13T18:45:05.360954+0000","last_became_active":"2024-09-13T18:45:05.358265+0000","last_became_peered":"2024-09-13T18:45:05.358265+0000","last_unstale":"2024-09-13T18:45:05.360954+0000","last_undegraded":"2024-09-13T18:45:05.360954+0000","last_fullsized":"2024-09-13T18:45:05.360954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:54.622499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339482+0000","last_change":"2024-09-13T18:45:01.331909+0000","last_active":"2024-09-13T18:45:05.339482+0000","last_peered":"2024-09-13T18:45:05.339482+0000","last_clean":"2024-09-13T18:45:05.339482+0000","last_became_active":"2024-09-13T18:45:01.331544+0000","last_became_peered":"2024-09-13T18:45:01.331544+0000","last_unstale":"2024-09-13T18:45:05.339482+0000","last_undegraded":"2024-09-13T18:45:05.339482+0000","last_fullsized":"2024-09-13T18:45:05.339482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:02.211129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330589+0000","last_change":"2024-09-13T18:45:00.860547+0000","last_active":"2024-09-13T18:45:05.330589+0000","last_peered":"2024-09-13T18:45:05.330589+0000","last_clean":"2024-09-13T18:45:05.330589+0000","last_became_active":"2024-09-13T18:45:00.860280+0000","last_became_peered":"2024-09-13T18:45:00.860280+0000","last_unstale":"2024-09-13T18:45:05.330589+0000","last_undegraded":"2024-09-13T18:45:05.330589+0000","last_fullsized":"2024-09-13T18:45:05.330589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.637492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328943+0000","last_change":"2024-09-13T18:45:00.868492+0000","last_active":"2024-09-13T18:45:06.328943+0000","last_peered":"2024-09-13T18:45:06.328943+0000","last_clean":"2024-09-13T18:45:06.328943+0000","last_became_active":"2024-09-13T18:45:00.867974+0000","last_became_peered":"2024-09-13T18:45:00.867974+0000","last_unstale":"2024-09-13T18:45:06.328943+0000","last_undegraded":"2024-09-13T18:45:06.328943+0000","last_fullsized":"2024-09-13T18:45:06.328943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:23.081313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335187+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:45:05.335187+0000","last_peered":"2024-09-13T18:45:05.335187+0000","last_clean":"2024-09-13T18:45:05.335187+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:45:05.335187+0000","last_undegraded":"2024-09-13T18:45:05.335187+0000","last_fullsized":"2024-09-13T18:45:05.335187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826337+0000","last_change":"2024-09-13T18:45:05.353000+0000","last_active":"2024-09-13T18:45:05.826337+0000","last_peered":"2024-09-13T18:45:05.826337+0000","last_clean":"2024-09-13T18:45:05.826337+0000","last_became_active":"2024-09-13T18:45:05.352517+0000","last_became_peered":"2024-09-13T18:45:05.352517+0000","last_unstale":"2024-09-13T18:45:05.826337+0000","last_undegraded":"2024-09-13T18:45:05.826337+0000","last_fullsized":"2024-09-13T18:45:05.826337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:55.468696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333615+0000","last_change":"2024-09-13T18:45:00.846090+0000","last_active":"2024-09-13T18:45:06.333615+0000","last_peered":"2024-09-13T18:45:06.333615+0000","last_clean":"2024-09-13T18:45:06.333615+0000","last_became_active":"2024-09-13T18:45:00.845817+0000","last_became_peered":"2024-09-13T18:45:00.845817+0000","last_unstale":"2024-09-13T18:45:06.333615+0000","last_undegraded":"2024-09-13T18:45:06.333615+0000","last_fullsized":"2024-09-13T18:45:06.333615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.183900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341132+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:45:05.341132+0000","last_peered":"2024-09-13T18:45:05.341132+0000","last_clean":"2024-09-13T18:45:05.341132+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:45:05.341132+0000","last_undegraded":"2024-09-13T18:45:05.341132+0000","last_fullsized":"2024-09-13T18:45:05.341132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826910+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:45:05.826910+0000","last_peered":"2024-09-13T18:45:05.826910+0000","last_clean":"2024-09-13T18:45:05.826910+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:45:05.826910+0000","last_undegraded":"2024-09-13T18:45:05.826910+0000","last_fullsized":"2024-09-13T18:45:05.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.344158+0000","last_change":"2024-09-13T18:45:01.333747+0000","last_active":"2024-09-13T18:45:05.344158+0000","last_peered":"2024-09-13T18:45:05.344158+0000","last_clean":"2024-09-13T18:45:05.344158+0000","last_became_active":"2024-09-13T18:45:01.332419+0000","last_became_peered":"2024-09-13T18:45:01.332419+0000","last_unstale":"2024-09-13T18:45:05.344158+0000","last_undegraded":"2024-09-13T18:45:05.344158+0000","last_fullsized":"2024-09-13T18:45:05.344158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:04.031786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341696+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:45:05.341696+0000","last_peered":"2024-09-13T18:45:05.341696+0000","last_clean":"2024-09-13T18:45:05.341696+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:45:05.341696+0000","last_undegraded":"2024-09-13T18:45:05.341696+0000","last_fullsized":"2024-09-13T18:45:05.341696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328563+0000","last_change":"2024-09-13T18:45:01.334186+0000","last_active":"2024-09-13T18:45:05.328563+0000","last_peered":"2024-09-13T18:45:05.328563+0000","last_clean":"2024-09-13T18:45:05.328563+0000","last_became_active":"2024-09-13T18:45:01.331220+0000","last_became_peered":"2024-09-13T18:45:01.331220+0000","last_unstale":"2024-09-13T18:45:05.328563+0000","last_undegraded":"2024-09-13T18:45:05.328563+0000","last_fullsized":"2024-09-13T18:45:05.328563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.221841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340277+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:45:05.340277+0000","last_peered":"2024-09-13T18:45:05.340277+0000","last_clean":"2024-09-13T18:45:05.340277+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:45:05.340277+0000","last_undegraded":"2024-09-13T18:45:05.340277+0000","last_fullsized":"2024-09-13T18:45:05.340277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332940+0000","last_change":"2024-09-13T18:45:01.345092+0000","last_active":"2024-09-13T18:45:05.332940+0000","last_peered":"2024-09-13T18:45:05.332940+0000","last_clean":"2024-09-13T18:45:05.332940+0000","last_became_active":"2024-09-13T18:45:01.344771+0000","last_became_peered":"2024-09-13T18:45:01.344771+0000","last_unstale":"2024-09-13T18:45:05.332940+0000","last_undegraded":"2024-09-13T18:45:05.332940+0000","last_fullsized":"2024-09-13T18:45:05.332940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.063948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332680+0000","last_change":"2024-09-13T18:45:01.331621+0000","last_active":"2024-09-13T18:45:05.332680+0000","last_peered":"2024-09-13T18:45:05.332680+0000","last_clean":"2024-09-13T18:45:05.332680+0000","last_became_active":"2024-09-13T18:45:01.331345+0000","last_became_peered":"2024-09-13T18:45:01.331345+0000","last_unstale":"2024-09-13T18:45:05.332680+0000","last_undegraded":"2024-09-13T18:45:05.332680+0000","last_fullsized":"2024-09-13T18:45:05.332680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.955367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350661+0000","last_change":"2024-09-13T18:45:01.339375+0000","last_active":"2024-09-13T18:45:05.350661+0000","last_peered":"2024-09-13T18:45:05.350661+0000","last_clean":"2024-09-13T18:45:05.350661+0000","last_became_active":"2024-09-13T18:45:01.339100+0000","last_became_peered":"2024-09-13T18:45:01.339100+0000","last_unstale":"2024-09-13T18:45:05.350661+0000","last_undegraded":"2024-09-13T18:45:05.350661+0000","last_fullsized":"2024-09-13T18:45:05.350661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:07.665938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341432+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:45:05.341432+0000","last_peered":"2024-09-13T18:45:05.341432+0000","last_clean":"2024-09-13T18:45:05.341432+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:45:05.341432+0000","last_undegraded":"2024-09-13T18:45:05.341432+0000","last_fullsized":"2024-09-13T18:45:05.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329413+0000","last_change":"2024-09-13T18:45:01.337763+0000","last_active":"2024-09-13T18:45:05.329413+0000","last_peered":"2024-09-13T18:45:05.329413+0000","last_clean":"2024-09-13T18:45:05.329413+0000","last_became_active":"2024-09-13T18:45:01.337436+0000","last_became_peered":"2024-09-13T18:45:01.337436+0000","last_unstale":"2024-09-13T18:45:05.329413+0000","last_undegraded":"2024-09-13T18:45:05.329413+0000","last_fullsized":"2024-09-13T18:45:05.329413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:24.283724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339364+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:45:05.339364+0000","last_peered":"2024-09-13T18:45:05.339364+0000","last_clean":"2024-09-13T18:45:05.339364+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:45:05.339364+0000","last_undegraded":"2024-09-13T18:45:05.339364+0000","last_fullsized":"2024-09-13T18:45:05.339364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341034+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:45:05.341034+0000","last_peered":"2024-09-13T18:45:05.341034+0000","last_clean":"2024-09-13T18:45:05.341034+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:45:05.341034+0000","last_undegraded":"2024-09-13T18:45:05.341034+0000","last_fullsized":"2024-09-13T18:45:05.341034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335095+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:45:05.335095+0000","last_peered":"2024-09-13T18:45:05.335095+0000","last_clean":"2024-09-13T18:45:05.335095+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:45:05.335095+0000","last_undegraded":"2024-09-13T18:45:05.335095+0000","last_fullsized":"2024-09-13T18:45:05.335095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342093+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:45:05.342093+0000","last_peered":"2024-09-13T18:45:05.342093+0000","last_clean":"2024-09-13T18:45:05.342093+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:45:05.342093+0000","last_undegraded":"2024-09-13T18:45:05.342093+0000","last_fullsized":"2024-09-13T18:45:05.342093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330753+0000","last_change":"2024-09-13T18:45:01.330449+0000","last_active":"2024-09-13T18:45:05.330753+0000","last_peered":"2024-09-13T18:45:05.330753+0000","last_clean":"2024-09-13T18:45:05.330753+0000","last_became_active":"2024-09-13T18:45:01.329169+0000","last_became_peered":"2024-09-13T18:45:01.329169+0000","last_unstale":"2024-09-13T18:45:05.330753+0000","last_undegraded":"2024-09-13T18:45:05.330753+0000","last_fullsized":"2024-09-13T18:45:05.330753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.348264+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:45:05.348264+0000","last_peered":"2024-09-13T18:45:05.348264+0000","last_clean":"2024-09-13T18:45:05.348264+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:45:05.348264+0000","last_undegraded":"2024-09-13T18:45:05.348264+0000","last_fullsized":"2024-09-13T18:45:05.348264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330371+0000","last_change":"2024-09-13T18:45:01.350125+0000","last_active":"2024-09-13T18:45:05.330371+0000","last_peered":"2024-09-13T18:45:05.330371+0000","last_clean":"2024-09-13T18:45:05.330371+0000","last_became_active":"2024-09-13T18:45:01.349938+0000","last_became_peered":"2024-09-13T18:45:01.349938+0000","last_unstale":"2024-09-13T18:45:05.330371+0000","last_undegraded":"2024-09-13T18:45:05.330371+0000","last_fullsized":"2024-09-13T18:45:05.330371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:31.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329585+0000","last_change":"2024-09-13T18:45:01.346136+0000","last_active":"2024-09-13T18:45:05.329585+0000","last_peered":"2024-09-13T18:45:05.329585+0000","last_clean":"2024-09-13T18:45:05.329585+0000","last_became_active":"2024-09-13T18:45:01.345857+0000","last_became_peered":"2024-09-13T18:45:01.345857+0000","last_unstale":"2024-09-13T18:45:05.329585+0000","last_undegraded":"2024-09-13T18:45:05.329585+0000","last_fullsized":"2024-09-13T18:45:05.329585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:54.067158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339025+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:45:05.339025+0000","last_peered":"2024-09-13T18:45:05.339025+0000","last_clean":"2024-09-13T18:45:05.339025+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:45:05.339025+0000","last_undegraded":"2024-09-13T18:45:05.339025+0000","last_fullsized":"2024-09-13T18:45:05.339025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.331987+0000","last_change":"2024-09-13T18:45:01.331111+0000","last_active":"2024-09-13T18:45:05.331987+0000","last_peered":"2024-09-13T18:45:05.331987+0000","last_clean":"2024-09-13T18:45:05.331987+0000","last_became_active":"2024-09-13T18:45:01.330778+0000","last_became_peered":"2024-09-13T18:45:01.330778+0000","last_unstale":"2024-09-13T18:45:05.331987+0000","last_undegraded":"2024-09-13T18:45:05.331987+0000","last_fullsized":"2024-09-13T18:45:05.331987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:32.014051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330546+0000","last_change":"2024-09-13T18:45:01.345047+0000","last_active":"2024-09-13T18:45:05.330546+0000","last_peered":"2024-09-13T18:45:05.330546+0000","last_clean":"2024-09-13T18:45:05.330546+0000","last_became_active":"2024-09-13T18:45:01.344779+0000","last_became_peered":"2024-09-13T18:45:01.344779+0000","last_unstale":"2024-09-13T18:45:05.330546+0000","last_undegraded":"2024-09-13T18:45:05.330546+0000","last_fullsized":"2024-09-13T18:45:05.330546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:17.412356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342014+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:45:05.342014+0000","last_peered":"2024-09-13T18:45:05.342014+0000","last_clean":"2024-09-13T18:45:05.342014+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:45:05.342014+0000","last_undegraded":"2024-09-13T18:45:05.342014+0000","last_fullsized":"2024-09-13T18:45:05.342014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338578+0000","last_change":"2024-09-13T18:45:01.353648+0000","last_active":"2024-09-13T18:45:05.338578+0000","last_peered":"2024-09-13T18:45:05.338578+0000","last_clean":"2024-09-13T18:45:05.338578+0000","last_became_active":"2024-09-13T18:45:01.353313+0000","last_became_peered":"2024-09-13T18:45:01.353313+0000","last_unstale":"2024-09-13T18:45:05.338578+0000","last_undegraded":"2024-09-13T18:45:05.338578+0000","last_fullsized":"2024-09-13T18:45:05.338578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:42.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339716+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:45:05.339716+0000","last_peered":"2024-09-13T18:45:05.339716+0000","last_clean":"2024-09-13T18:45:05.339716+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:45:05.339716+0000","last_undegraded":"2024-09-13T18:45:05.339716+0000","last_fullsized":"2024-09-13T18:45:05.339716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345424+0000","last_change":"2024-09-13T18:45:01.343394+0000","last_active":"2024-09-13T18:45:05.345424+0000","last_peered":"2024-09-13T18:45:05.345424+0000","last_clean":"2024-09-13T18:45:05.345424+0000","last_became_active":"2024-09-13T18:45:01.342835+0000","last_became_peered":"2024-09-13T18:45:01.342835+0000","last_unstale":"2024-09-13T18:45:05.345424+0000","last_undegraded":"2024-09-13T18:45:05.345424+0000","last_fullsized":"2024-09-13T18:45:05.345424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:02.097270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339302+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:45:05.339302+0000","last_peered":"2024-09-13T18:45:05.339302+0000","last_clean":"2024-09-13T18:45:05.339302+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:45:05.339302+0000","last_undegraded":"2024-09-13T18:45:05.339302+0000","last_fullsized":"2024-09-13T18:45:05.339302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336323+0000","last_change":"2024-09-13T18:45:01.336594+0000","last_active":"2024-09-13T18:45:05.336323+0000","last_peered":"2024-09-13T18:45:05.336323+0000","last_clean":"2024-09-13T18:45:05.336323+0000","last_became_active":"2024-09-13T18:45:01.331640+0000","last_became_peered":"2024-09-13T18:45:01.331640+0000","last_unstale":"2024-09-13T18:45:05.336323+0000","last_undegraded":"2024-09-13T18:45:05.336323+0000","last_fullsized":"2024-09-13T18:45:05.336323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346373+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:45:05.346373+0000","last_peered":"2024-09-13T18:45:05.346373+0000","last_clean":"2024-09-13T18:45:05.346373+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:45:05.346373+0000","last_undegraded":"2024-09-13T18:45:05.346373+0000","last_fullsized":"2024-09-13T18:45:05.346373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338544+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:45:05.338544+0000","last_peered":"2024-09-13T18:45:05.338544+0000","last_clean":"2024-09-13T18:45:05.338544+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:45:05.338544+0000","last_undegraded":"2024-09-13T18:45:05.338544+0000","last_fullsized":"2024-09-13T18:45:05.338544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.347239+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:45:05.347239+0000","last_peered":"2024-09-13T18:45:05.347239+0000","last_clean":"2024-09-13T18:45:05.347239+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:45:05.347239+0000","last_undegraded":"2024-09-13T18:45:05.347239+0000","last_fullsized":"2024-09-13T18:45:05.347239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340614+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:45:05.340614+0000","last_peered":"2024-09-13T18:45:05.340614+0000","last_clean":"2024-09-13T18:45:05.340614+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:45:05.340614+0000","last_undegraded":"2024-09-13T18:45:05.340614+0000","last_fullsized":"2024-09-13T18:45:05.340614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341414+0000","last_change":"2024-09-13T18:45:01.331882+0000","last_active":"2024-09-13T18:45:05.341414+0000","last_peered":"2024-09-13T18:45:05.341414+0000","last_clean":"2024-09-13T18:45:05.341414+0000","last_became_active":"2024-09-13T18:45:01.331547+0000","last_became_peered":"2024-09-13T18:45:01.331547+0000","last_unstale":"2024-09-13T18:45:05.341414+0000","last_undegraded":"2024-09-13T18:45:05.341414+0000","last_fullsized":"2024-09-13T18:45:05.341414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:58.736123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338749+0000","last_change":"2024-09-13T18:45:01.354801+0000","last_active":"2024-09-13T18:45:05.338749+0000","last_peered":"2024-09-13T18:45:05.338749+0000","last_clean":"2024-09-13T18:45:05.338749+0000","last_became_active":"2024-09-13T18:45:01.354525+0000","last_became_peered":"2024-09-13T18:45:01.354525+0000","last_unstale":"2024-09-13T18:45:05.338749+0000","last_undegraded":"2024-09-13T18:45:05.338749+0000","last_fullsized":"2024-09-13T18:45:05.338749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.153253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":106626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":696482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":106168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:32.505 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:45:32.506 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:45:32.506 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:45:32.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:45:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.701+0000 7f263aa00700 1 Processor -- start 2024-09-13T18:45:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.701+0000 7f263aa00700 1 -- start start 2024-09-13T18:45:32.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f263aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f263415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f263aa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f263415d8f0 0x7f2634156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f263aa00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2634072370 con 0x7f26340cb860 2024-09-13T18:45:32.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f263aa00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263415dd00 con 0x7f263415d8f0 2024-09-13T18:45:32.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f263aa00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340aa1a0 con 0x7f263415cfd0 2024-09-13T18:45:32.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2638c00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f26340cb860 0x7f26340c8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55716/0 (socket says 172.21.15.32:55716) 2024-09-13T18:45:32.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2639600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f263415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2638c00700 1 -- 172.21.15.32:0/687591508 learned_addr learned my addr 172.21.15.32:0/687591508 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:32.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f263a000700 1 --2- 172.21.15.32:0/687591508 >> v2:172.21.15.32:3300/0 conn(0x7f263415d8f0 0x7f2634156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2639600700 1 -- 172.21.15.32:0/687591508 >> v2:172.21.15.32:3300/0 conn(0x7f263415d8f0 msgr2=0x7f2634156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:32.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2639600700 1 --2- 172.21.15.32:0/687591508 >> v2:172.21.15.32:3300/0 conn(0x7f263415d8f0 0x7f2634156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2639600700 1 -- 172.21.15.32:0/687591508 >> v1:172.21.15.32:6789/0 conn(0x7f26340cb860 legacy=0x7f26340c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2639600700 1 -- 172.21.15.32:0/687591508 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340a9d00 con 0x7f263415cfd0 2024-09-13T18:45:32.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2633e00700 1 -- 172.21.15.32:0/687591508 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229316759 0 0) 0x7f2634072370 con 0x7f26340cb860 2024-09-13T18:45:32.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2639600700 1 --2- 172.21.15.32:0/687591508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f263415d3b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2628009850 tx=0x7f2628009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1546359713e4775 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2633e00700 1 -- 172.21.15.32:0/687591508 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628011830 con 0x7f263415cfd0 2024-09-13T18:45:32.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2633e00700 1 -- 172.21.15.32:0/687591508 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628011990 con 0x7f263415cfd0 2024-09-13T18:45:32.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.705+0000 7f2633e00700 1 -- 172.21.15.32:0/687591508 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628011d20 con 0x7f263415cfd0 2024-09-13T18:45:32.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 -- 172.21.15.32:0/687591508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 msgr2=0x7f263415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 --2- 172.21.15.32:0/687591508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f263415d3b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2628009850 tx=0x7f2628009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:32.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 -- 172.21.15.32:0/687591508 shutdown_connections 2024-09-13T18:45:32.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 --2- 172.21.15.32:0/687591508 >> v2:172.21.15.32:3300/0 conn(0x7f263415d8f0 0x7f2634156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 --2- 172.21.15.32:0/687591508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f263415d3b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 -- 172.21.15.32:0/687591508 >> 172.21.15.32:0/687591508 conn(0x7f26340cad40 msgr2=0x7f26340cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 -- 172.21.15.32:0/687591508 shutdown_connections 2024-09-13T18:45:32.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 -- 172.21.15.32:0/687591508 wait complete. 2024-09-13T18:45:32.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 Processor -- start 2024-09-13T18:45:32.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.709+0000 7f263aa00700 1 -- start start 2024-09-13T18:45:32.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 0x7f2634159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f26340c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 0x7f26341554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26341eecb0 con 0x7f263415d8f0 2024-09-13T18:45:32.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26340bfd60 con 0x7f26340cb860 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26341f0120 con 0x7f263415cfd0 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 0x7f26341554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2639600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 0x7f2634159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2639600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 0x7f2634159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37336/0 (socket says 172.21.15.32:37336) 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 0x7f26341554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48966/0 (socket says 172.21.15.32:48966) 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2639600700 1 -- 172.21.15.32:0/257038712 learned_addr learned my addr 172.21.15.32:0/257038712 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:32.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2638c00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f26340c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 -- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 msgr2=0x7f26340c0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f26340c0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 -- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 msgr2=0x7f2634159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 0x7f2634159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 -- 172.21.15.32:0/257038712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280094b0 con 0x7f263415d8f0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2639600700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 0x7f2634159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263a000700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 0x7f26341554f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f262c007d90 tx=0x7f262c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c018070 con 0x7f263415d8f0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00eb30 con 0x7f263415d8f0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26341eeec0 con 0x7f263415d8f0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c003a40 con 0x7f263415d8f0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.713+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26340c0290 con 0x7f263415d8f0 2024-09-13T18:45:32.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.717+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26340747e0 con 0x7f263415d8f0 2024-09-13T18:45:32.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.717+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f262c014420 con 0x7f263415d8f0 2024-09-13T18:45:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.717+0000 7f2631600700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2614066730 0x7f2614068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.717+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f262c0842e0 con 0x7f263415d8f0 2024-09-13T18:45:32.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.717+0000 7f2639600700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2614066730 0x7f2614068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:32.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.721+0000 7f2639600700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2614066730 0x7f2614068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2628009ba0 tx=0x7f2628008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:32.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.725+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f262c0513f0 con 0x7f263415d8f0 2024-09-13T18:45:32.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.941+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2634073c10 con 0x7f263415d8f0 2024-09-13T18:45:32.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f2631600700 1 -- 172.21.15.32:0/257038712 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f262c054a10 con 0x7f263415d8f0 2024-09-13T18:45:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:32.951 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:45:32.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2614066730 msgr2=0x7f2614068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2614066730 0x7f2614068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2628009ba0 tx=0x7f2628008030 comp rx=0 tx=0).stop 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 msgr2=0x7f26341554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 0x7f26341554f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f262c007d90 tx=0x7f262c00e3c0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 shutdown_connections 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2614066730 0x7f2614068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f263415d8f0 0x7f26341554f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f263415cfd0 0x7f26340c0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 --2- 172.21.15.32:0/257038712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26340cb860 0x7f2634159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 >> 172.21.15.32:0/257038712 conn(0x7f26340cad40 msgr2=0x7f26340c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:32.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 shutdown_connections 2024-09-13T18:45:32.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:32.945+0000 7f263aa00700 1 -- 172.21.15.32:0/257038712 wait complete. 2024-09-13T18:45:32.976 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:45:32.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.149+0000 7fc71b600700 1 Processor -- start 2024-09-13T18:45:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.149+0000 7fc71b600700 1 -- start start 2024-09-13T18:45:33.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc71b600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7140aa230 0x7fc7140cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc71b600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7140caa20 0x7fc714071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc71b600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7140c9420 con 0x7fc7140aa610 2024-09-13T18:45:33.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc71b600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140c9140 con 0x7fc7140aa230 2024-09-13T18:45:33.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc71b600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140a95c0 con 0x7fc7140caa20 2024-09-13T18:45:33.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc718c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7140aa230 0x7fc7140cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7140caa20 0x7fc714071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc718c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7140aa230 0x7fc7140cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48974/0 (socket says 172.21.15.32:48974) 2024-09-13T18:45:33.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc719600700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fc7140aa610 0x7fc71415b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51374/0 (socket says 172.21.15.32:51374) 2024-09-13T18:45:33.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc718c00700 1 -- 172.21.15.32:0/2071020779 learned_addr learned my addr 172.21.15.32:0/2071020779 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:33.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc7140caa20 0x7fc714071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37344/0 (socket says 172.21.15.32:37344) 2024-09-13T18:45:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 -- 172.21.15.32:0/2071020779 >> v2:172.21.15.32:3300/0 conn(0x7fc7140aa230 msgr2=0x7fc7140cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 --2- 172.21.15.32:0/2071020779 >> v2:172.21.15.32:3300/0 conn(0x7fc7140aa230 0x7fc7140cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713400700 1 -- 172.21.15.32:0/2071020779 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679998454 0 0) 0x7fc7140c9420 con 0x7fc7140aa610 2024-09-13T18:45:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 -- 172.21.15.32:0/2071020779 >> v1:172.21.15.86:6789/0 conn(0x7fc7140aa610 legacy=0x7fc71415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 -- 172.21.15.32:0/2071020779 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7140a98a0 con 0x7fc7140caa20 2024-09-13T18:45:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713e00700 1 --2- 172.21.15.32:0/2071020779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140caa20 0x7fc714071dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc714155490 tx=0x7fc700009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4642b74d7316f392 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713400700 1 -- 172.21.15.32:0/2071020779 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700011830 con 0x7fc7140caa20 2024-09-13T18:45:33.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713400700 1 -- 172.21.15.32:0/2071020779 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700011990 con 0x7fc7140caa20 2024-09-13T18:45:33.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.153+0000 7fc713400700 1 -- 172.21.15.32:0/2071020779 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700011d20 con 0x7fc7140caa20 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 -- 172.21.15.32:0/2071020779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140caa20 msgr2=0x7fc714071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 --2- 172.21.15.32:0/2071020779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140caa20 0x7fc714071dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc714155490 tx=0x7fc700009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 -- 172.21.15.32:0/2071020779 shutdown_connections 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 --2- 172.21.15.32:0/2071020779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140caa20 0x7fc714071dd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 --2- 172.21.15.32:0/2071020779 >> v2:172.21.15.32:3300/0 conn(0x7fc7140aa230 0x7fc7140cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 -- 172.21.15.32:0/2071020779 >> 172.21.15.32:0/2071020779 conn(0x7fc714071240 msgr2=0x7fc71406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 -- 172.21.15.32:0/2071020779 shutdown_connections 2024-09-13T18:45:33.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 -- 172.21.15.32:0/2071020779 wait complete. 2024-09-13T18:45:33.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.157+0000 7fc71b600700 1 Processor -- start 2024-09-13T18:45:33.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 -- start start 2024-09-13T18:45:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7140aa230 0x7fc7140aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140aa610 0x7fc7141f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 0x7fc7141f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140abe80 con 0x7fc7140caa20 2024-09-13T18:45:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71415a8f0 con 0x7fc7140aa610 2024-09-13T18:45:33.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140ac090 con 0x7fc7140aa230 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 0x7fc7141f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 0x7fc7141f0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48976/0 (socket says 172.21.15.32:48976) 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 -- 172.21.15.32:0/1454372907 learned_addr learned my addr 172.21.15.32:0/1454372907 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc713e00700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140aa610 0x7fc7141f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc718c00700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7140aa230 0x7fc7140aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 -- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7140aa230 msgr2=0x7fc7140aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7140aa230 0x7fc7140aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 -- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140aa610 msgr2=0x7fc7141f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140aa610 0x7fc7141f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 -- 172.21.15.32:0/1454372907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000094b0 con 0x7fc7140caa20 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc718c00700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7140aa230 0x7fc7140aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc719600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 0x7fc7141f0670 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00cc70 tx=0x7fc70c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00ab50 con 0x7fc7140caa20 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c00acd0 con 0x7fc7140caa20 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c007310 con 0x7fc7140caa20 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7140ac370 con 0x7fc7140caa20 2024-09-13T18:45:33.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.161+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7140ac930 con 0x7fc7140caa20 2024-09-13T18:45:33.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.165+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7140cb0c0 con 0x7fc7140caa20 2024-09-13T18:45:33.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.165+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc70c007470 con 0x7fc7140caa20 2024-09-13T18:45:33.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.165+0000 7fc710c00700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc6f4066730 0x7fc6f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.165+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc70c0840b0 con 0x7fc7140caa20 2024-09-13T18:45:33.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.169+0000 7fc718c00700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc6f4066730 0x7fc6f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.169+0000 7fc718c00700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc6f4066730 0x7fc6f4068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc708009c40 tx=0x7fc708008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.173+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc70c051000 con 0x7fc7140caa20 2024-09-13T18:45:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.385+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7140c8d00 con 0x7fc7140caa20 2024-09-13T18:45:33.391 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.389+0000 7fc710c00700 1 -- 172.21.15.32:0/1454372907 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fc70c018020 con 0x7fc7140caa20 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:33.392 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.389+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc6f4066730 msgr2=0x7fc6f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc6f4066730 0x7fc6f4068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc708009c40 tx=0x7fc708008040 comp rx=0 tx=0).stop 2024-09-13T18:45:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 msgr2=0x7fc7141f0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 0x7fc7141f0670 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00cc70 tx=0x7fc70c00cf80 comp rx=0 tx=0).stop 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 shutdown_connections 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc6f4066730 0x7fc6f4068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7140caa20 0x7fc7141f0670 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7140aa610 0x7fc7141f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 --2- 172.21.15.32:0/1454372907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7140aa230 0x7fc7140aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 >> 172.21.15.32:0/1454372907 conn(0x7fc714071240 msgr2=0x7fc7140c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 shutdown_connections 2024-09-13T18:45:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.393+0000 7fc71b600700 1 -- 172.21.15.32:0/1454372907 wait complete. 2024-09-13T18:45:33.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:33.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:33.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.605+0000 7f4fb1e00700 1 Processor -- start 2024-09-13T18:45:33.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb1e00700 1 -- start start 2024-09-13T18:45:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb1e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4fac15d2f0 0x7f4fac0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb1e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0c8370 con 0x7f4fac0c8f10 2024-09-13T18:45:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb1e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0c8650 con 0x7f4fac153840 2024-09-13T18:45:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb1e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac06b810 con 0x7f4fac15d2f0 2024-09-13T18:45:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fabe00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4fac0c8f10 0x7f4fac15cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55730/0 (socket says 172.21.15.32:55730) 2024-09-13T18:45:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fabe00700 1 -- 172.21.15.32:0/2586103152 learned_addr learned my addr 172.21.15.32:0/2586103152 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb0a00700 1 --1- 172.21.15.32:0/2586103152 >> v1:172.21.15.86:6789/0 conn(0x7f4fac153840 0x7f4fac0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51378/0 (socket says 172.21.15.32:51378) 2024-09-13T18:45:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.609+0000 7f4fb1400700 1 --2- 172.21.15.32:0/2586103152 >> v2:172.21.15.86:3300/0 conn(0x7f4fac15d2f0 0x7f4fac0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280021913 0 0) 0x7f4fac0c8370 con 0x7f4fac0c8f10 2024-09-13T18:45:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f940035d0 con 0x7f4fac0c8f10 2024-09-13T18:45:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433336237 0 0) 0x7f4fac0c8650 con 0x7f4fac153840 2024-09-13T18:45:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac0c8370 con 0x7f4fac153840 2024-09-13T18:45:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1400700 1 -- 172.21.15.32:0/2586103152 >> v1:172.21.15.86:6789/0 conn(0x7f4fac153840 legacy=0x7f4fac0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1400700 1 -- 172.21.15.32:0/2586103152 >> v1:172.21.15.32:6789/0 conn(0x7f4fac0c8f10 legacy=0x7f4fac15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1400700 1 -- 172.21.15.32:0/2586103152 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac06ae70 con 0x7f4fac15d2f0 2024-09-13T18:45:33.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1400700 1 --2- 172.21.15.32:0/2586103152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac15d2f0 0x7f4fac0c93e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009d90 tx=0x7f4fa400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6e5d92dbcca8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400e070 con 0x7f4fac15d2f0 2024-09-13T18:45:33.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa400bb20 con 0x7f4fac15d2f0 2024-09-13T18:45:33.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fab400700 1 -- 172.21.15.32:0/2586103152 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4012430 con 0x7f4fac15d2f0 2024-09-13T18:45:33.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 -- 172.21.15.32:0/2586103152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac15d2f0 msgr2=0x7f4fac0c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/2586103152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac15d2f0 0x7f4fac0c93e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009d90 tx=0x7f4fa400b330 comp rx=0 tx=0).stop 2024-09-13T18:45:33.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 -- 172.21.15.32:0/2586103152 shutdown_connections 2024-09-13T18:45:33.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/2586103152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac15d2f0 0x7f4fac0c93e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 -- 172.21.15.32:0/2586103152 >> 172.21.15.32:0/2586103152 conn(0x7f4fac071740 msgr2=0x7f4fac071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 -- 172.21.15.32:0/2586103152 shutdown_connections 2024-09-13T18:45:33.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.613+0000 7f4fb1e00700 1 -- 172.21.15.32:0/2586103152 wait complete. 2024-09-13T18:45:33.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 Processor -- start 2024-09-13T18:45:33.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 -- start start 2024-09-13T18:45:33.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fac0c8f10 0x7f4fac1e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 0x7f4fac150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fac145340 0x7f4fac1457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac140930 con 0x7f4fac0c8f10 2024-09-13T18:45:33.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac145d30 con 0x7f4fac153840 2024-09-13T18:45:33.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0cba80 con 0x7f4fac145340 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 0x7f4fac150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fac0c8f10 0x7f4fac1e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 0x7f4fac150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37360/0 (socket says 172.21.15.32:37360) 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 -- 172.21.15.32:0/4000588220 learned_addr learned my addr 172.21.15.32:0/4000588220 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fb1400700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fac145340 0x7f4fac1457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 -- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fac145340 msgr2=0x7f4fac1457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fac145340 0x7f4fac1457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 -- 172.21.15.32:0/4000588220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fac0c8f10 msgr2=0x7f4fac1e3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fac0c8f10 0x7f4fac1e3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.617+0000 7f4fabe00700 1 -- 172.21.15.32:0/4000588220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009a70 con 0x7f4fac153840 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fabe00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 0x7f4fac150350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800c5c0 tx=0x7f4f9800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98005d90 con 0x7f4fac153840 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac0cbd00 con 0x7f4fac153840 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980070d0 con 0x7f4fac153840 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98007440 con 0x7f4fac153840 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac144b40 con 0x7f4fac153840 2024-09-13T18:45:33.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.621+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac0c2a50 con 0x7f4fac153840 2024-09-13T18:45:33.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.625+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f980075a0 con 0x7f4fac153840 2024-09-13T18:45:33.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.625+0000 7f4fa8c00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4f8c066730 0x7f4f8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:33.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.625+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f98083db0 con 0x7f4fac153840 2024-09-13T18:45:33.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.625+0000 7f4fb0a00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4f8c066730 0x7f4f8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:33.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.625+0000 7f4fb0a00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4f8c066730 0x7f4f8c068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0007fd0 tx=0x7f4fa0007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:33.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.637+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f98050e30 con 0x7f4fac153840 2024-09-13T18:45:33.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.817+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fac153c20 con 0x7f4fac153840 2024-09-13T18:45:33.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.817+0000 7f4fa8c00700 1 -- 172.21.15.32:0/4000588220 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f98017020 con 0x7f4fac153840 2024-09-13T18:45:33.821 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4f8c066730 msgr2=0x7f4f8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4f8c066730 0x7f4f8c068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0007fd0 tx=0x7f4fa0007de0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 msgr2=0x7f4fac150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 0x7f4fac150350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800c5c0 tx=0x7f4f9800c8d0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 shutdown_connections 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4f8c066730 0x7f4f8c068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4fac145340 0x7f4fac1457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fac153840 0x7f4fac150350 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 --2- 172.21.15.32:0/4000588220 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4fac0c8f10 0x7f4fac1e3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:33.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.821+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 >> 172.21.15.32:0/4000588220 conn(0x7f4fac071740 msgr2=0x7f4fac0c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:33.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.825+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 shutdown_connections 2024-09-13T18:45:33.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:33.825+0000 7f4fb1e00700 1 -- 172.21.15.32:0/4000588220 wait complete. 2024-09-13T18:45:33.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:34.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.025+0000 7fcd3a600700 1 Processor -- start 2024-09-13T18:45:34.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd3a600700 1 -- start start 2024-09-13T18:45:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd3a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340722f0 0x7fcd340c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd3a600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd340726d0 0x7fcd341515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd3a600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd340c6d90 con 0x7fcd340c7990 2024-09-13T18:45:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd3a600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340c7f20 con 0x7fcd340726d0 2024-09-13T18:45:34.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd3a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3415aeb0 con 0x7fcd340722f0 2024-09-13T18:45:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd32a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd340726d0 0x7fcd341515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd33400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340722f0 0x7fcd340c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd33e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcd340c7990 0x7fcd34157910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55744/0 (socket says 172.21.15.32:55744) 2024-09-13T18:45:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd32a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd340726d0 0x7fcd341515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37372/0 (socket says 172.21.15.32:37372) 2024-09-13T18:45:34.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.029+0000 7fcd33e00700 1 -- 172.21.15.32:0/1651532116 learned_addr learned my addr 172.21.15.32:0/1651532116 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32a00700 1 -- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340722f0 msgr2=0x7fcd340c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32a00700 1 --2- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340722f0 0x7fcd340c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32a00700 1 -- 172.21.15.32:0/1651532116 >> v1:172.21.15.32:6789/0 conn(0x7fcd340c7990 legacy=0x7fcd34157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32a00700 1 -- 172.21.15.32:0/1651532116 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3415b150 con 0x7fcd340726d0 2024-09-13T18:45:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32a00700 1 --2- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340726d0 0x7fcd341515d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009880 tx=0x7fcd20009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb886db5e5979c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32000700 1 -- 172.21.15.32:0/1651532116 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20011830 con 0x7fcd340726d0 2024-09-13T18:45:34.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32000700 1 -- 172.21.15.32:0/1651532116 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20011990 con 0x7fcd340726d0 2024-09-13T18:45:34.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd32000700 1 -- 172.21.15.32:0/1651532116 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20011d20 con 0x7fcd340726d0 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 -- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340726d0 msgr2=0x7fcd341515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 --2- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340726d0 0x7fcd341515d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009880 tx=0x7fcd20009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 -- 172.21.15.32:0/1651532116 shutdown_connections 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 --2- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340726d0 0x7fcd341515d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 --2- 172.21.15.32:0/1651532116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340722f0 0x7fcd340c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 -- 172.21.15.32:0/1651532116 >> 172.21.15.32:0/1651532116 conn(0x7fcd340c8bd0 msgr2=0x7fcd340c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 -- 172.21.15.32:0/1651532116 shutdown_connections 2024-09-13T18:45:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.033+0000 7fcd3a600700 1 -- 172.21.15.32:0/1651532116 wait complete. 2024-09-13T18:45:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.037+0000 7fcd3a600700 1 Processor -- start 2024-09-13T18:45:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.037+0000 7fcd3a600700 1 -- start start 2024-09-13T18:45:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 0x7fcd340cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340726d0 0x7fcd341f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340c7990 0x7fcd3414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34155030 con 0x7fcd340722f0 2024-09-13T18:45:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34154820 con 0x7fcd340c7990 2024-09-13T18:45:34.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34157410 con 0x7fcd340726d0 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 0x7fcd340cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340c7990 0x7fcd3414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 0x7fcd340cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:48988/0 (socket says 172.21.15.32:48988) 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 -- 172.21.15.32:0/149404244 learned_addr learned my addr 172.21.15.32:0/149404244 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd32a00700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340726d0 0x7fcd341f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 -- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340726d0 msgr2=0x7fcd341f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340726d0 0x7fcd341f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 -- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340c7990 msgr2=0x7fcd3414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340c7990 0x7fcd3414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 -- 172.21.15.32:0/149404244 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200094b0 con 0x7fcd340722f0 2024-09-13T18:45:34.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd33400700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 0x7fcd340cb910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400e9d0 tx=0x7fcd2400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24009720 con 0x7fcd340722f0 2024-09-13T18:45:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2400ee70 con 0x7fcd340722f0 2024-09-13T18:45:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd34154a70 con 0x7fcd340722f0 2024-09-13T18:45:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2400ca50 con 0x7fcd340722f0 2024-09-13T18:45:34.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.041+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd34070600 con 0x7fcd340722f0 2024-09-13T18:45:34.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.045+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd340cb290 con 0x7fcd340722f0 2024-09-13T18:45:34.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.045+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd2400cbb0 con 0x7fcd340722f0 2024-09-13T18:45:34.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.049+0000 7fcd2b400700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcd14066730 0x7fcd14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.049+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd240844b0 con 0x7fcd340722f0 2024-09-13T18:45:34.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.049+0000 7fcd32a00700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcd14066730 0x7fcd14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.049+0000 7fcd32a00700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcd14066730 0x7fcd14068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009880 tx=0x7fcd20008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.057+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd340cb290 con 0x7fcd340722f0 2024-09-13T18:45:34.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.241+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd340cb760 con 0x7fcd340722f0 2024-09-13T18:45:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd2b400700 1 -- 172.21.15.32:0/149404244 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd24051520 con 0x7fcd340722f0 2024-09-13T18:45:34.247 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcd14066730 msgr2=0x7fcd14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcd14066730 0x7fcd14068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009880 tx=0x7fcd20008030 comp rx=0 tx=0).stop 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 msgr2=0x7fcd340cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 0x7fcd340cb910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400e9d0 tx=0x7fcd2400ece0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 shutdown_connections 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcd14066730 0x7fcd14068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd340c7990 0x7fcd3414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd340726d0 0x7fcd341f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 --2- 172.21.15.32:0/149404244 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd340722f0 0x7fcd340cb910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.245+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 >> 172.21.15.32:0/149404244 conn(0x7fcd340c8bd0 msgr2=0x7fcd340c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.249+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 shutdown_connections 2024-09-13T18:45:34.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.249+0000 7fcd3a600700 1 -- 172.21.15.32:0/149404244 wait complete. 2024-09-13T18:45:34.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.449+0000 7f79cbe00700 1 Processor -- start 2024-09-13T18:45:34.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.449+0000 7f79cbe00700 1 -- start start 2024-09-13T18:45:34.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f79cc06ea50 0x7f79cc15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79cc0c9440 con 0x7f79cc0c9e90 2024-09-13T18:45:34.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0c9a70 con 0x7f79cc06ea50 2024-09-13T18:45:34.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0c7aa0 con 0x7f79cc06fac0 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79caa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f79cc06ea50 0x7f79cc15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79ca000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f79cc0c9e90 0x7f79cc0ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51392/0 (socket says 172.21.15.32:51392) 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79ca000700 1 -- 172.21.15.32:0/23580666 learned_addr learned my addr 172.21.15.32:0/23580666 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cb400700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79c9600700 1 -- 172.21.15.32:0/23580666 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156767114 0 0) 0x7f79cc0c9440 con 0x7f79cc0c9e90 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79c9600700 1 -- 172.21.15.32:0/23580666 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b00035d0 con 0x7f79cc0c9e90 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79caa00700 1 -- 172.21.15.32:0/23580666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 msgr2=0x7f79cc06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:34.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79caa00700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc06ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79caa00700 1 -- 172.21.15.32:0/23580666 >> v1:172.21.15.86:6789/0 conn(0x7f79cc0c9e90 legacy=0x7f79cc0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79caa00700 1 -- 172.21.15.32:0/23580666 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc0c7d60 con 0x7f79cc06ea50 2024-09-13T18:45:34.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cb400700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:34.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79caa00700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc06ea50 0x7f79cc15aa70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009850 tx=0x7f79bc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f47a88bd5fdfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79c9600700 1 -- 172.21.15.32:0/23580666 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc011830 con 0x7f79cc06ea50 2024-09-13T18:45:34.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79c9600700 1 -- 172.21.15.32:0/23580666 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc011990 con 0x7f79cc06ea50 2024-09-13T18:45:34.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79c9600700 1 -- 172.21.15.32:0/23580666 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc011d40 con 0x7f79cc06ea50 2024-09-13T18:45:34.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- 172.21.15.32:0/23580666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc06ea50 msgr2=0x7f79cc15aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc06ea50 0x7f79cc15aa70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009850 tx=0x7f79bc009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- 172.21.15.32:0/23580666 shutdown_connections 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 --2- 172.21.15.32:0/23580666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc06ea50 0x7f79cc15aa70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- 172.21.15.32:0/23580666 >> 172.21.15.32:0/23580666 conn(0x7f79cc0cac60 msgr2=0x7f79cc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.453+0000 7f79cbe00700 1 -- 172.21.15.32:0/23580666 shutdown_connections 2024-09-13T18:45:34.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.457+0000 7f79cbe00700 1 -- 172.21.15.32:0/23580666 wait complete. 2024-09-13T18:45:34.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.457+0000 7f79cbe00700 1 Processor -- start 2024-09-13T18:45:34.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.457+0000 7f79cbe00700 1 -- start start 2024-09-13T18:45:34.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.457+0000 7f79cbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79cc06ea50 0x7f79cc150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.457+0000 7f79cbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc1efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cbe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 0x7f79cc1f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cbe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0c2d90 con 0x7f79cc0c9e90 2024-09-13T18:45:34.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cbe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0c2010 con 0x7f79cc06ea50 2024-09-13T18:45:34.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0afe30 con 0x7f79cc06fac0 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 0x7f79cc1f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 0x7f79cc1f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49000/0 (socket says 172.21.15.32:49000) 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 -- 172.21.15.32:0/1949129769 learned_addr learned my addr 172.21.15.32:0/1949129769 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79caa00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79cc06ea50 0x7f79cc150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79ca000700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc1efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 -- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 msgr2=0x7f79cc1efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc1efaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 -- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79cc06ea50 msgr2=0x7f79cc150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79cc06ea50 0x7f79cc150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 -- 172.21.15.32:0/1949129769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009a70 con 0x7f79cc0c9e90 2024-09-13T18:45:34.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cb400700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 0x7f79cc1f0030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79c400efc0 tx=0x7f79c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400ca90 con 0x7f79cc0c9e90 2024-09-13T18:45:34.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c400f040 con 0x7f79cc0c9e90 2024-09-13T18:45:34.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc0094b0 con 0x7f79cc0c9e90 2024-09-13T18:45:34.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400ce10 con 0x7f79cc0c9e90 2024-09-13T18:45:34.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.461+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc0c22b0 con 0x7f79cc0c9e90 2024-09-13T18:45:34.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.465+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc06ee30 con 0x7f79cc0c9e90 2024-09-13T18:45:34.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.465+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79c4014480 con 0x7f79cc0c9e90 2024-09-13T18:45:34.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.465+0000 7f79c2a00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f79ac066760 0x7f79ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.465+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79c4084be0 con 0x7f79cc0c9e90 2024-09-13T18:45:34.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.465+0000 7f79caa00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f79ac066760 0x7f79ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.469+0000 7f79caa00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f79ac066760 0x7f79ac068c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0090b0 tx=0x7f79bc008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.473+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79c4051b30 con 0x7f79cc0c9e90 2024-09-13T18:45:34.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.661+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79cc15af60 con 0x7f79cc0c9e90 2024-09-13T18:45:34.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.661+0000 7f79c2a00700 1 -- 172.21.15.32:0/1949129769 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79c40180a0 con 0x7f79cc0c9e90 2024-09-13T18:45:34.665 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-09-13T18:45:34.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.665+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f79ac066760 msgr2=0x7f79ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f79ac066760 0x7f79ac068c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0090b0 tx=0x7f79bc008030 comp rx=0 tx=0).stop 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 msgr2=0x7f79cc1f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 0x7f79cc1f0030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79c400efc0 tx=0x7f79c400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 shutdown_connections 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f79ac066760 0x7f79ac068c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f79cc0c9e90 0x7f79cc1f0030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79cc06fac0 0x7f79cc1efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 --2- 172.21.15.32:0/1949129769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79cc06ea50 0x7f79cc150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 >> 172.21.15.32:0/1949129769 conn(0x7f79cc0cac60 msgr2=0x7f79cc154260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 shutdown_connections 2024-09-13T18:45:34.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.669+0000 7f79cbe00700 1 -- 172.21.15.32:0/1949129769 wait complete. 2024-09-13T18:45:34.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.865+0000 7ff116e00700 1 Processor -- start 2024-09-13T18:45:34.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.865+0000 7ff116e00700 1 -- start start 2024-09-13T18:45:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.865+0000 7ff116e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff110151a60 0x7ff1100ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.865+0000 7ff116e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11015aa50 con 0x7ff1100cd470 2024-09-13T18:45:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.865+0000 7ff116e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100cd880 con 0x7ff110151680 2024-09-13T18:45:34.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.865+0000 7ff116e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11015aca0 con 0x7ff110151a60 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff115000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff110151a60 0x7ff1100ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff1100cd470 0x7ff110157a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55754/0 (socket says 172.21.15.32:55754) 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116400700 1 -- 172.21.15.32:0/81420159 learned_addr learned my addr 172.21.15.32:0/81420159 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff115a00700 1 --1- 172.21.15.32:0/81420159 >> v1:172.21.15.86:6789/0 conn(0x7ff110151680 0x7ff11006b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51406/0 (socket says 172.21.15.32:51406) 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff115000700 1 -- 172.21.15.32:0/81420159 >> v1:172.21.15.86:6789/0 conn(0x7ff110151680 legacy=0x7ff11006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff115000700 1 -- 172.21.15.32:0/81420159 >> v1:172.21.15.32:6789/0 conn(0x7ff1100cd470 legacy=0x7ff110157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff115000700 1 -- 172.21.15.32:0/81420159 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11015af80 con 0x7ff110151a60 2024-09-13T18:45:34.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff10fe00700 1 -- 172.21.15.32:0/81420159 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794640453 0 0) 0x7ff11015aa50 con 0x7ff1100cd470 2024-09-13T18:45:34.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff115000700 1 --2- 172.21.15.32:0/81420159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff110151a60 0x7ff1100ccf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009850 tx=0x7ff0fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1637b906efca6977 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff10fe00700 1 -- 172.21.15.32:0/81420159 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011830 con 0x7ff110151a60 2024-09-13T18:45:34.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff10fe00700 1 -- 172.21.15.32:0/81420159 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc011990 con 0x7ff110151a60 2024-09-13T18:45:34.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff10fe00700 1 -- 172.21.15.32:0/81420159 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011d20 con 0x7ff110151a60 2024-09-13T18:45:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 -- 172.21.15.32:0/81420159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff110151a60 msgr2=0x7ff1100ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 --2- 172.21.15.32:0/81420159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff110151a60 0x7ff1100ccf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009850 tx=0x7ff0fc009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 -- 172.21.15.32:0/81420159 shutdown_connections 2024-09-13T18:45:34.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 --2- 172.21.15.32:0/81420159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff110151a60 0x7ff1100ccf30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 -- 172.21.15.32:0/81420159 >> 172.21.15.32:0/81420159 conn(0x7ff110071740 msgr2=0x7ff110071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 -- 172.21.15.32:0/81420159 shutdown_connections 2024-09-13T18:45:34.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.869+0000 7ff116e00700 1 -- 172.21.15.32:0/81420159 wait complete. 2024-09-13T18:45:34.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 Processor -- start 2024-09-13T18:45:34.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 -- start start 2024-09-13T18:45:34.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1100cd470 0x7ff1101f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 0x7ff110150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1101e12e0 0x7ff110150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101e1950 con 0x7ff110151680 2024-09-13T18:45:34.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100714b0 con 0x7ff1100cd470 2024-09-13T18:45:34.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff116e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff110152190 con 0x7ff1101e12e0 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.873+0000 7ff115000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 0x7ff110150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff116400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1101e12e0 0x7ff110150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 0x7ff110150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49004/0 (socket says 172.21.15.32:49004) 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 -- 172.21.15.32:0/3256129348 learned_addr learned my addr 172.21.15.32:0/3256129348 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115a00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1100cd470 0x7ff1101f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 -- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1101e12e0 msgr2=0x7ff110150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1101e12e0 0x7ff110150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 -- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1100cd470 msgr2=0x7ff1101f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1100cd470 0x7ff1101f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 -- 172.21.15.32:0/3256129348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0094b0 con 0x7ff110151680 2024-09-13T18:45:34.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff115000700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 0x7ff110150630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c00 tx=0x7ff0fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc004310 con 0x7ff110151680 2024-09-13T18:45:34.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc01f070 con 0x7ff110151680 2024-09-13T18:45:34.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1101f3170 con 0x7ff110151680 2024-09-13T18:45:34.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0036c0 con 0x7ff110151680 2024-09-13T18:45:34.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1101f0540 con 0x7ff110151680 2024-09-13T18:45:34.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.877+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff110157460 con 0x7ff110151680 2024-09-13T18:45:34.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.881+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0fc021030 con 0x7ff110151680 2024-09-13T18:45:34.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.881+0000 7ff10d600700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff0f0066730 0x7ff0f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.881+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0fc085550 con 0x7ff110151680 2024-09-13T18:45:34.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.881+0000 7ff115a00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff0f0066730 0x7ff0f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.885+0000 7ff115a00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff0f0066730 0x7ff0f0068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff104000f60 tx=0x7ff104007ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:34.885+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0fc052530 con 0x7ff110151680 2024-09-13T18:45:35.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.069+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff1100c40b0 con 0x7ff110151680 2024-09-13T18:45:35.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.069+0000 7ff10d600700 1 -- 172.21.15.32:0/3256129348 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff0fc055b50 con 0x7ff110151680 2024-09-13T18:45:35.071 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:35.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff0f0066730 msgr2=0x7ff0f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff0f0066730 0x7ff0f0068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff104000f60 tx=0x7ff104007ef0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 msgr2=0x7ff110150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 0x7ff110150630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c00 tx=0x7ff0fc004770 comp rx=0 tx=0).stop 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 shutdown_connections 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff0f0066730 0x7ff0f0068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1101e12e0 0x7ff110150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff110151680 0x7ff110150630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 --2- 172.21.15.32:0/3256129348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1100cd470 0x7ff1101f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 >> 172.21.15.32:0/3256129348 conn(0x7ff110071740 msgr2=0x7ff11006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 shutdown_connections 2024-09-13T18:45:35.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.073+0000 7ff116e00700 1 -- 172.21.15.32:0/3256129348 wait complete. 2024-09-13T18:45:35.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:35.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 Processor -- start 2024-09-13T18:45:35.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 -- start start 2024-09-13T18:45:35.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 0x7fb9200c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 0x7fb920156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb920072370 con 0x7fb92015cfd0 2024-09-13T18:45:35.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9200c97c0 con 0x7fb9200c9390 2024-09-13T18:45:35.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.273+0000 7fb925e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200aa1a0 con 0x7fb9200cb860 2024-09-13T18:45:35.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb925400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 0x7fb920156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 0x7fb9200c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb925400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 0x7fb920156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49012/0 (socket says 172.21.15.32:49012) 2024-09-13T18:45:35.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 0x7fb9200c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57544/0 (socket says 172.21.15.32:57544) 2024-09-13T18:45:35.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 -- 172.21.15.32:0/882363851 learned_addr learned my addr 172.21.15.32:0/882363851 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:35.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb924a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb92015cfd0 0x7fb92015d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55770/0 (socket says 172.21.15.32:55770) 2024-09-13T18:45:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 -- 172.21.15.32:0/882363851 >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 msgr2=0x7fb920156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 --2- 172.21.15.32:0/882363851 >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 0x7fb920156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 -- 172.21.15.32:0/882363851 >> v1:172.21.15.32:6789/0 conn(0x7fb92015cfd0 legacy=0x7fb92015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 -- 172.21.15.32:0/882363851 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200a9d00 con 0x7fb9200cb860 2024-09-13T18:45:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb925400700 1 --2- 172.21.15.32:0/882363851 >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 0x7fb920156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:35.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91fe00700 1 --2- 172.21.15.32:0/882363851 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 0x7fb9200c8e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009910 tx=0x7fb90c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7bc641683c89ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91f400700 1 -- 172.21.15.32:0/882363851 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c011830 con 0x7fb9200cb860 2024-09-13T18:45:35.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91f400700 1 -- 172.21.15.32:0/882363851 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c011990 con 0x7fb9200cb860 2024-09-13T18:45:35.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb91f400700 1 -- 172.21.15.32:0/882363851 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c011d40 con 0x7fb9200cb860 2024-09-13T18:45:35.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb925e00700 1 -- 172.21.15.32:0/882363851 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 msgr2=0x7fb9200c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.277+0000 7fb925e00700 1 --2- 172.21.15.32:0/882363851 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 0x7fb9200c8e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009910 tx=0x7fb90c009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 -- 172.21.15.32:0/882363851 shutdown_connections 2024-09-13T18:45:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 --2- 172.21.15.32:0/882363851 >> v2:172.21.15.32:3300/0 conn(0x7fb9200c9390 0x7fb920156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 --2- 172.21.15.32:0/882363851 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200cb860 0x7fb9200c8e50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 -- 172.21.15.32:0/882363851 >> 172.21.15.32:0/882363851 conn(0x7fb9200cad40 msgr2=0x7fb9200cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 -- 172.21.15.32:0/882363851 shutdown_connections 2024-09-13T18:45:35.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 -- 172.21.15.32:0/882363851 wait complete. 2024-09-13T18:45:35.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 Processor -- start 2024-09-13T18:45:35.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.281+0000 7fb925e00700 1 -- start start 2024-09-13T18:45:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 0x7fb920123ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 0x7fb9201267d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb92015cfd0 0x7fb9201f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb920126d10 con 0x7fb9200cb860 2024-09-13T18:45:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200c5b80 con 0x7fb92015cfd0 2024-09-13T18:45:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9201f7700 con 0x7fb9200c9390 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 0x7fb9201267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 0x7fb920123ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 0x7fb9201267d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49024/0 (socket says 172.21.15.32:49024) 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91fe00700 1 -- 172.21.15.32:0/274142167 learned_addr learned my addr 172.21.15.32:0/274142167 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 0x7fb920123ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57546/0 (socket says 172.21.15.32:57546) 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925400700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb92015cfd0 0x7fb9201f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 -- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb92015cfd0 msgr2=0x7fb9201f71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb92015cfd0 0x7fb9201f71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 -- 172.21.15.32:0/274142167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 msgr2=0x7fb9201267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 0x7fb9201267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 -- 172.21.15.32:0/274142167 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009a70 con 0x7fb9200c9390 2024-09-13T18:45:35.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91fe00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 0x7fb9201267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:35.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb924a00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 0x7fb920123ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c430 tx=0x7fb91400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914004a90 con 0x7fb9200c9390 2024-09-13T18:45:35.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914004bf0 con 0x7fb9200c9390 2024-09-13T18:45:35.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c009570 con 0x7fb9200c9390 2024-09-13T18:45:35.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140070d0 con 0x7fb9200c9390 2024-09-13T18:45:35.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.285+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92015a920 con 0x7fb9200c9390 2024-09-13T18:45:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.289+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9200a9950 con 0x7fb9200c9390 2024-09-13T18:45:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.289+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb914007230 con 0x7fb9200c9390 2024-09-13T18:45:35.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.293+0000 7fb91cc00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb900066730 0x7fb900068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.293+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9140843e0 con 0x7fb9200c9390 2024-09-13T18:45:35.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.293+0000 7fb91fe00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb900066730 0x7fb900068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.293+0000 7fb91fe00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb900066730 0x7fb900068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9200c7820 tx=0x7fb90c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.297+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb914051440 con 0x7fb9200c9390 2024-09-13T18:45:35.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.521+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9200c8410 con 0x7fb9200c9390 2024-09-13T18:45:35.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb91cc00700 1 -- 172.21.15.32:0/274142167 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fb914054a60 con 0x7fb9200c9390 2024-09-13T18:45:35.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:35.527 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:25.505215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb900066730 msgr2=0x7fb900068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb900066730 0x7fb900068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb9200c7820 tx=0x7fb90c008030 comp rx=0 tx=0).stop 2024-09-13T18:45:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 msgr2=0x7fb920123ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 0x7fb920123ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c430 tx=0x7fb91400c740 comp rx=0 tx=0).stop 2024-09-13T18:45:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 shutdown_connections 2024-09-13T18:45:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb900066730 0x7fb900068bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb92015cfd0 0x7fb9201f71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9200cb860 0x7fb9201267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 --2- 172.21.15.32:0/274142167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9200c9390 0x7fb920123ec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.525+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 >> 172.21.15.32:0/274142167 conn(0x7fb9200cad40 msgr2=0x7fb92015c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.529+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 shutdown_connections 2024-09-13T18:45:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.529+0000 7fb925e00700 1 -- 172.21.15.32:0/274142167 wait complete. 2024-09-13T18:45:35.533 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 10 2024-09-13T18:45:35.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:35.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.725+0000 7fdbbb200700 1 Processor -- start 2024-09-13T18:45:35.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.725+0000 7fdbbb200700 1 -- start start 2024-09-13T18:45:35.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbbb200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdbbc0ca150 0x7fdbbc1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbbb200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc157730 con 0x7fdbbc0c8450 2024-09-13T18:45:35.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbbb200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc157a10 con 0x7fdbbc0c8070 2024-09-13T18:45:35.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbbb200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc157cf0 con 0x7fdbbc0ca150 2024-09-13T18:45:35.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fdbbc0c8070 0x7fdbbc0c9a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51422/0 (socket says 172.21.15.32:51422) 2024-09-13T18:45:35.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9e00700 1 -- 172.21.15.32:0/768784476 learned_addr learned my addr 172.21.15.32:0/768784476 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:35.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbba800700 1 --2- 172.21.15.32:0/768784476 >> v2:172.21.15.32:3300/0 conn(0x7fdbbc0ca150 0x7fdbbc1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305794148 0 0) 0x7fdbbc157a10 con 0x7fdbbc0c8070 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba00035d0 con 0x7fdbbc0c8070 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593318685 0 0) 0x7fdbbc157730 con 0x7fdbbc0c8450 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbbc157a10 con 0x7fdbbc0c8450 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbba800700 1 -- 172.21.15.32:0/768784476 >> v1:172.21.15.86:6789/0 conn(0x7fdbbc0c8070 legacy=0x7fdbbc0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbba800700 1 -- 172.21.15.32:0/768784476 >> v1:172.21.15.32:6789/0 conn(0x7fdbbc0c8450 legacy=0x7fdbbc1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbba800700 1 -- 172.21.15.32:0/768784476 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc157fd0 con 0x7fdbbc0ca150 2024-09-13T18:45:35.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbba800700 1 --2- 172.21.15.32:0/768784476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc1517c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009d90 tx=0x7fdbb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648a8acdf51538ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400e070 con 0x7fdbbc0ca150 2024-09-13T18:45:35.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400bb20 con 0x7fdbbc0ca150 2024-09-13T18:45:35.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.729+0000 7fdbb9400700 1 -- 172.21.15.32:0/768784476 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4012430 con 0x7fdbbc0ca150 2024-09-13T18:45:35.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 -- 172.21.15.32:0/768784476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0ca150 msgr2=0x7fdbbc1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 --2- 172.21.15.32:0/768784476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc1517c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009d90 tx=0x7fdbb400b330 comp rx=0 tx=0).stop 2024-09-13T18:45:35.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 -- 172.21.15.32:0/768784476 shutdown_connections 2024-09-13T18:45:35.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 --2- 172.21.15.32:0/768784476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc1517c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 -- 172.21.15.32:0/768784476 >> 172.21.15.32:0/768784476 conn(0x7fdbbc06c200 msgr2=0x7fdbbc06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 -- 172.21.15.32:0/768784476 shutdown_connections 2024-09-13T18:45:35.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.733+0000 7fdbbb200700 1 -- 172.21.15.32:0/768784476 wait complete. 2024-09-13T18:45:35.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 Processor -- start 2024-09-13T18:45:35.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 -- start start 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbbc0c8070 0x7fdbbc1eee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 0x7fdbbc1ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc151590 con 0x7fdbbc0c8450 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc1f1010 con 0x7fdbbc0ca150 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc1f1540 con 0x7fdbbc0c8070 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 0x7fdbbc1ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 0x7fdbbc1ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49034/0 (socket says 172.21.15.32:49034) 2024-09-13T18:45:35.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 -- 172.21.15.32:0/2523957179 learned_addr learned my addr 172.21.15.32:0/2523957179 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:35.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb9e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbbc0c8070 0x7fdbbc1eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbba800700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 -- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbbc0c8070 msgr2=0x7fdbbc1eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbbc0c8070 0x7fdbbc1eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 -- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbbc0ca150 msgr2=0x7fdbbc14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 -- 172.21.15.32:0/2523957179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009a70 con 0x7fdbbc0c8450 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb9e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbbc0c8070 0x7fdbbc1eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbba800700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb3e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 0x7fdbbc1ef370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c520 tx=0x7fdba400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40052d0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4005430 con 0x7fdbbc0c8450 2024-09-13T18:45:35.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40055a0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc1e46f0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.737+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc1f1260 con 0x7fdbbc0c8450 2024-09-13T18:45:35.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.741+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc06bed0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.741+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdba40038e0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.741+0000 7fdbb2000700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb98066730 0x7fdb98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.745+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdba4083960 con 0x7fdbbc0c8450 2024-09-13T18:45:35.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.745+0000 7fdbb9e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb98066730 0x7fdb98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.745+0000 7fdbb9e00700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb98066730 0x7fdb98068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0011e0 tx=0x7fdbac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.749+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdba40509d0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.945+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbbc15b7c0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbb2000700 1 -- 172.21.15.32:0/2523957179 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7fdba4053ff0 con 0x7fdbbc0c8450 2024-09-13T18:45:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:35.951 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:35.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb98066730 msgr2=0x7fdb98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb98066730 0x7fdb98068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0011e0 tx=0x7fdbac009040 comp rx=0 tx=0).stop 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 msgr2=0x7fdbbc1ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 0x7fdbbc1ef370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c520 tx=0x7fdba400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 shutdown_connections 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb98066730 0x7fdb98068bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbbc0ca150 0x7fdbbc14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbbc0c8450 0x7fdbbc1ef370 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 --2- 172.21.15.32:0/2523957179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbbc0c8070 0x7fdbbc1eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 >> 172.21.15.32:0/2523957179 conn(0x7fdbbc06c200 msgr2=0x7fdbbc150e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 shutdown_connections 2024-09-13T18:45:35.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:35.949+0000 7fdbbb200700 1 -- 172.21.15.32:0/2523957179 wait complete. 2024-09-13T18:45:35.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:45:35.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.153+0000 7f62b1600700 1 Processor -- start 2024-09-13T18:45:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.153+0000 7f62b1600700 1 -- start start 2024-09-13T18:45:36.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62b1600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62ac151ab0 0x7f62ac06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62b1600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62b1600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0c28d0 con 0x7f62ac06ae20 2024-09-13T18:45:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62b1600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac0c4150 con 0x7f62ac151ab0 2024-09-13T18:45:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62b1600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0c2310 con 0x7f62ac0cd0e0 2024-09-13T18:45:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aaa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f62ac151ab0 0x7f62ac06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aa000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f62ac06ae20 0x7f62ac0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51428/0 (socket says 172.21.15.32:51428) 2024-09-13T18:45:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aa000700 1 -- 172.21.15.32:0/3053095748 learned_addr learned my addr 172.21.15.32:0/3053095748 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62ab400700 1 --2- 172.21.15.32:0/3053095748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62a9600700 1 -- 172.21.15.32:0/3053095748 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041073931 0 0) 0x7f62ac0c28d0 con 0x7f62ac06ae20 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62a9600700 1 -- 172.21.15.32:0/3053095748 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62900035d0 con 0x7f62ac06ae20 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aaa00700 1 -- 172.21.15.32:0/3053095748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 msgr2=0x7f62ac0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aaa00700 1 --2- 172.21.15.32:0/3053095748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aaa00700 1 -- 172.21.15.32:0/3053095748 >> v1:172.21.15.86:6789/0 conn(0x7f62ac06ae20 legacy=0x7f62ac0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aaa00700 1 -- 172.21.15.32:0/3053095748 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0c25f0 con 0x7f62ac151ab0 2024-09-13T18:45:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62aaa00700 1 --2- 172.21.15.32:0/3053095748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac151ab0 0x7f62ac06b980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f629c009850 tx=0x7f629c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0a7864f4a4b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62a9600700 1 -- 172.21.15.32:0/3053095748 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011830 con 0x7f62ac151ab0 2024-09-13T18:45:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.157+0000 7f62a9600700 1 -- 172.21.15.32:0/3053095748 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c011990 con 0x7f62ac151ab0 2024-09-13T18:45:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62a9600700 1 -- 172.21.15.32:0/3053095748 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011d00 con 0x7f62ac151ab0 2024-09-13T18:45:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 -- 172.21.15.32:0/3053095748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac151ab0 msgr2=0x7f62ac06b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 --2- 172.21.15.32:0/3053095748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac151ab0 0x7f62ac06b980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f629c009850 tx=0x7f629c009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:36.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 -- 172.21.15.32:0/3053095748 shutdown_connections 2024-09-13T18:45:36.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 --2- 172.21.15.32:0/3053095748 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 --2- 172.21.15.32:0/3053095748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac151ab0 0x7f62ac06b980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 -- 172.21.15.32:0/3053095748 >> 172.21.15.32:0/3053095748 conn(0x7f62ac06eae0 msgr2=0x7f62ac06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 -- 172.21.15.32:0/3053095748 shutdown_connections 2024-09-13T18:45:36.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 -- 172.21.15.32:0/3053095748 wait complete. 2024-09-13T18:45:36.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 Processor -- start 2024-09-13T18:45:36.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.161+0000 7f62b1600700 1 -- start start 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 0x7f62ac1e1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac1f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac151ab0 0x7f62ac1e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac06cd50 con 0x7f62ac06ae20 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac15b710 con 0x7f62ac151ab0 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac06cae0 con 0x7f62ac0cd0e0 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 0x7f62ac1e1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 0x7f62ac1e1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49054/0 (socket says 172.21.15.32:49054) 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 -- 172.21.15.32:0/2775756001 learned_addr learned my addr 172.21.15.32:0/2775756001 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62ab400700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac151ab0 0x7f62ac1e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aa000700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac1f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 -- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 msgr2=0x7f62ac1f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac1f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 -- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac151ab0 msgr2=0x7f62ac1e09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac151ab0 0x7f62ac1e09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 -- 172.21.15.32:0/2775756001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0094b0 con 0x7f62ac06ae20 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62aaa00700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 0x7f62ac1e1da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f629c0090b0 tx=0x7f629c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c004450 con 0x7f62ac06ae20 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c01e070 con 0x7f62ac06ae20 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac15b920 con 0x7f62ac06ae20 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c003900 con 0x7f62ac06ae20 2024-09-13T18:45:36.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.165+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac0cca60 con 0x7f62ac06ae20 2024-09-13T18:45:36.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.169+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac1e6860 con 0x7f62ac06ae20 2024-09-13T18:45:36.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.169+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f629c003a60 con 0x7f62ac06ae20 2024-09-13T18:45:36.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.173+0000 7f62a2a00700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f628c066730 0x7f628c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.173+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f629c0851a0 con 0x7f62ac06ae20 2024-09-13T18:45:36.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.173+0000 7f62aa000700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f628c066730 0x7f628c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.173+0000 7f62aa000700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f628c066730 0x7f628c068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0c5ea0 tx=0x7f6298007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.181+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62ac1e6860 con 0x7f62ac06ae20 2024-09-13T18:45:36.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.361+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62ac15bb00 con 0x7f62ac06ae20 2024-09-13T18:45:36.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.361+0000 7f62a2a00700 1 -- 172.21.15.32:0/2775756001 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f629c052210 con 0x7f62ac06ae20 2024-09-13T18:45:36.366 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:45:36.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f628c066730 msgr2=0x7f628c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f628c066730 0x7f628c068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0c5ea0 tx=0x7f6298007de0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 msgr2=0x7f62ac1e1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 0x7f62ac1e1da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f629c0090b0 tx=0x7f629c004770 comp rx=0 tx=0).stop 2024-09-13T18:45:36.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 shutdown_connections 2024-09-13T18:45:36.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f628c066730 0x7f628c068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62ac151ab0 0x7f62ac1e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62ac0cd0e0 0x7f62ac1f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 --2- 172.21.15.32:0/2775756001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62ac06ae20 0x7f62ac1e1da0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 >> 172.21.15.32:0/2775756001 conn(0x7f62ac06eae0 msgr2=0x7f62ac0b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 shutdown_connections 2024-09-13T18:45:36.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.365+0000 7f62b1600700 1 -- 172.21.15.32:0/2775756001 wait complete. 2024-09-13T18:45:36.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:36.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 Processor -- start 2024-09-13T18:45:36.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 -- start start 2024-09-13T18:45:36.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fc0072590 0x7f9fc00c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc015a620 con 0x7f9fc0153450 2024-09-13T18:45:36.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00716a0 con 0x7f9fc0072590 2024-09-13T18:45:36.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.569+0000 7f9fc5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc015db50 con 0x7f9fc00721b0 2024-09-13T18:45:36.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fc0072590 0x7f9fc00c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9fc0072590 0x7f9fc00c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37440/0 (socket says 172.21.15.32:37440) 2024-09-13T18:45:36.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 -- 172.21.15.32:0/4003700787 learned_addr learned my addr 172.21.15.32:0/4003700787 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:36.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbfe00700 1 --2- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 -- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 msgr2=0x7f9fc015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:36.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 --2- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 -- 172.21.15.32:0/4003700787 >> v1:172.21.15.32:6789/0 conn(0x7f9fc0153450 legacy=0x7f9fc00caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 -- 172.21.15.32:0/4003700787 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc015ccf0 con 0x7f9fc0072590 2024-09-13T18:45:36.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbea00700 1 -- 172.21.15.32:0/4003700787 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538413518 0 0) 0x7f9fc015a620 con 0x7f9fc0153450 2024-09-13T18:45:36.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbf400700 1 --2- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc00c9ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009910 tx=0x7f9fac009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9680c7cbe7798ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbea00700 1 -- 172.21.15.32:0/4003700787 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011830 con 0x7f9fc0072590 2024-09-13T18:45:36.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbea00700 1 -- 172.21.15.32:0/4003700787 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac011990 con 0x7f9fc0072590 2024-09-13T18:45:36.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fbea00700 1 -- 172.21.15.32:0/4003700787 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011d40 con 0x7f9fc0072590 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 -- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 msgr2=0x7f9fc00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 --2- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc00c9ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009910 tx=0x7f9fac009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 -- 172.21.15.32:0/4003700787 shutdown_connections 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 --2- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc00c9ac0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 --2- 172.21.15.32:0/4003700787 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 -- 172.21.15.32:0/4003700787 >> 172.21.15.32:0/4003700787 conn(0x7f9fc00cbfe0 msgr2=0x7f9fc00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 -- 172.21.15.32:0/4003700787 shutdown_connections 2024-09-13T18:45:36.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.573+0000 7f9fc5400700 1 -- 172.21.15.32:0/4003700787 wait complete. 2024-09-13T18:45:36.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.577+0000 7f9fc5400700 1 Processor -- start 2024-09-13T18:45:36.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.577+0000 7f9fc5400700 1 -- start start 2024-09-13T18:45:36.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc0157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc01f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc5400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fc0153450 0x7f9fc01517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc5400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc015be10 con 0x7f9fc0153450 2024-09-13T18:45:36.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc5400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f2270 con 0x7f9fc0072590 2024-09-13T18:45:36.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc014dcd0 con 0x7f9fc00721b0 2024-09-13T18:45:36.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbf400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc01f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc0157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fc4a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fc0153450 0x7f9fc01517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc0157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57586/0 (socket says 172.21.15.32:57586) 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbf400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc01f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37452/0 (socket says 172.21.15.32:37452) 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 -- 172.21.15.32:0/3912682048 learned_addr learned my addr 172.21.15.32:0/3912682048 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 -- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 msgr2=0x7f9fc01f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc01f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 -- 172.21.15.32:0/3912682048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fc0153450 msgr2=0x7f9fc01517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fc0153450 0x7f9fc01517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 -- 172.21.15.32:0/3912682048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac009570 con 0x7f9fc00721b0 2024-09-13T18:45:36.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbf400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc01f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:36.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.581+0000 7f9fbfe00700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc0157660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000e9d0 tx=0x7f9fb000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.585+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0009720 con 0x7f9fc00721b0 2024-09-13T18:45:36.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.585+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000ee70 con 0x7f9fc00721b0 2024-09-13T18:45:36.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.585+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000ca50 con 0x7f9fc00721b0 2024-09-13T18:45:36.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.585+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01f31c0 con 0x7f9fc00721b0 2024-09-13T18:45:36.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.585+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc014bb30 con 0x7f9fc00721b0 2024-09-13T18:45:36.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.585+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc015d550 con 0x7f9fc00721b0 2024-09-13T18:45:36.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.589+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9fb000cbb0 con 0x7f9fc00721b0 2024-09-13T18:45:36.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.589+0000 7f9fb7e00700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fa0066730 0x7f9fa0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.589+0000 7f9fbf400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fa0066730 0x7f9fa0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.593+0000 7f9fbf400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fa0066730 0x7f9fa0068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009910 tx=0x7f9fac008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.593+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fb0055ab0 con 0x7f9fc00721b0 2024-09-13T18:45:36.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.601+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9fb00516f0 con 0x7f9fc00721b0 2024-09-13T18:45:36.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.785+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fc01f31c0 con 0x7f9fc00721b0 2024-09-13T18:45:36.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.785+0000 7f9fb7e00700 1 -- 172.21.15.32:0/3912682048 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9fc01f31c0 con 0x7f9fc00721b0 2024-09-13T18:45:36.790 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:36.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fa0066730 msgr2=0x7f9fa0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fa0066730 0x7f9fa0068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009910 tx=0x7f9fac008030 comp rx=0 tx=0).stop 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 msgr2=0x7f9fc0157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc0157660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000e9d0 tx=0x7f9fb000ece0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 shutdown_connections 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fa0066730 0x7f9fa0068bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9fc0153450 0x7f9fc01517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fc0072590 0x7f9fc01f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 --2- 172.21.15.32:0/3912682048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fc00721b0 0x7f9fc0157660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 >> 172.21.15.32:0/3912682048 conn(0x7f9fc00cbfe0 msgr2=0x7f9fc00c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 shutdown_connections 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.789+0000 7f9fc5400700 1 -- 172.21.15.32:0/3912682048 wait complete. 2024-09-13T18:45:36.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:37.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.997+0000 7fd30b400700 1 Processor -- start 2024-09-13T18:45:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:36.997+0000 7fd30b400700 1 -- start start 2024-09-13T18:45:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd30415e610 0x7fd30406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd30415e9f0 0x7fd3040c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304161290 con 0x7fd304071280 2024-09-13T18:45:37.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304161570 con 0x7fd30415e610 2024-09-13T18:45:37.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304161850 con 0x7fd30415e9f0 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd30415e610 0x7fd30406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd30415e610 0x7fd30406f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49058/0 (socket says 172.21.15.32:49058) 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 -- 172.21.15.32:0/2841450012 learned_addr learned my addr 172.21.15.32:0/2841450012 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd303e00700 1 --2- 172.21.15.32:0/2841450012 >> v2:172.21.15.86:3300/0 conn(0x7fd30415e9f0 0x7fd3040c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 -- 172.21.15.32:0/2841450012 >> v2:172.21.15.86:3300/0 conn(0x7fd30415e9f0 msgr2=0x7fd3040c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 --2- 172.21.15.32:0/2841450012 >> v2:172.21.15.86:3300/0 conn(0x7fd30415e9f0 0x7fd3040c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 -- 172.21.15.32:0/2841450012 >> v1:172.21.15.86:6789/0 conn(0x7fd304071280 legacy=0x7fd3040cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 -- 172.21.15.32:0/2841450012 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304161b30 con 0x7fd30415e610 2024-09-13T18:45:37.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd308a00700 1 --2- 172.21.15.32:0/2841450012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30406f530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd3040cb000 tx=0x7fd2f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b43726e450fb830 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd303400700 1 -- 172.21.15.32:0/2841450012 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8011830 con 0x7fd30415e610 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd303400700 1 -- 172.21.15.32:0/2841450012 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8011990 con 0x7fd30415e610 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd303400700 1 -- 172.21.15.32:0/2841450012 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8011d20 con 0x7fd30415e610 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- 172.21.15.32:0/2841450012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 msgr2=0x7fd30406f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 --2- 172.21.15.32:0/2841450012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30406f530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd3040cb000 tx=0x7fd2f8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- 172.21.15.32:0/2841450012 shutdown_connections 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 --2- 172.21.15.32:0/2841450012 >> v2:172.21.15.86:3300/0 conn(0x7fd30415e9f0 0x7fd3040c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 --2- 172.21.15.32:0/2841450012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30406f530 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- 172.21.15.32:0/2841450012 >> 172.21.15.32:0/2841450012 conn(0x7fd30406eae0 msgr2=0x7fd30406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- 172.21.15.32:0/2841450012 shutdown_connections 2024-09-13T18:45:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.001+0000 7fd30b400700 1 -- 172.21.15.32:0/2841450012 wait complete. 2024-09-13T18:45:37.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.005+0000 7fd30b400700 1 Processor -- start 2024-09-13T18:45:37.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.005+0000 7fd30b400700 1 -- start start 2024-09-13T18:45:37.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd30b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 0x7fd3041f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd30b400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30415f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd30b400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd304160240 0x7fd3040cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd30b400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30414b080 con 0x7fd30415e610 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd30b400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041f4c20 con 0x7fd304160240 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd30b400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30415ede0 con 0x7fd304071280 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 0x7fd3041f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd303e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 0x7fd3041f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57590/0 (socket says 172.21.15.32:57590) 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 -- 172.21.15.32:0/2303134565 learned_addr learned my addr 172.21.15.32:0/2303134565 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:37.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd309400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd304160240 0x7fd3040cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 -- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd304160240 msgr2=0x7fd3040cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd304160240 0x7fd3040cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 -- 172.21.15.32:0/2303134565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 msgr2=0x7fd30415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30415f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 -- 172.21.15.32:0/2303134565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8009570 con 0x7fd304071280 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.009+0000 7fd308a00700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 0x7fd3041f46e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009f40 tx=0x7fd2f8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.013+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8004450 con 0x7fd304071280 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.013+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30415f3a0 con 0x7fd304071280 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.013+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f801f070 con 0x7fd304071280 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.013+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8003900 con 0x7fd304071280 2024-09-13T18:45:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.013+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3041606d0 con 0x7fd304071280 2024-09-13T18:45:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.013+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304067a00 con 0x7fd304071280 2024-09-13T18:45:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.017+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2f8003a60 con 0x7fd304071280 2024-09-13T18:45:37.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.017+0000 7fd300c00700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2e4066760 0x7fd2e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.017+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2f8021070 con 0x7fd304071280 2024-09-13T18:45:37.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.017+0000 7fd303e00700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2e4066760 0x7fd2e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.017+0000 7fd303e00700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2e4066760 0x7fd2e4068c20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3041519f0 tx=0x7fd2f0009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.025+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2f8053030 con 0x7fd304071280 2024-09-13T18:45:37.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.213+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd30415dcf0 con 0x7fd304071280 2024-09-13T18:45:37.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.213+0000 7fd300c00700 1 -- 172.21.15.32:0/2303134565 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2f802a0a0 con 0x7fd304071280 2024-09-13T18:45:37.216 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-09-13T18:45:37.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2e4066760 msgr2=0x7fd2e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2e4066760 0x7fd2e4068c20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3041519f0 tx=0x7fd2f0009240 comp rx=0 tx=0).stop 2024-09-13T18:45:37.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 msgr2=0x7fd3041f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 0x7fd3041f46e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009f40 tx=0x7fd2f8004770 comp rx=0 tx=0).stop 2024-09-13T18:45:37.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 shutdown_connections 2024-09-13T18:45:37.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2e4066760 0x7fd2e4068c20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd304160240 0x7fd3040cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd30415e610 0x7fd30415f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 --2- 172.21.15.32:0/2303134565 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd304071280 0x7fd3041f46e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 >> 172.21.15.32:0/2303134565 conn(0x7fd30406eae0 msgr2=0x7fd30415be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 shutdown_connections 2024-09-13T18:45:37.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.217+0000 7fd30b400700 1 -- 172.21.15.32:0/2303134565 wait complete. 2024-09-13T18:45:37.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:45:37.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.685+0000 7f2728a00700 1 Processor -- start 2024-09-13T18:45:37.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.685+0000 7f2728a00700 1 -- start start 2024-09-13T18:45:37.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.685+0000 7f2728a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 0x7f272415a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.685+0000 7f2728a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272415a840 con 0x7f27240c7960 2024-09-13T18:45:37.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.685+0000 7f2728a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2724072410 con 0x7f27240c5870 2024-09-13T18:45:37.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.685+0000 7f2728a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2724156e30 con 0x7f27240c7d40 2024-09-13T18:45:37.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 0x7f272415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2723200700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f27240c5870 0x7f2724153620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:51444/0 (socket says 172.21.15.32:51444) 2024-09-13T18:45:37.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 0x7f272415a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57600/0 (socket says 172.21.15.32:57600) 2024-09-13T18:45:37.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2723200700 1 -- 172.21.15.32:0/1189156519 learned_addr learned my addr 172.21.15.32:0/1189156519 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:37.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721e00700 1 -- 172.21.15.32:0/1189156519 >> v1:172.21.15.86:6789/0 conn(0x7f27240c5870 legacy=0x7f2724153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721e00700 1 -- 172.21.15.32:0/1189156519 >> v1:172.21.15.32:6789/0 conn(0x7f27240c7960 legacy=0x7f2724071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721e00700 1 -- 172.21.15.32:0/1189156519 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240726f0 con 0x7f27240c7d40 2024-09-13T18:45:37.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721e00700 1 --2- 172.21.15.32:0/1189156519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 0x7f272415a300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2710009880 tx=0x7f2710009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb678512c52e85a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721400700 1 -- 172.21.15.32:0/1189156519 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000f8a0 con 0x7f27240c7d40 2024-09-13T18:45:37.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721400700 1 -- 172.21.15.32:0/1189156519 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000fa00 con 0x7f27240c7d40 2024-09-13T18:45:37.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2721400700 1 -- 172.21.15.32:0/1189156519 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000fd90 con 0x7f27240c7d40 2024-09-13T18:45:37.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 -- 172.21.15.32:0/1189156519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 msgr2=0x7f272415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 --2- 172.21.15.32:0/1189156519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 0x7f272415a300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2710009880 tx=0x7f2710009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:37.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 -- 172.21.15.32:0/1189156519 shutdown_connections 2024-09-13T18:45:37.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 --2- 172.21.15.32:0/1189156519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c7d40 0x7f272415a300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 -- 172.21.15.32:0/1189156519 >> 172.21.15.32:0/1189156519 conn(0x7f27240cac60 msgr2=0x7f27240cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 -- 172.21.15.32:0/1189156519 shutdown_connections 2024-09-13T18:45:37.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.689+0000 7f2728a00700 1 -- 172.21.15.32:0/1189156519 wait complete. 2024-09-13T18:45:37.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.693+0000 7f2728a00700 1 Processor -- start 2024-09-13T18:45:37.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.693+0000 7f2728a00700 1 -- start start 2024-09-13T18:45:37.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c5870 0x7f27240acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 0x7f2724151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 0x7f27240abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240ab3c0 con 0x7f27240c7d40 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240ab660 con 0x7f27240c7960 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240ad400 con 0x7f27240c5870 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2723200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 0x7f27240abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2722800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c5870 0x7f27240acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 0x7f2724151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2722800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c5870 0x7f27240acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57612/0 (socket says 172.21.15.32:57612) 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2722800700 1 -- 172.21.15.32:0/42005637 learned_addr learned my addr 172.21.15.32:0/42005637 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:37.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 0x7f2724151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37492/0 (socket says 172.21.15.32:37492) 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2723200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 0x7f27240abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49074/0 (socket says 172.21.15.32:49074) 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 -- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c5870 msgr2=0x7f27240acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c5870 0x7f27240acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 -- 172.21.15.32:0/42005637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 msgr2=0x7f27240abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 0x7f27240abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 -- 172.21.15.32:0/42005637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094b0 con 0x7f27240c7960 2024-09-13T18:45:37.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2723200700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 0x7f27240abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:37.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2721e00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 0x7f2724151700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2710018000 tx=0x7f2710004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004460 con 0x7f27240c7960 2024-09-13T18:45:37.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100045c0 con 0x7f27240c7960 2024-09-13T18:45:37.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27241efb70 con 0x7f27240c7960 2024-09-13T18:45:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710010ac0 con 0x7f27240c7960 2024-09-13T18:45:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.697+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27240aac50 con 0x7f27240c7960 2024-09-13T18:45:37.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.701+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27240ab7d0 con 0x7f27240c7960 2024-09-13T18:45:37.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.701+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27100036c0 con 0x7f27240c7960 2024-09-13T18:45:37.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.701+0000 7f271aa00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2704066760 0x7f2704068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.701+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2710085160 con 0x7f27240c7960 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.705+0000 7f2722800700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2704066760 0x7f2704068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.705+0000 7f2722800700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2704066760 0x7f2704068c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2714001940 tx=0x7f2714009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.713+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2710052140 con 0x7f27240c7960 2024-09-13T18:45:37.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.900+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f27240c5d00 con 0x7f27240c7960 2024-09-13T18:45:37.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.900+0000 7f271aa00700 1 -- 172.21.15.32:0/42005637 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2710055760 con 0x7f27240c7960 2024-09-13T18:45:37.904 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:45:37.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2704066760 msgr2=0x7f2704068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2704066760 0x7f2704068c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2714001940 tx=0x7f2714009040 comp rx=0 tx=0).stop 2024-09-13T18:45:37.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 msgr2=0x7f2724151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 0x7f2724151700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2710018000 tx=0x7f2710004770 comp rx=0 tx=0).stop 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 shutdown_connections 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2704066760 0x7f2704068c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f27240c7d40 0x7f27240abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27240c7960 0x7f2724151700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 --2- 172.21.15.32:0/42005637 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27240c5870 0x7f27240acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 >> 172.21.15.32:0/42005637 conn(0x7f27240cac60 msgr2=0x7f27241526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 shutdown_connections 2024-09-13T18:45:37.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:37.904+0000 7f2728a00700 1 -- 172.21.15.32:0/42005637 wait complete. 2024-09-13T18:45:37.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:38.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.092+0000 7f7234e00700 1 Processor -- start 2024-09-13T18:45:38.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.092+0000 7f7234e00700 1 -- start start 2024-09-13T18:45:38.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f7234e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7230153af0 0x7f723015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f7234e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723015da30 con 0x7f7230153710 2024-09-13T18:45:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f7234e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723015a2e0 con 0x7f72300c7ae0 2024-09-13T18:45:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f7234e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723006ba20 con 0x7f7230153af0 2024-09-13T18:45:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f7226a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7230153af0 0x7f723015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f722f400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7230153710 0x7f72300c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55814/0 (socket says 172.21.15.32:55814) 2024-09-13T18:45:38.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f722f400700 1 -- 172.21.15.32:0/4143962002 learned_addr learned my addr 172.21.15.32:0/4143962002 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f722ea00700 1 -- 172.21.15.32:0/4143962002 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692775150 0 0) 0x7f723015a2e0 con 0x7f72300c7ae0 2024-09-13T18:45:38.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.096+0000 7f722ea00700 1 -- 172.21.15.32:0/4143962002 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72140035d0 con 0x7f72300c7ae0 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7226a00700 1 -- 172.21.15.32:0/4143962002 >> v1:172.21.15.86:6789/0 conn(0x7f72300c7ae0 legacy=0x7f723006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7226a00700 1 -- 172.21.15.32:0/4143962002 >> v1:172.21.15.32:6789/0 conn(0x7f7230153710 legacy=0x7f72300c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7226a00700 1 -- 172.21.15.32:0/4143962002 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230159710 con 0x7f7230153af0 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7226a00700 1 --2- 172.21.15.32:0/4143962002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153af0 0x7f723015d4f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7218009850 tx=0x7f7218009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420b79557668dbe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f722ea00700 1 -- 172.21.15.32:0/4143962002 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218004230 con 0x7f7230153af0 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f722ea00700 1 -- 172.21.15.32:0/4143962002 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218004390 con 0x7f7230153af0 2024-09-13T18:45:38.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f722ea00700 1 -- 172.21.15.32:0/4143962002 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180036c0 con 0x7f7230153af0 2024-09-13T18:45:38.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 -- 172.21.15.32:0/4143962002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153af0 msgr2=0x7f723015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 --2- 172.21.15.32:0/4143962002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153af0 0x7f723015d4f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7218009850 tx=0x7f7218009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 -- 172.21.15.32:0/4143962002 shutdown_connections 2024-09-13T18:45:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 --2- 172.21.15.32:0/4143962002 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153af0 0x7f723015d4f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 -- 172.21.15.32:0/4143962002 >> 172.21.15.32:0/4143962002 conn(0x7f723006c200 msgr2=0x7f723006c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 -- 172.21.15.32:0/4143962002 shutdown_connections 2024-09-13T18:45:38.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.100+0000 7f7234e00700 1 -- 172.21.15.32:0/4143962002 wait complete. 2024-09-13T18:45:38.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 Processor -- start 2024-09-13T18:45:38.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 -- start start 2024-09-13T18:45:38.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72300c7ae0 0x7f7230152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 0x7f72301ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153ee0 0x7f72301ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723015c8b0 con 0x7f7230153ee0 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72301544e0 con 0x7f7230153710 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7234e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72301eefe0 con 0x7f72300c7ae0 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7226a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 0x7f72301ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f722fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153ee0 0x7f72301ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f722f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72300c7ae0 0x7f7230152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7226a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 0x7f72301ef470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37494/0 (socket says 172.21.15.32:37494) 2024-09-13T18:45:38.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.104+0000 7f7226a00700 1 -- 172.21.15.32:0/3474459027 learned_addr learned my addr 172.21.15.32:0/3474459027 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:38.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7226a00700 1 -- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72300c7ae0 msgr2=0x7f7230152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7226a00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72300c7ae0 0x7f7230152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7226a00700 1 -- 172.21.15.32:0/3474459027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153ee0 msgr2=0x7f72301ef9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7226a00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153ee0 0x7f72301ef9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7226a00700 1 -- 172.21.15.32:0/3474459027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180094b0 con 0x7f7230153710 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f722fe00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153ee0 0x7f72301ef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7226a00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 0x7f72301ef470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7218004000 tx=0x7f7218004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218006ea0 con 0x7f7230153710 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721801f070 con 0x7f7230153710 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7230154f40 con 0x7f7230153710 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218011850 con 0x7f7230153710 2024-09-13T18:45:38.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72301f2990 con 0x7f7230153710 2024-09-13T18:45:38.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.108+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723006b450 con 0x7f7230153710 2024-09-13T18:45:38.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.112+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7218021030 con 0x7f7230153710 2024-09-13T18:45:38.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.112+0000 7f7227e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f720c066730 0x7f720c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.112+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72180857c0 con 0x7f7230153710 2024-09-13T18:45:38.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.112+0000 7f722f400700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f720c066730 0x7f720c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.112+0000 7f722f400700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f720c066730 0x7f720c068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f72200012e0 tx=0x7f7220001a30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.120+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7218052830 con 0x7f7230153710 2024-09-13T18:45:38.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.356+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f723006b450 con 0x7f7230153710 2024-09-13T18:45:38.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7227e00700 1 -- 172.21.15.32:0/3474459027 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f7218055e50 con 0x7f7230153710 2024-09-13T18:45:38.363 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:38.363 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:25.505215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:38.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f720c066730 msgr2=0x7f720c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f720c066730 0x7f720c068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f72200012e0 tx=0x7f7220001a30 comp rx=0 tx=0).stop 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 msgr2=0x7f72301ef470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 0x7f72301ef470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7218004000 tx=0x7f7218004770 comp rx=0 tx=0).stop 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 shutdown_connections 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f720c066730 0x7f720c068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7230153ee0 0x7f72301ef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7230153710 0x7f72301ef470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 --2- 172.21.15.32:0/3474459027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f72300c7ae0 0x7f7230152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 >> 172.21.15.32:0/3474459027 conn(0x7f723006c200 msgr2=0x7f723006c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.360+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 shutdown_connections 2024-09-13T18:45:38.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.364+0000 7f7234e00700 1 -- 172.21.15.32:0/3474459027 wait complete. 2024-09-13T18:45:38.368 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 10 2024-09-13T18:45:38.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:38.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 Processor -- start 2024-09-13T18:45:38.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 -- start start 2024-09-13T18:45:38.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00aa360 0x7f50e01545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50e00c6590 0x7f50e0154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e0070510 con 0x7f50e00c61b0 2024-09-13T18:45:38.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00aa920 con 0x7f50e00c6590 2024-09-13T18:45:38.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.556+0000 7f50e4c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0155020 con 0x7f50e00aa360 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50e00c6590 0x7f50e0154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f50e00c6590 0x7f50e0154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37508/0 (socket says 172.21.15.32:37508) 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 -- 172.21.15.32:0/435674847 learned_addr learned my addr 172.21.15.32:0/435674847 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50d7e00700 1 --2- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00aa360 0x7f50e01545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 -- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00aa360 msgr2=0x7f50e01545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 --2- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00aa360 0x7f50e01545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 -- 172.21.15.32:0/435674847 >> v1:172.21.15.86:6789/0 conn(0x7f50e00c61b0 legacy=0x7f50e0071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:38.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 -- 172.21.15.32:0/435674847 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0157570 con 0x7f50e00c6590 2024-09-13T18:45:38.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dfe00700 1 --2- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00c6590 0x7f50e0154ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b401e2cb7f9c7728 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dea00700 1 -- 172.21.15.32:0/435674847 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800e070 con 0x7f50e00c6590 2024-09-13T18:45:38.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dea00700 1 -- 172.21.15.32:0/435674847 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d800b9c0 con 0x7f50e00c6590 2024-09-13T18:45:38.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50dea00700 1 -- 172.21.15.32:0/435674847 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800bd70 con 0x7f50e00c6590 2024-09-13T18:45:38.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 -- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00c6590 msgr2=0x7f50e0154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 --2- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00c6590 0x7f50e0154ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:38.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 -- 172.21.15.32:0/435674847 shutdown_connections 2024-09-13T18:45:38.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 --2- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00c6590 0x7f50e0154ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 --2- 172.21.15.32:0/435674847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00aa360 0x7f50e01545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 -- 172.21.15.32:0/435674847 >> 172.21.15.32:0/435674847 conn(0x7f50e00cad40 msgr2=0x7f50e00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 -- 172.21.15.32:0/435674847 shutdown_connections 2024-09-13T18:45:38.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.560+0000 7f50e4c00700 1 -- 172.21.15.32:0/435674847 wait complete. 2024-09-13T18:45:38.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 Processor -- start 2024-09-13T18:45:38.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 -- start start 2024-09-13T18:45:38.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00aa360 0x7f50e00c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 0x7f50e00c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50e00c6590 0x7f50e00c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e01f00a0 con 0x7f50e00c6590 2024-09-13T18:45:38.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e01532d0 con 0x7f50e00aa360 2024-09-13T18:45:38.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50e4c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e00c2d50 con 0x7f50e00c61b0 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.564+0000 7f50dfe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50e00c6590 0x7f50e00c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 0x7f50e00c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50df400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00aa360 0x7f50e00c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 0x7f50e00c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57640/0 (socket says 172.21.15.32:57640) 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 -- 172.21.15.32:0/3400870176 learned_addr learned my addr 172.21.15.32:0/3400870176 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 -- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00aa360 msgr2=0x7f50e00c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00aa360 0x7f50e00c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 -- 172.21.15.32:0/3400870176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50e00c6590 msgr2=0x7f50e00c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50e00c6590 0x7f50e00c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 -- 172.21.15.32:0/3400870176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8009b30 con 0x7f50e00c61b0 2024-09-13T18:45:38.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7e00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 0x7f50e00c2680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50c800e760 tx=0x7f50c800ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c800c070 con 0x7f50e00c61b0 2024-09-13T18:45:38.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8013610 con 0x7f50e00c61b0 2024-09-13T18:45:38.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8013980 con 0x7f50e00c61b0 2024-09-13T18:45:38.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e01539c0 con 0x7f50e00c61b0 2024-09-13T18:45:38.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e00c0130 con 0x7f50e00c61b0 2024-09-13T18:45:38.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.568+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e01f01e0 con 0x7f50e00c61b0 2024-09-13T18:45:38.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.572+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50c8013ae0 con 0x7f50e00c61b0 2024-09-13T18:45:38.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.572+0000 7f50d7400700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f50bc066760 0x7f50bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.572+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50c8084280 con 0x7f50e00c61b0 2024-09-13T18:45:38.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.572+0000 7f50df400700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f50bc066760 0x7f50bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.576+0000 7f50df400700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f50bc066760 0x7f50bc068c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50d0000f60 tx=0x7f50d0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.584+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50e01f01e0 con 0x7f50e00c61b0 2024-09-13T18:45:38.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.796+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50e01f01e0 con 0x7f50e00c61b0 2024-09-13T18:45:38.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.796+0000 7f50d7400700 1 -- 172.21.15.32:0/3400870176 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18290 (secure 0 0 0) 0x7f50e01f01e0 con 0x7f50e00c61b0 2024-09-13T18:45:38.802 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:38.802 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":26,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:45:05.814823+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:44:40.704698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:38.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f50bc066760 msgr2=0x7f50bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f50bc066760 0x7f50bc068c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50d0000f60 tx=0x7f50d0009040 comp rx=0 tx=0).stop 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 msgr2=0x7f50e00c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 0x7f50e00c2680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50c800e760 tx=0x7f50c800ea70 comp rx=0 tx=0).stop 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 shutdown_connections 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f50bc066760 0x7f50bc068c20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f50e00c6590 0x7f50e00c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e00c61b0 0x7f50e00c2680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 --2- 172.21.15.32:0/3400870176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e00aa360 0x7f50e00c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 >> 172.21.15.32:0/3400870176 conn(0x7f50e00cad40 msgr2=0x7f50e00c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 shutdown_connections 2024-09-13T18:45:38.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:38.804+0000 7f50e4c00700 1 -- 172.21.15.32:0/3400870176 wait complete. 2024-09-13T18:45:38.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:39.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.000+0000 7f68cba00700 1 Processor -- start 2024-09-13T18:45:39.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.000+0000 7f68cba00700 1 -- start start 2024-09-13T18:45:39.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68cba00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c41610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68cba00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68c4071320 0x7f68c415e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68cba00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f68c406fd80 0x7f68c4070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68cba00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40c6050 con 0x7f68c406fd80 2024-09-13T18:45:39.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68cba00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40c9ad0 con 0x7f68c4071320 2024-09-13T18:45:39.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68cba00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40b20a0 con 0x7f68c4157e70 2024-09-13T18:45:39.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c41610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c3e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f68c4071320 0x7f68c415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c41610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57678/0 (socket says 172.21.15.32:57678) 2024-09-13T18:45:39.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 -- 172.21.15.32:0/2319568270 learned_addr learned my addr 172.21.15.32:0/2319568270 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:39.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9a00700 1 --2- 172.21.15.32:0/2319568270 >> v2:172.21.15.32:3300/0 conn(0x7f68c406fd80 0x7f68c4070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 -- 172.21.15.32:0/2319568270 >> v2:172.21.15.86:3300/0 conn(0x7f68c4071320 msgr2=0x7f68c415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 --2- 172.21.15.32:0/2319568270 >> v2:172.21.15.86:3300/0 conn(0x7f68c4071320 0x7f68c415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 -- 172.21.15.32:0/2319568270 >> v2:172.21.15.32:3300/0 conn(0x7f68c406fd80 msgr2=0x7f68c4070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 --2- 172.21.15.32:0/2319568270 >> v2:172.21.15.32:3300/0 conn(0x7f68c406fd80 0x7f68c4070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 -- 172.21.15.32:0/2319568270 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c4158250 con 0x7f68c4157e70 2024-09-13T18:45:39.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9a00700 1 --2- 172.21.15.32:0/2319568270 >> v2:172.21.15.32:3300/0 conn(0x7f68c406fd80 0x7f68c4070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:39.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.004+0000 7f68c9000700 1 --2- 172.21.15.32:0/2319568270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c41610d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68c40745f0 tx=0x7f68b8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff12113dfa4a473 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68c3400700 1 -- 172.21.15.32:0/2319568270 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8011830 con 0x7f68c4157e70 2024-09-13T18:45:39.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68c3400700 1 -- 172.21.15.32:0/2319568270 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b8011990 con 0x7f68c4157e70 2024-09-13T18:45:39.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68c3400700 1 -- 172.21.15.32:0/2319568270 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8011d20 con 0x7f68c4157e70 2024-09-13T18:45:39.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 -- 172.21.15.32:0/2319568270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 msgr2=0x7f68c41610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 --2- 172.21.15.32:0/2319568270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c41610d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68c40745f0 tx=0x7f68b8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 -- 172.21.15.32:0/2319568270 shutdown_connections 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 --2- 172.21.15.32:0/2319568270 >> v2:172.21.15.32:3300/0 conn(0x7f68c406fd80 0x7f68c4070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 --2- 172.21.15.32:0/2319568270 >> v2:172.21.15.86:3300/0 conn(0x7f68c4071320 0x7f68c415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 --2- 172.21.15.32:0/2319568270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c41610d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 -- 172.21.15.32:0/2319568270 >> 172.21.15.32:0/2319568270 conn(0x7f68c40725a0 msgr2=0x7f68c4073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 -- 172.21.15.32:0/2319568270 shutdown_connections 2024-09-13T18:45:39.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.008+0000 7f68cba00700 1 -- 172.21.15.32:0/2319568270 wait complete. 2024-09-13T18:45:39.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 Processor -- start 2024-09-13T18:45:39.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 -- start start 2024-09-13T18:45:39.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 0x7f68c415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68c4071320 0x7f68c415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c4151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4158af0 con 0x7f68c406fd80 2024-09-13T18:45:39.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c41f3740 con 0x7f68c4071320 2024-09-13T18:45:39.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68cba00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4158530 con 0x7f68c4157e70 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 0x7f68c415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 0x7f68c415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37896/0 (socket says 172.21.15.32:37896) 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 -- 172.21.15.32:0/3067146354 learned_addr learned my addr 172.21.15.32:0/3067146354 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c3e00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68c4071320 0x7f68c415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9a00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c4151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 -- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 msgr2=0x7f68c4151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c4151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 -- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68c4071320 msgr2=0x7f68c415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68c4071320 0x7f68c415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 -- 172.21.15.32:0/3067146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009a70 con 0x7f68c406fd80 2024-09-13T18:45:39.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c9000700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 0x7f68c415b780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f68b8014040 tx=0x7f68b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8004460 con 0x7f68c406fd80 2024-09-13T18:45:39.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b801e070 con 0x7f68c406fd80 2024-09-13T18:45:39.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.012+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8003900 con 0x7f68c406fd80 2024-09-13T18:45:39.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.016+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b8009570 con 0x7f68c406fd80 2024-09-13T18:45:39.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.016+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c41f3950 con 0x7f68c406fd80 2024-09-13T18:45:39.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.016+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c40b1d90 con 0x7f68c406fd80 2024-09-13T18:45:39.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.016+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68b8003a60 con 0x7f68c406fd80 2024-09-13T18:45:39.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.020+0000 7f68c0c00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f68a4066730 0x7f68a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.020+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68b8020070 con 0x7f68c406fd80 2024-09-13T18:45:39.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.020+0000 7f68c3e00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f68a4066730 0x7f68a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.020+0000 7f68c3e00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f68a4066730 0x7f68a4068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f68c415dbb0 tx=0x7f68b00091c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.024+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68b8052100 con 0x7f68c406fd80 2024-09-13T18:45:39.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.260+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68c415bcc0 con 0x7f68c406fd80 2024-09-13T18:45:39.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.260+0000 7f68c0c00700 1 -- 172.21.15.32:0/3067146354 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6245 (secure 0 0 0) 0x7f68b8055720 con 0x7f68c406fd80 2024-09-13T18:45:39.266 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:39.267 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:25.505215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:45:39.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f68a4066730 msgr2=0x7f68a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f68a4066730 0x7f68a4068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f68c415dbb0 tx=0x7f68b00091c0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 msgr2=0x7f68c415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 0x7f68c415b780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f68b8014040 tx=0x7f68b8004770 comp rx=0 tx=0).stop 2024-09-13T18:45:39.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 shutdown_connections 2024-09-13T18:45:39.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f68a4066730 0x7f68a4068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68c4157e70 0x7f68c4151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68c4071320 0x7f68c415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 --2- 172.21.15.32:0/3067146354 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f68c406fd80 0x7f68c415b780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 >> 172.21.15.32:0/3067146354 conn(0x7f68c40725a0 msgr2=0x7f68c4155690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 shutdown_connections 2024-09-13T18:45:39.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:39.268+0000 7f68cba00700 1 -- 172.21.15.32:0/3067146354 wait complete. 2024-09-13T18:45:39.273 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 10 2024-09-13T18:45:39.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:45:01.303364+0000', 'modified': '2024-09-13T18:45:25.505215+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4262}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4262': {'gid': 4262, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.32:6837/1489168013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6835', 'nonce': 1489168013}, {'type': 'v1', 'addr': '172.21.15.32:6837', 'nonce': 1489168013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:45:39.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:45:39.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:45:40.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a7200700 1 Processor -- start 2024-09-13T18:45:40.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a7200700 1 -- start start 2024-09-13T18:45:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a806ea50 0x7f49a815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a7200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80c9440 con 0x7f49a806fac0 2024-09-13T18:45:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a7200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80c7aa0 con 0x7f49a80c9e90 2024-09-13T18:45:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c9a70 con 0x7f49a806ea50 2024-09-13T18:45:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a806ea50 0x7f49a815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f499d400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f49a80c9e90 0x7f49a80ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52444/0 (socket says 172.21.15.32:52444) 2024-09-13T18:45:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f499d400700 1 -- 172.21.15.32:0/2270591329 learned_addr learned my addr 172.21.15.32:0/2270591329 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a5e00700 1 -- 172.21.15.32:0/2270591329 >> v1:172.21.15.86:6789/0 conn(0x7f49a80c9e90 legacy=0x7f49a80ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a5e00700 1 -- 172.21.15.32:0/2270591329 >> v1:172.21.15.32:6789/0 conn(0x7f49a806fac0 legacy=0x7f49a8161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a5400700 1 -- 172.21.15.32:0/2270591329 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613386018 0 0) 0x7f49a80c9440 con 0x7f49a806fac0 2024-09-13T18:45:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.084+0000 7f49a5e00700 1 -- 172.21.15.32:0/2270591329 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80c7d60 con 0x7f49a806ea50 2024-09-13T18:45:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a5e00700 1 --2- 172.21.15.32:0/2270591329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a806ea50 0x7f49a815aa70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4998009dc0 tx=0x7f499800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ea74100d2a076c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a5400700 1 -- 172.21.15.32:0/2270591329 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800e070 con 0x7f49a806ea50 2024-09-13T18:45:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a5400700 1 -- 172.21.15.32:0/2270591329 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499800bad0 con 0x7f49a806ea50 2024-09-13T18:45:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a5400700 1 -- 172.21.15.32:0/2270591329 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800be80 con 0x7f49a806ea50 2024-09-13T18:45:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 -- 172.21.15.32:0/2270591329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a806ea50 msgr2=0x7f49a815aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 --2- 172.21.15.32:0/2270591329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a806ea50 0x7f49a815aa70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4998009dc0 tx=0x7f499800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 -- 172.21.15.32:0/2270591329 shutdown_connections 2024-09-13T18:45:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 --2- 172.21.15.32:0/2270591329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a806ea50 0x7f49a815aa70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 -- 172.21.15.32:0/2270591329 >> 172.21.15.32:0/2270591329 conn(0x7f49a80cac60 msgr2=0x7f49a80cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 -- 172.21.15.32:0/2270591329 shutdown_connections 2024-09-13T18:45:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 -- 172.21.15.32:0/2270591329 wait complete. 2024-09-13T18:45:40.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.088+0000 7f49a7200700 1 Processor -- start 2024-09-13T18:45:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 -- start start 2024-09-13T18:45:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49a806ea50 0x7f49a8152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 0x7f49a8150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a80c9e90 0x7f49a81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a81f0440 con 0x7f49a806fac0 2024-09-13T18:45:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8150a00 con 0x7f49a806ea50 2024-09-13T18:45:40.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a81efec0 con 0x7f49a80c9e90 2024-09-13T18:45:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 0x7f49a8150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 0x7f49a8150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37908/0 (socket says 172.21.15.32:37908) 2024-09-13T18:45:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49a806ea50 0x7f49a8152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 -- 172.21.15.32:0/978130969 learned_addr learned my addr 172.21.15.32:0/978130969 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a6800700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a80c9e90 0x7f49a81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 -- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a80c9e90 msgr2=0x7f49a81513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a80c9e90 0x7f49a81513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 -- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49a806ea50 msgr2=0x7f49a8152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49a806ea50 0x7f49a8152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 -- 172.21.15.32:0/978130969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009a70 con 0x7f49a806fac0 2024-09-13T18:45:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499d400700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 0x7f49a8150e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f499000c550 tx=0x7f499000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499ea00700 1 -- 172.21.15.32:0/978130969 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990004ca0 con 0x7f49a806fac0 2024-09-13T18:45:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499ea00700 1 -- 172.21.15.32:0/978130969 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4990004e00 con 0x7f49a806fac0 2024-09-13T18:45:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a8153500 con 0x7f49a806fac0 2024-09-13T18:45:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f499ea00700 1 -- 172.21.15.32:0/978130969 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990007310 con 0x7f49a806fac0 2024-09-13T18:45:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.092+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a8150690 con 0x7f49a806fac0 2024-09-13T18:45:40.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.096+0000 7f499ea00700 1 -- 172.21.15.32:0/978130969 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4990007470 con 0x7f49a806fac0 2024-09-13T18:45:40.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 Processor -- start 2024-09-13T18:45:40.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f499ea00700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4984066730 0x7f4984068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 -- start start 2024-09-13T18:45:40.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f499ea00700 1 -- 172.21.15.32:0/978130969 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4990084140 con 0x7f49a806fac0 2024-09-13T18:45:40.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a6800700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4984066730 0x7f4984068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f96a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96ad00 0x3f96b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96b620 0x3f96ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f8b5d80 con 0x3f96ad00 2024-09-13T18:45:40.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f8b3510 con 0x3f97eba0 2024-09-13T18:45:40.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f8aee00 con 0x3f96b620 2024-09-13T18:45:40.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f96a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f96a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45612/0 (socket says 172.21.15.32:45612) 2024-09-13T18:45:40.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 -- 172.21.15.32:0/418531596 learned_addr learned my addr 172.21.15.32:0/418531596 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:40.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f499d400700 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96ad00 0x3f96b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a6800700 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96b620 0x3f96ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 -- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96b620 msgr2=0x3f96ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96b620 0x3f96ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a6800700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4984066730 0x7f4984068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49a0001030 tx=0x7f49a0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 -- 172.21.15.32:0/418531596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96ad00 msgr2=0x3f96b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96ad00 0x3f96b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 -- 172.21.15.32:0/418531596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3f721960 con 0x3f97eba0 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f499d400700 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96ad00 0x3f96b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:40.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f49a5e00700 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f96a7c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4998009d90 tx=0x7f4998010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2c7c5bfc7f3e29c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f4996a00700 1 -- 172.21.15.32:0/418531596 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998004230 con 0x3f97eba0 2024-09-13T18:45:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.100+0000 7f4996a00700 1 -- 172.21.15.32:0/418531596 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998021070 con 0x3f97eba0 2024-09-13T18:45:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f4996a00700 1 -- 172.21.15.32:0/418531596 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980045f0 con 0x3f97eba0 2024-09-13T18:45:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 -- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 msgr2=0x3f96a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f96a7c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4998009d90 tx=0x7f4998010000 comp rx=0 tx=0).stop 2024-09-13T18:45:40.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 -- 172.21.15.32:0/418531596 shutdown_connections 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96b620 0x3f96ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96ad00 0x3f96b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 --2- 172.21.15.32:0/418531596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f96a7c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 -- 172.21.15.32:0/418531596 >> 172.21.15.32:0/418531596 conn(0x3f6d64d0 msgr2=0x3f981990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 -- 172.21.15.32:0/418531596 shutdown_connections 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 -- 172.21.15.32:0/418531596 wait complete. 2024-09-13T18:45:40.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 -- start start 2024-09-13T18:45:40.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.104+0000 7f49b03e1740 1 Processor -- start 2024-09-13T18:45:40.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f981dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f947c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f9481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f86c730 con 0x3f96b620 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f8725b0 con 0x3f97eba0 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f75aaa0 con 0x3f96ad00 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 10 client.0 _ll_register_callbacks cb 0x3f8a8610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f947c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f981dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f947c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37928/0 (socket says 172.21.15.32:37928) 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 -- 172.21.15.32:0/4151452764 learned_addr learned my addr 172.21.15.32:0/4151452764 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:40.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49a6800700 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f9481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 -- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 msgr2=0x3f981dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f981dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 -- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 msgr2=0x3f9481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f9481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 -- 172.21.15.32:0/4151452764 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a80c7d60 con 0x3f96b620 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f499d400700 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f947c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4990004fd0 tx=0x7f4990054770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4535704959e91db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f498b400700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f498b400700 1 -- 172.21.15.32:0/4151452764 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990054440 con 0x3f96b620 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f498b400700 1 -- 172.21.15.32:0/4151452764 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4990055450 con 0x3f96b620 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3f6e31e0 con 0x3f96b620 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f498b400700 1 -- 172.21.15.32:0/4151452764 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4990054d50 con 0x3f96b620 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 10 client.4818 fetch_fsmap learned FSMap version 10 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x3f875220 con 0x3f96b620 2024-09-13T18:45:40.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f498b400700 1 -- 172.21.15.32:0/4151452764 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3f6e31e0 con 0x3f96b620 2024-09-13T18:45:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f498b400700 1 -- 172.21.15.32:0/4151452764 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f499005cd40 con 0x3f96b620 2024-09-13T18:45:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 10 client.4818 fetch_fsmap finished waiting for FSMap version 10 2024-09-13T18:45:40.114 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 10 client.4818 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 20 client.4818 populate_metadata read hostname 'smithi032' 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f993330 0x3f993710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 4 client.4818 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 --> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3f72d460 con 0x3f993330 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.108+0000 7f49a5e00700 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f993330 0x3f993710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49a5e00700 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f993330 0x3f993710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac21c223084442c server_cookie=8496f04110950956 in_seq=0 out_seq=0 2024-09-13T18:45:40.115 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f498b400700 10 client.4818 ms_handle_connect on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:40.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f498b400700 1 -- 172.21.15.32:0/4151452764 <== mds.0 v2:172.21.15.32:6835/1489168013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3f72d460 con 0x3f993330 2024-09-13T18:45:40.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f498b400700 10 client.4818 handle_command_reply: tid=0 2024-09-13T18:45:40.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 client.4818 shutdown 2024-09-13T18:45:40.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 msgr2=0x3f947c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f947c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4990004fd0 tx=0x7f4990054770 comp rx=0 tx=0).stop 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 shutdown_connections 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f993330 0x3f993710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f97eba0 0x3f9481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f498b400700 0 client.4818 ms_handle_reset on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f947c80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 --2- 172.21.15.32:0/4151452764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f981dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 >> 172.21.15.32:0/4151452764 conn(0x3f6d64d0 msgr2=0x3f97ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 shutdown_connections 2024-09-13T18:45:40.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 1 -- 172.21.15.32:0/4151452764 wait complete. 2024-09-13T18:45:40.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.112+0000 7f49b03e1740 20 client.4818 trim_cache size 0 max 16384 2024-09-13T18:45:40.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.132+0000 7f49b03e1740 1 Processor -- start 2024-09-13T18:45:40.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.132+0000 7f49b03e1740 1 -- start start 2024-09-13T18:45:40.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96ad00 0x3f999760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f980f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f97eba0 0x3f9814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f84d470 con 0x3f96b620 2024-09-13T18:45:40.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f98a1f0 con 0x3f96ad00 2024-09-13T18:45:40.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f8ddec0 con 0x3f97eba0 2024-09-13T18:45:40.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f980f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96ad00 0x3f999760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49a6800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f97eba0 0x3f9814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f980f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37938/0 (socket says 172.21.15.32:37938) 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 -- 172.21.15.32:0/2737695179 learned_addr learned my addr 172.21.15.32:0/2737695179 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96ad00 0x3f999760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45628/0 (socket says 172.21.15.32:45628) 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 -- 172.21.15.32:0/2737695179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f97eba0 msgr2=0x3f9814d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f97eba0 0x3f9814d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 -- 172.21.15.32:0/2737695179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96ad00 msgr2=0x3f999760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96ad00 0x3f999760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 -- 172.21.15.32:0/2737695179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3f85b450 con 0x3f96b620 2024-09-13T18:45:40.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f499d400700 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f980f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4990054a50 tx=0x7f4990057070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f848fded1f0dbff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f4997400700 1 -- 172.21.15.32:0/2737695179 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990054890 con 0x3f96b620 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f4997400700 1 -- 172.21.15.32:0/2737695179 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4990075020 con 0x3f96b620 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f4997400700 1 -- 172.21.15.32:0/2737695179 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990055450 con 0x3f96b620 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- 172.21.15.32:0/2737695179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 msgr2=0x3f980f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f980f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4990054a50 tx=0x7f4990057070 comp rx=0 tx=0).stop 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- 172.21.15.32:0/2737695179 shutdown_connections 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f97eba0 0x3f9814d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f96b620 0x3f980f90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 --2- 172.21.15.32:0/2737695179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96ad00 0x3f999760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- 172.21.15.32:0/2737695179 >> 172.21.15.32:0/2737695179 conn(0x3f6d64d0 msgr2=0x3f988720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- 172.21.15.32:0/2737695179 shutdown_connections 2024-09-13T18:45:40.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.136+0000 7f49b03e1740 1 -- 172.21.15.32:0/2737695179 wait complete. 2024-09-13T18:45:40.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.140+0000 7f49b03e1740 1 -- start start 2024-09-13T18:45:40.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.140+0000 7f49b03e1740 1 Processor -- start 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f9e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 0x3f9e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f97eba0 0x3f9eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f989aa0 con 0x3f97eba0 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f97e730 con 0x3f96b620 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x3f9822f0 con 0x3f96ad00 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 10 client.0 _ll_register_callbacks cb 0x7f4998009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49a5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f9e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 0x3f9e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 0x3f9e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45634/0 (socket says 172.21.15.32:45634) 2024-09-13T18:45:40.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 -- 172.21.15.32:0/1145184742 learned_addr learned my addr 172.21.15.32:0/1145184742 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:40.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49a6800700 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f97eba0 0x3f9eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 -- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 msgr2=0x3f9e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f9e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 -- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f97eba0 msgr2=0x3f9eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f97eba0 0x3f9eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 -- 172.21.15.32:0/1145184742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3f875220 con 0x3f96b620 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f499d400700 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 0x3f9e54b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4990054a50 tx=0x7f49900821b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df56972ade662902 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f498b400700 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f498b400700 1 -- 172.21.15.32:0/1145184742 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990054890 con 0x3f96b620 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4998021070 con 0x3f96b620 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f498b400700 1 -- 172.21.15.32:0/1145184742 <== mon.1 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4990076070 con 0x3f96b620 2024-09-13T18:45:40.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f498b400700 1 -- 172.21.15.32:0/1145184742 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4990055450 con 0x3f96b620 2024-09-13T18:45:40.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 10 client.4825 fetch_fsmap learned FSMap version 10 2024-09-13T18:45:40.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x3f84f720 con 0x3f96b620 2024-09-13T18:45:40.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f498b400700 1 -- 172.21.15.32:0/1145184742 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998021070 con 0x3f96b620 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f498b400700 1 -- 172.21.15.32:0/1145184742 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f4990050b40 con 0x3f96b620 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 10 client.4825 fetch_fsmap finished waiting for FSMap version 10 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 10 client.4825 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 20 client.4825 populate_metadata read hostname 'smithi032' 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f9eef80 0x3f9eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 4 client.4825 mds_command: new command op to 4262 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.144+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 --> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] -- command(tid 0: {"prefix": "status"}) v1 -- 0x3f7521e0 con 0x3f9eef80 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a5e00700 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f9eef80 0x3f9eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a5e00700 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f9eef80 0x3f9eb2e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36142dadf535f911 server_cookie=ab340de6a02bb4ee in_seq=0 out_seq=0 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f498b400700 10 client.4825 ms_handle_connect on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:40.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f498b400700 1 -- 172.21.15.32:0/1145184742 <== mds.0 v2:172.21.15.32:6835/1489168013 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x3f7521e0 con 0x3f9eef80 2024-09-13T18:45:40.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f498b400700 10 client.4825 handle_command_reply: tid=0 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 client.4825 shutdown 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 msgr2=0x3f9e54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 0x3f9e54b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4990054a50 tx=0x7f49900821b0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 shutdown_connections 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:6835/1489168013,v1:172.21.15.32:6837/1489168013] conn(0x3f9eef80 0x3f9eb2e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x3f97eba0 0x3f9eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x3f96b620 0x3f9e54b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 --2- 172.21.15.32:0/1145184742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x3f96ad00 0x3f9e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f498b400700 0 client.4825 ms_handle_reset on v2:172.21.15.32:6835/1489168013 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 >> 172.21.15.32:0/1145184742 conn(0x3f6d64d0 msgr2=0x3f98c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 shutdown_connections 2024-09-13T18:45:40.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 1 -- 172.21.15.32:0/1145184742 wait complete. 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49b03e1740 20 client.4825 trim_cache size 0 max 16384 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "e3c44028-1b11-4958-a433-ecab24d0f05e", 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4262, 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 38.840318052000001, 2024-09-13T18:45:40.154 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 10, 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 26, 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 26, 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 43.449326370000001 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4984066730 msgr2=0x7f4984068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4984066730 0x7f4984068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49a0001030 tx=0x7f49a0009040 comp rx=0 tx=0).stop 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 msgr2=0x7f49a8150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 0x7f49a8150e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f499000c550 tx=0x7f499000c860 comp rx=0 tx=0).stop 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 shutdown_connections 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4984066730 0x7f4984068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49a80c9e90 0x7f49a81513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f49a806fac0 0x7f49a8150e90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 --2- 172.21.15.32:0/978130969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49a806ea50 0x7f49a8152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.148+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 >> 172.21.15.32:0/978130969 conn(0x7f49a80cac60 msgr2=0x7f49a80afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.152+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 shutdown_connections 2024-09-13T18:45:40.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:40.152+0000 7f49a7200700 1 -- 172.21.15.32:0/978130969 wait complete. 2024-09-13T18:45:40.177 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:45:40.186 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:45:40.186 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:45:40.187 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:45:40.187 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:45:40.325 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:45:40.326 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T18:45:40.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:40.326 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-09-13T18:45:40.346 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T18:45:40.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:40.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:45:40.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:40.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-09-13T18:45:41.022 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T18:45:41.023 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:45:41.023 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:41.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:45:41.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.200+0000 7f88fa600700 1 Processor -- start 2024-09-13T18:45:41.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.200+0000 7f88fa600700 1 -- start start 2024-09-13T18:45:41.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88fa600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88f415cfd0 0x7f88f415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88fa600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f40cb860 0x7f88f415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88fa600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f88f40c8e50 0x7f88f40c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88fa600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f4072370 con 0x7f88f415cfd0 2024-09-13T18:45:41.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88fa600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40aa1a0 con 0x7f88f40c8e50 2024-09-13T18:45:41.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88fa600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40a9d00 con 0x7f88f40cb860 2024-09-13T18:45:41.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88f415cfd0 0x7f88f415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88f415cfd0 0x7f88f415d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37956/0 (socket says 172.21.15.32:37956) 2024-09-13T18:45:41.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 -- 172.21.15.32:0/1819571241 learned_addr learned my addr 172.21.15.32:0/1819571241 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f3e00700 1 --2- 172.21.15.32:0/1819571241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f40cb860 0x7f88f415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9c00700 1 --2- 172.21.15.32:0/1819571241 >> v2:172.21.15.86:3300/0 conn(0x7f88f40c8e50 0x7f88f40c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 -- 172.21.15.32:0/1819571241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f40cb860 msgr2=0x7f88f415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 --2- 172.21.15.32:0/1819571241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f40cb860 0x7f88f415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 -- 172.21.15.32:0/1819571241 >> v2:172.21.15.86:3300/0 conn(0x7f88f40c8e50 msgr2=0x7f88f40c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 --2- 172.21.15.32:0/1819571241 >> v2:172.21.15.86:3300/0 conn(0x7f88f40c8e50 0x7f88f40c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9200700 1 -- 172.21.15.32:0/1819571241 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40725c0 con 0x7f88f415cfd0 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.204+0000 7f88f9c00700 1 --2- 172.21.15.32:0/1819571241 >> v2:172.21.15.86:3300/0 conn(0x7f88f40c8e50 0x7f88f40c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:41.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88f9200700 1 --2- 172.21.15.32:0/1819571241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f415cfd0 0x7f88f415d3b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88f4070ab0 tx=0x7f88e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59549acc9dad087d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88f3400700 1 -- 172.21.15.32:0/1819571241 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800e070 con 0x7f88f415cfd0 2024-09-13T18:45:41.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88f3400700 1 -- 172.21.15.32:0/1819571241 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e800b910 con 0x7f88f415cfd0 2024-09-13T18:45:41.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88f3400700 1 -- 172.21.15.32:0/1819571241 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800bcc0 con 0x7f88f415cfd0 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 -- 172.21.15.32:0/1819571241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f415cfd0 msgr2=0x7f88f415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 --2- 172.21.15.32:0/1819571241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f415cfd0 0x7f88f415d3b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88f4070ab0 tx=0x7f88e800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 -- 172.21.15.32:0/1819571241 shutdown_connections 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 --2- 172.21.15.32:0/1819571241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f40cb860 0x7f88f415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 --2- 172.21.15.32:0/1819571241 >> v2:172.21.15.86:3300/0 conn(0x7f88f40c8e50 0x7f88f40c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 --2- 172.21.15.32:0/1819571241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f415cfd0 0x7f88f415d3b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 -- 172.21.15.32:0/1819571241 >> 172.21.15.32:0/1819571241 conn(0x7f88f40cad40 msgr2=0x7f88f40cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 -- 172.21.15.32:0/1819571241 shutdown_connections 2024-09-13T18:45:41.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.208+0000 7f88fa600700 1 -- 172.21.15.32:0/1819571241 wait complete. 2024-09-13T18:45:41.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 Processor -- start 2024-09-13T18:45:41.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 -- start start 2024-09-13T18:45:41.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88f40c8e50 0x7f88f40c00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 0x7f88f406e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f415cfd0 0x7f88f4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41eef30 con 0x7f88f40cb860 2024-09-13T18:45:41.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41ef140 con 0x7f88f40c8e50 2024-09-13T18:45:41.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88fa600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f41ef420 con 0x7f88f415cfd0 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 0x7f88f406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f9200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88f40c8e50 0x7f88f40c00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 0x7f88f406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37966/0 (socket says 172.21.15.32:37966) 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f9200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88f40c8e50 0x7f88f40c00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45654/0 (socket says 172.21.15.32:45654) 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 -- 172.21.15.32:0/647274797 learned_addr learned my addr 172.21.15.32:0/647274797 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f9c00700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f415cfd0 0x7f88f4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 -- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f415cfd0 msgr2=0x7f88f4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f415cfd0 0x7f88f4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 -- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88f40c8e50 msgr2=0x7f88f40c00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88f40c8e50 0x7f88f40c00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.212+0000 7f88f3e00700 1 -- 172.21.15.32:0/647274797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009b30 con 0x7f88f40cb860 2024-09-13T18:45:41.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88f3e00700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 0x7f88f406e210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e9d0 tx=0x7f88e000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0009720 con 0x7f88f40cb860 2024-09-13T18:45:41.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000ee70 con 0x7f88f40cb860 2024-09-13T18:45:41.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000ca50 con 0x7f88f40cb860 2024-09-13T18:45:41.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f41ef700 con 0x7f88f40cb860 2024-09-13T18:45:41.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f41efcc0 con 0x7f88f40cb860 2024-09-13T18:45:41.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f40c92c0 con 0x7f88f40cb860 2024-09-13T18:45:41.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.216+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88e000cbb0 con 0x7f88f40cb860 2024-09-13T18:45:41.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.220+0000 7f88f0c00700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f88d4066760 0x7f88d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.220+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88e0084520 con 0x7f88f40cb860 2024-09-13T18:45:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.220+0000 7f88f9200700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f88d4066760 0x7f88d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.220+0000 7f88f9200700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f88d4066760 0x7f88d4068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f88e800b370 tx=0x7f88e8009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.228+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88e0051470 con 0x7f88f40cb860 2024-09-13T18:45:41.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.460+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88f40c8410 con 0x7f88f40cb860 2024-09-13T18:45:41.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88f0c00700 1 -- 172.21.15.32:0/647274797 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f88e0017070 con 0x7f88f40cb860 2024-09-13T18:45:41.466 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:45:41.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f88d4066760 msgr2=0x7f88d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f88d4066760 0x7f88d4068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f88e800b370 tx=0x7f88e8009000 comp rx=0 tx=0).stop 2024-09-13T18:45:41.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 msgr2=0x7f88f406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 0x7f88f406e210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e9d0 tx=0x7f88e000ece0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 shutdown_connections 2024-09-13T18:45:41.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f88d4066760 0x7f88d4068c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f88f415cfd0 0x7f88f4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88f40cb860 0x7f88f406e210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 --2- 172.21.15.32:0/647274797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88f40c8e50 0x7f88f40c00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 >> 172.21.15.32:0/647274797 conn(0x7f88f40cad40 msgr2=0x7f88f4155520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 shutdown_connections 2024-09-13T18:45:41.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:41.464+0000 7f88fa600700 1 -- 172.21.15.32:0/647274797 wait complete. 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:45:41.489 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:45:41.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.490 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:41.504 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42422sec preferred_lft 42422sec 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:41.505 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:45:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2024-09-13T18:45:41.506 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:45:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:82:10:93:56 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:45:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:45:41.506 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:45:41.507 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:45:41.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:45:41.507 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:41.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.660 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:45:41.692 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-09-13T18:45:41.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.696 DEBUG:teuthology.orchestra.run.smithi032:> route 2024-09-13T18:45:41.757 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2024-09-13T18:45:41.757 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:45:41.757 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:45:41.758 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:45:41.758 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:45:41.758 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:45:41.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.759 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:41.759 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:41.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:45:41.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:45:41.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:45:41.759 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:41.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.895 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-09-13T18:45:41.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.912 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2024-09-13T18:45:41.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:41.975 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:41.975 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:41.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:45:41.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:45:41.975 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:42.094 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:45:42.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:45:42.095 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:42.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:42.241 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2024-09-13T18:45:42.241 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2024-09-13T18:45:42.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2024-09-13T18:45:42.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:45:42.242 DEBUG:teuthology.orchestra.run.smithi032:> ') 2024-09-13T18:45:42.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:42.311 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:42.328 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:45:42.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:45:42.328 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:42.392 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:45:42.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:42.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:45:42.530 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:45:42.530 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:45:42.530 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-09-13T18:45:43.317 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:45:43.317 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:45:43.317 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-09-13T18:45:43.317 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-13T18:45:43.317 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:invalid new device string format 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-13T18:45:43.341 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.32:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-13T18:45:43.342 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e3c44028-1b11-4958-a433-ecab24d0f05e" will pass to kernel 2024-09-13T18:45:43.349 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:45:43.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:43.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:43.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:43.382 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:45:43.456 INFO:teuthology.orchestra.run.smithi032.stdout:client4834 2024-09-13T18:45:43.456 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:45:43.457 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:43.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:43.519 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:45:43.588 INFO:teuthology.orchestra.run.smithi032.stdout:client4834 2024-09-13T18:45:43.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:43.588 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:45:43.659 INFO:teuthology.orchestra.run.smithi032.stdout:client4834 2024-09-13T18:45:43.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:43.660 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e3c44028-1b11-4958-a433-ecab24d0f05e.client4834/status') 2024-09-13T18:45:43.748 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4834 (3)172.21.15.32:0/2668082713 2024-09-13T18:45:43.748 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2024-09-13T18:45:43.748 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2024-09-13T18:45:43.748 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2024-09-13T18:45:43.749 INFO:teuthology.orchestra.run.smithi032.stderr:70 bytes copied, 0.000173632 s, 403 kB/s 2024-09-13T18:45:43.752 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-13T18:45:43.765 INFO:tasks.thrashosds:config is {'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-13T18:45:43.765 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:45:43.766 INFO:tasks.thrashosds:config is {'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-13T18:45:43.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-13T18:45:43.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.980+0000 7fedb5800700 1 Processor -- start 2024-09-13T18:45:43.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.980+0000 7fedb5800700 1 -- start start 2024-09-13T18:45:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.980+0000 7fedb5800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 0x7fedb006f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fedb0070930 0x7fedb01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb0070de0 con 0x7fedb00c5cc0 2024-09-13T18:45:43.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb006fa70 con 0x7fedb0070930 2024-09-13T18:45:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb015aac0 con 0x7fedb00c58e0 2024-09-13T18:45:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 0x7fedb006f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 0x7fedb006f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57764/0 (socket says 172.21.15.32:57764) 2024-09-13T18:45:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb4e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fedb0070930 0x7fedb01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 -- 172.21.15.32:0/4228013666 learned_addr learned my addr 172.21.15.32:0/4228013666 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:43.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedaf400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fedb00c5cc0 0x7fedb006e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52450/0 (socket says 172.21.15.32:52450) 2024-09-13T18:45:43.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 -- 172.21.15.32:0/4228013666 >> v2:172.21.15.86:3300/0 conn(0x7fedb0070930 msgr2=0x7fedb01578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 --2- 172.21.15.32:0/4228013666 >> v2:172.21.15.86:3300/0 conn(0x7fedb0070930 0x7fedb01578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 -- 172.21.15.32:0/4228013666 >> v1:172.21.15.86:6789/0 conn(0x7fedb00c5cc0 legacy=0x7fedb006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 -- 172.21.15.32:0/4228013666 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb015ada0 con 0x7fedb00c58e0 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedaea00700 1 -- 172.21.15.32:0/4228013666 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808144413 0 0) 0x7fedb0070de0 con 0x7fedb00c5cc0 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedafe00700 1 --2- 172.21.15.32:0/4228013666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 0x7fedb006f530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feda0009910 tx=0x7feda0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=557ad90812933297 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedaea00700 1 -- 172.21.15.32:0/4228013666 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0011830 con 0x7fedb00c58e0 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedaea00700 1 -- 172.21.15.32:0/4228013666 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0011990 con 0x7fedb00c58e0 2024-09-13T18:45:43.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedaea00700 1 -- 172.21.15.32:0/4228013666 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0011d40 con 0x7fedb00c58e0 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- 172.21.15.32:0/4228013666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 msgr2=0x7fedb006f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 --2- 172.21.15.32:0/4228013666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 0x7fedb006f530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feda0009910 tx=0x7feda0009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- 172.21.15.32:0/4228013666 shutdown_connections 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 --2- 172.21.15.32:0/4228013666 >> v2:172.21.15.86:3300/0 conn(0x7fedb0070930 0x7fedb01578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 --2- 172.21.15.32:0/4228013666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c58e0 0x7fedb006f530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- 172.21.15.32:0/4228013666 >> 172.21.15.32:0/4228013666 conn(0x7fedb00c8a60 msgr2=0x7fedb00c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- 172.21.15.32:0/4228013666 shutdown_connections 2024-09-13T18:45:43.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.984+0000 7fedb5800700 1 -- 172.21.15.32:0/4228013666 wait complete. 2024-09-13T18:45:43.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 Processor -- start 2024-09-13T18:45:43.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 -- start start 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 0x7fedb015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c5cc0 0x7fedb0155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedb00c1410 0x7fedb0159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00c2830 con 0x7fedb0070930 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb01eca80 con 0x7fedb00c1410 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedb5800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0156050 con 0x7fedb00c5cc0 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.988+0000 7fedafe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 0x7fedb015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 0x7fedb015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37976/0 (socket says 172.21.15.32:37976) 2024-09-13T18:45:43.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 -- 172.21.15.32:0/2310945039 learned_addr learned my addr 172.21.15.32:0/2310945039 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedaf400700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c5cc0 0x7fedb0155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedb4e00700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedb00c1410 0x7fedb0159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 -- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c5cc0 msgr2=0x7fedb0155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c5cc0 0x7fedb0155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 -- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedb00c1410 msgr2=0x7fedb0159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedb00c1410 0x7fedb0159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 -- 172.21.15.32:0/2310945039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0009570 con 0x7fedb0070930 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedafe00700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 0x7fedb015a420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feda0011db0 tx=0x7feda0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda001b840 con 0x7fedb0070930 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda001f070 con 0x7fedb0070930 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda001bc00 con 0x7fedb0070930 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb00c1cb0 con 0x7fedb0070930 2024-09-13T18:45:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb00c2270 con 0x7fedb0070930 2024-09-13T18:45:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.992+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb00c9550 con 0x7fedb0070930 2024-09-13T18:45:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.996+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feda001a430 con 0x7fedb0070930 2024-09-13T18:45:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.996+0000 7feda7e00700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fed90066730 0x7fed90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.996+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feda0021070 con 0x7fedb0070930 2024-09-13T18:45:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.996+0000 7fedaf400700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fed90066730 0x7fed90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:43.996+0000 7fedaf400700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fed90066730 0x7fed90068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fedb00bf5d0 tx=0x7fed9c007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.004+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feda0052590 con 0x7fedb0070930 2024-09-13T18:45:44.192 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.188+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mgr_debug_aggressive_pg_num_changes}] v 0) v1 -- 0x7fedb006fe80 con 0x7fedb0070930 2024-09-13T18:45:44.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.192+0000 7feda7e00700 1 -- 172.21.15.32:0/2310945039 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr_debug_aggressive_pg_num_changes}]=0 v10)=0 v10) v1 ==== 136+0+0 (secure 0 0 0) 0x7feda0006da0 con 0x7fedb0070930 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fed90066730 msgr2=0x7fed90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fed90066730 0x7fed90068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fedb00bf5d0 tx=0x7fed9c007e00 comp rx=0 tx=0).stop 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 msgr2=0x7fedb015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 0x7fedb015a420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feda0011db0 tx=0x7feda0004770 comp rx=0 tx=0).stop 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 shutdown_connections 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fed90066730 0x7fed90068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedb00c1410 0x7fedb0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedb00c5cc0 0x7fedb0155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 --2- 172.21.15.32:0/2310945039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fedb0070930 0x7fedb015a420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 >> 172.21.15.32:0/2310945039 conn(0x7fedb00c8a60 msgr2=0x7fedb00c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 shutdown_connections 2024-09-13T18:45:44.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.196+0000 7fedb5800700 1 -- 172.21.15.32:0/2310945039 wait complete. 2024-09-13T18:45:44.223 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-13T18:45:44.223 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:45:44.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 Processor -- start 2024-09-13T18:45:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 -- start start 2024-09-13T18:45:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 0x7ffa540cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffa540caa20 0x7ffa54071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa540aa610 0x7ffa5415b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa540c9420 con 0x7ffa540aa610 2024-09-13T18:45:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa540c9140 con 0x7ffa540caa20 2024-09-13T18:45:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa5b000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540a95c0 con 0x7ffa540aa230 2024-09-13T18:45:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa53e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 0x7ffa540cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa53400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffa540caa20 0x7ffa54071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa53e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 0x7ffa540cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57774/0 (socket says 172.21.15.32:57774) 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa53e00700 1 -- 172.21.15.32:0/4035915796 learned_addr learned my addr 172.21.15.32:0/4035915796 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.400+0000 7ffa59000700 1 --2- 172.21.15.32:0/4035915796 >> v2:172.21.15.32:3300/0 conn(0x7ffa540aa610 0x7ffa5415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa53e00700 1 -- 172.21.15.32:0/4035915796 >> v2:172.21.15.86:3300/0 conn(0x7ffa540caa20 msgr2=0x7ffa54071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa53e00700 1 --2- 172.21.15.32:0/4035915796 >> v2:172.21.15.86:3300/0 conn(0x7ffa540caa20 0x7ffa54071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa53e00700 1 -- 172.21.15.32:0/4035915796 >> v2:172.21.15.32:3300/0 conn(0x7ffa540aa610 msgr2=0x7ffa5415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa53e00700 1 --2- 172.21.15.32:0/4035915796 >> v2:172.21.15.32:3300/0 conn(0x7ffa540aa610 0x7ffa5415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa53e00700 1 -- 172.21.15.32:0/4035915796 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540a98a0 con 0x7ffa540aa230 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa59000700 1 --2- 172.21.15.32:0/4035915796 >> v2:172.21.15.32:3300/0 conn(0x7ffa540aa610 0x7ffa5415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa53e00700 1 --2- 172.21.15.32:0/4035915796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 0x7ffa540cb770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa5406af10 tx=0x7ffa44009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b2e7e61e6513b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa52a00700 1 -- 172.21.15.32:0/4035915796 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011830 con 0x7ffa540aa230 2024-09-13T18:45:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa52a00700 1 -- 172.21.15.32:0/4035915796 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44011990 con 0x7ffa540aa230 2024-09-13T18:45:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa52a00700 1 -- 172.21.15.32:0/4035915796 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011d20 con 0x7ffa540aa230 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 -- 172.21.15.32:0/4035915796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 msgr2=0x7ffa540cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 --2- 172.21.15.32:0/4035915796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 0x7ffa540cb770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa5406af10 tx=0x7ffa44009bf0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 -- 172.21.15.32:0/4035915796 shutdown_connections 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 --2- 172.21.15.32:0/4035915796 >> v2:172.21.15.32:3300/0 conn(0x7ffa540aa610 0x7ffa5415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 --2- 172.21.15.32:0/4035915796 >> v2:172.21.15.86:3300/0 conn(0x7ffa540caa20 0x7ffa54071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 --2- 172.21.15.32:0/4035915796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540aa230 0x7ffa540cb770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 -- 172.21.15.32:0/4035915796 >> 172.21.15.32:0/4035915796 conn(0x7ffa54071240 msgr2=0x7ffa5406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 -- 172.21.15.32:0/4035915796 shutdown_connections 2024-09-13T18:45:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.404+0000 7ffa5b000700 1 -- 172.21.15.32:0/4035915796 wait complete. 2024-09-13T18:45:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.408+0000 7ffa5b000700 1 Processor -- start 2024-09-13T18:45:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.408+0000 7ffa5b000700 1 -- start start 2024-09-13T18:45:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 0x7ffa54158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa540aa610 0x7ffa540c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540caa20 0x7ffa541ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541586c0 con 0x7ffa540aa230 2024-09-13T18:45:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541ef320 con 0x7ffa540aa610 2024-09-13T18:45:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541f25a0 con 0x7ffa540caa20 2024-09-13T18:45:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 0x7ffa54158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa540aa610 0x7ffa540c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 0x7ffa54158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37986/0 (socket says 172.21.15.32:37986) 2024-09-13T18:45:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53e00700 1 -- 172.21.15.32:0/641923330 learned_addr learned my addr 172.21.15.32:0/641923330 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa59000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540caa20 0x7ffa541ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 -- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540caa20 msgr2=0x7ffa541ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540caa20 0x7ffa541ef7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 -- 172.21.15.32:0/641923330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 msgr2=0x7ffa54158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 0x7ffa54158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 -- 172.21.15.32:0/641923330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44009570 con 0x7ffa540aa610 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53e00700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 0x7ffa54158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa53400700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa540aa610 0x7ffa540c7eb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000e8a0 tx=0x7ffa4000ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40013680 con 0x7ffa540aa610 2024-09-13T18:45:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa541eefd0 con 0x7ffa540aa610 2024-09-13T18:45:44.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa400137e0 con 0x7ffa540aa610 2024-09-13T18:45:44.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40013b70 con 0x7ffa540aa610 2024-09-13T18:45:44.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.412+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa540ad3a0 con 0x7ffa540aa610 2024-09-13T18:45:44.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.416+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa540cb0c0 con 0x7ffa540aa610 2024-09-13T18:45:44.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.416+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa40013cd0 con 0x7ffa540aa610 2024-09-13T18:45:44.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.420+0000 7ffa4be00700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffa34066730 0x7ffa34068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.420+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa400848c0 con 0x7ffa540aa610 2024-09-13T18:45:44.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.420+0000 7ffa53e00700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffa34066730 0x7ffa34068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.420+0000 7ffa53e00700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffa34066730 0x7ffa34068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009150 tx=0x7ffa44008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.424+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa40051810 con 0x7ffa540aa610 2024-09-13T18:45:44.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.612+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa540cbcb0 con 0x7ffa34066730 2024-09-13T18:45:44.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.636+0000 7ffa4be00700 1 -- 172.21.15.32:0/641923330 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345133 (secure 0 0 0) 0x7ffa44011c00 con 0x7ffa34066730 2024-09-13T18:45:44.642 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:44.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffa34066730 msgr2=0x7ffa34068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffa34066730 0x7ffa34068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009150 tx=0x7ffa44008030 comp rx=0 tx=0).stop 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa540aa610 msgr2=0x7ffa540c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa540aa610 0x7ffa540c7eb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000e8a0 tx=0x7ffa4000ebb0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 shutdown_connections 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffa34066730 0x7ffa34068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffa540caa20 0x7ffa541ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa540aa610 0x7ffa540c7eb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 --2- 172.21.15.32:0/641923330 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa540aa230 0x7ffa54158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 >> 172.21.15.32:0/641923330 conn(0x7ffa54071240 msgr2=0x7ffa54072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 shutdown_connections 2024-09-13T18:45:44.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.644+0000 7ffa5b000700 1 -- 172.21.15.32:0/641923330 wait complete. 2024-09-13T18:45:44.651 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:45:44.672 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-13T18:45:44.078555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3416064,"data_stored":2038274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005124"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.332147+0000","last_change":"2024-09-13T18:45:00.864148+0000","last_active":"2024-09-13T18:45:06.332147+0000","last_peered":"2024-09-13T18:45:06.332147+0000","last_clean":"2024-09-13T18:45:06.332147+0000","last_became_active":"2024-09-13T18:45:00.863883+0000","last_became_peered":"2024-09-13T18:45:00.863883+0000","last_unstale":"2024-09-13T18:45:06.332147+0000","last_undegraded":"2024-09-13T18:45:06.332147+0000","last_fullsized":"2024-09-13T18:45:06.332147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:45:05.341525+0000","last_peered":"2024-09-13T18:45:05.341525+0000","last_clean":"2024-09-13T18:45:05.341525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:45:05.341525+0000","last_undegraded":"2024-09-13T18:45:05.341525+0000","last_fullsized":"2024-09-13T18:45:05.341525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824414+0000","last_change":"2024-09-13T18:45:05.359268+0000","last_active":"2024-09-13T18:45:05.824414+0000","last_peered":"2024-09-13T18:45:05.824414+0000","last_clean":"2024-09-13T18:45:05.824414+0000","last_became_active":"2024-09-13T18:45:05.358933+0000","last_became_peered":"2024-09-13T18:45:05.358933+0000","last_unstale":"2024-09-13T18:45:05.824414+0000","last_undegraded":"2024-09-13T18:45:05.824414+0000","last_fullsized":"2024-09-13T18:45:05.824414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:00.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330857+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:45:06.330857+0000","last_peered":"2024-09-13T18:45:06.330857+0000","last_clean":"2024-09-13T18:45:06.330857+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:45:06.330857+0000","last_undegraded":"2024-09-13T18:45:06.330857+0000","last_fullsized":"2024-09-13T18:45:06.330857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341543+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:45:05.341543+0000","last_peered":"2024-09-13T18:45:05.341543+0000","last_clean":"2024-09-13T18:45:05.341543+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:45:05.341543+0000","last_undegraded":"2024-09-13T18:45:05.341543+0000","last_fullsized":"2024-09-13T18:45:05.341543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.357301+0000","last_change":"2024-09-13T18:45:05.351838+0000","last_active":"2024-09-13T18:45:05.357301+0000","last_peered":"2024-09-13T18:45:05.357301+0000","last_clean":"2024-09-13T18:45:05.357301+0000","last_became_active":"2024-09-13T18:45:05.351437+0000","last_became_peered":"2024-09-13T18:45:05.351437+0000","last_unstale":"2024-09-13T18:45:05.357301+0000","last_undegraded":"2024-09-13T18:45:05.357301+0000","last_fullsized":"2024-09-13T18:45:05.357301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:46.755054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328767+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:45:06.328767+0000","last_peered":"2024-09-13T18:45:06.328767+0000","last_clean":"2024-09-13T18:45:06.328767+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:45:06.328767+0000","last_undegraded":"2024-09-13T18:45:06.328767+0000","last_fullsized":"2024-09-13T18:45:06.328767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341864+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:45:05.341864+0000","last_peered":"2024-09-13T18:45:05.341864+0000","last_clean":"2024-09-13T18:45:05.341864+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:45:05.341864+0000","last_undegraded":"2024-09-13T18:45:05.341864+0000","last_fullsized":"2024-09-13T18:45:05.341864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366911+0000","last_change":"2024-09-13T18:45:05.363274+0000","last_active":"2024-09-13T18:45:05.366911+0000","last_peered":"2024-09-13T18:45:05.366911+0000","last_clean":"2024-09-13T18:45:05.366911+0000","last_became_active":"2024-09-13T18:45:05.362870+0000","last_became_peered":"2024-09-13T18:45:05.362870+0000","last_unstale":"2024-09-13T18:45:05.366911+0000","last_undegraded":"2024-09-13T18:45:05.366911+0000","last_fullsized":"2024-09-13T18:45:05.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:54.494396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327442+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:45:06.327442+0000","last_peered":"2024-09-13T18:45:06.327442+0000","last_clean":"2024-09-13T18:45:06.327442+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:45:06.327442+0000","last_undegraded":"2024-09-13T18:45:06.327442+0000","last_fullsized":"2024-09-13T18:45:06.327442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330635+0000","last_change":"2024-09-13T18:45:01.355711+0000","last_active":"2024-09-13T18:45:05.330635+0000","last_peered":"2024-09-13T18:45:05.330635+0000","last_clean":"2024-09-13T18:45:05.330635+0000","last_became_active":"2024-09-13T18:45:01.355463+0000","last_became_peered":"2024-09-13T18:45:01.355463+0000","last_unstale":"2024-09-13T18:45:05.330635+0000","last_undegraded":"2024-09-13T18:45:05.330635+0000","last_fullsized":"2024-09-13T18:45:05.330635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365664+0000","last_change":"2024-09-13T18:45:05.360940+0000","last_active":"2024-09-13T18:45:05.365664+0000","last_peered":"2024-09-13T18:45:05.365664+0000","last_clean":"2024-09-13T18:45:05.365664+0000","last_became_active":"2024-09-13T18:45:05.360491+0000","last_became_peered":"2024-09-13T18:45:05.360491+0000","last_unstale":"2024-09-13T18:45:05.365664+0000","last_undegraded":"2024-09-13T18:45:05.365664+0000","last_fullsized":"2024-09-13T18:45:05.365664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:26.565354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328208+0000","last_change":"2024-09-13T18:45:01.345265+0000","last_active":"2024-09-13T18:45:05.328208+0000","last_peered":"2024-09-13T18:45:05.328208+0000","last_clean":"2024-09-13T18:45:05.328208+0000","last_became_active":"2024-09-13T18:45:01.344996+0000","last_became_peered":"2024-09-13T18:45:01.344996+0000","last_unstale":"2024-09-13T18:45:05.328208+0000","last_undegraded":"2024-09-13T18:45:05.328208+0000","last_fullsized":"2024-09-13T18:45:05.328208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:11.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327878+0000","last_change":"2024-09-13T18:45:00.867459+0000","last_active":"2024-09-13T18:45:06.327878+0000","last_peered":"2024-09-13T18:45:06.327878+0000","last_clean":"2024-09-13T18:45:06.327878+0000","last_became_active":"2024-09-13T18:45:00.867028+0000","last_became_peered":"2024-09-13T18:45:00.867028+0000","last_unstale":"2024-09-13T18:45:06.327878+0000","last_undegraded":"2024-09-13T18:45:06.327878+0000","last_fullsized":"2024-09-13T18:45:06.327878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.262031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370686+0000","last_change":"2024-09-13T18:45:05.368886+0000","last_active":"2024-09-13T18:45:05.370686+0000","last_peered":"2024-09-13T18:45:05.370686+0000","last_clean":"2024-09-13T18:45:05.370686+0000","last_became_active":"2024-09-13T18:45:05.368510+0000","last_became_peered":"2024-09-13T18:45:05.368510+0000","last_unstale":"2024-09-13T18:45:05.370686+0000","last_undegraded":"2024-09-13T18:45:05.370686+0000","last_fullsized":"2024-09-13T18:45:05.370686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:26.194694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341816+0000","last_change":"2024-09-13T18:45:01.332274+0000","last_active":"2024-09-13T18:45:05.341816+0000","last_peered":"2024-09-13T18:45:05.341816+0000","last_clean":"2024-09-13T18:45:05.341816+0000","last_became_active":"2024-09-13T18:45:01.331671+0000","last_became_peered":"2024-09-13T18:45:01.331671+0000","last_unstale":"2024-09-13T18:45:05.341816+0000","last_undegraded":"2024-09-13T18:45:05.341816+0000","last_fullsized":"2024-09-13T18:45:05.341816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:38.214360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332230+0000","last_change":"2024-09-13T18:45:00.843856+0000","last_active":"2024-09-13T18:45:05.332230+0000","last_peered":"2024-09-13T18:45:05.332230+0000","last_clean":"2024-09-13T18:45:05.332230+0000","last_became_active":"2024-09-13T18:45:00.843456+0000","last_became_peered":"2024-09-13T18:45:00.843456+0000","last_unstale":"2024-09-13T18:45:05.332230+0000","last_undegraded":"2024-09-13T18:45:05.332230+0000","last_fullsized":"2024-09-13T18:45:05.332230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:52.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.353284+0000","last_change":"2024-09-13T18:45:05.349810+0000","last_active":"2024-09-13T18:45:05.353284+0000","last_peered":"2024-09-13T18:45:05.353284+0000","last_clean":"2024-09-13T18:45:05.353284+0000","last_became_active":"2024-09-13T18:45:05.348815+0000","last_became_peered":"2024-09-13T18:45:05.348815+0000","last_unstale":"2024-09-13T18:45:05.353284+0000","last_undegraded":"2024-09-13T18:45:05.353284+0000","last_fullsized":"2024-09-13T18:45:05.353284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:20.676172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336422+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:45:05.336422+0000","last_peered":"2024-09-13T18:45:05.336422+0000","last_clean":"2024-09-13T18:45:05.336422+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:45:05.336422+0000","last_undegraded":"2024-09-13T18:45:05.336422+0000","last_fullsized":"2024-09-13T18:45:05.336422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336648+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:45:05.336648+0000","last_peered":"2024-09-13T18:45:05.336648+0000","last_clean":"2024-09-13T18:45:05.336648+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:45:05.336648+0000","last_undegraded":"2024-09-13T18:45:05.336648+0000","last_fullsized":"2024-09-13T18:45:05.336648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.827311+0000","last_change":"2024-09-13T18:45:05.357361+0000","last_active":"2024-09-13T18:45:05.827311+0000","last_peered":"2024-09-13T18:45:05.827311+0000","last_clean":"2024-09-13T18:45:05.827311+0000","last_became_active":"2024-09-13T18:45:05.357036+0000","last_became_peered":"2024-09-13T18:45:05.357036+0000","last_unstale":"2024-09-13T18:45:05.827311+0000","last_undegraded":"2024-09-13T18:45:05.827311+0000","last_fullsized":"2024-09-13T18:45:05.827311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:00.105880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327853+0000","last_change":"2024-09-13T18:45:01.329048+0000","last_active":"2024-09-13T18:45:05.327853+0000","last_peered":"2024-09-13T18:45:05.327853+0000","last_clean":"2024-09-13T18:45:05.327853+0000","last_became_active":"2024-09-13T18:45:01.328762+0000","last_became_peered":"2024-09-13T18:45:01.328762+0000","last_unstale":"2024-09-13T18:45:05.327853+0000","last_undegraded":"2024-09-13T18:45:05.327853+0000","last_fullsized":"2024-09-13T18:45:05.327853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:21.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336115+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:45:05.336115+0000","last_peered":"2024-09-13T18:45:05.336115+0000","last_clean":"2024-09-13T18:45:05.336115+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:45:05.336115+0000","last_undegraded":"2024-09-13T18:45:05.336115+0000","last_fullsized":"2024-09-13T18:45:05.336115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366976+0000","last_change":"2024-09-13T18:45:05.364829+0000","last_active":"2024-09-13T18:45:05.366976+0000","last_peered":"2024-09-13T18:45:05.366976+0000","last_clean":"2024-09-13T18:45:05.366976+0000","last_became_active":"2024-09-13T18:45:05.364538+0000","last_became_peered":"2024-09-13T18:45:05.364538+0000","last_unstale":"2024-09-13T18:45:05.366976+0000","last_undegraded":"2024-09-13T18:45:05.366976+0000","last_fullsized":"2024-09-13T18:45:05.366976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.945041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336737+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:45:05.336737+0000","last_peered":"2024-09-13T18:45:05.336737+0000","last_clean":"2024-09-13T18:45:05.336737+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:45:05.336737+0000","last_undegraded":"2024-09-13T18:45:05.336737+0000","last_fullsized":"2024-09-13T18:45:05.336737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327578+0000","last_change":"2024-09-13T18:45:00.863206+0000","last_active":"2024-09-13T18:45:06.327578+0000","last_peered":"2024-09-13T18:45:06.327578+0000","last_clean":"2024-09-13T18:45:06.327578+0000","last_became_active":"2024-09-13T18:45:00.862917+0000","last_became_peered":"2024-09-13T18:45:00.862917+0000","last_unstale":"2024-09-13T18:45:06.327578+0000","last_undegraded":"2024-09-13T18:45:06.327578+0000","last_fullsized":"2024-09-13T18:45:06.327578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.289662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.367010+0000","last_change":"2024-09-13T18:45:05.364598+0000","last_active":"2024-09-13T18:45:05.367010+0000","last_peered":"2024-09-13T18:45:05.367010+0000","last_clean":"2024-09-13T18:45:05.367010+0000","last_became_active":"2024-09-13T18:45:05.364194+0000","last_became_peered":"2024-09-13T18:45:05.364194+0000","last_unstale":"2024-09-13T18:45:05.367010+0000","last_undegraded":"2024-09-13T18:45:05.367010+0000","last_fullsized":"2024-09-13T18:45:05.367010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.594403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336439+0000","last_change":"2024-09-13T18:45:01.333827+0000","last_active":"2024-09-13T18:45:05.336439+0000","last_peered":"2024-09-13T18:45:05.336439+0000","last_clean":"2024-09-13T18:45:05.336439+0000","last_became_active":"2024-09-13T18:45:01.333500+0000","last_became_peered":"2024-09-13T18:45:01.333500+0000","last_unstale":"2024-09-13T18:45:05.336439+0000","last_undegraded":"2024-09-13T18:45:05.336439+0000","last_fullsized":"2024-09-13T18:45:05.336439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:37.963424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826853+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:45:05.826853+0000","last_peered":"2024-09-13T18:45:05.826853+0000","last_clean":"2024-09-13T18:45:05.826853+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:45:05.826853+0000","last_undegraded":"2024-09-13T18:45:05.826853+0000","last_fullsized":"2024-09-13T18:45:05.826853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824166+0000","last_change":"2024-09-13T18:45:05.349605+0000","last_active":"2024-09-13T18:45:05.824166+0000","last_peered":"2024-09-13T18:45:05.824166+0000","last_clean":"2024-09-13T18:45:05.824166+0000","last_became_active":"2024-09-13T18:45:05.349213+0000","last_became_peered":"2024-09-13T18:45:05.349213+0000","last_unstale":"2024-09-13T18:45:05.824166+0000","last_undegraded":"2024-09-13T18:45:05.824166+0000","last_fullsized":"2024-09-13T18:45:05.824166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:17.638750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333067+0000","last_change":"2024-09-13T18:45:01.331576+0000","last_active":"2024-09-13T18:45:05.333067+0000","last_peered":"2024-09-13T18:45:05.333067+0000","last_clean":"2024-09-13T18:45:05.333067+0000","last_became_active":"2024-09-13T18:45:01.331313+0000","last_became_peered":"2024-09-13T18:45:01.331313+0000","last_unstale":"2024-09-13T18:45:05.333067+0000","last_undegraded":"2024-09-13T18:45:05.333067+0000","last_fullsized":"2024-09-13T18:45:05.333067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:15.549020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330831+0000","last_change":"2024-09-13T18:45:00.856368+0000","last_active":"2024-09-13T18:45:05.330831+0000","last_peered":"2024-09-13T18:45:05.330831+0000","last_clean":"2024-09-13T18:45:05.330831+0000","last_became_active":"2024-09-13T18:45:00.856067+0000","last_became_peered":"2024-09-13T18:45:00.856067+0000","last_unstale":"2024-09-13T18:45:05.330831+0000","last_undegraded":"2024-09-13T18:45:05.330831+0000","last_fullsized":"2024-09-13T18:45:05.330831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:29.141185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602069+0000","last_change":"2024-09-13T18:45:05.358233+0000","last_active":"2024-09-13T18:45:06.602069+0000","last_peered":"2024-09-13T18:45:06.602069+0000","last_clean":"2024-09-13T18:45:06.602069+0000","last_became_active":"2024-09-13T18:45:05.357819+0000","last_became_peered":"2024-09-13T18:45:05.357819+0000","last_unstale":"2024-09-13T18:45:06.602069+0000","last_undegraded":"2024-09-13T18:45:06.602069+0000","last_fullsized":"2024-09-13T18:45:06.602069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:06.840619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.349889+0000","last_change":"2024-09-13T18:45:01.323768+0000","last_active":"2024-09-13T18:45:05.349889+0000","last_peered":"2024-09-13T18:45:05.349889+0000","last_clean":"2024-09-13T18:45:05.349889+0000","last_became_active":"2024-09-13T18:45:01.323449+0000","last_became_peered":"2024-09-13T18:45:01.323449+0000","last_unstale":"2024-09-13T18:45:05.349889+0000","last_undegraded":"2024-09-13T18:45:05.349889+0000","last_fullsized":"2024-09-13T18:45:05.349889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:32.782226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340579+0000","last_change":"2024-09-13T18:45:00.848001+0000","last_active":"2024-09-13T18:45:05.340579+0000","last_peered":"2024-09-13T18:45:05.340579+0000","last_clean":"2024-09-13T18:45:05.340579+0000","last_became_active":"2024-09-13T18:45:00.847720+0000","last_became_peered":"2024-09-13T18:45:00.847720+0000","last_unstale":"2024-09-13T18:45:05.340579+0000","last_undegraded":"2024-09-13T18:45:05.340579+0000","last_fullsized":"2024-09-13T18:45:05.340579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.566248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.601658+0000","last_change":"2024-09-13T18:45:05.344571+0000","last_active":"2024-09-13T18:45:06.601658+0000","last_peered":"2024-09-13T18:45:06.601658+0000","last_clean":"2024-09-13T18:45:06.601658+0000","last_became_active":"2024-09-13T18:45:05.344171+0000","last_became_peered":"2024-09-13T18:45:05.344171+0000","last_unstale":"2024-09-13T18:45:06.601658+0000","last_undegraded":"2024-09-13T18:45:06.601658+0000","last_fullsized":"2024-09-13T18:45:06.601658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:15.473898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338368+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:45:05.338368+0000","last_peered":"2024-09-13T18:45:05.338368+0000","last_clean":"2024-09-13T18:45:05.338368+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:45:05.338368+0000","last_undegraded":"2024-09-13T18:45:05.338368+0000","last_fullsized":"2024-09-13T18:45:05.338368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329231+0000","last_change":"2024-09-13T18:45:00.861944+0000","last_active":"2024-09-13T18:45:05.329231+0000","last_peered":"2024-09-13T18:45:05.329231+0000","last_clean":"2024-09-13T18:45:05.329231+0000","last_became_active":"2024-09-13T18:45:00.861249+0000","last_became_peered":"2024-09-13T18:45:00.861249+0000","last_unstale":"2024-09-13T18:45:05.329231+0000","last_undegraded":"2024-09-13T18:45:05.329231+0000","last_fullsized":"2024-09-13T18:45:05.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:09.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602419+0000","last_change":"2024-09-13T18:45:05.351737+0000","last_active":"2024-09-13T18:45:06.602419+0000","last_peered":"2024-09-13T18:45:06.602419+0000","last_clean":"2024-09-13T18:45:06.602419+0000","last_became_active":"2024-09-13T18:45:05.351311+0000","last_became_peered":"2024-09-13T18:45:05.351311+0000","last_unstale":"2024-09-13T18:45:06.602419+0000","last_undegraded":"2024-09-13T18:45:06.602419+0000","last_fullsized":"2024-09-13T18:45:06.602419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.229616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340831+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:45:05.340831+0000","last_peered":"2024-09-13T18:45:05.340831+0000","last_clean":"2024-09-13T18:45:05.340831+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:45:05.340831+0000","last_undegraded":"2024-09-13T18:45:05.340831+0000","last_fullsized":"2024-09-13T18:45:05.340831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341794+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:45:05.341794+0000","last_peered":"2024-09-13T18:45:05.341794+0000","last_clean":"2024-09-13T18:45:05.341794+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:45:05.341794+0000","last_undegraded":"2024-09-13T18:45:05.341794+0000","last_fullsized":"2024-09-13T18:45:05.341794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602617+0000","last_change":"2024-09-13T18:45:05.354392+0000","last_active":"2024-09-13T18:45:06.602617+0000","last_peered":"2024-09-13T18:45:06.602617+0000","last_clean":"2024-09-13T18:45:06.602617+0000","last_became_active":"2024-09-13T18:45:05.354022+0000","last_became_peered":"2024-09-13T18:45:05.354022+0000","last_unstale":"2024-09-13T18:45:06.602617+0000","last_undegraded":"2024-09-13T18:45:06.602617+0000","last_fullsized":"2024-09-13T18:45:06.602617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.160746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330365+0000","last_change":"2024-09-13T18:45:01.342993+0000","last_active":"2024-09-13T18:45:05.330365+0000","last_peered":"2024-09-13T18:45:05.330365+0000","last_clean":"2024-09-13T18:45:05.330365+0000","last_became_active":"2024-09-13T18:45:01.342730+0000","last_became_peered":"2024-09-13T18:45:01.342730+0000","last_unstale":"2024-09-13T18:45:05.330365+0000","last_undegraded":"2024-09-13T18:45:05.330365+0000","last_fullsized":"2024-09-13T18:45:05.330365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:53.451442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330417+0000","last_change":"2024-09-13T18:45:00.861710+0000","last_active":"2024-09-13T18:45:05.330417+0000","last_peered":"2024-09-13T18:45:05.330417+0000","last_clean":"2024-09-13T18:45:05.330417+0000","last_became_active":"2024-09-13T18:45:00.861091+0000","last_became_peered":"2024-09-13T18:45:00.861091+0000","last_unstale":"2024-09-13T18:45:05.330417+0000","last_undegraded":"2024-09-13T18:45:05.330417+0000","last_fullsized":"2024-09-13T18:45:05.330417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:30.431815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334987+0000","last_change":"2024-09-13T18:45:05.349312+0000","last_active":"2024-09-13T18:45:06.334987+0000","last_peered":"2024-09-13T18:45:06.334987+0000","last_clean":"2024-09-13T18:45:06.334987+0000","last_became_active":"2024-09-13T18:45:05.348858+0000","last_became_peered":"2024-09-13T18:45:05.348858+0000","last_unstale":"2024-09-13T18:45:06.334987+0000","last_undegraded":"2024-09-13T18:45:06.334987+0000","last_fullsized":"2024-09-13T18:45:06.334987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:09.955609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336475+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:45:05.336475+0000","last_peered":"2024-09-13T18:45:05.336475+0000","last_clean":"2024-09-13T18:45:05.336475+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:45:05.336475+0000","last_undegraded":"2024-09-13T18:45:05.336475+0000","last_fullsized":"2024-09-13T18:45:05.336475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328614+0000","last_change":"2024-09-13T18:45:00.870886+0000","last_active":"2024-09-13T18:45:05.328614+0000","last_peered":"2024-09-13T18:45:05.328614+0000","last_clean":"2024-09-13T18:45:05.328614+0000","last_became_active":"2024-09-13T18:45:00.870563+0000","last_became_peered":"2024-09-13T18:45:00.870563+0000","last_unstale":"2024-09-13T18:45:05.328614+0000","last_undegraded":"2024-09-13T18:45:05.328614+0000","last_fullsized":"2024-09-13T18:45:05.328614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341074+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:45:05.341074+0000","last_peered":"2024-09-13T18:45:05.341074+0000","last_clean":"2024-09-13T18:45:05.341074+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:45:05.341074+0000","last_undegraded":"2024-09-13T18:45:05.341074+0000","last_fullsized":"2024-09-13T18:45:05.341074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.371253+0000","last_change":"2024-09-13T18:45:05.369616+0000","last_active":"2024-09-13T18:45:05.371253+0000","last_peered":"2024-09-13T18:45:05.371253+0000","last_clean":"2024-09-13T18:45:05.371253+0000","last_became_active":"2024-09-13T18:45:05.368904+0000","last_became_peered":"2024-09-13T18:45:05.368904+0000","last_unstale":"2024-09-13T18:45:05.371253+0000","last_undegraded":"2024-09-13T18:45:05.371253+0000","last_fullsized":"2024-09-13T18:45:05.371253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:55.985326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330699+0000","last_change":"2024-09-13T18:45:01.342548+0000","last_active":"2024-09-13T18:45:05.330699+0000","last_peered":"2024-09-13T18:45:05.330699+0000","last_clean":"2024-09-13T18:45:05.330699+0000","last_became_active":"2024-09-13T18:45:01.342038+0000","last_became_peered":"2024-09-13T18:45:01.342038+0000","last_unstale":"2024-09-13T18:45:05.330699+0000","last_undegraded":"2024-09-13T18:45:05.330699+0000","last_fullsized":"2024-09-13T18:45:05.330699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.863893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333149+0000","last_change":"2024-09-13T18:45:00.859879+0000","last_active":"2024-09-13T18:45:05.333149+0000","last_peered":"2024-09-13T18:45:05.333149+0000","last_clean":"2024-09-13T18:45:05.333149+0000","last_became_active":"2024-09-13T18:45:00.859621+0000","last_became_peered":"2024-09-13T18:45:00.859621+0000","last_unstale":"2024-09-13T18:45:05.333149+0000","last_undegraded":"2024-09-13T18:45:05.333149+0000","last_fullsized":"2024-09-13T18:45:05.333149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:17.771135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366813+0000","last_change":"2024-09-13T18:45:05.362604+0000","last_active":"2024-09-13T18:45:05.366813+0000","last_peered":"2024-09-13T18:45:05.366813+0000","last_clean":"2024-09-13T18:45:05.366813+0000","last_became_active":"2024-09-13T18:45:05.362142+0000","last_became_peered":"2024-09-13T18:45:05.362142+0000","last_unstale":"2024-09-13T18:45:05.366813+0000","last_undegraded":"2024-09-13T18:45:05.366813+0000","last_fullsized":"2024-09-13T18:45:05.366813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342162+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:45:05.342162+0000","last_peered":"2024-09-13T18:45:05.342162+0000","last_clean":"2024-09-13T18:45:05.342162+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:45:05.342162+0000","last_undegraded":"2024-09-13T18:45:05.342162+0000","last_fullsized":"2024-09-13T18:45:05.342162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333613+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:45:06.333613+0000","last_peered":"2024-09-13T18:45:06.333613+0000","last_clean":"2024-09-13T18:45:06.333613+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:45:06.333613+0000","last_undegraded":"2024-09-13T18:45:06.333613+0000","last_fullsized":"2024-09-13T18:45:06.333613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334610+0000","last_change":"2024-09-13T18:45:05.359310+0000","last_active":"2024-09-13T18:45:06.334610+0000","last_peered":"2024-09-13T18:45:06.334610+0000","last_clean":"2024-09-13T18:45:06.334610+0000","last_became_active":"2024-09-13T18:45:05.358824+0000","last_became_peered":"2024-09-13T18:45:05.358824+0000","last_unstale":"2024-09-13T18:45:06.334610+0000","last_undegraded":"2024-09-13T18:45:06.334610+0000","last_fullsized":"2024-09-13T18:45:06.334610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:24.283145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338768+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:45:05.338768+0000","last_peered":"2024-09-13T18:45:05.338768+0000","last_clean":"2024-09-13T18:45:05.338768+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:45:05.338768+0000","last_undegraded":"2024-09-13T18:45:05.338768+0000","last_fullsized":"2024-09-13T18:45:05.338768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333901+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:45:06.333901+0000","last_peered":"2024-09-13T18:45:06.333901+0000","last_clean":"2024-09-13T18:45:06.333901+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:45:06.333901+0000","last_undegraded":"2024-09-13T18:45:06.333901+0000","last_fullsized":"2024-09-13T18:45:06.333901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365485+0000","last_change":"2024-09-13T18:45:05.362240+0000","last_active":"2024-09-13T18:45:05.365485+0000","last_peered":"2024-09-13T18:45:05.365485+0000","last_clean":"2024-09-13T18:45:05.365485+0000","last_became_active":"2024-09-13T18:45:05.361810+0000","last_became_peered":"2024-09-13T18:45:05.361810+0000","last_unstale":"2024-09-13T18:45:05.365485+0000","last_undegraded":"2024-09-13T18:45:05.365485+0000","last_fullsized":"2024-09-13T18:45:05.365485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:38.083269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350837+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:45:05.350837+0000","last_peered":"2024-09-13T18:45:05.350837+0000","last_clean":"2024-09-13T18:45:05.350837+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:45:05.350837+0000","last_undegraded":"2024-09-13T18:45:05.350837+0000","last_fullsized":"2024-09-13T18:45:05.350837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.326163+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:45:06.326163+0000","last_peered":"2024-09-13T18:45:06.326163+0000","last_clean":"2024-09-13T18:45:06.326163+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:45:06.326163+0000","last_undegraded":"2024-09-13T18:45:06.326163+0000","last_fullsized":"2024-09-13T18:45:06.326163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370349+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:45:05.370349+0000","last_peered":"2024-09-13T18:45:05.370349+0000","last_clean":"2024-09-13T18:45:05.370349+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:45:05.370349+0000","last_undegraded":"2024-09-13T18:45:05.370349+0000","last_fullsized":"2024-09-13T18:45:05.370349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327734+0000","last_change":"2024-09-13T18:45:01.346791+0000","last_active":"2024-09-13T18:45:05.327734+0000","last_peered":"2024-09-13T18:45:05.327734+0000","last_clean":"2024-09-13T18:45:05.327734+0000","last_became_active":"2024-09-13T18:45:01.346515+0000","last_became_peered":"2024-09-13T18:45:01.346515+0000","last_unstale":"2024-09-13T18:45:05.327734+0000","last_undegraded":"2024-09-13T18:45:05.327734+0000","last_fullsized":"2024-09-13T18:45:05.327734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.337346+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:45:06.337346+0000","last_peered":"2024-09-13T18:45:06.337346+0000","last_clean":"2024-09-13T18:45:06.337346+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:45:06.337346+0000","last_undegraded":"2024-09-13T18:45:06.337346+0000","last_fullsized":"2024-09-13T18:45:06.337346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335188+0000","last_change":"2024-09-13T18:45:05.348324+0000","last_active":"2024-09-13T18:45:06.335188+0000","last_peered":"2024-09-13T18:45:06.335188+0000","last_clean":"2024-09-13T18:45:06.335188+0000","last_became_active":"2024-09-13T18:45:05.347908+0000","last_became_peered":"2024-09-13T18:45:05.347908+0000","last_unstale":"2024-09-13T18:45:06.335188+0000","last_undegraded":"2024-09-13T18:45:06.335188+0000","last_fullsized":"2024-09-13T18:45:06.335188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:29.155413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340979+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:45:05.340979+0000","last_peered":"2024-09-13T18:45:05.340979+0000","last_clean":"2024-09-13T18:45:05.340979+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:45:05.340979+0000","last_undegraded":"2024-09-13T18:45:05.340979+0000","last_fullsized":"2024-09-13T18:45:05.340979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336406+0000","last_change":"2024-09-13T18:45:00.866140+0000","last_active":"2024-09-13T18:45:05.336406+0000","last_peered":"2024-09-13T18:45:05.336406+0000","last_clean":"2024-09-13T18:45:05.336406+0000","last_became_active":"2024-09-13T18:45:00.865898+0000","last_became_peered":"2024-09-13T18:45:00.865898+0000","last_unstale":"2024-09-13T18:45:05.336406+0000","last_undegraded":"2024-09-13T18:45:05.336406+0000","last_fullsized":"2024-09-13T18:45:05.336406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:16.378417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335021+0000","last_change":"2024-09-13T18:45:05.359539+0000","last_active":"2024-09-13T18:45:06.335021+0000","last_peered":"2024-09-13T18:45:06.335021+0000","last_clean":"2024-09-13T18:45:06.335021+0000","last_became_active":"2024-09-13T18:45:05.358801+0000","last_became_peered":"2024-09-13T18:45:05.358801+0000","last_unstale":"2024-09-13T18:45:06.335021+0000","last_undegraded":"2024-09-13T18:45:06.335021+0000","last_fullsized":"2024-09-13T18:45:06.335021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:04.787244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328147+0000","last_change":"2024-09-13T18:45:01.347194+0000","last_active":"2024-09-13T18:45:05.328147+0000","last_peered":"2024-09-13T18:45:05.328147+0000","last_clean":"2024-09-13T18:45:05.328147+0000","last_became_active":"2024-09-13T18:45:01.346941+0000","last_became_peered":"2024-09-13T18:45:01.346941+0000","last_unstale":"2024-09-13T18:45:05.328147+0000","last_undegraded":"2024-09-13T18:45:05.328147+0000","last_fullsized":"2024-09-13T18:45:05.328147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:05.677969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328824+0000","last_change":"2024-09-13T18:45:00.858781+0000","last_active":"2024-09-13T18:45:05.328824+0000","last_peered":"2024-09-13T18:45:05.328824+0000","last_clean":"2024-09-13T18:45:05.328824+0000","last_became_active":"2024-09-13T18:45:00.858418+0000","last_became_peered":"2024-09-13T18:45:00.858418+0000","last_unstale":"2024-09-13T18:45:05.328824+0000","last_undegraded":"2024-09-13T18:45:05.328824+0000","last_fullsized":"2024-09-13T18:45:05.328824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:23.372534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602425+0000","last_change":"2024-09-13T18:45:05.354664+0000","last_active":"2024-09-13T18:45:06.602425+0000","last_peered":"2024-09-13T18:45:06.602425+0000","last_clean":"2024-09-13T18:45:06.602425+0000","last_became_active":"2024-09-13T18:45:05.354148+0000","last_became_peered":"2024-09-13T18:45:05.354148+0000","last_unstale":"2024-09-13T18:45:06.602425+0000","last_undegraded":"2024-09-13T18:45:06.602425+0000","last_fullsized":"2024-09-13T18:45:06.602425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332095+0000","last_change":"2024-09-13T18:45:01.339092+0000","last_active":"2024-09-13T18:45:05.332095+0000","last_peered":"2024-09-13T18:45:05.332095+0000","last_clean":"2024-09-13T18:45:05.332095+0000","last_became_active":"2024-09-13T18:45:01.338762+0000","last_became_peered":"2024-09-13T18:45:01.338762+0000","last_unstale":"2024-09-13T18:45:05.332095+0000","last_undegraded":"2024-09-13T18:45:05.332095+0000","last_fullsized":"2024-09-13T18:45:05.332095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:01.205580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330228+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:45:06.330228+0000","last_peered":"2024-09-13T18:45:06.330228+0000","last_clean":"2024-09-13T18:45:06.330228+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:45:06.330228+0000","last_undegraded":"2024-09-13T18:45:06.330228+0000","last_fullsized":"2024-09-13T18:45:06.330228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346254+0000","last_change":"2024-09-13T18:45:05.343560+0000","last_active":"2024-09-13T18:45:05.346254+0000","last_peered":"2024-09-13T18:45:05.346254+0000","last_clean":"2024-09-13T18:45:05.346254+0000","last_became_active":"2024-09-13T18:45:05.342971+0000","last_became_peered":"2024-09-13T18:45:05.342971+0000","last_unstale":"2024-09-13T18:45:05.346254+0000","last_undegraded":"2024-09-13T18:45:05.346254+0000","last_fullsized":"2024-09-13T18:45:05.346254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:35.432501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338671+0000","last_change":"2024-09-13T18:45:01.345151+0000","last_active":"2024-09-13T18:45:05.338671+0000","last_peered":"2024-09-13T18:45:05.338671+0000","last_clean":"2024-09-13T18:45:05.338671+0000","last_became_active":"2024-09-13T18:45:01.344621+0000","last_became_peered":"2024-09-13T18:45:01.344621+0000","last_unstale":"2024-09-13T18:45:05.338671+0000","last_undegraded":"2024-09-13T18:45:05.338671+0000","last_fullsized":"2024-09-13T18:45:05.338671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:08.938308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:15.780850+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:45:15.780850+0000","last_peered":"2024-09-13T18:45:15.780850+0000","last_clean":"2024-09-13T18:45:15.780850+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:45:15.780850+0000","last_undegraded":"2024-09-13T18:45:15.780850+0000","last_fullsized":"2024-09-13T18:45:15.780850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825851+0000","last_change":"2024-09-13T18:45:05.349290+0000","last_active":"2024-09-13T18:45:05.825851+0000","last_peered":"2024-09-13T18:45:05.825851+0000","last_clean":"2024-09-13T18:45:05.825851+0000","last_became_active":"2024-09-13T18:45:05.347388+0000","last_became_peered":"2024-09-13T18:45:05.347388+0000","last_unstale":"2024-09-13T18:45:05.825851+0000","last_undegraded":"2024-09-13T18:45:05.825851+0000","last_fullsized":"2024-09-13T18:45:05.825851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:22.040097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328132+0000","last_change":"2024-09-13T18:45:01.346055+0000","last_active":"2024-09-13T18:45:05.328132+0000","last_peered":"2024-09-13T18:45:05.328132+0000","last_clean":"2024-09-13T18:45:05.328132+0000","last_became_active":"2024-09-13T18:45:01.345837+0000","last_became_peered":"2024-09-13T18:45:01.345837+0000","last_unstale":"2024-09-13T18:45:05.328132+0000","last_undegraded":"2024-09-13T18:45:05.328132+0000","last_fullsized":"2024-09-13T18:45:05.328132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:49.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.331407+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:45:06.331407+0000","last_peered":"2024-09-13T18:45:06.331407+0000","last_clean":"2024-09-13T18:45:06.331407+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:45:06.331407+0000","last_undegraded":"2024-09-13T18:45:06.331407+0000","last_fullsized":"2024-09-13T18:45:06.331407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.374060+0000","last_change":"2024-09-13T18:45:05.372988+0000","last_active":"2024-09-13T18:45:05.374060+0000","last_peered":"2024-09-13T18:45:05.374060+0000","last_clean":"2024-09-13T18:45:05.374060+0000","last_became_active":"2024-09-13T18:45:05.372512+0000","last_became_peered":"2024-09-13T18:45:05.372512+0000","last_unstale":"2024-09-13T18:45:05.374060+0000","last_undegraded":"2024-09-13T18:45:05.374060+0000","last_fullsized":"2024-09-13T18:45:05.374060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:34.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341638+0000","last_change":"2024-09-13T18:45:01.338401+0000","last_active":"2024-09-13T18:45:05.341638+0000","last_peered":"2024-09-13T18:45:05.341638+0000","last_clean":"2024-09-13T18:45:05.341638+0000","last_became_active":"2024-09-13T18:45:01.338030+0000","last_became_peered":"2024-09-13T18:45:01.338030+0000","last_unstale":"2024-09-13T18:45:05.341638+0000","last_undegraded":"2024-09-13T18:45:05.341638+0000","last_fullsized":"2024-09-13T18:45:05.341638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:37.030900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339846+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:45:05.339846+0000","last_peered":"2024-09-13T18:45:05.339846+0000","last_clean":"2024-09-13T18:45:05.339846+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:45:05.339846+0000","last_undegraded":"2024-09-13T18:45:05.339846+0000","last_fullsized":"2024-09-13T18:45:05.339846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.823921+0000","last_change":"2024-09-13T18:45:05.359747+0000","last_active":"2024-09-13T18:45:05.823921+0000","last_peered":"2024-09-13T18:45:05.823921+0000","last_clean":"2024-09-13T18:45:05.823921+0000","last_became_active":"2024-09-13T18:45:05.359227+0000","last_became_peered":"2024-09-13T18:45:05.359227+0000","last_unstale":"2024-09-13T18:45:05.823921+0000","last_undegraded":"2024-09-13T18:45:05.823921+0000","last_fullsized":"2024-09-13T18:45:05.823921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:13.356194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350743+0000","last_change":"2024-09-13T18:45:01.330522+0000","last_active":"2024-09-13T18:45:05.350743+0000","last_peered":"2024-09-13T18:45:05.350743+0000","last_clean":"2024-09-13T18:45:05.350743+0000","last_became_active":"2024-09-13T18:45:01.330292+0000","last_became_peered":"2024-09-13T18:45:01.330292+0000","last_unstale":"2024-09-13T18:45:05.350743+0000","last_undegraded":"2024-09-13T18:45:05.350743+0000","last_fullsized":"2024-09-13T18:45:05.350743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.819826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345469+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:45:05.345469+0000","last_peered":"2024-09-13T18:45:05.345469+0000","last_clean":"2024-09-13T18:45:05.345469+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:45:05.345469+0000","last_undegraded":"2024-09-13T18:45:05.345469+0000","last_fullsized":"2024-09-13T18:45:05.345469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825026+0000","last_change":"2024-09-13T18:45:05.345124+0000","last_active":"2024-09-13T18:45:05.825026+0000","last_peered":"2024-09-13T18:45:05.825026+0000","last_clean":"2024-09-13T18:45:05.825026+0000","last_became_active":"2024-09-13T18:45:05.344585+0000","last_became_peered":"2024-09-13T18:45:05.344585+0000","last_unstale":"2024-09-13T18:45:05.825026+0000","last_undegraded":"2024-09-13T18:45:05.825026+0000","last_fullsized":"2024-09-13T18:45:05.825026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.627036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826452+0000","last_change":"2024-09-13T18:45:05.354450+0000","last_active":"2024-09-13T18:45:05.826452+0000","last_peered":"2024-09-13T18:45:05.826452+0000","last_clean":"2024-09-13T18:45:05.826452+0000","last_became_active":"2024-09-13T18:45:05.354125+0000","last_became_peered":"2024-09-13T18:45:05.354125+0000","last_unstale":"2024-09-13T18:45:05.826452+0000","last_undegraded":"2024-09-13T18:45:05.826452+0000","last_fullsized":"2024-09-13T18:45:05.826452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:40.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335038+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:45:05.335038+0000","last_peered":"2024-09-13T18:45:05.335038+0000","last_clean":"2024-09-13T18:45:05.335038+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:45:05.335038+0000","last_undegraded":"2024-09-13T18:45:05.335038+0000","last_fullsized":"2024-09-13T18:45:05.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330036+0000","last_change":"2024-09-13T18:45:00.865663+0000","last_active":"2024-09-13T18:45:05.330036+0000","last_peered":"2024-09-13T18:45:05.330036+0000","last_clean":"2024-09-13T18:45:05.330036+0000","last_became_active":"2024-09-13T18:45:00.864827+0000","last_became_peered":"2024-09-13T18:45:00.864827+0000","last_unstale":"2024-09-13T18:45:05.330036+0000","last_undegraded":"2024-09-13T18:45:05.330036+0000","last_fullsized":"2024-09-13T18:45:05.330036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:17.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.360954+0000","last_change":"2024-09-13T18:45:05.358868+0000","last_active":"2024-09-13T18:45:05.360954+0000","last_peered":"2024-09-13T18:45:05.360954+0000","last_clean":"2024-09-13T18:45:05.360954+0000","last_became_active":"2024-09-13T18:45:05.358265+0000","last_became_peered":"2024-09-13T18:45:05.358265+0000","last_unstale":"2024-09-13T18:45:05.360954+0000","last_undegraded":"2024-09-13T18:45:05.360954+0000","last_fullsized":"2024-09-13T18:45:05.360954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:54.622499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339482+0000","last_change":"2024-09-13T18:45:01.331909+0000","last_active":"2024-09-13T18:45:05.339482+0000","last_peered":"2024-09-13T18:45:05.339482+0000","last_clean":"2024-09-13T18:45:05.339482+0000","last_became_active":"2024-09-13T18:45:01.331544+0000","last_became_peered":"2024-09-13T18:45:01.331544+0000","last_unstale":"2024-09-13T18:45:05.339482+0000","last_undegraded":"2024-09-13T18:45:05.339482+0000","last_fullsized":"2024-09-13T18:45:05.339482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:02.211129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330589+0000","last_change":"2024-09-13T18:45:00.860547+0000","last_active":"2024-09-13T18:45:05.330589+0000","last_peered":"2024-09-13T18:45:05.330589+0000","last_clean":"2024-09-13T18:45:05.330589+0000","last_became_active":"2024-09-13T18:45:00.860280+0000","last_became_peered":"2024-09-13T18:45:00.860280+0000","last_unstale":"2024-09-13T18:45:05.330589+0000","last_undegraded":"2024-09-13T18:45:05.330589+0000","last_fullsized":"2024-09-13T18:45:05.330589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.637492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328943+0000","last_change":"2024-09-13T18:45:00.868492+0000","last_active":"2024-09-13T18:45:06.328943+0000","last_peered":"2024-09-13T18:45:06.328943+0000","last_clean":"2024-09-13T18:45:06.328943+0000","last_became_active":"2024-09-13T18:45:00.867974+0000","last_became_peered":"2024-09-13T18:45:00.867974+0000","last_unstale":"2024-09-13T18:45:06.328943+0000","last_undegraded":"2024-09-13T18:45:06.328943+0000","last_fullsized":"2024-09-13T18:45:06.328943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:23.081313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335187+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:45:05.335187+0000","last_peered":"2024-09-13T18:45:05.335187+0000","last_clean":"2024-09-13T18:45:05.335187+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:45:05.335187+0000","last_undegraded":"2024-09-13T18:45:05.335187+0000","last_fullsized":"2024-09-13T18:45:05.335187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826337+0000","last_change":"2024-09-13T18:45:05.353000+0000","last_active":"2024-09-13T18:45:05.826337+0000","last_peered":"2024-09-13T18:45:05.826337+0000","last_clean":"2024-09-13T18:45:05.826337+0000","last_became_active":"2024-09-13T18:45:05.352517+0000","last_became_peered":"2024-09-13T18:45:05.352517+0000","last_unstale":"2024-09-13T18:45:05.826337+0000","last_undegraded":"2024-09-13T18:45:05.826337+0000","last_fullsized":"2024-09-13T18:45:05.826337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:55.468696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333615+0000","last_change":"2024-09-13T18:45:00.846090+0000","last_active":"2024-09-13T18:45:06.333615+0000","last_peered":"2024-09-13T18:45:06.333615+0000","last_clean":"2024-09-13T18:45:06.333615+0000","last_became_active":"2024-09-13T18:45:00.845817+0000","last_became_peered":"2024-09-13T18:45:00.845817+0000","last_unstale":"2024-09-13T18:45:06.333615+0000","last_undegraded":"2024-09-13T18:45:06.333615+0000","last_fullsized":"2024-09-13T18:45:06.333615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.183900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341132+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:45:05.341132+0000","last_peered":"2024-09-13T18:45:05.341132+0000","last_clean":"2024-09-13T18:45:05.341132+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:45:05.341132+0000","last_undegraded":"2024-09-13T18:45:05.341132+0000","last_fullsized":"2024-09-13T18:45:05.341132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826910+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:45:05.826910+0000","last_peered":"2024-09-13T18:45:05.826910+0000","last_clean":"2024-09-13T18:45:05.826910+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:45:05.826910+0000","last_undegraded":"2024-09-13T18:45:05.826910+0000","last_fullsized":"2024-09-13T18:45:05.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.344158+0000","last_change":"2024-09-13T18:45:01.333747+0000","last_active":"2024-09-13T18:45:05.344158+0000","last_peered":"2024-09-13T18:45:05.344158+0000","last_clean":"2024-09-13T18:45:05.344158+0000","last_became_active":"2024-09-13T18:45:01.332419+0000","last_became_peered":"2024-09-13T18:45:01.332419+0000","last_unstale":"2024-09-13T18:45:05.344158+0000","last_undegraded":"2024-09-13T18:45:05.344158+0000","last_fullsized":"2024-09-13T18:45:05.344158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:04.031786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341696+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:45:05.341696+0000","last_peered":"2024-09-13T18:45:05.341696+0000","last_clean":"2024-09-13T18:45:05.341696+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:45:05.341696+0000","last_undegraded":"2024-09-13T18:45:05.341696+0000","last_fullsized":"2024-09-13T18:45:05.341696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328563+0000","last_change":"2024-09-13T18:45:01.334186+0000","last_active":"2024-09-13T18:45:05.328563+0000","last_peered":"2024-09-13T18:45:05.328563+0000","last_clean":"2024-09-13T18:45:05.328563+0000","last_became_active":"2024-09-13T18:45:01.331220+0000","last_became_peered":"2024-09-13T18:45:01.331220+0000","last_unstale":"2024-09-13T18:45:05.328563+0000","last_undegraded":"2024-09-13T18:45:05.328563+0000","last_fullsized":"2024-09-13T18:45:05.328563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.221841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340277+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:45:05.340277+0000","last_peered":"2024-09-13T18:45:05.340277+0000","last_clean":"2024-09-13T18:45:05.340277+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:45:05.340277+0000","last_undegraded":"2024-09-13T18:45:05.340277+0000","last_fullsized":"2024-09-13T18:45:05.340277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332940+0000","last_change":"2024-09-13T18:45:01.345092+0000","last_active":"2024-09-13T18:45:05.332940+0000","last_peered":"2024-09-13T18:45:05.332940+0000","last_clean":"2024-09-13T18:45:05.332940+0000","last_became_active":"2024-09-13T18:45:01.344771+0000","last_became_peered":"2024-09-13T18:45:01.344771+0000","last_unstale":"2024-09-13T18:45:05.332940+0000","last_undegraded":"2024-09-13T18:45:05.332940+0000","last_fullsized":"2024-09-13T18:45:05.332940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.063948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332680+0000","last_change":"2024-09-13T18:45:01.331621+0000","last_active":"2024-09-13T18:45:05.332680+0000","last_peered":"2024-09-13T18:45:05.332680+0000","last_clean":"2024-09-13T18:45:05.332680+0000","last_became_active":"2024-09-13T18:45:01.331345+0000","last_became_peered":"2024-09-13T18:45:01.331345+0000","last_unstale":"2024-09-13T18:45:05.332680+0000","last_undegraded":"2024-09-13T18:45:05.332680+0000","last_fullsized":"2024-09-13T18:45:05.332680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.955367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350661+0000","last_change":"2024-09-13T18:45:01.339375+0000","last_active":"2024-09-13T18:45:05.350661+0000","last_peered":"2024-09-13T18:45:05.350661+0000","last_clean":"2024-09-13T18:45:05.350661+0000","last_became_active":"2024-09-13T18:45:01.339100+0000","last_became_peered":"2024-09-13T18:45:01.339100+0000","last_unstale":"2024-09-13T18:45:05.350661+0000","last_undegraded":"2024-09-13T18:45:05.350661+0000","last_fullsized":"2024-09-13T18:45:05.350661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:07.665938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341432+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:45:05.341432+0000","last_peered":"2024-09-13T18:45:05.341432+0000","last_clean":"2024-09-13T18:45:05.341432+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:45:05.341432+0000","last_undegraded":"2024-09-13T18:45:05.341432+0000","last_fullsized":"2024-09-13T18:45:05.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329413+0000","last_change":"2024-09-13T18:45:01.337763+0000","last_active":"2024-09-13T18:45:05.329413+0000","last_peered":"2024-09-13T18:45:05.329413+0000","last_clean":"2024-09-13T18:45:05.329413+0000","last_became_active":"2024-09-13T18:45:01.337436+0000","last_became_peered":"2024-09-13T18:45:01.337436+0000","last_unstale":"2024-09-13T18:45:05.329413+0000","last_undegraded":"2024-09-13T18:45:05.329413+0000","last_fullsized":"2024-09-13T18:45:05.329413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:24.283724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339364+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:45:05.339364+0000","last_peered":"2024-09-13T18:45:05.339364+0000","last_clean":"2024-09-13T18:45:05.339364+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:45:05.339364+0000","last_undegraded":"2024-09-13T18:45:05.339364+0000","last_fullsized":"2024-09-13T18:45:05.339364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341034+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:45:05.341034+0000","last_peered":"2024-09-13T18:45:05.341034+0000","last_clean":"2024-09-13T18:45:05.341034+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:45:05.341034+0000","last_undegraded":"2024-09-13T18:45:05.341034+0000","last_fullsized":"2024-09-13T18:45:05.341034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335095+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:45:05.335095+0000","last_peered":"2024-09-13T18:45:05.335095+0000","last_clean":"2024-09-13T18:45:05.335095+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:45:05.335095+0000","last_undegraded":"2024-09-13T18:45:05.335095+0000","last_fullsized":"2024-09-13T18:45:05.335095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342093+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:45:05.342093+0000","last_peered":"2024-09-13T18:45:05.342093+0000","last_clean":"2024-09-13T18:45:05.342093+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:45:05.342093+0000","last_undegraded":"2024-09-13T18:45:05.342093+0000","last_fullsized":"2024-09-13T18:45:05.342093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330753+0000","last_change":"2024-09-13T18:45:01.330449+0000","last_active":"2024-09-13T18:45:05.330753+0000","last_peered":"2024-09-13T18:45:05.330753+0000","last_clean":"2024-09-13T18:45:05.330753+0000","last_became_active":"2024-09-13T18:45:01.329169+0000","last_became_peered":"2024-09-13T18:45:01.329169+0000","last_unstale":"2024-09-13T18:45:05.330753+0000","last_undegraded":"2024-09-13T18:45:05.330753+0000","last_fullsized":"2024-09-13T18:45:05.330753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.348264+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:45:05.348264+0000","last_peered":"2024-09-13T18:45:05.348264+0000","last_clean":"2024-09-13T18:45:05.348264+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:45:05.348264+0000","last_undegraded":"2024-09-13T18:45:05.348264+0000","last_fullsized":"2024-09-13T18:45:05.348264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330371+0000","last_change":"2024-09-13T18:45:01.350125+0000","last_active":"2024-09-13T18:45:05.330371+0000","last_peered":"2024-09-13T18:45:05.330371+0000","last_clean":"2024-09-13T18:45:05.330371+0000","last_became_active":"2024-09-13T18:45:01.349938+0000","last_became_peered":"2024-09-13T18:45:01.349938+0000","last_unstale":"2024-09-13T18:45:05.330371+0000","last_undegraded":"2024-09-13T18:45:05.330371+0000","last_fullsized":"2024-09-13T18:45:05.330371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:31.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329585+0000","last_change":"2024-09-13T18:45:01.346136+0000","last_active":"2024-09-13T18:45:05.329585+0000","last_peered":"2024-09-13T18:45:05.329585+0000","last_clean":"2024-09-13T18:45:05.329585+0000","last_became_active":"2024-09-13T18:45:01.345857+0000","last_became_peered":"2024-09-13T18:45:01.345857+0000","last_unstale":"2024-09-13T18:45:05.329585+0000","last_undegraded":"2024-09-13T18:45:05.329585+0000","last_fullsized":"2024-09-13T18:45:05.329585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:54.067158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339025+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:45:05.339025+0000","last_peered":"2024-09-13T18:45:05.339025+0000","last_clean":"2024-09-13T18:45:05.339025+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:45:05.339025+0000","last_undegraded":"2024-09-13T18:45:05.339025+0000","last_fullsized":"2024-09-13T18:45:05.339025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.331987+0000","last_change":"2024-09-13T18:45:01.331111+0000","last_active":"2024-09-13T18:45:05.331987+0000","last_peered":"2024-09-13T18:45:05.331987+0000","last_clean":"2024-09-13T18:45:05.331987+0000","last_became_active":"2024-09-13T18:45:01.330778+0000","last_became_peered":"2024-09-13T18:45:01.330778+0000","last_unstale":"2024-09-13T18:45:05.331987+0000","last_undegraded":"2024-09-13T18:45:05.331987+0000","last_fullsized":"2024-09-13T18:45:05.331987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:32.014051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330546+0000","last_change":"2024-09-13T18:45:01.345047+0000","last_active":"2024-09-13T18:45:05.330546+0000","last_peered":"2024-09-13T18:45:05.330546+0000","last_clean":"2024-09-13T18:45:05.330546+0000","last_became_active":"2024-09-13T18:45:01.344779+0000","last_became_peered":"2024-09-13T18:45:01.344779+0000","last_unstale":"2024-09-13T18:45:05.330546+0000","last_undegraded":"2024-09-13T18:45:05.330546+0000","last_fullsized":"2024-09-13T18:45:05.330546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:17.412356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342014+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:45:05.342014+0000","last_peered":"2024-09-13T18:45:05.342014+0000","last_clean":"2024-09-13T18:45:05.342014+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:45:05.342014+0000","last_undegraded":"2024-09-13T18:45:05.342014+0000","last_fullsized":"2024-09-13T18:45:05.342014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338578+0000","last_change":"2024-09-13T18:45:01.353648+0000","last_active":"2024-09-13T18:45:05.338578+0000","last_peered":"2024-09-13T18:45:05.338578+0000","last_clean":"2024-09-13T18:45:05.338578+0000","last_became_active":"2024-09-13T18:45:01.353313+0000","last_became_peered":"2024-09-13T18:45:01.353313+0000","last_unstale":"2024-09-13T18:45:05.338578+0000","last_undegraded":"2024-09-13T18:45:05.338578+0000","last_fullsized":"2024-09-13T18:45:05.338578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:42.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339716+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:45:05.339716+0000","last_peered":"2024-09-13T18:45:05.339716+0000","last_clean":"2024-09-13T18:45:05.339716+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:45:05.339716+0000","last_undegraded":"2024-09-13T18:45:05.339716+0000","last_fullsized":"2024-09-13T18:45:05.339716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345424+0000","last_change":"2024-09-13T18:45:01.343394+0000","last_active":"2024-09-13T18:45:05.345424+0000","last_peered":"2024-09-13T18:45:05.345424+0000","last_clean":"2024-09-13T18:45:05.345424+0000","last_became_active":"2024-09-13T18:45:01.342835+0000","last_became_peered":"2024-09-13T18:45:01.342835+0000","last_unstale":"2024-09-13T18:45:05.345424+0000","last_undegraded":"2024-09-13T18:45:05.345424+0000","last_fullsized":"2024-09-13T18:45:05.345424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:02.097270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339302+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:45:05.339302+0000","last_peered":"2024-09-13T18:45:05.339302+0000","last_clean":"2024-09-13T18:45:05.339302+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:45:05.339302+0000","last_undegraded":"2024-09-13T18:45:05.339302+0000","last_fullsized":"2024-09-13T18:45:05.339302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336323+0000","last_change":"2024-09-13T18:45:01.336594+0000","last_active":"2024-09-13T18:45:05.336323+0000","last_peered":"2024-09-13T18:45:05.336323+0000","last_clean":"2024-09-13T18:45:05.336323+0000","last_became_active":"2024-09-13T18:45:01.331640+0000","last_became_peered":"2024-09-13T18:45:01.331640+0000","last_unstale":"2024-09-13T18:45:05.336323+0000","last_undegraded":"2024-09-13T18:45:05.336323+0000","last_fullsized":"2024-09-13T18:45:05.336323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346373+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:45:05.346373+0000","last_peered":"2024-09-13T18:45:05.346373+0000","last_clean":"2024-09-13T18:45:05.346373+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:45:05.346373+0000","last_undegraded":"2024-09-13T18:45:05.346373+0000","last_fullsized":"2024-09-13T18:45:05.346373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338544+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:45:05.338544+0000","last_peered":"2024-09-13T18:45:05.338544+0000","last_clean":"2024-09-13T18:45:05.338544+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:45:05.338544+0000","last_undegraded":"2024-09-13T18:45:05.338544+0000","last_fullsized":"2024-09-13T18:45:05.338544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.347239+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:45:05.347239+0000","last_peered":"2024-09-13T18:45:05.347239+0000","last_clean":"2024-09-13T18:45:05.347239+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:45:05.347239+0000","last_undegraded":"2024-09-13T18:45:05.347239+0000","last_fullsized":"2024-09-13T18:45:05.347239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340614+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:45:05.340614+0000","last_peered":"2024-09-13T18:45:05.340614+0000","last_clean":"2024-09-13T18:45:05.340614+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:45:05.340614+0000","last_undegraded":"2024-09-13T18:45:05.340614+0000","last_fullsized":"2024-09-13T18:45:05.340614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341414+0000","last_change":"2024-09-13T18:45:01.331882+0000","last_active":"2024-09-13T18:45:05.341414+0000","last_peered":"2024-09-13T18:45:05.341414+0000","last_clean":"2024-09-13T18:45:05.341414+0000","last_became_active":"2024-09-13T18:45:01.331547+0000","last_became_peered":"2024-09-13T18:45:01.331547+0000","last_unstale":"2024-09-13T18:45:05.341414+0000","last_undegraded":"2024-09-13T18:45:05.341414+0000","last_fullsized":"2024-09-13T18:45:05.341414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:58.736123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338749+0000","last_change":"2024-09-13T18:45:01.354801+0000","last_active":"2024-09-13T18:45:05.338749+0000","last_peered":"2024-09-13T18:45:05.338749+0000","last_clean":"2024-09-13T18:45:05.338749+0000","last_became_active":"2024-09-13T18:45:01.354525+0000","last_became_peered":"2024-09-13T18:45:01.354525+0000","last_unstale":"2024-09-13T18:45:05.338749+0000","last_undegraded":"2024-09-13T18:45:05.338749+0000","last_fullsized":"2024-09-13T18:45:05.338749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.153253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":106626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":696482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1120000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":106168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:44.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:44.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4373a00700 1 Processor -- start 2024-09-13T18:45:44.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4373a00700 1 -- start start 2024-09-13T18:45:44.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4373a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f436c0c59c0 0x7f436c0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4373a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0c9040 con 0x7f436c15a6b0 2024-09-13T18:45:44.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4373a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0c84c0 con 0x7f436c0c74a0 2024-09-13T18:45:44.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4373a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c0c3940 con 0x7f436c0c59c0 2024-09-13T18:45:44.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4371000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f436c0c74a0 0x7f436c159fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52464/0 (socket says 172.21.15.32:52464) 2024-09-13T18:45:44.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4371000700 1 -- 172.21.15.32:0/1980707098 learned_addr learned my addr 172.21.15.32:0/1980707098 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:44.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f436be00700 1 --1- 172.21.15.32:0/1980707098 >> v1:172.21.15.32:6789/0 conn(0x7f436c15a6b0 0x7f436c0c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43198/0 (socket says 172.21.15.32:43198) 2024-09-13T18:45:44.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.900+0000 7f4371a00700 1 --2- 172.21.15.32:0/1980707098 >> v2:172.21.15.86:3300/0 conn(0x7f436c0c59c0 0x7f436c0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849362287 0 0) 0x7f436c0c84c0 con 0x7f436c0c74a0 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43540057e0 con 0x7f436c0c74a0 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260479406 0 0) 0x7f436c0c9040 con 0x7f436c15a6b0 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f436c0c84c0 con 0x7f436c15a6b0 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4371a00700 1 -- 172.21.15.32:0/1980707098 >> v1:172.21.15.86:6789/0 conn(0x7f436c0c74a0 legacy=0x7f436c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4371a00700 1 -- 172.21.15.32:0/1980707098 >> v1:172.21.15.32:6789/0 conn(0x7f436c15a6b0 legacy=0x7f436c0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4371a00700 1 -- 172.21.15.32:0/1980707098 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0c87a0 con 0x7f436c0c59c0 2024-09-13T18:45:44.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4371a00700 1 --2- 172.21.15.32:0/1980707098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c0c2c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4364009d90 tx=0x7f436400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e92e4d6399000a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400e070 con 0x7f436c0c59c0 2024-09-13T18:45:44.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400bb20 con 0x7f436c0c59c0 2024-09-13T18:45:44.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f436b400700 1 -- 172.21.15.32:0/1980707098 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400be90 con 0x7f436c0c59c0 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4373a00700 1 -- 172.21.15.32:0/1980707098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 msgr2=0x7f436c0c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4373a00700 1 --2- 172.21.15.32:0/1980707098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c0c2c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4364009d90 tx=0x7f436400b330 comp rx=0 tx=0).stop 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4373a00700 1 -- 172.21.15.32:0/1980707098 shutdown_connections 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4373a00700 1 --2- 172.21.15.32:0/1980707098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c0c2c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.904+0000 7f4373a00700 1 -- 172.21.15.32:0/1980707098 >> 172.21.15.32:0/1980707098 conn(0x7f436c072300 msgr2=0x7f436c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.908+0000 7f4373a00700 1 -- 172.21.15.32:0/1980707098 shutdown_connections 2024-09-13T18:45:44.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.908+0000 7f4373a00700 1 -- 172.21.15.32:0/1980707098 wait complete. 2024-09-13T18:45:44.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.908+0000 7f4373a00700 1 Processor -- start 2024-09-13T18:45:44.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.908+0000 7f4373a00700 1 -- start start 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0c74a0 0x7f436c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f436c15a6b0 0x7f436c1ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0caf10 con 0x7f436c0c74a0 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c159240 con 0x7f436c0c59c0 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c159470 con 0x7f436c15a6b0 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45692/0 (socket says 172.21.15.32:45692) 2024-09-13T18:45:44.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 -- 172.21.15.32:0/569928000 learned_addr learned my addr 172.21.15.32:0/569928000 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f436c15a6b0 0x7f436c1ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f436be00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0c74a0 0x7f436c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 -- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f436c15a6b0 msgr2=0x7f436c1ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f436c15a6b0 0x7f436c1ee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 -- 172.21.15.32:0/569928000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0c74a0 msgr2=0x7f436c13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0c74a0 0x7f436c13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 -- 172.21.15.32:0/569928000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009a70 con 0x7f436c0c59c0 2024-09-13T18:45:44.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f436be00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0c74a0 0x7f436c13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:44.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4371000700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c06d910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f436000c560 tx=0x7f436000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360005d90 con 0x7f436c0c59c0 2024-09-13T18:45:44.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43600070d0 con 0x7f436c0c59c0 2024-09-13T18:45:44.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c159750 con 0x7f436c0c59c0 2024-09-13T18:45:44.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360007460 con 0x7f436c0c59c0 2024-09-13T18:45:44.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.912+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c1eb240 con 0x7f436c0c59c0 2024-09-13T18:45:44.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.916+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c0c2c20 con 0x7f436c0c59c0 2024-09-13T18:45:44.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.916+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43600075c0 con 0x7f436c0c59c0 2024-09-13T18:45:44.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.916+0000 7f4368c00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f434c066760 0x7f434c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.916+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4360083a70 con 0x7f436c0c59c0 2024-09-13T18:45:44.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.920+0000 7f436be00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f434c066760 0x7f434c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.920+0000 7f436be00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f434c066760 0x7f434c068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4358007fd0 tx=0x7f4358007c40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:44.928+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4360050980 con 0x7f436c0c59c0 2024-09-13T18:45:45.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.128+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f436c159a80 con 0x7f434c066760 2024-09-13T18:45:45.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.148+0000 7f4368c00700 1 -- 172.21.15.32:0/569928000 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345128 (secure 0 0 0) 0x7f4358001210 con 0x7f434c066760 2024-09-13T18:45:45.159 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:45:45.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f434c066760 msgr2=0x7f434c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f434c066760 0x7f434c068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4358007fd0 tx=0x7f4358007c40 comp rx=0 tx=0).stop 2024-09-13T18:45:45.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 msgr2=0x7f436c06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c06d910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f436000c560 tx=0x7f436000c870 comp rx=0 tx=0).stop 2024-09-13T18:45:45.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 shutdown_connections 2024-09-13T18:45:45.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f434c066760 0x7f434c068c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f436c15a6b0 0x7f436c1ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f436c0c74a0 0x7f436c13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 --2- 172.21.15.32:0/569928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f436c0c59c0 0x7f436c06d910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 >> 172.21.15.32:0/569928000 conn(0x7f436c072300 msgr2=0x7f436c0c5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 shutdown_connections 2024-09-13T18:45:45.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.156+0000 7f4373a00700 1 -- 172.21.15.32:0/569928000 wait complete. 2024-09-13T18:45:45.164 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:45:45.185 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-13T18:45:44.655719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3416064,"data_stored":2038533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":229625401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.581346"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.332147+0000","last_change":"2024-09-13T18:45:00.864148+0000","last_active":"2024-09-13T18:45:06.332147+0000","last_peered":"2024-09-13T18:45:06.332147+0000","last_clean":"2024-09-13T18:45:06.332147+0000","last_became_active":"2024-09-13T18:45:00.863883+0000","last_became_peered":"2024-09-13T18:45:00.863883+0000","last_unstale":"2024-09-13T18:45:06.332147+0000","last_undegraded":"2024-09-13T18:45:06.332147+0000","last_fullsized":"2024-09-13T18:45:06.332147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:45:05.341525+0000","last_peered":"2024-09-13T18:45:05.341525+0000","last_clean":"2024-09-13T18:45:05.341525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:45:05.341525+0000","last_undegraded":"2024-09-13T18:45:05.341525+0000","last_fullsized":"2024-09-13T18:45:05.341525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824414+0000","last_change":"2024-09-13T18:45:05.359268+0000","last_active":"2024-09-13T18:45:05.824414+0000","last_peered":"2024-09-13T18:45:05.824414+0000","last_clean":"2024-09-13T18:45:05.824414+0000","last_became_active":"2024-09-13T18:45:05.358933+0000","last_became_peered":"2024-09-13T18:45:05.358933+0000","last_unstale":"2024-09-13T18:45:05.824414+0000","last_undegraded":"2024-09-13T18:45:05.824414+0000","last_fullsized":"2024-09-13T18:45:05.824414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:00.376711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330857+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:45:06.330857+0000","last_peered":"2024-09-13T18:45:06.330857+0000","last_clean":"2024-09-13T18:45:06.330857+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:45:06.330857+0000","last_undegraded":"2024-09-13T18:45:06.330857+0000","last_fullsized":"2024-09-13T18:45:06.330857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341543+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:45:05.341543+0000","last_peered":"2024-09-13T18:45:05.341543+0000","last_clean":"2024-09-13T18:45:05.341543+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:45:05.341543+0000","last_undegraded":"2024-09-13T18:45:05.341543+0000","last_fullsized":"2024-09-13T18:45:05.341543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.357301+0000","last_change":"2024-09-13T18:45:05.351838+0000","last_active":"2024-09-13T18:45:05.357301+0000","last_peered":"2024-09-13T18:45:05.357301+0000","last_clean":"2024-09-13T18:45:05.357301+0000","last_became_active":"2024-09-13T18:45:05.351437+0000","last_became_peered":"2024-09-13T18:45:05.351437+0000","last_unstale":"2024-09-13T18:45:05.357301+0000","last_undegraded":"2024-09-13T18:45:05.357301+0000","last_fullsized":"2024-09-13T18:45:05.357301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:46.755054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328767+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:45:06.328767+0000","last_peered":"2024-09-13T18:45:06.328767+0000","last_clean":"2024-09-13T18:45:06.328767+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:45:06.328767+0000","last_undegraded":"2024-09-13T18:45:06.328767+0000","last_fullsized":"2024-09-13T18:45:06.328767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341864+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:45:05.341864+0000","last_peered":"2024-09-13T18:45:05.341864+0000","last_clean":"2024-09-13T18:45:05.341864+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:45:05.341864+0000","last_undegraded":"2024-09-13T18:45:05.341864+0000","last_fullsized":"2024-09-13T18:45:05.341864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366911+0000","last_change":"2024-09-13T18:45:05.363274+0000","last_active":"2024-09-13T18:45:05.366911+0000","last_peered":"2024-09-13T18:45:05.366911+0000","last_clean":"2024-09-13T18:45:05.366911+0000","last_became_active":"2024-09-13T18:45:05.362870+0000","last_became_peered":"2024-09-13T18:45:05.362870+0000","last_unstale":"2024-09-13T18:45:05.366911+0000","last_undegraded":"2024-09-13T18:45:05.366911+0000","last_fullsized":"2024-09-13T18:45:05.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:54.494396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327442+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:45:06.327442+0000","last_peered":"2024-09-13T18:45:06.327442+0000","last_clean":"2024-09-13T18:45:06.327442+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:45:06.327442+0000","last_undegraded":"2024-09-13T18:45:06.327442+0000","last_fullsized":"2024-09-13T18:45:06.327442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330635+0000","last_change":"2024-09-13T18:45:01.355711+0000","last_active":"2024-09-13T18:45:05.330635+0000","last_peered":"2024-09-13T18:45:05.330635+0000","last_clean":"2024-09-13T18:45:05.330635+0000","last_became_active":"2024-09-13T18:45:01.355463+0000","last_became_peered":"2024-09-13T18:45:01.355463+0000","last_unstale":"2024-09-13T18:45:05.330635+0000","last_undegraded":"2024-09-13T18:45:05.330635+0000","last_fullsized":"2024-09-13T18:45:05.330635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365664+0000","last_change":"2024-09-13T18:45:05.360940+0000","last_active":"2024-09-13T18:45:05.365664+0000","last_peered":"2024-09-13T18:45:05.365664+0000","last_clean":"2024-09-13T18:45:05.365664+0000","last_became_active":"2024-09-13T18:45:05.360491+0000","last_became_peered":"2024-09-13T18:45:05.360491+0000","last_unstale":"2024-09-13T18:45:05.365664+0000","last_undegraded":"2024-09-13T18:45:05.365664+0000","last_fullsized":"2024-09-13T18:45:05.365664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:26.565354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328208+0000","last_change":"2024-09-13T18:45:01.345265+0000","last_active":"2024-09-13T18:45:05.328208+0000","last_peered":"2024-09-13T18:45:05.328208+0000","last_clean":"2024-09-13T18:45:05.328208+0000","last_became_active":"2024-09-13T18:45:01.344996+0000","last_became_peered":"2024-09-13T18:45:01.344996+0000","last_unstale":"2024-09-13T18:45:05.328208+0000","last_undegraded":"2024-09-13T18:45:05.328208+0000","last_fullsized":"2024-09-13T18:45:05.328208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:11.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327878+0000","last_change":"2024-09-13T18:45:00.867459+0000","last_active":"2024-09-13T18:45:06.327878+0000","last_peered":"2024-09-13T18:45:06.327878+0000","last_clean":"2024-09-13T18:45:06.327878+0000","last_became_active":"2024-09-13T18:45:00.867028+0000","last_became_peered":"2024-09-13T18:45:00.867028+0000","last_unstale":"2024-09-13T18:45:06.327878+0000","last_undegraded":"2024-09-13T18:45:06.327878+0000","last_fullsized":"2024-09-13T18:45:06.327878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:03.262031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370686+0000","last_change":"2024-09-13T18:45:05.368886+0000","last_active":"2024-09-13T18:45:05.370686+0000","last_peered":"2024-09-13T18:45:05.370686+0000","last_clean":"2024-09-13T18:45:05.370686+0000","last_became_active":"2024-09-13T18:45:05.368510+0000","last_became_peered":"2024-09-13T18:45:05.368510+0000","last_unstale":"2024-09-13T18:45:05.370686+0000","last_undegraded":"2024-09-13T18:45:05.370686+0000","last_fullsized":"2024-09-13T18:45:05.370686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:26.194694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341816+0000","last_change":"2024-09-13T18:45:01.332274+0000","last_active":"2024-09-13T18:45:05.341816+0000","last_peered":"2024-09-13T18:45:05.341816+0000","last_clean":"2024-09-13T18:45:05.341816+0000","last_became_active":"2024-09-13T18:45:01.331671+0000","last_became_peered":"2024-09-13T18:45:01.331671+0000","last_unstale":"2024-09-13T18:45:05.341816+0000","last_undegraded":"2024-09-13T18:45:05.341816+0000","last_fullsized":"2024-09-13T18:45:05.341816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:38.214360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332230+0000","last_change":"2024-09-13T18:45:00.843856+0000","last_active":"2024-09-13T18:45:05.332230+0000","last_peered":"2024-09-13T18:45:05.332230+0000","last_clean":"2024-09-13T18:45:05.332230+0000","last_became_active":"2024-09-13T18:45:00.843456+0000","last_became_peered":"2024-09-13T18:45:00.843456+0000","last_unstale":"2024-09-13T18:45:05.332230+0000","last_undegraded":"2024-09-13T18:45:05.332230+0000","last_fullsized":"2024-09-13T18:45:05.332230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:52.484343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.353284+0000","last_change":"2024-09-13T18:45:05.349810+0000","last_active":"2024-09-13T18:45:05.353284+0000","last_peered":"2024-09-13T18:45:05.353284+0000","last_clean":"2024-09-13T18:45:05.353284+0000","last_became_active":"2024-09-13T18:45:05.348815+0000","last_became_peered":"2024-09-13T18:45:05.348815+0000","last_unstale":"2024-09-13T18:45:05.353284+0000","last_undegraded":"2024-09-13T18:45:05.353284+0000","last_fullsized":"2024-09-13T18:45:05.353284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:20.676172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336422+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:45:05.336422+0000","last_peered":"2024-09-13T18:45:05.336422+0000","last_clean":"2024-09-13T18:45:05.336422+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:45:05.336422+0000","last_undegraded":"2024-09-13T18:45:05.336422+0000","last_fullsized":"2024-09-13T18:45:05.336422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336648+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:45:05.336648+0000","last_peered":"2024-09-13T18:45:05.336648+0000","last_clean":"2024-09-13T18:45:05.336648+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:45:05.336648+0000","last_undegraded":"2024-09-13T18:45:05.336648+0000","last_fullsized":"2024-09-13T18:45:05.336648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.827311+0000","last_change":"2024-09-13T18:45:05.357361+0000","last_active":"2024-09-13T18:45:05.827311+0000","last_peered":"2024-09-13T18:45:05.827311+0000","last_clean":"2024-09-13T18:45:05.827311+0000","last_became_active":"2024-09-13T18:45:05.357036+0000","last_became_peered":"2024-09-13T18:45:05.357036+0000","last_unstale":"2024-09-13T18:45:05.827311+0000","last_undegraded":"2024-09-13T18:45:05.827311+0000","last_fullsized":"2024-09-13T18:45:05.827311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:00.105880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327853+0000","last_change":"2024-09-13T18:45:01.329048+0000","last_active":"2024-09-13T18:45:05.327853+0000","last_peered":"2024-09-13T18:45:05.327853+0000","last_clean":"2024-09-13T18:45:05.327853+0000","last_became_active":"2024-09-13T18:45:01.328762+0000","last_became_peered":"2024-09-13T18:45:01.328762+0000","last_unstale":"2024-09-13T18:45:05.327853+0000","last_undegraded":"2024-09-13T18:45:05.327853+0000","last_fullsized":"2024-09-13T18:45:05.327853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:21.207451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336115+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:45:05.336115+0000","last_peered":"2024-09-13T18:45:05.336115+0000","last_clean":"2024-09-13T18:45:05.336115+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:45:05.336115+0000","last_undegraded":"2024-09-13T18:45:05.336115+0000","last_fullsized":"2024-09-13T18:45:05.336115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366976+0000","last_change":"2024-09-13T18:45:05.364829+0000","last_active":"2024-09-13T18:45:05.366976+0000","last_peered":"2024-09-13T18:45:05.366976+0000","last_clean":"2024-09-13T18:45:05.366976+0000","last_became_active":"2024-09-13T18:45:05.364538+0000","last_became_peered":"2024-09-13T18:45:05.364538+0000","last_unstale":"2024-09-13T18:45:05.366976+0000","last_undegraded":"2024-09-13T18:45:05.366976+0000","last_fullsized":"2024-09-13T18:45:05.366976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.945041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336737+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:45:05.336737+0000","last_peered":"2024-09-13T18:45:05.336737+0000","last_clean":"2024-09-13T18:45:05.336737+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:45:05.336737+0000","last_undegraded":"2024-09-13T18:45:05.336737+0000","last_fullsized":"2024-09-13T18:45:05.336737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.327578+0000","last_change":"2024-09-13T18:45:00.863206+0000","last_active":"2024-09-13T18:45:06.327578+0000","last_peered":"2024-09-13T18:45:06.327578+0000","last_clean":"2024-09-13T18:45:06.327578+0000","last_became_active":"2024-09-13T18:45:00.862917+0000","last_became_peered":"2024-09-13T18:45:00.862917+0000","last_unstale":"2024-09-13T18:45:06.327578+0000","last_undegraded":"2024-09-13T18:45:06.327578+0000","last_fullsized":"2024-09-13T18:45:06.327578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.289662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.367010+0000","last_change":"2024-09-13T18:45:05.364598+0000","last_active":"2024-09-13T18:45:05.367010+0000","last_peered":"2024-09-13T18:45:05.367010+0000","last_clean":"2024-09-13T18:45:05.367010+0000","last_became_active":"2024-09-13T18:45:05.364194+0000","last_became_peered":"2024-09-13T18:45:05.364194+0000","last_unstale":"2024-09-13T18:45:05.367010+0000","last_undegraded":"2024-09-13T18:45:05.367010+0000","last_fullsized":"2024-09-13T18:45:05.367010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.594403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336439+0000","last_change":"2024-09-13T18:45:01.333827+0000","last_active":"2024-09-13T18:45:05.336439+0000","last_peered":"2024-09-13T18:45:05.336439+0000","last_clean":"2024-09-13T18:45:05.336439+0000","last_became_active":"2024-09-13T18:45:01.333500+0000","last_became_peered":"2024-09-13T18:45:01.333500+0000","last_unstale":"2024-09-13T18:45:05.336439+0000","last_undegraded":"2024-09-13T18:45:05.336439+0000","last_fullsized":"2024-09-13T18:45:05.336439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:37.963424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826853+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:45:05.826853+0000","last_peered":"2024-09-13T18:45:05.826853+0000","last_clean":"2024-09-13T18:45:05.826853+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:45:05.826853+0000","last_undegraded":"2024-09-13T18:45:05.826853+0000","last_fullsized":"2024-09-13T18:45:05.826853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.824166+0000","last_change":"2024-09-13T18:45:05.349605+0000","last_active":"2024-09-13T18:45:05.824166+0000","last_peered":"2024-09-13T18:45:05.824166+0000","last_clean":"2024-09-13T18:45:05.824166+0000","last_became_active":"2024-09-13T18:45:05.349213+0000","last_became_peered":"2024-09-13T18:45:05.349213+0000","last_unstale":"2024-09-13T18:45:05.824166+0000","last_undegraded":"2024-09-13T18:45:05.824166+0000","last_fullsized":"2024-09-13T18:45:05.824166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:17.638750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333067+0000","last_change":"2024-09-13T18:45:01.331576+0000","last_active":"2024-09-13T18:45:05.333067+0000","last_peered":"2024-09-13T18:45:05.333067+0000","last_clean":"2024-09-13T18:45:05.333067+0000","last_became_active":"2024-09-13T18:45:01.331313+0000","last_became_peered":"2024-09-13T18:45:01.331313+0000","last_unstale":"2024-09-13T18:45:05.333067+0000","last_undegraded":"2024-09-13T18:45:05.333067+0000","last_fullsized":"2024-09-13T18:45:05.333067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:15.549020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330831+0000","last_change":"2024-09-13T18:45:00.856368+0000","last_active":"2024-09-13T18:45:05.330831+0000","last_peered":"2024-09-13T18:45:05.330831+0000","last_clean":"2024-09-13T18:45:05.330831+0000","last_became_active":"2024-09-13T18:45:00.856067+0000","last_became_peered":"2024-09-13T18:45:00.856067+0000","last_unstale":"2024-09-13T18:45:05.330831+0000","last_undegraded":"2024-09-13T18:45:05.330831+0000","last_fullsized":"2024-09-13T18:45:05.330831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:29.141185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602069+0000","last_change":"2024-09-13T18:45:05.358233+0000","last_active":"2024-09-13T18:45:06.602069+0000","last_peered":"2024-09-13T18:45:06.602069+0000","last_clean":"2024-09-13T18:45:06.602069+0000","last_became_active":"2024-09-13T18:45:05.357819+0000","last_became_peered":"2024-09-13T18:45:05.357819+0000","last_unstale":"2024-09-13T18:45:06.602069+0000","last_undegraded":"2024-09-13T18:45:06.602069+0000","last_fullsized":"2024-09-13T18:45:06.602069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:06.840619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.349889+0000","last_change":"2024-09-13T18:45:01.323768+0000","last_active":"2024-09-13T18:45:05.349889+0000","last_peered":"2024-09-13T18:45:05.349889+0000","last_clean":"2024-09-13T18:45:05.349889+0000","last_became_active":"2024-09-13T18:45:01.323449+0000","last_became_peered":"2024-09-13T18:45:01.323449+0000","last_unstale":"2024-09-13T18:45:05.349889+0000","last_undegraded":"2024-09-13T18:45:05.349889+0000","last_fullsized":"2024-09-13T18:45:05.349889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:32.782226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340579+0000","last_change":"2024-09-13T18:45:00.848001+0000","last_active":"2024-09-13T18:45:05.340579+0000","last_peered":"2024-09-13T18:45:05.340579+0000","last_clean":"2024-09-13T18:45:05.340579+0000","last_became_active":"2024-09-13T18:45:00.847720+0000","last_became_peered":"2024-09-13T18:45:00.847720+0000","last_unstale":"2024-09-13T18:45:05.340579+0000","last_undegraded":"2024-09-13T18:45:05.340579+0000","last_fullsized":"2024-09-13T18:45:05.340579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.566248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.601658+0000","last_change":"2024-09-13T18:45:05.344571+0000","last_active":"2024-09-13T18:45:06.601658+0000","last_peered":"2024-09-13T18:45:06.601658+0000","last_clean":"2024-09-13T18:45:06.601658+0000","last_became_active":"2024-09-13T18:45:05.344171+0000","last_became_peered":"2024-09-13T18:45:05.344171+0000","last_unstale":"2024-09-13T18:45:06.601658+0000","last_undegraded":"2024-09-13T18:45:06.601658+0000","last_fullsized":"2024-09-13T18:45:06.601658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:15.473898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338368+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:45:05.338368+0000","last_peered":"2024-09-13T18:45:05.338368+0000","last_clean":"2024-09-13T18:45:05.338368+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:45:05.338368+0000","last_undegraded":"2024-09-13T18:45:05.338368+0000","last_fullsized":"2024-09-13T18:45:05.338368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329231+0000","last_change":"2024-09-13T18:45:00.861944+0000","last_active":"2024-09-13T18:45:05.329231+0000","last_peered":"2024-09-13T18:45:05.329231+0000","last_clean":"2024-09-13T18:45:05.329231+0000","last_became_active":"2024-09-13T18:45:00.861249+0000","last_became_peered":"2024-09-13T18:45:00.861249+0000","last_unstale":"2024-09-13T18:45:05.329231+0000","last_undegraded":"2024-09-13T18:45:05.329231+0000","last_fullsized":"2024-09-13T18:45:05.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:09.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602419+0000","last_change":"2024-09-13T18:45:05.351737+0000","last_active":"2024-09-13T18:45:06.602419+0000","last_peered":"2024-09-13T18:45:06.602419+0000","last_clean":"2024-09-13T18:45:06.602419+0000","last_became_active":"2024-09-13T18:45:05.351311+0000","last_became_peered":"2024-09-13T18:45:05.351311+0000","last_unstale":"2024-09-13T18:45:06.602419+0000","last_undegraded":"2024-09-13T18:45:06.602419+0000","last_fullsized":"2024-09-13T18:45:06.602419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:32.229616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340831+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:45:05.340831+0000","last_peered":"2024-09-13T18:45:05.340831+0000","last_clean":"2024-09-13T18:45:05.340831+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:45:05.340831+0000","last_undegraded":"2024-09-13T18:45:05.340831+0000","last_fullsized":"2024-09-13T18:45:05.340831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341794+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:45:05.341794+0000","last_peered":"2024-09-13T18:45:05.341794+0000","last_clean":"2024-09-13T18:45:05.341794+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:45:05.341794+0000","last_undegraded":"2024-09-13T18:45:05.341794+0000","last_fullsized":"2024-09-13T18:45:05.341794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602617+0000","last_change":"2024-09-13T18:45:05.354392+0000","last_active":"2024-09-13T18:45:06.602617+0000","last_peered":"2024-09-13T18:45:06.602617+0000","last_clean":"2024-09-13T18:45:06.602617+0000","last_became_active":"2024-09-13T18:45:05.354022+0000","last_became_peered":"2024-09-13T18:45:05.354022+0000","last_unstale":"2024-09-13T18:45:06.602617+0000","last_undegraded":"2024-09-13T18:45:06.602617+0000","last_fullsized":"2024-09-13T18:45:06.602617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.160746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330365+0000","last_change":"2024-09-13T18:45:01.342993+0000","last_active":"2024-09-13T18:45:05.330365+0000","last_peered":"2024-09-13T18:45:05.330365+0000","last_clean":"2024-09-13T18:45:05.330365+0000","last_became_active":"2024-09-13T18:45:01.342730+0000","last_became_peered":"2024-09-13T18:45:01.342730+0000","last_unstale":"2024-09-13T18:45:05.330365+0000","last_undegraded":"2024-09-13T18:45:05.330365+0000","last_fullsized":"2024-09-13T18:45:05.330365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:53.451442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330417+0000","last_change":"2024-09-13T18:45:00.861710+0000","last_active":"2024-09-13T18:45:05.330417+0000","last_peered":"2024-09-13T18:45:05.330417+0000","last_clean":"2024-09-13T18:45:05.330417+0000","last_became_active":"2024-09-13T18:45:00.861091+0000","last_became_peered":"2024-09-13T18:45:00.861091+0000","last_unstale":"2024-09-13T18:45:05.330417+0000","last_undegraded":"2024-09-13T18:45:05.330417+0000","last_fullsized":"2024-09-13T18:45:05.330417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:30.431815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334987+0000","last_change":"2024-09-13T18:45:05.349312+0000","last_active":"2024-09-13T18:45:06.334987+0000","last_peered":"2024-09-13T18:45:06.334987+0000","last_clean":"2024-09-13T18:45:06.334987+0000","last_became_active":"2024-09-13T18:45:05.348858+0000","last_became_peered":"2024-09-13T18:45:05.348858+0000","last_unstale":"2024-09-13T18:45:06.334987+0000","last_undegraded":"2024-09-13T18:45:06.334987+0000","last_fullsized":"2024-09-13T18:45:06.334987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:09.955609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336475+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:45:05.336475+0000","last_peered":"2024-09-13T18:45:05.336475+0000","last_clean":"2024-09-13T18:45:05.336475+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:45:05.336475+0000","last_undegraded":"2024-09-13T18:45:05.336475+0000","last_fullsized":"2024-09-13T18:45:05.336475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328614+0000","last_change":"2024-09-13T18:45:00.870886+0000","last_active":"2024-09-13T18:45:05.328614+0000","last_peered":"2024-09-13T18:45:05.328614+0000","last_clean":"2024-09-13T18:45:05.328614+0000","last_became_active":"2024-09-13T18:45:00.870563+0000","last_became_peered":"2024-09-13T18:45:00.870563+0000","last_unstale":"2024-09-13T18:45:05.328614+0000","last_undegraded":"2024-09-13T18:45:05.328614+0000","last_fullsized":"2024-09-13T18:45:05.328614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:50.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341074+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:45:05.341074+0000","last_peered":"2024-09-13T18:45:05.341074+0000","last_clean":"2024-09-13T18:45:05.341074+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:45:05.341074+0000","last_undegraded":"2024-09-13T18:45:05.341074+0000","last_fullsized":"2024-09-13T18:45:05.341074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.371253+0000","last_change":"2024-09-13T18:45:05.369616+0000","last_active":"2024-09-13T18:45:05.371253+0000","last_peered":"2024-09-13T18:45:05.371253+0000","last_clean":"2024-09-13T18:45:05.371253+0000","last_became_active":"2024-09-13T18:45:05.368904+0000","last_became_peered":"2024-09-13T18:45:05.368904+0000","last_unstale":"2024-09-13T18:45:05.371253+0000","last_undegraded":"2024-09-13T18:45:05.371253+0000","last_fullsized":"2024-09-13T18:45:05.371253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:55.985326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330699+0000","last_change":"2024-09-13T18:45:01.342548+0000","last_active":"2024-09-13T18:45:05.330699+0000","last_peered":"2024-09-13T18:45:05.330699+0000","last_clean":"2024-09-13T18:45:05.330699+0000","last_became_active":"2024-09-13T18:45:01.342038+0000","last_became_peered":"2024-09-13T18:45:01.342038+0000","last_unstale":"2024-09-13T18:45:05.330699+0000","last_undegraded":"2024-09-13T18:45:05.330699+0000","last_fullsized":"2024-09-13T18:45:05.330699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:51.863893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.333149+0000","last_change":"2024-09-13T18:45:00.859879+0000","last_active":"2024-09-13T18:45:05.333149+0000","last_peered":"2024-09-13T18:45:05.333149+0000","last_clean":"2024-09-13T18:45:05.333149+0000","last_became_active":"2024-09-13T18:45:00.859621+0000","last_became_peered":"2024-09-13T18:45:00.859621+0000","last_unstale":"2024-09-13T18:45:05.333149+0000","last_undegraded":"2024-09-13T18:45:05.333149+0000","last_fullsized":"2024-09-13T18:45:05.333149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:17.771135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.366813+0000","last_change":"2024-09-13T18:45:05.362604+0000","last_active":"2024-09-13T18:45:05.366813+0000","last_peered":"2024-09-13T18:45:05.366813+0000","last_clean":"2024-09-13T18:45:05.366813+0000","last_became_active":"2024-09-13T18:45:05.362142+0000","last_became_peered":"2024-09-13T18:45:05.362142+0000","last_unstale":"2024-09-13T18:45:05.366813+0000","last_undegraded":"2024-09-13T18:45:05.366813+0000","last_fullsized":"2024-09-13T18:45:05.366813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342162+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:45:05.342162+0000","last_peered":"2024-09-13T18:45:05.342162+0000","last_clean":"2024-09-13T18:45:05.342162+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:45:05.342162+0000","last_undegraded":"2024-09-13T18:45:05.342162+0000","last_fullsized":"2024-09-13T18:45:05.342162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333613+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:45:06.333613+0000","last_peered":"2024-09-13T18:45:06.333613+0000","last_clean":"2024-09-13T18:45:06.333613+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:45:06.333613+0000","last_undegraded":"2024-09-13T18:45:06.333613+0000","last_fullsized":"2024-09-13T18:45:06.333613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.334610+0000","last_change":"2024-09-13T18:45:05.359310+0000","last_active":"2024-09-13T18:45:06.334610+0000","last_peered":"2024-09-13T18:45:06.334610+0000","last_clean":"2024-09-13T18:45:06.334610+0000","last_became_active":"2024-09-13T18:45:05.358824+0000","last_became_peered":"2024-09-13T18:45:05.358824+0000","last_unstale":"2024-09-13T18:45:06.334610+0000","last_undegraded":"2024-09-13T18:45:06.334610+0000","last_fullsized":"2024-09-13T18:45:06.334610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:24.283145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338768+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:45:05.338768+0000","last_peered":"2024-09-13T18:45:05.338768+0000","last_clean":"2024-09-13T18:45:05.338768+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:45:05.338768+0000","last_undegraded":"2024-09-13T18:45:05.338768+0000","last_fullsized":"2024-09-13T18:45:05.338768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333901+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:45:06.333901+0000","last_peered":"2024-09-13T18:45:06.333901+0000","last_clean":"2024-09-13T18:45:06.333901+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:45:06.333901+0000","last_undegraded":"2024-09-13T18:45:06.333901+0000","last_fullsized":"2024-09-13T18:45:06.333901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.365485+0000","last_change":"2024-09-13T18:45:05.362240+0000","last_active":"2024-09-13T18:45:05.365485+0000","last_peered":"2024-09-13T18:45:05.365485+0000","last_clean":"2024-09-13T18:45:05.365485+0000","last_became_active":"2024-09-13T18:45:05.361810+0000","last_became_peered":"2024-09-13T18:45:05.361810+0000","last_unstale":"2024-09-13T18:45:05.365485+0000","last_undegraded":"2024-09-13T18:45:05.365485+0000","last_fullsized":"2024-09-13T18:45:05.365485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:38.083269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350837+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:45:05.350837+0000","last_peered":"2024-09-13T18:45:05.350837+0000","last_clean":"2024-09-13T18:45:05.350837+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:45:05.350837+0000","last_undegraded":"2024-09-13T18:45:05.350837+0000","last_fullsized":"2024-09-13T18:45:05.350837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.326163+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:45:06.326163+0000","last_peered":"2024-09-13T18:45:06.326163+0000","last_clean":"2024-09-13T18:45:06.326163+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:45:06.326163+0000","last_undegraded":"2024-09-13T18:45:06.326163+0000","last_fullsized":"2024-09-13T18:45:06.326163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.370349+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:45:05.370349+0000","last_peered":"2024-09-13T18:45:05.370349+0000","last_clean":"2024-09-13T18:45:05.370349+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:45:05.370349+0000","last_undegraded":"2024-09-13T18:45:05.370349+0000","last_fullsized":"2024-09-13T18:45:05.370349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.327734+0000","last_change":"2024-09-13T18:45:01.346791+0000","last_active":"2024-09-13T18:45:05.327734+0000","last_peered":"2024-09-13T18:45:05.327734+0000","last_clean":"2024-09-13T18:45:05.327734+0000","last_became_active":"2024-09-13T18:45:01.346515+0000","last_became_peered":"2024-09-13T18:45:01.346515+0000","last_unstale":"2024-09-13T18:45:05.327734+0000","last_undegraded":"2024-09-13T18:45:05.327734+0000","last_fullsized":"2024-09-13T18:45:05.327734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.337346+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:45:06.337346+0000","last_peered":"2024-09-13T18:45:06.337346+0000","last_clean":"2024-09-13T18:45:06.337346+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:45:06.337346+0000","last_undegraded":"2024-09-13T18:45:06.337346+0000","last_fullsized":"2024-09-13T18:45:06.337346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335188+0000","last_change":"2024-09-13T18:45:05.348324+0000","last_active":"2024-09-13T18:45:06.335188+0000","last_peered":"2024-09-13T18:45:06.335188+0000","last_clean":"2024-09-13T18:45:06.335188+0000","last_became_active":"2024-09-13T18:45:05.347908+0000","last_became_peered":"2024-09-13T18:45:05.347908+0000","last_unstale":"2024-09-13T18:45:06.335188+0000","last_undegraded":"2024-09-13T18:45:06.335188+0000","last_fullsized":"2024-09-13T18:45:06.335188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:29.155413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340979+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:45:05.340979+0000","last_peered":"2024-09-13T18:45:05.340979+0000","last_clean":"2024-09-13T18:45:05.340979+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:45:05.340979+0000","last_undegraded":"2024-09-13T18:45:05.340979+0000","last_fullsized":"2024-09-13T18:45:05.340979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336406+0000","last_change":"2024-09-13T18:45:00.866140+0000","last_active":"2024-09-13T18:45:05.336406+0000","last_peered":"2024-09-13T18:45:05.336406+0000","last_clean":"2024-09-13T18:45:05.336406+0000","last_became_active":"2024-09-13T18:45:00.865898+0000","last_became_peered":"2024-09-13T18:45:00.865898+0000","last_unstale":"2024-09-13T18:45:05.336406+0000","last_undegraded":"2024-09-13T18:45:05.336406+0000","last_fullsized":"2024-09-13T18:45:05.336406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:16.378417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.335021+0000","last_change":"2024-09-13T18:45:05.359539+0000","last_active":"2024-09-13T18:45:06.335021+0000","last_peered":"2024-09-13T18:45:06.335021+0000","last_clean":"2024-09-13T18:45:06.335021+0000","last_became_active":"2024-09-13T18:45:05.358801+0000","last_became_peered":"2024-09-13T18:45:05.358801+0000","last_unstale":"2024-09-13T18:45:06.335021+0000","last_undegraded":"2024-09-13T18:45:06.335021+0000","last_fullsized":"2024-09-13T18:45:06.335021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:04.787244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328147+0000","last_change":"2024-09-13T18:45:01.347194+0000","last_active":"2024-09-13T18:45:05.328147+0000","last_peered":"2024-09-13T18:45:05.328147+0000","last_clean":"2024-09-13T18:45:05.328147+0000","last_became_active":"2024-09-13T18:45:01.346941+0000","last_became_peered":"2024-09-13T18:45:01.346941+0000","last_unstale":"2024-09-13T18:45:05.328147+0000","last_undegraded":"2024-09-13T18:45:05.328147+0000","last_fullsized":"2024-09-13T18:45:05.328147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:05.677969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328824+0000","last_change":"2024-09-13T18:45:00.858781+0000","last_active":"2024-09-13T18:45:05.328824+0000","last_peered":"2024-09-13T18:45:05.328824+0000","last_clean":"2024-09-13T18:45:05.328824+0000","last_became_active":"2024-09-13T18:45:00.858418+0000","last_became_peered":"2024-09-13T18:45:00.858418+0000","last_unstale":"2024-09-13T18:45:05.328824+0000","last_undegraded":"2024-09-13T18:45:05.328824+0000","last_fullsized":"2024-09-13T18:45:05.328824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:23.372534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.602425+0000","last_change":"2024-09-13T18:45:05.354664+0000","last_active":"2024-09-13T18:45:06.602425+0000","last_peered":"2024-09-13T18:45:06.602425+0000","last_clean":"2024-09-13T18:45:06.602425+0000","last_became_active":"2024-09-13T18:45:05.354148+0000","last_became_peered":"2024-09-13T18:45:05.354148+0000","last_unstale":"2024-09-13T18:45:06.602425+0000","last_undegraded":"2024-09-13T18:45:06.602425+0000","last_fullsized":"2024-09-13T18:45:06.602425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332095+0000","last_change":"2024-09-13T18:45:01.339092+0000","last_active":"2024-09-13T18:45:05.332095+0000","last_peered":"2024-09-13T18:45:05.332095+0000","last_clean":"2024-09-13T18:45:05.332095+0000","last_became_active":"2024-09-13T18:45:01.338762+0000","last_became_peered":"2024-09-13T18:45:01.338762+0000","last_unstale":"2024-09-13T18:45:05.332095+0000","last_undegraded":"2024-09-13T18:45:05.332095+0000","last_fullsized":"2024-09-13T18:45:05.332095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:01.205580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.330228+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:45:06.330228+0000","last_peered":"2024-09-13T18:45:06.330228+0000","last_clean":"2024-09-13T18:45:06.330228+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:45:06.330228+0000","last_undegraded":"2024-09-13T18:45:06.330228+0000","last_fullsized":"2024-09-13T18:45:06.330228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346254+0000","last_change":"2024-09-13T18:45:05.343560+0000","last_active":"2024-09-13T18:45:05.346254+0000","last_peered":"2024-09-13T18:45:05.346254+0000","last_clean":"2024-09-13T18:45:05.346254+0000","last_became_active":"2024-09-13T18:45:05.342971+0000","last_became_peered":"2024-09-13T18:45:05.342971+0000","last_unstale":"2024-09-13T18:45:05.346254+0000","last_undegraded":"2024-09-13T18:45:05.346254+0000","last_fullsized":"2024-09-13T18:45:05.346254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:35.432501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338671+0000","last_change":"2024-09-13T18:45:01.345151+0000","last_active":"2024-09-13T18:45:05.338671+0000","last_peered":"2024-09-13T18:45:05.338671+0000","last_clean":"2024-09-13T18:45:05.338671+0000","last_became_active":"2024-09-13T18:45:01.344621+0000","last_became_peered":"2024-09-13T18:45:01.344621+0000","last_unstale":"2024-09-13T18:45:05.338671+0000","last_undegraded":"2024-09-13T18:45:05.338671+0000","last_fullsized":"2024-09-13T18:45:05.338671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:08.938308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:15.780850+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:45:15.780850+0000","last_peered":"2024-09-13T18:45:15.780850+0000","last_clean":"2024-09-13T18:45:15.780850+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:45:15.780850+0000","last_undegraded":"2024-09-13T18:45:15.780850+0000","last_fullsized":"2024-09-13T18:45:15.780850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825851+0000","last_change":"2024-09-13T18:45:05.349290+0000","last_active":"2024-09-13T18:45:05.825851+0000","last_peered":"2024-09-13T18:45:05.825851+0000","last_clean":"2024-09-13T18:45:05.825851+0000","last_became_active":"2024-09-13T18:45:05.347388+0000","last_became_peered":"2024-09-13T18:45:05.347388+0000","last_unstale":"2024-09-13T18:45:05.825851+0000","last_undegraded":"2024-09-13T18:45:05.825851+0000","last_fullsized":"2024-09-13T18:45:05.825851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:22.040097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328132+0000","last_change":"2024-09-13T18:45:01.346055+0000","last_active":"2024-09-13T18:45:05.328132+0000","last_peered":"2024-09-13T18:45:05.328132+0000","last_clean":"2024-09-13T18:45:05.328132+0000","last_became_active":"2024-09-13T18:45:01.345837+0000","last_became_peered":"2024-09-13T18:45:01.345837+0000","last_unstale":"2024-09-13T18:45:05.328132+0000","last_undegraded":"2024-09-13T18:45:05.328132+0000","last_fullsized":"2024-09-13T18:45:05.328132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:49.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.331407+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:45:06.331407+0000","last_peered":"2024-09-13T18:45:06.331407+0000","last_clean":"2024-09-13T18:45:06.331407+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:45:06.331407+0000","last_undegraded":"2024-09-13T18:45:06.331407+0000","last_fullsized":"2024-09-13T18:45:06.331407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.374060+0000","last_change":"2024-09-13T18:45:05.372988+0000","last_active":"2024-09-13T18:45:05.374060+0000","last_peered":"2024-09-13T18:45:05.374060+0000","last_clean":"2024-09-13T18:45:05.374060+0000","last_became_active":"2024-09-13T18:45:05.372512+0000","last_became_peered":"2024-09-13T18:45:05.372512+0000","last_unstale":"2024-09-13T18:45:05.374060+0000","last_undegraded":"2024-09-13T18:45:05.374060+0000","last_fullsized":"2024-09-13T18:45:05.374060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:34.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341638+0000","last_change":"2024-09-13T18:45:01.338401+0000","last_active":"2024-09-13T18:45:05.341638+0000","last_peered":"2024-09-13T18:45:05.341638+0000","last_clean":"2024-09-13T18:45:05.341638+0000","last_became_active":"2024-09-13T18:45:01.338030+0000","last_became_peered":"2024-09-13T18:45:01.338030+0000","last_unstale":"2024-09-13T18:45:05.341638+0000","last_undegraded":"2024-09-13T18:45:05.341638+0000","last_fullsized":"2024-09-13T18:45:05.341638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:37.030900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339846+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:45:05.339846+0000","last_peered":"2024-09-13T18:45:05.339846+0000","last_clean":"2024-09-13T18:45:05.339846+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:45:05.339846+0000","last_undegraded":"2024-09-13T18:45:05.339846+0000","last_fullsized":"2024-09-13T18:45:05.339846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.823921+0000","last_change":"2024-09-13T18:45:05.359747+0000","last_active":"2024-09-13T18:45:05.823921+0000","last_peered":"2024-09-13T18:45:05.823921+0000","last_clean":"2024-09-13T18:45:05.823921+0000","last_became_active":"2024-09-13T18:45:05.359227+0000","last_became_peered":"2024-09-13T18:45:05.359227+0000","last_unstale":"2024-09-13T18:45:05.823921+0000","last_undegraded":"2024-09-13T18:45:05.823921+0000","last_fullsized":"2024-09-13T18:45:05.823921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:13.356194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350743+0000","last_change":"2024-09-13T18:45:01.330522+0000","last_active":"2024-09-13T18:45:05.350743+0000","last_peered":"2024-09-13T18:45:05.350743+0000","last_clean":"2024-09-13T18:45:05.350743+0000","last_became_active":"2024-09-13T18:45:01.330292+0000","last_became_peered":"2024-09-13T18:45:01.330292+0000","last_unstale":"2024-09-13T18:45:05.350743+0000","last_undegraded":"2024-09-13T18:45:05.350743+0000","last_fullsized":"2024-09-13T18:45:05.350743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.819826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345469+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:45:05.345469+0000","last_peered":"2024-09-13T18:45:05.345469+0000","last_clean":"2024-09-13T18:45:05.345469+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:45:05.345469+0000","last_undegraded":"2024-09-13T18:45:05.345469+0000","last_fullsized":"2024-09-13T18:45:05.345469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.825026+0000","last_change":"2024-09-13T18:45:05.345124+0000","last_active":"2024-09-13T18:45:05.825026+0000","last_peered":"2024-09-13T18:45:05.825026+0000","last_clean":"2024-09-13T18:45:05.825026+0000","last_became_active":"2024-09-13T18:45:05.344585+0000","last_became_peered":"2024-09-13T18:45:05.344585+0000","last_unstale":"2024-09-13T18:45:05.825026+0000","last_undegraded":"2024-09-13T18:45:05.825026+0000","last_fullsized":"2024-09-13T18:45:05.825026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.627036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826452+0000","last_change":"2024-09-13T18:45:05.354450+0000","last_active":"2024-09-13T18:45:05.826452+0000","last_peered":"2024-09-13T18:45:05.826452+0000","last_clean":"2024-09-13T18:45:05.826452+0000","last_became_active":"2024-09-13T18:45:05.354125+0000","last_became_peered":"2024-09-13T18:45:05.354125+0000","last_unstale":"2024-09-13T18:45:05.826452+0000","last_undegraded":"2024-09-13T18:45:05.826452+0000","last_fullsized":"2024-09-13T18:45:05.826452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:40.671842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335038+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:45:05.335038+0000","last_peered":"2024-09-13T18:45:05.335038+0000","last_clean":"2024-09-13T18:45:05.335038+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:45:05.335038+0000","last_undegraded":"2024-09-13T18:45:05.335038+0000","last_fullsized":"2024-09-13T18:45:05.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330036+0000","last_change":"2024-09-13T18:45:00.865663+0000","last_active":"2024-09-13T18:45:05.330036+0000","last_peered":"2024-09-13T18:45:05.330036+0000","last_clean":"2024-09-13T18:45:05.330036+0000","last_became_active":"2024-09-13T18:45:00.864827+0000","last_became_peered":"2024-09-13T18:45:00.864827+0000","last_unstale":"2024-09-13T18:45:05.330036+0000","last_undegraded":"2024-09-13T18:45:05.330036+0000","last_fullsized":"2024-09-13T18:45:05.330036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:17.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.360954+0000","last_change":"2024-09-13T18:45:05.358868+0000","last_active":"2024-09-13T18:45:05.360954+0000","last_peered":"2024-09-13T18:45:05.360954+0000","last_clean":"2024-09-13T18:45:05.360954+0000","last_became_active":"2024-09-13T18:45:05.358265+0000","last_became_peered":"2024-09-13T18:45:05.358265+0000","last_unstale":"2024-09-13T18:45:05.360954+0000","last_undegraded":"2024-09-13T18:45:05.360954+0000","last_fullsized":"2024-09-13T18:45:05.360954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:54.622499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339482+0000","last_change":"2024-09-13T18:45:01.331909+0000","last_active":"2024-09-13T18:45:05.339482+0000","last_peered":"2024-09-13T18:45:05.339482+0000","last_clean":"2024-09-13T18:45:05.339482+0000","last_became_active":"2024-09-13T18:45:01.331544+0000","last_became_peered":"2024-09-13T18:45:01.331544+0000","last_unstale":"2024-09-13T18:45:05.339482+0000","last_undegraded":"2024-09-13T18:45:05.339482+0000","last_fullsized":"2024-09-13T18:45:05.339482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:02.211129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330589+0000","last_change":"2024-09-13T18:45:00.860547+0000","last_active":"2024-09-13T18:45:05.330589+0000","last_peered":"2024-09-13T18:45:05.330589+0000","last_clean":"2024-09-13T18:45:05.330589+0000","last_became_active":"2024-09-13T18:45:00.860280+0000","last_became_peered":"2024-09-13T18:45:00.860280+0000","last_unstale":"2024-09-13T18:45:05.330589+0000","last_undegraded":"2024-09-13T18:45:05.330589+0000","last_fullsized":"2024-09-13T18:45:05.330589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.637492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.328943+0000","last_change":"2024-09-13T18:45:00.868492+0000","last_active":"2024-09-13T18:45:06.328943+0000","last_peered":"2024-09-13T18:45:06.328943+0000","last_clean":"2024-09-13T18:45:06.328943+0000","last_became_active":"2024-09-13T18:45:00.867974+0000","last_became_peered":"2024-09-13T18:45:00.867974+0000","last_unstale":"2024-09-13T18:45:06.328943+0000","last_undegraded":"2024-09-13T18:45:06.328943+0000","last_fullsized":"2024-09-13T18:45:06.328943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:23.081313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335187+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:45:05.335187+0000","last_peered":"2024-09-13T18:45:05.335187+0000","last_clean":"2024-09-13T18:45:05.335187+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:45:05.335187+0000","last_undegraded":"2024-09-13T18:45:05.335187+0000","last_fullsized":"2024-09-13T18:45:05.335187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826337+0000","last_change":"2024-09-13T18:45:05.353000+0000","last_active":"2024-09-13T18:45:05.826337+0000","last_peered":"2024-09-13T18:45:05.826337+0000","last_clean":"2024-09-13T18:45:05.826337+0000","last_became_active":"2024-09-13T18:45:05.352517+0000","last_became_peered":"2024-09-13T18:45:05.352517+0000","last_unstale":"2024-09-13T18:45:05.826337+0000","last_undegraded":"2024-09-13T18:45:05.826337+0000","last_fullsized":"2024-09-13T18:45:05.826337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:55.468696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:06.333615+0000","last_change":"2024-09-13T18:45:00.846090+0000","last_active":"2024-09-13T18:45:06.333615+0000","last_peered":"2024-09-13T18:45:06.333615+0000","last_clean":"2024-09-13T18:45:06.333615+0000","last_became_active":"2024-09-13T18:45:00.845817+0000","last_became_peered":"2024-09-13T18:45:00.845817+0000","last_unstale":"2024-09-13T18:45:06.333615+0000","last_undegraded":"2024-09-13T18:45:06.333615+0000","last_fullsized":"2024-09-13T18:45:06.333615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.183900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341132+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:45:05.341132+0000","last_peered":"2024-09-13T18:45:05.341132+0000","last_clean":"2024-09-13T18:45:05.341132+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:45:05.341132+0000","last_undegraded":"2024-09-13T18:45:05.341132+0000","last_fullsized":"2024-09-13T18:45:05.341132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.826910+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:45:05.826910+0000","last_peered":"2024-09-13T18:45:05.826910+0000","last_clean":"2024-09-13T18:45:05.826910+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:45:05.826910+0000","last_undegraded":"2024-09-13T18:45:05.826910+0000","last_fullsized":"2024-09-13T18:45:05.826910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.344158+0000","last_change":"2024-09-13T18:45:01.333747+0000","last_active":"2024-09-13T18:45:05.344158+0000","last_peered":"2024-09-13T18:45:05.344158+0000","last_clean":"2024-09-13T18:45:05.344158+0000","last_became_active":"2024-09-13T18:45:01.332419+0000","last_became_peered":"2024-09-13T18:45:01.332419+0000","last_unstale":"2024-09-13T18:45:05.344158+0000","last_undegraded":"2024-09-13T18:45:05.344158+0000","last_fullsized":"2024-09-13T18:45:05.344158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:04.031786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341696+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:45:05.341696+0000","last_peered":"2024-09-13T18:45:05.341696+0000","last_clean":"2024-09-13T18:45:05.341696+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:45:05.341696+0000","last_undegraded":"2024-09-13T18:45:05.341696+0000","last_fullsized":"2024-09-13T18:45:05.341696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.328563+0000","last_change":"2024-09-13T18:45:01.334186+0000","last_active":"2024-09-13T18:45:05.328563+0000","last_peered":"2024-09-13T18:45:05.328563+0000","last_clean":"2024-09-13T18:45:05.328563+0000","last_became_active":"2024-09-13T18:45:01.331220+0000","last_became_peered":"2024-09-13T18:45:01.331220+0000","last_unstale":"2024-09-13T18:45:05.328563+0000","last_undegraded":"2024-09-13T18:45:05.328563+0000","last_fullsized":"2024-09-13T18:45:05.328563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.221841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340277+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:45:05.340277+0000","last_peered":"2024-09-13T18:45:05.340277+0000","last_clean":"2024-09-13T18:45:05.340277+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:45:05.340277+0000","last_undegraded":"2024-09-13T18:45:05.340277+0000","last_fullsized":"2024-09-13T18:45:05.340277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332940+0000","last_change":"2024-09-13T18:45:01.345092+0000","last_active":"2024-09-13T18:45:05.332940+0000","last_peered":"2024-09-13T18:45:05.332940+0000","last_clean":"2024-09-13T18:45:05.332940+0000","last_became_active":"2024-09-13T18:45:01.344771+0000","last_became_peered":"2024-09-13T18:45:01.344771+0000","last_unstale":"2024-09-13T18:45:05.332940+0000","last_undegraded":"2024-09-13T18:45:05.332940+0000","last_fullsized":"2024-09-13T18:45:05.332940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:33.063948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.332680+0000","last_change":"2024-09-13T18:45:01.331621+0000","last_active":"2024-09-13T18:45:05.332680+0000","last_peered":"2024-09-13T18:45:05.332680+0000","last_clean":"2024-09-13T18:45:05.332680+0000","last_became_active":"2024-09-13T18:45:01.331345+0000","last_became_peered":"2024-09-13T18:45:01.331345+0000","last_unstale":"2024-09-13T18:45:05.332680+0000","last_undegraded":"2024-09-13T18:45:05.332680+0000","last_fullsized":"2024-09-13T18:45:05.332680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.955367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.350661+0000","last_change":"2024-09-13T18:45:01.339375+0000","last_active":"2024-09-13T18:45:05.350661+0000","last_peered":"2024-09-13T18:45:05.350661+0000","last_clean":"2024-09-13T18:45:05.350661+0000","last_became_active":"2024-09-13T18:45:01.339100+0000","last_became_peered":"2024-09-13T18:45:01.339100+0000","last_unstale":"2024-09-13T18:45:05.350661+0000","last_undegraded":"2024-09-13T18:45:05.350661+0000","last_fullsized":"2024-09-13T18:45:05.350661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:07.665938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341432+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:45:05.341432+0000","last_peered":"2024-09-13T18:45:05.341432+0000","last_clean":"2024-09-13T18:45:05.341432+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:45:05.341432+0000","last_undegraded":"2024-09-13T18:45:05.341432+0000","last_fullsized":"2024-09-13T18:45:05.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329413+0000","last_change":"2024-09-13T18:45:01.337763+0000","last_active":"2024-09-13T18:45:05.329413+0000","last_peered":"2024-09-13T18:45:05.329413+0000","last_clean":"2024-09-13T18:45:05.329413+0000","last_became_active":"2024-09-13T18:45:01.337436+0000","last_became_peered":"2024-09-13T18:45:01.337436+0000","last_unstale":"2024-09-13T18:45:05.329413+0000","last_undegraded":"2024-09-13T18:45:05.329413+0000","last_fullsized":"2024-09-13T18:45:05.329413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:24.283724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339364+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:45:05.339364+0000","last_peered":"2024-09-13T18:45:05.339364+0000","last_clean":"2024-09-13T18:45:05.339364+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:45:05.339364+0000","last_undegraded":"2024-09-13T18:45:05.339364+0000","last_fullsized":"2024-09-13T18:45:05.339364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341034+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:45:05.341034+0000","last_peered":"2024-09-13T18:45:05.341034+0000","last_clean":"2024-09-13T18:45:05.341034+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:45:05.341034+0000","last_undegraded":"2024-09-13T18:45:05.341034+0000","last_fullsized":"2024-09-13T18:45:05.341034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.335095+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:45:05.335095+0000","last_peered":"2024-09-13T18:45:05.335095+0000","last_clean":"2024-09-13T18:45:05.335095+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:45:05.335095+0000","last_undegraded":"2024-09-13T18:45:05.335095+0000","last_fullsized":"2024-09-13T18:45:05.335095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342093+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:45:05.342093+0000","last_peered":"2024-09-13T18:45:05.342093+0000","last_clean":"2024-09-13T18:45:05.342093+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:45:05.342093+0000","last_undegraded":"2024-09-13T18:45:05.342093+0000","last_fullsized":"2024-09-13T18:45:05.342093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330753+0000","last_change":"2024-09-13T18:45:01.330449+0000","last_active":"2024-09-13T18:45:05.330753+0000","last_peered":"2024-09-13T18:45:05.330753+0000","last_clean":"2024-09-13T18:45:05.330753+0000","last_became_active":"2024-09-13T18:45:01.329169+0000","last_became_peered":"2024-09-13T18:45:01.329169+0000","last_unstale":"2024-09-13T18:45:05.330753+0000","last_undegraded":"2024-09-13T18:45:05.330753+0000","last_fullsized":"2024-09-13T18:45:05.330753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.348264+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:45:05.348264+0000","last_peered":"2024-09-13T18:45:05.348264+0000","last_clean":"2024-09-13T18:45:05.348264+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:45:05.348264+0000","last_undegraded":"2024-09-13T18:45:05.348264+0000","last_fullsized":"2024-09-13T18:45:05.348264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330371+0000","last_change":"2024-09-13T18:45:01.350125+0000","last_active":"2024-09-13T18:45:05.330371+0000","last_peered":"2024-09-13T18:45:05.330371+0000","last_clean":"2024-09-13T18:45:05.330371+0000","last_became_active":"2024-09-13T18:45:01.349938+0000","last_became_peered":"2024-09-13T18:45:01.349938+0000","last_unstale":"2024-09-13T18:45:05.330371+0000","last_undegraded":"2024-09-13T18:45:05.330371+0000","last_fullsized":"2024-09-13T18:45:05.330371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:31.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.329585+0000","last_change":"2024-09-13T18:45:01.346136+0000","last_active":"2024-09-13T18:45:05.329585+0000","last_peered":"2024-09-13T18:45:05.329585+0000","last_clean":"2024-09-13T18:45:05.329585+0000","last_became_active":"2024-09-13T18:45:01.345857+0000","last_became_peered":"2024-09-13T18:45:01.345857+0000","last_unstale":"2024-09-13T18:45:05.329585+0000","last_undegraded":"2024-09-13T18:45:05.329585+0000","last_fullsized":"2024-09-13T18:45:05.329585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:54.067158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339025+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:45:05.339025+0000","last_peered":"2024-09-13T18:45:05.339025+0000","last_clean":"2024-09-13T18:45:05.339025+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:45:05.339025+0000","last_undegraded":"2024-09-13T18:45:05.339025+0000","last_fullsized":"2024-09-13T18:45:05.339025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.331987+0000","last_change":"2024-09-13T18:45:01.331111+0000","last_active":"2024-09-13T18:45:05.331987+0000","last_peered":"2024-09-13T18:45:05.331987+0000","last_clean":"2024-09-13T18:45:05.331987+0000","last_became_active":"2024-09-13T18:45:01.330778+0000","last_became_peered":"2024-09-13T18:45:01.330778+0000","last_unstale":"2024-09-13T18:45:05.331987+0000","last_undegraded":"2024-09-13T18:45:05.331987+0000","last_fullsized":"2024-09-13T18:45:05.331987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:32.014051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.330546+0000","last_change":"2024-09-13T18:45:01.345047+0000","last_active":"2024-09-13T18:45:05.330546+0000","last_peered":"2024-09-13T18:45:05.330546+0000","last_clean":"2024-09-13T18:45:05.330546+0000","last_became_active":"2024-09-13T18:45:01.344779+0000","last_became_peered":"2024-09-13T18:45:01.344779+0000","last_unstale":"2024-09-13T18:45:05.330546+0000","last_undegraded":"2024-09-13T18:45:05.330546+0000","last_fullsized":"2024-09-13T18:45:05.330546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:17.412356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.342014+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:45:05.342014+0000","last_peered":"2024-09-13T18:45:05.342014+0000","last_clean":"2024-09-13T18:45:05.342014+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:45:05.342014+0000","last_undegraded":"2024-09-13T18:45:05.342014+0000","last_fullsized":"2024-09-13T18:45:05.342014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338578+0000","last_change":"2024-09-13T18:45:01.353648+0000","last_active":"2024-09-13T18:45:05.338578+0000","last_peered":"2024-09-13T18:45:05.338578+0000","last_clean":"2024-09-13T18:45:05.338578+0000","last_became_active":"2024-09-13T18:45:01.353313+0000","last_became_peered":"2024-09-13T18:45:01.353313+0000","last_unstale":"2024-09-13T18:45:05.338578+0000","last_undegraded":"2024-09-13T18:45:05.338578+0000","last_fullsized":"2024-09-13T18:45:05.338578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:42.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339716+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:45:05.339716+0000","last_peered":"2024-09-13T18:45:05.339716+0000","last_clean":"2024-09-13T18:45:05.339716+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:45:05.339716+0000","last_undegraded":"2024-09-13T18:45:05.339716+0000","last_fullsized":"2024-09-13T18:45:05.339716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.345424+0000","last_change":"2024-09-13T18:45:01.343394+0000","last_active":"2024-09-13T18:45:05.345424+0000","last_peered":"2024-09-13T18:45:05.345424+0000","last_clean":"2024-09-13T18:45:05.345424+0000","last_became_active":"2024-09-13T18:45:01.342835+0000","last_became_peered":"2024-09-13T18:45:01.342835+0000","last_unstale":"2024-09-13T18:45:05.345424+0000","last_undegraded":"2024-09-13T18:45:05.345424+0000","last_fullsized":"2024-09-13T18:45:05.345424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:02.097270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.339302+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:45:05.339302+0000","last_peered":"2024-09-13T18:45:05.339302+0000","last_clean":"2024-09-13T18:45:05.339302+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:45:05.339302+0000","last_undegraded":"2024-09-13T18:45:05.339302+0000","last_fullsized":"2024-09-13T18:45:05.339302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.336323+0000","last_change":"2024-09-13T18:45:01.336594+0000","last_active":"2024-09-13T18:45:05.336323+0000","last_peered":"2024-09-13T18:45:05.336323+0000","last_clean":"2024-09-13T18:45:05.336323+0000","last_became_active":"2024-09-13T18:45:01.331640+0000","last_became_peered":"2024-09-13T18:45:01.331640+0000","last_unstale":"2024-09-13T18:45:05.336323+0000","last_undegraded":"2024-09-13T18:45:05.336323+0000","last_fullsized":"2024-09-13T18:45:05.336323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:26.084476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.346373+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:45:05.346373+0000","last_peered":"2024-09-13T18:45:05.346373+0000","last_clean":"2024-09-13T18:45:05.346373+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:45:05.346373+0000","last_undegraded":"2024-09-13T18:45:05.346373+0000","last_fullsized":"2024-09-13T18:45:05.346373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338544+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:45:05.338544+0000","last_peered":"2024-09-13T18:45:05.338544+0000","last_clean":"2024-09-13T18:45:05.338544+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:45:05.338544+0000","last_undegraded":"2024-09-13T18:45:05.338544+0000","last_fullsized":"2024-09-13T18:45:05.338544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.347239+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:45:05.347239+0000","last_peered":"2024-09-13T18:45:05.347239+0000","last_clean":"2024-09-13T18:45:05.347239+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:45:05.347239+0000","last_undegraded":"2024-09-13T18:45:05.347239+0000","last_fullsized":"2024-09-13T18:45:05.347239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.340614+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:45:05.340614+0000","last_peered":"2024-09-13T18:45:05.340614+0000","last_clean":"2024-09-13T18:45:05.340614+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:45:05.340614+0000","last_undegraded":"2024-09-13T18:45:05.340614+0000","last_fullsized":"2024-09-13T18:45:05.340614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.341414+0000","last_change":"2024-09-13T18:45:01.331882+0000","last_active":"2024-09-13T18:45:05.341414+0000","last_peered":"2024-09-13T18:45:05.341414+0000","last_clean":"2024-09-13T18:45:05.341414+0000","last_became_active":"2024-09-13T18:45:01.331547+0000","last_became_peered":"2024-09-13T18:45:01.331547+0000","last_unstale":"2024-09-13T18:45:05.341414+0000","last_undegraded":"2024-09-13T18:45:05.341414+0000","last_fullsized":"2024-09-13T18:45:05.341414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:58.736123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T18:45:05.338749+0000","last_change":"2024-09-13T18:45:01.354801+0000","last_active":"2024-09-13T18:45:05.338749+0000","last_peered":"2024-09-13T18:45:05.338749+0000","last_clean":"2024-09-13T18:45:05.338749+0000","last_became_active":"2024-09-13T18:45:01.354525+0000","last_became_peered":"2024-09-13T18:45:01.354525+0000","last_unstale":"2024-09-13T18:45:05.338749+0000","last_undegraded":"2024-09-13T18:45:05.338749+0000","last_fullsized":"2024-09-13T18:45:05.338749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.153253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":106626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":109839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":696482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1120000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":106168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":110770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:45:45.191 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:45:45.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-13T18:45:45.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 Processor -- start 2024-09-13T18:45:45.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 -- start start 2024-09-13T18:45:45.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1da00c61b0 0x7f1da0071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00c6590 0x7f1da0161e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da0070510 con 0x7f1da00aa360 2024-09-13T18:45:45.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da00aa920 con 0x7f1da00c61b0 2024-09-13T18:45:45.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0157570 con 0x7f1da00c6590 2024-09-13T18:45:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1d9f400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1da00aa360 0x7f1da01545a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43210/0 (socket says 172.21.15.32:43210) 2024-09-13T18:45:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1d9f400700 1 -- 172.21.15.32:0/1682207086 learned_addr learned my addr 172.21.15.32:0/1682207086 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da4a00700 1 --2- 172.21.15.32:0/1682207086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00c6590 0x7f1da0161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1d9fe00700 1 --2- 172.21.15.32:0/1682207086 >> v2:172.21.15.86:3300/0 conn(0x7f1da00c61b0 0x7f1da0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da4a00700 1 -- 172.21.15.32:0/1682207086 >> v2:172.21.15.86:3300/0 conn(0x7f1da00c61b0 msgr2=0x7f1da0071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da4a00700 1 --2- 172.21.15.32:0/1682207086 >> v2:172.21.15.86:3300/0 conn(0x7f1da00c61b0 0x7f1da0071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da4a00700 1 -- 172.21.15.32:0/1682207086 >> v1:172.21.15.32:6789/0 conn(0x7f1da00aa360 legacy=0x7f1da01545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da4a00700 1 -- 172.21.15.32:0/1682207086 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0070760 con 0x7f1da00c6590 2024-09-13T18:45:45.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1d9ea00700 1 -- 172.21.15.32:0/1682207086 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250693362 0 0) 0x7f1da0070510 con 0x7f1da00aa360 2024-09-13T18:45:45.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.404+0000 7f1da4a00700 1 --2- 172.21.15.32:0/1682207086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00c6590 0x7f1da0161e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009d90 tx=0x7f1d9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdc581d98cc45b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1d9ea00700 1 -- 172.21.15.32:0/1682207086 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800e070 con 0x7f1da00c6590 2024-09-13T18:45:45.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1d9ea00700 1 -- 172.21.15.32:0/1682207086 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9800bbd0 con 0x7f1da00c6590 2024-09-13T18:45:45.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1d9ea00700 1 -- 172.21.15.32:0/1682207086 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98012430 con 0x7f1da00c6590 2024-09-13T18:45:45.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 -- 172.21.15.32:0/1682207086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00c6590 msgr2=0x7f1da0161e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 --2- 172.21.15.32:0/1682207086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00c6590 0x7f1da0161e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009d90 tx=0x7f1d9800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:45.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 -- 172.21.15.32:0/1682207086 shutdown_connections 2024-09-13T18:45:45.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 --2- 172.21.15.32:0/1682207086 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00c6590 0x7f1da0161e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 --2- 172.21.15.32:0/1682207086 >> v2:172.21.15.86:3300/0 conn(0x7f1da00c61b0 0x7f1da0071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 -- 172.21.15.32:0/1682207086 >> 172.21.15.32:0/1682207086 conn(0x7f1da00cad40 msgr2=0x7f1da00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 -- 172.21.15.32:0/1682207086 shutdown_connections 2024-09-13T18:45:45.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.408+0000 7f1da5400700 1 -- 172.21.15.32:0/1682207086 wait complete. 2024-09-13T18:45:45.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 Processor -- start 2024-09-13T18:45:45.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 -- start start 2024-09-13T18:45:45.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00aa360 0x7f1da014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 0x7f1da01f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da00c6590 0x7f1da00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da014f950 con 0x7f1da00c6590 2024-09-13T18:45:45.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00b0b40 con 0x7f1da00c61b0 2024-09-13T18:45:45.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da014e9f0 con 0x7f1da00aa360 2024-09-13T18:45:45.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 0x7f1da01f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1da4a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da00c6590 0x7f1da00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 0x7f1da01f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45720/0 (socket says 172.21.15.32:45720) 2024-09-13T18:45:45.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 -- 172.21.15.32:0/4137257639 learned_addr learned my addr 172.21.15.32:0/4137257639 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:45.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9fe00700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00aa360 0x7f1da014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 -- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00aa360 msgr2=0x7f1da014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00aa360 0x7f1da014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 -- 172.21.15.32:0/4137257639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da00c6590 msgr2=0x7f1da00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da00c6590 0x7f1da00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 -- 172.21.15.32:0/4137257639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98009a70 con 0x7f1da00c61b0 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d9f400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 0x7f1da01f2150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c580 tx=0x7f1d8c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.412+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c004ca0 con 0x7f1da00c61b0 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.416+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c004e20 con 0x7f1da00c61b0 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.416+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da00b0d50 con 0x7f1da00c61b0 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.416+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c007310 con 0x7f1da00c61b0 2024-09-13T18:45:45.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.416+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da00aee70 con 0x7f1da00c61b0 2024-09-13T18:45:45.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.416+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0158310 con 0x7f1da00c61b0 2024-09-13T18:45:45.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.420+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d8c007470 con 0x7f1da00c61b0 2024-09-13T18:45:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.420+0000 7f1d97e00700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.420+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1d8c084190 con 0x7f1da00c61b0 2024-09-13T18:45:45.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.420+0000 7f1d9fe00700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.420+0000 7f1d9fe00700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009a00 tx=0x7f1d90008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.428+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d8c051130 con 0x7f1da00c61b0 2024-09-13T18:45:45.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.616+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f1da00c8b40 con 0x7f1da00c61b0 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.620+0000 7f1d97e00700 1 -- 172.21.15.32:0/4137257639 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v27) v1 ==== 56+0+3548 (secure 0 0 0) 0x7f1d8c007720 con 0x7f1da00c61b0 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 27 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi032.stdout:fsid e3c44028-1b11-4958-a433-ecab24d0f05e 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-09-13T18:44:38.402959+0000 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-09-13T18:45:44.620534+0000 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:crush_version 6 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:full_ratio 0.95 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:backfillfull_ratio 0.9 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:nearfull_ratio 0.85 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:require_min_compat_client luminous 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:min_compat_client luminous 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:require_osd_release reef 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:stretch_mode_enabled false 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi032.stdout:pool 2 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:pool 3 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:max_osd 8 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] [v2:172.21.15.32:6816/3679908055,v1:172.21.15.32:6818/3679908055] exists,up 973dc52d-4a57-489e-b680-f484a091a77f 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] [v2:172.21.15.32:6802/1416437982,v1:172.21.15.32:6803/1416437982] exists,up 354ae97e-51cf-423c-b257-37bf8960729b 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] [v2:172.21.15.32:6810/1016396602,v1:172.21.15.32:6811/1016396602] exists,up b76494fe-9ae4-4444-8f25-15b7bb18dece 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] [v2:172.21.15.32:6826/2476570305,v1:172.21.15.32:6827/2476570305] exists,up 3b89a1fa-2088-4a23-b1e6-31644ebc6000 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] [v2:172.21.15.86:6815/838245911,v1:172.21.15.86:6819/838245911] exists,up 63973273-0c32-404c-9eb2-943b451d3da7 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] [v2:172.21.15.86:6817/2187629356,v1:172.21.15.86:6820/2187629356] exists,up 2678edb8-ca2a-497a-8439-5f1dc709dbe8 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] [v2:172.21.15.86:6802/4096931368,v1:172.21.15.86:6803/4096931368] exists,up 8adaa119-857f-4d43-bf54-dcac614aba37 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] [v2:172.21.15.86:6814/943661157,v1:172.21.15.86:6816/943661157] exists,up 97880368-e206-4217-aeee-cf13756aa32b 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:pg_upmap_items 3.39 [0,7] 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi032.stdout:pg_upmap_items 4.18 [7,0] 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 msgr2=0x7f1d80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009a00 tx=0x7f1d90008040 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 msgr2=0x7f1da01f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 0x7f1da01f2150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c580 tx=0x7f1d8c00c890 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 shutdown_connections 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da00c6590 0x7f1da00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da00c61b0 0x7f1da01f2150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 --2- 172.21.15.32:0/4137257639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da00aa360 0x7f1da014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 >> 172.21.15.32:0/4137257639 conn(0x7f1da00cad40 msgr2=0x7f1da0156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 shutdown_connections 2024-09-13T18:45:45.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:45.624+0000 7f1da5400700 1 -- 172.21.15.32:0/4137257639 wait complete. 2024-09-13T18:45:45.654 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] [v2:172.21.15.32:6816/3679908055,v1:172.21.15.32:6818/3679908055] exists,up 973dc52d-4a57-489e-b680-f484a091a77f', 'osd.1 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] [v2:172.21.15.32:6802/1416437982,v1:172.21.15.32:6803/1416437982] exists,up 354ae97e-51cf-423c-b257-37bf8960729b', 'osd.2 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] [v2:172.21.15.32:6810/1016396602,v1:172.21.15.32:6811/1016396602] exists,up b76494fe-9ae4-4444-8f25-15b7bb18dece', 'osd.3 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] [v2:172.21.15.32:6826/2476570305,v1:172.21.15.32:6827/2476570305] exists,up 3b89a1fa-2088-4a23-b1e6-31644ebc6000', 'osd.4 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] [v2:172.21.15.86:6815/838245911,v1:172.21.15.86:6819/838245911] exists,up 63973273-0c32-404c-9eb2-943b451d3da7', 'osd.5 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] [v2:172.21.15.86:6817/2187629356,v1:172.21.15.86:6820/2187629356] exists,up 2678edb8-ca2a-497a-8439-5f1dc709dbe8', 'osd.6 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] [v2:172.21.15.86:6802/4096931368,v1:172.21.15.86:6803/4096931368] exists,up 8adaa119-857f-4d43-bf54-dcac614aba37', 'osd.7 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] [v2:172.21.15.86:6814/943661157,v1:172.21.15.86:6816/943661157] exists,up 97880368-e206-4217-aeee-cf13756aa32b'] 2024-09-13T18:45:45.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "name": "mon.a", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster": "ceph", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket_mode": "", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_client_required": "cephx, none", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_cluster_required": "cephx", 2024-09-13T18:45:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_debug": "true", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_required": "cephx", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_supported": "cephx", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio": "true", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_poll_ms": "250", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_reap_max": "16", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_async_discard": "false", 2024-09-13T18:45:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_block_size": "4096", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio": "false", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_inflight_ios": "false", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_enable_discard": "false", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry": "3", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash": "0", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring": "false", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_hipri": "false", 2024-09-13T18:45:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_type": "", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_alloc_size": "1048576", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_allocator": "hybrid", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_buffered_io": "true", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_for_zeros": "false", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_compact_log_sync": "false", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-13T18:45:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_log_runway": "4194304", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_prefetch": "1048576", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_flush_size": "524288", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_log_runway": "1048576", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery": "false", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_sync_write": "false", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-13T18:45:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocation_from_file": "true", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocator": "hybrid", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_create": "true", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_create": "false", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_path": "", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_size": "0", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_path": "", 2024-09-13T18:45:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_preallocate_file": "false", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_size": "107374182400", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_create": "false", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_path": "", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_size": "100663296", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs": "true", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-13T18:45:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune": "true", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size": "0", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_type": "2q", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-13T18:45:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_clone_cow": "true", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_mode": "none", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_csum_type": "crc32c", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_freelist": "false", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-13T18:45:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_bug21040": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-13T18:45:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_prefill": "0.000000", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_small_allocations": "0", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_read": "true", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_write": "false", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-13T18:45:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fail_eio": "false", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-13T18:45:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount": "false", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount": "false", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_ignore_data_csum": "false", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-13T18:45:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_op_age": "5.000000", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_alloc_size": "0", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size": "0", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_deferred_txc": "32", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size": "0", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_nid_prealloc": "1024", 2024-09-13T18:45:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_retry_disk_reads": "3", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cf": "true", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-13T18:45:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_mem": "512", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_tracing": "false", 2024-09-13T18:45:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_zero_block_detection": "false", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-13T18:45:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-13T18:45:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_signatures": "false", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_version": "2", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_signatures": "false", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_version": "2", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_signatures": "false", 2024-09-13T18:45:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_version": "2", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_sign_messages": "true", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "chdir": "", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_acl_type": "", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_asio_thread_count": "2", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_mid": "0.750000", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_size": "16384", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_caps_release_delay": "5", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_check_pool_perm": "true", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_force_sync_read": "false", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_getattr_caps": "false", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_features": "", 2024-09-13T18:45:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_tick_delay": "0", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_remount": "false", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_dirsize_rbytes": "true", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_force_lazyio": "false", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_fs": "", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_release_failure": "false", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_inline_size": "4096", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mds_namespace": "", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_metadata": "", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_gid": "-1", 2024-09-13T18:45:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_timeout": "300", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_uid": "-1", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mountpoint": "/", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_notify_timeout": "10", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc": "true", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty": "104857600", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_objects": "1000", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_size": "209715200", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_target_dirty": "8388608", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_permissions": "true", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota": "true", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota_df": "true", 2024-09-13T18:45:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_bytes": "0", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_periods": "4", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_min": "131072", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_reconnect_stale": "false", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_shutdown_timeout": "30", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_snapdir": ".snap", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_tick_interval": "1", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_trace": "", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_try_dentry_invalidate": "false", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_faked_inos": "false", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_random_mds": "false", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog": "false", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-13T18:45:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_port": "12201", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_monitors": "default=true", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog": "false", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_level": "info", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "-", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network": "", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network_interface": "", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_isal": "false", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_level": "5", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_winsize": "-15", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zstd_level": "1", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-13T18:45:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_op_num_threads": "6", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_obc_lru_size": "10", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_seastar_smp": "1", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location": "", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook": "", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook_timeout": "10", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "daemonize": "false", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "daos_pool": "tank", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-13T18:45:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_alienstore": "0/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_allow_any_pool_priority": "false", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok": "1/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok_assert_abort": "false", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asserts_on_shutdown": "true", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_auth": "20/20", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bdev": "1/3", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluefs": "1/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluestore": "1/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_buffer": "0/1", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ceph_exporter": "1/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephfs_mirror": "0/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephsqlite": "0/5", 2024-09-13T18:45:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_client": "0/5", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_compressor": "1/5", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_context": "0/1", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crush": "1/1", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crypto": "1/5", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cyanstore": "0/5", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_deliberately_leak_memory": "false", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_disable_randomized_ping": "false", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_dpdk": "1/5", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_eventtrace": "1/5", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filer": "0/1", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filestore": "1/3", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_finisher": "1/1", 2024-09-13T18:45:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_fuse": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeat_testing_span": "0", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeatmap": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_javaclient": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journal": "1/3", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journaler": "0/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_kstore": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_leveldb": "4/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_lockdep": "0/1", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mclock": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_balancer": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_locker": "1/5", 2024-09-13T18:45:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log": "1/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log_expire": "1/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_migrator": "1/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_memstore": "1/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgr": "2/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgrc": "1/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mon": "20/20", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_monc": "0/10", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ms": "1/1", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_none": "0/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objclass": "0/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objectcacher": "0/5", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objecter": "0/1", 2024-09-13T18:45:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_optracker": "0/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_osd": "1/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_paxos": "20/20", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_perfcounter": "1/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_prioritycache": "1/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rados": "0/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd": "0/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_mirror": "0/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_pwl": "0/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_replay": "0/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_refs": "0/0", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_reserver": "1/1", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw": "1/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_access": "1/5", 2024-09-13T18:45:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_datacache": "1/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_dbstore": "1/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_flight": "1/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_sync": "1/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rocksdb": "4/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_backref": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cache": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cleaner": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_device": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_epm": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_journal": "0/5", 2024-09-13T18:45:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_lba": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_odata": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_omap": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_onode": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_t": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_tm": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_striper": "0/1", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_test": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_throttle": "1/1", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_timer": "0/1", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_tp": "0/5", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "device_failure_prediction_mode": "none", 2024-09-13T18:45:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_graylog": "false", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_journald": "false", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_stderr": "true", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_syslog": "false", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event_tracing": "false", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_addr": "0.0.0.0", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_http_port": "9926", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_prio_limit": "5", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sort_metrics": "true", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_stats_period": "5", 2024-09-13T18:45:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "fake_statfs_for_testing": "0", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "fatal_signal_handlers": "true", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_purge_ops": "10", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_truncate_ops": "128", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_apply_finisher_threads": "1", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_blackhole": "false", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_clone_range": "true", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_snap": "true", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_caller_concurrency": "10", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_collect_device_partition_information": "true", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_commit_timeout": "600.000000", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_inject_read_err": "false", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_omap_check": "false", 2024-09-13T18:45:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_verify_split": "false", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_dump_file": "", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fadvise": "true", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fail_eio": "true", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_shards": "16", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_size": "128", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap": "false", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap_threshold": "4096", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-13T18:45:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_inject_stall": "0", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_parallel": "false", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_trailing": "false", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_writeahead": "false", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_kill_at": "0", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-13T18:45:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs": "0", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size": "0", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-13T18:45:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_merge_threshold": "-10", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_odsync_write": "false", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend": "rocksdb", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend_path": "", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_timeout": "60", 2024-09-13T18:45:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_threads": "2", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_punch_hole": "false", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-13T18:45:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_ops": "50", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_seek_data_hole": "false", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc": "false", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_splice": "false", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_multiple": "2", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_rand_factor": "20", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_update_to": "1000", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-13T18:45:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_enable": "true", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_xfs_extsize": "false", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_zfs_snap": "false", 2024-09-13T18:45:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "fio_dir": "/tmp/fio", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fsid": "e3c44028-1b11-4958-a433-ecab24d0f05e", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_allow_other": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_atomic_o_trunc": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_big_writes": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_debug": "false", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_default_permissions": "false", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_disable_pagecache": "false", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_max_write": "0", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_multithreaded": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_require_active_mds": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_set_user_groups": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_move": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_read": "true", 2024-09-13T18:45:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_write": "true", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_use_invalidate_cb": "true", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_target_name": "ceph", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_file": "", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_inject_failure": "0", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_interval": "5", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "host": "smithi032", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-13T18:45:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "inject_early_sigterm": "false", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_agent_port": "6799", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_tracing_enable": "false", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_aio": "true", 2024-09-13T18:45:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_align_min_size": "65536", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_align": "true", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_size": "4096", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_dio": "true", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_discard": "false", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_force_aio": "false", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_ignore_corruption": "false", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_bytes": "10485760", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_entries": "100", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_replay_from": "0", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-13T18:45:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_write_header_frequency": "0", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_zero_on_create": "false", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prefetch_periods": "10", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prezero_periods": "5", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_write_head_interval": "15", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "keyfile": "", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_backend": "rocksdb", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_default_stripe_size": "65536", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount": "false", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_bytes": "67108864", 2024-09-13T18:45:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_ops": "512", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_nid_prealloc": "1024", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_onode_map_size": "1024", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_submit_transaction": "false", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_transaction": "false", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_block_size": "65536", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_bloom_size": "0", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_cache_size": "536870912", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_compact_on_mount": "false", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_compression": "false", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_log": "", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_log_to_ceph_log": "true", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_max_open_files": "0", 2024-09-13T18:45:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_paranoid": "false", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "leveldb_write_buffer_size": "33554432", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "librados_thread_count": "2", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep": "false", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep_force_backtrace": "false", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "log_coarse_timestamps": "true", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "log_flush_on_exit": "false", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_host": "127.0.0.1", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_port": "12201", 2024-09-13T18:45:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_new": "1000", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_recent": "10000", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stderr_prefix": "", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stop_at_utilization": "0.970000", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_file": "true", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_graylog": "false", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_journald": "false", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_stderr": "false", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_syslog": "false", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "max_rotating_auth_attempts": "10", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_action_on_write_error": "1", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_alternate_name_max": "8192", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_asio_thread_count": "2", 2024-09-13T18:45:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_export_pin": "true", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_dirs": "true", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_interval": "5", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_interval": "10", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max": "-1", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max_until": "-1", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_merge_size": "50", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_midchunk": "0.300000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_start": "0.200000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_minchunk": "0.001000", 2024-09-13T18:45:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_mode": "0", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_max": "1.200000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_min": "0.800000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_bits": "3", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_size": "10000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_target_decay": "10.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_grace": "15.000000", 2024-09-13T18:45:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_interval": "4.000000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_mid": "0.700000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_release_free_interval": "10", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_reservation": "0.050000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_interval": "1", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_threshold": "262144", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_prealloc_inos": "1000", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-13T18:45:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_connect_bootstrapping": "false", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_damage_table_max_entries": "10000", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_auth_pins": "false", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_frag": "false", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_scatterstat": "false", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_subtrees": "false", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_decay_halflife": "5.000000", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_default_dir_hash": "2", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_defer_session_stale": "true", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_deny_all_reconnect": "false", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_keys_per_op": "16384", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_commit_size": "10", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_entries": "0", 2024-09-13T18:45:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_prefetch": "true", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_on_map": "false", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_early_reply": "true", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enable_op_tracker": "true", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enforce_unique_name": "true", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random": "true", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-13T18:45:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_summarize_threshold": "10", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_health_dummy": "false", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_migrator_session_race": "false", 2024-09-13T18:45:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_join_fs": "", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_journal_format": "1", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_create_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_export_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_import_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_expire_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_replay_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_link_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_mdstable_at": "0", 2024-09-13T18:45:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_openc_at": "0", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_rename_at": "0", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_events_per_segment": "1024", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_events": "-1", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_segments": "128", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_pause": "false", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_segment_size": "0", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_warn_factor": "2.000000", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_caps_per_client": "1048576", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_flushes": "100000", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_requests": "100000", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_export_size": "20971520", 2024-09-13T18:45:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_file_recover": "32", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_files": "64", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops": "8192", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_snaps_per_dir": "100", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_metrics_update_interval": "2", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_per_client": "100", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_working_set": "10000", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_numa_node": "-1", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_complaint_time": "30.000000", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_duration": "600", 2024-09-13T18:45:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_size": "20", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_size": "20", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_log_threshold": "5", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_grace": "15", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_interval": "5", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_caps": "30000", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_threshold": "262144", 2024-09-13T18:45:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_interval": "1.000000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_gid": "0", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_uid": "0", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-13T18:45:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_shutdown_check": "0", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_skip_ino": "0", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_max_uid": "4294967294", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_min_uid": "0", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_rstat": "false", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_standby_replay_damaged": "false", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_symlink_recovery": "true", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_exports": "0", 2024-09-13T18:45:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_fragments": "0", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_tick_interval": "5.000000", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_valgrind_exit": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_backtrace": "1", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_scatter": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_sessions": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool_debug": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_device_bytes": "1073741824", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_set": "false", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_size": "65536", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_bytes": "134217728", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_messages": "512", 2024-09-13T18:45:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_disabled_modules": "", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_max_pg_num_change": "128", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_bytes": "134217728", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_messages": "128", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_bytes": "134217728", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_messages": "128", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_bytes": "536870912", 2024-09-13T18:45:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_messages": "8192", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_pool": "true", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_standby_modules": "true", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_period": "5", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_threshold": "5", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_tick_period": "2", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_delete": "true", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_size_one": "true", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_auth_validate_all_caps": "true", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-13T18:45:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_bytes": "104857600", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_directed_command_retry": "2", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_parallel": "3", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_log_interval": "1.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_interval": "10.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-13T18:45:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file_level": "debug", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_file": "true", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_journald": "false", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_bootstrap": "false", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_start": "false", 2024-09-13T18:45:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_trim": "true", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cpu_threads": "4", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_crush_min_required_version": "hammer", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_daemon_bytes": "419430400", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_crit": "5", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_warn": "5", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_size_warn": "16106127360", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_json": "false", 2024-09-13T18:45:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_transactions": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_extra_checks": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_quincy": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_reef": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_mkfs_grace": "120", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_default_strategy": "1", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_timeout": "5.000000", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-13T18:45:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_divisor": "2", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_enable_op_tracker": "true", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_fake_pool_delete": "false", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_force_quorum_join": "false", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_globalid_prealloc": "10000", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_detail_to_clog": "false", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_log_update_period": "5", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_max_detail": "50", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog": "true", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_interval": "600", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host": "172.21.15.32,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]", 2024-09-13T18:45:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host_override": "", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_initial_members": "", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease": "5.000000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_full_interval": "50", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max": "10000", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max_summary": "50", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-13T18:45:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_epochs": "500", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_osd": "10000", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pg_per_osd": "10000", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pool_pg_num": "65536", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_force_trim_to": "0", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_skip_sanity": "false", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_autotune": "true", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_target": "2147483648", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_beacon_grace": "30", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-13T18:45:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_digest_period": "5", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_inactive_grace": "60", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_min_osdmap_epochs": "500", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_complaint_time": "120", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_duration": "600", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_size": "20", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_size": "20", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_log_threshold": "5", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-13T18:45:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_in": "false", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size": "500", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_interval": "600", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_force_trim_to": "0", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-13T18:45:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_down_reporters": "2", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-13T18:45:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_report_timeout": "900", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_stuck_threshold": "60", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-13T18:45:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_probe_timeout": "2.000000", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_change": "0.050000", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_osds": "4", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_interval": "86400", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_max_keys": "100", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_timeout": "300", 2024-09-13T18:45:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_session_timeout": "300", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_smart_report_timeout": "5", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stat_smooth_intervals": "6", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_min_size": "2", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_size": "4", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_debug": "false", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_provider_kill_at": "0", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_requester_kill_at": "0", 2024-09-13T18:45:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_timeout": "60.000000", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_target_pg_per_osd": "100", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_tick_interval": "5", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_interval": "300.000000", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_use_min_delay_socket": "false", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_older_version_delay": "604800", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-13T18:45:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_misplaced": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_older_version": "true", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "monmap": "", 2024-09-13T18:45:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_tracing_enabled": "false", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_op_threads": "3", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_cm": "false", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_device_name": "", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_dscp": "96", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-13T18:45:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_local_gid": "", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_port_num": "1", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_sl": "3", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_support_srq": "true", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_type": "ib", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_reap_threshold": "5", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_before_connect": "false", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv4": "true", 2024-09-13T18:45:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv6": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr1": "true", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr2": "true", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_max": "7568", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_min": "6800", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_count": "3", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_delay": "5", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_client": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mds": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mgr": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mon": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_osd": "false", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_client_mode": "crc secure", 2024-09-13T18:45:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_mode": "crc secure", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_type": "", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_compress_secure": "false", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_idle_timeout": "900", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_ready_timeout": "10", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_data": "true", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_header": "true", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bad_msg": "false", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bug": "true", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_old_message": "true", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_skipped_message": "false", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-13T18:45:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_coremask": "0xF", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_enable_tso": "true", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hugepages": "", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_lro": "true", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_memory_channel": "4", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_pmd": "", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_port_id": "0", 2024-09-13T18:45:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_on_send": "false", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_initial_backoff": "0.200000", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_max": "1.000000", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_type": "", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_network_congestion": "0", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_socket_failures": "0", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_learn_addr_from_peer": "true", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_accept_failures": "4", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_backoff": "15.000000", 2024-09-13T18:45:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_client_mode": "secure crc", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_service_mode": "secure crc", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_min_size": "1024", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_mode": "none", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_min_cost": "65536", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_public_type": "", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_service_mode": "crc secure", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_listen_backlog": "512", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_nodelay": "true", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_rcvbuf": "0", 2024-09-13T18:45:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_type": "async+posix", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "no_config_file": "false", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_completion_locks_per_session": "32", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_ops": "1024", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_tick_interval": "5.000000", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_timeout": "10.000000", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_blackhole": "false", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "openssl_engine_opts": "", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_delay_time": "5.000000", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_hist_halflife": "1000", 2024-09-13T18:45:45.904 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_low_ops": "2", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_ops": "4", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_slop": "0.020000", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_asio_thread_count": "2", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_async_recovery_min_cost": "100", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-13T18:45:45.905 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_max": "512", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_min": "64", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_degraded": "false", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_peering": "false", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_unfound": "true", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_beacon_report_interval": "300", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_duration": "30", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_max_block_size": "67108864", 2024-09-13T18:45:45.906 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blkin_trace_all": "false", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_for_log_corruption": "false", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_update_on_start": "true", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_cap": "256", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_size_cap": "524288000", 2024-09-13T18:45:45.907 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_op_priority": "63", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_watch_timeout": "30", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_command_max_records": "256", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_compact_on_start": "false", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_on_start": "true", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_weight_set": "true", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-13T18:45:45.908 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_feed_pullee": "-1", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_misdirected_ops": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_acting_change": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_purge_strays": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_op_order": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_shutdown": "false", 2024-09-13T18:45:45.909 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_snaps": "false", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_keys": "1024", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_stride": "524288", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-13T18:45:45.910 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_notify_timeout": "30", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep": "0.000000", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_discard_disconnected_ops": "true", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_enable_op_tracker": "true", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_info": "true", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown": "true", 2024-09-13T18:45:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_function_tracing": "false", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_grace": "20", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_interval": "6", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_peers": "10", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_size": "2000", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_stale": "600", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-13T18:45:45.912 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_max_size": "100000", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_min_size": "1000", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_size": "5120", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_kill_backfill_at": "0", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_cache_size": "50", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_dedup": "true", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max": "40", 2024-09-13T18:45:45.913 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_share_max_epochs": "40", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_name_len": "100", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_size": "0", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_backfills": "1", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_count": "5", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_period": "600", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_name_len": "2048", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_namespace_len": "256", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_size": "134217728", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_blocked_by": "16", 2024-09-13T18:45:45.914 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_log_entries": "10000", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pgls": "1024", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_cost": "8388608", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_objects": "10", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_scrubs": "3", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_trimming_pgs": "2", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_op_reply_len": "64", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_size": "90", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-13T18:45:45.915 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_profile": "balanced", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-13T18:45:45.916 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_base": "805306368", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_min": "134217728", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target": "4294967296", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_autotune": "false", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_pg_log_entries": "250", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_recovery_priority": "0", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-13T18:45:45.917 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_interval": "5", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_cache_shards": "32", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_op_tracker_shard": "32", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_auto_affinity": "true", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_node": "-1", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_prefer_iface": "true", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objecter_finishers": "1", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore": "bluestore", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_fuse": "false", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_tracing": "false", 2024-09-13T18:45:45.918 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_complaint_time": "30.000000", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_duration": "600", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_size": "20", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_size": "20", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_log_threshold": "5", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards": "0", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_hdd": "5", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_ssd": "8", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_min_cost": "65536", 2024-09-13T18:45:45.919 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue_cut_off": "high", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_timeout": "15", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_open_classes_on_start": "true", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_os_flags": "0", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_peering_op_priority": "255", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_cost": "1048576", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_priority": "5", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_max": "10000", 2024-09-13T18:45:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_min": "100", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max": "500", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crimson": "false", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-13T18:45:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flags": "0", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_min_size": "0", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_num": "32", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pgp_num": "0", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_size": "2", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_type": "replicated", 2024-09-13T18:45:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_push_per_object_cost": "1000", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap": "true", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_cost": "20971520", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active": "0", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-13T18:45:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_single_start": "1", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_priority": "3", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_priority": "5", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep": "0.000000", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_repair_during_recovery": "false", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_requested_scrub_priority": "120", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-13T18:45:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair": "false", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_hour": "0", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_week_day": "0", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_max": "25", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_min": "5", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_cost": "52428800", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_during_recovery": "false", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_hour": "0", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_week_day": "0", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_event_cost": "4096", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-13T18:45:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_invalid_stats": "true", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_preemptions": "5", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_priority": "5", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_reservation_timeout": "5000", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_sleep": "0.000000", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_skip_data_digest": "false", 2024-09-13T18:45:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_smart_report_timeout": "5", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_cost": "1048576", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_priority": "5", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_transaction_size": "30", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-13T18:45:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tracing": "false", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_use_stale_snap": "false", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osdc_blkin_trace_all": "false", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_kill_at": "0", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_max_join_drift": "10", 2024-09-13T18:45:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min": "500", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min_wait": "0.050000", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_propose_interval": "1.000000", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max": "500", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_min": "250", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_stash_full_interval": "25", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_max": "500", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_min": "250", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "perf": "true", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-13T18:45:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "-", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrv": "", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "public_bind_addr": "-", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network": "", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network_interface": "", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_enabled": "false", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_session_max_number": "256", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_mon_op_timeout": "0", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_osd_op_timeout": "0", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_tracing": "false", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_atime_update_interval": "60", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_parent_reads": "false", 2024-09-13T18:45:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_snap_reads": "false", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blkin_trace_all": "false", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache": "true", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_policy": "writearound", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_size": "33554432", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-13T18:45:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_clone_copy_on_read": "false", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_compression_hint": "none", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_concurrent_management_ops": "10", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_clone_format": "auto", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_data_pool": "", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_features": "61", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_format": "2", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_map_options": "", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_order": "22", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_pool": "rbd", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_count": "0", 2024-09-13T18:45:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_unit": "0", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_enable_alloc_hint": "true", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler": "simple", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-13T18:45:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_order": "24", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_pool": "", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_splay_width": "4", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_parent_reads": "false", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_snap_reads": "false", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-13T18:45:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-13T18:45:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mtime_update_interval": "60", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_non_blocking_aio": "true", 2024-09-13T18:45:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_thread_timeout": "60", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_threads": "1", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_parent_cache_enabled": "false", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_plugins": "", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst": "0", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_limit": "0", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_exclude_ops": "0", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst": "0", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-13T18:45:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_limit": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-13T18:45:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_read_from_replica_policy": "default", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_skip_partial_discard": "true", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_tracing": "false", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_names": "true", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_pool": "true", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_base_url": "", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_log_level": "", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_acl_grants_max_num": "100", 2024-09-13T18:45:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_admin_entry": "admin", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_backend_store": "rados", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_barbican_url": "", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_beast_enable_async": "true", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-13T18:45:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_enabled": "true", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_expiry_interval": "900", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_lru_size": "10000", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_config_store": "rados", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_content_length_compat": "false", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress": "true", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cors_rules_max_num": "100", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cross_domain_policy": "", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_addr": "", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-13T18:45:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_password": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_username": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_require_ssl": "true", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-13T18:45:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_addr": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_auth": "token", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_namespace": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_prefix": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-13T18:45:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_token_file": "", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_buffersize": "524288", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_time": "300", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-13T18:45:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_changes_size": "1000", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_num_shards": "128", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_window": "30", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-13T18:45:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-13T18:45:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_name": "", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_s3website_name": "", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dynamic_resharding": "true", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_gc_threads": "true", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_lc_threads": "true", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_ops_log": "false", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_quota_threads": "true", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_static_website": "false", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_usage_log": "false", 2024-09-13T18:45:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enforce_swift_acls": "true", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_exit_timeout_secs": "120", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_expose_bucket": "false", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_extended_http_attrs": "", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_filter": "none", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontends": "beast port=7480", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred": "50", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_objs": "32", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-13T18:45:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_period": "3600", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_init_timeout": "300", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_domain": "", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password": "", 2024-09-13T18:45:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password_path": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_project": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_tenant": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token_path": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_user": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_api_version": "2", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_domain": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_password": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_project": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_user": "", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-13T18:45:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_url": "", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_debug_interval": "-1", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_lock_max_time": "90", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_objs": "32", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_rules": "1000", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_worker": "3", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_thread_delay": "0", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-13T18:45:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_dnattr": "uid", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchfilter": "", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_uri": "ldaps://", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_http_headers": "", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name_utc": "false", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_name_len": "0", 2024-09-13T18:45:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_size": "0", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_chunk_size": "4194304", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_listing_results": "1000", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_notify_retries": "10", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_param_size": "1048576", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_size": "5368709120", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_slo_entries": "1000", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_log_max_shards": "64", 2024-09-13T18:45:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mp_lock_max_time": "600", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-13T18:45:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_max_gc": "300", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_async_rados_threads": "32", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_control_oids": "8", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_numa_node": "-1", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_chunk_size": "100", 2024-09-13T18:45:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_gc_interval": "600", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_timeout": "600", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_tracing": "false", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_token": "", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_url": "", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_verify_ssl": "true", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_rados": "false", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_socket_path": "", 2024-09-13T18:45:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval": "2.000000", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_continue": "true", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_tracing": "false", 2024-09-13T18:45:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm": "", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_id": "", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region": "", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_request_uri": "", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_batch_size": "64", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_max_aio": "128", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_num_logs": "16", 2024-09-13T18:45:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_thread_interval": "600", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_resolve_cname": "false", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_run_sync_thread": "true", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_scheduler_type": "throttler", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_script_uri": "", 2024-09-13T18:45:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_service_provider_name": "", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_id": "", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_secret": "", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_entry": "sts", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_key": "sts", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_min_session_duration": "900", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_token_introspection_url": "", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_account_in_url": "false", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_entry": "auth", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_url": "", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_custom_header": "", 2024-09-13T18:45:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_need_stats": "true", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_tenant_name": "", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_token_expiration": "86400", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url": "", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url_prefix": "swift", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_lease_period": "120", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-13T18:45:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_thread_pool_size": "512", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_comment": "", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_createby": "", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_encoding": "", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_flag": "false", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_origin": "", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_tracker": "", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_trust_forwarded_https": "false", 2024-09-13T18:45:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_shards": "32", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_user_shards": "1", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_use_opa_authz": "false", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_max_buckets": "1000", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_policies_max_num": "100", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_unique_email": "true", 2024-09-13T18:45:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_verify_ssl": "true", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone": "", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_id": "", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup": "", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_id": "", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_auto_session_clear": "true", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_block_size": "4096", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-13T18:45:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_size": "536870912", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_index_type": "binary_search", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-13T18:45:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_partition_filters": "false", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_perf": "false", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "run_dir": "/var/run/ceph", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_block_create": "true", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cache_lru_size": "67108864", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_max_object_size": "16777216", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_device_size": "53687091200", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_capacity": "16", 2024-09-13T18:45:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_main_device_type": "SSD", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_segment_size": "67108864", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "set_keepcaps": "false", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "setgroup": "", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser": "", 2024-09-13T18:45:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser_match_path": "", 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "thp": "false", 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_default_timeout": "60", 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "throttler_perf_counter": "true" 2024-09-13T18:45:45.968 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:45.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-13T18:45:46.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.140+0000 7f14ebe00700 1 Processor -- start 2024-09-13T18:45:46.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.140+0000 7f14ebe00700 1 -- start start 2024-09-13T18:45:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14ebe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec0c4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14ebe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14ec0c2b90 0x7f14ec0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14ebe00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0c4890 con 0x7f14ec0c2620 2024-09-13T18:45:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14ebe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec0c3a90 con 0x7f14ec0c2b90 2024-09-13T18:45:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14ebe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0c4b00 con 0x7f14ec150540 2024-09-13T18:45:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14eb400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f14ec0c2620 0x7f14ec06e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43222/0 (socket says 172.21.15.32:43222) 2024-09-13T18:45:46.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14eb400700 1 -- 172.21.15.32:0/278288472 learned_addr learned my addr 172.21.15.32:0/278288472 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14eaa00700 1 --2- 172.21.15.32:0/278288472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec0c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.144+0000 7f14ea000700 1 --2- 172.21.15.32:0/278288472 >> v2:172.21.15.32:3300/0 conn(0x7f14ec0c2b90 0x7f14ec0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14e9600700 1 -- 172.21.15.32:0/278288472 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142757079 0 0) 0x7f14ec0c4890 con 0x7f14ec0c2620 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14e9600700 1 -- 172.21.15.32:0/278288472 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d00057e0 con 0x7f14ec0c2620 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14eaa00700 1 -- 172.21.15.32:0/278288472 >> v2:172.21.15.32:3300/0 conn(0x7f14ec0c2b90 msgr2=0x7f14ec0c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14eaa00700 1 --2- 172.21.15.32:0/278288472 >> v2:172.21.15.32:3300/0 conn(0x7f14ec0c2b90 0x7f14ec0c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14eaa00700 1 -- 172.21.15.32:0/278288472 >> v1:172.21.15.32:6789/0 conn(0x7f14ec0c2620 legacy=0x7f14ec06e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14eaa00700 1 -- 172.21.15.32:0/278288472 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec06d2f0 con 0x7f14ec150540 2024-09-13T18:45:46.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14eaa00700 1 --2- 172.21.15.32:0/278288472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec0c4350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009850 tx=0x7f14dc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7a9b89b308a5d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14e9600700 1 -- 172.21.15.32:0/278288472 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011830 con 0x7f14ec150540 2024-09-13T18:45:46.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14e9600700 1 -- 172.21.15.32:0/278288472 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc011990 con 0x7f14ec150540 2024-09-13T18:45:46.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14e9600700 1 -- 172.21.15.32:0/278288472 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011d40 con 0x7f14ec150540 2024-09-13T18:45:46.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 -- 172.21.15.32:0/278288472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 msgr2=0x7f14ec0c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 --2- 172.21.15.32:0/278288472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec0c4350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009850 tx=0x7f14dc009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:46.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 -- 172.21.15.32:0/278288472 shutdown_connections 2024-09-13T18:45:46.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 --2- 172.21.15.32:0/278288472 >> v2:172.21.15.32:3300/0 conn(0x7f14ec0c2b90 0x7f14ec0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 --2- 172.21.15.32:0/278288472 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec0c4350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 -- 172.21.15.32:0/278288472 >> 172.21.15.32:0/278288472 conn(0x7f14ec073720 msgr2=0x7f14ec073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 -- 172.21.15.32:0/278288472 shutdown_connections 2024-09-13T18:45:46.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.148+0000 7f14ebe00700 1 -- 172.21.15.32:0/278288472 wait complete. 2024-09-13T18:45:46.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.152+0000 7f14ebe00700 1 Processor -- start 2024-09-13T18:45:46.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.152+0000 7f14ebe00700 1 -- start start 2024-09-13T18:45:46.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0c2620 0x7f14ec1ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec0c2b90 0x7f14ec0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec1ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1ea270 con 0x7f14ec0c2620 2024-09-13T18:45:46.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1ee630 con 0x7f14ec0c2b90 2024-09-13T18:45:46.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec155be0 con 0x7f14ec150540 2024-09-13T18:45:46.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0c2620 0x7f14ec1ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ea000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec0c2b90 0x7f14ec0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0c2620 0x7f14ec1ee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38006/0 (socket says 172.21.15.32:38006) 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 -- 172.21.15.32:0/1606909584 learned_addr learned my addr 172.21.15.32:0/1606909584 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ea000700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec0c2b90 0x7f14ec0cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45722/0 (socket says 172.21.15.32:45722) 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec1ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 msgr2=0x7f14ec1ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150540 0x7f14ec1ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec0c2b90 msgr2=0x7f14ec0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec0c2b90 0x7f14ec0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0094b0 con 0x7f14ec0c2620 2024-09-13T18:45:46.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14eaa00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0c2620 0x7f14ec1ee0f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0c4c40 tx=0x7f14dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc004510 con 0x7f14ec0c2620 2024-09-13T18:45:46.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc01e070 con 0x7f14ec0c2620 2024-09-13T18:45:46.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec0c2310 con 0x7f14ec0c2620 2024-09-13T18:45:46.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0038c0 con 0x7f14ec0c2620 2024-09-13T18:45:46.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.156+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec155e50 con 0x7f14ec0c2620 2024-09-13T18:45:46.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.160+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f14ec0c4350 con 0x7f14ec0c2620 2024-09-13T18:45:46.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.160+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14dc003a20 con 0x7f14ec0c2620 2024-09-13T18:45:46.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f14cc066730 0x7f14cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f14dc020070 con 0x7f14ec0c2620 2024-09-13T18:45:46.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14ea000700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f14cc066730 0x7f14cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f14dc08c090 con 0x7f14ec0c2620 2024-09-13T18:45:46.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 0x7f14ec1eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec068030 con 0x7f14ec0b7f00 2024-09-13T18:45:46.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14ea000700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f14cc066730 0x7f14cc068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14ec155510 tx=0x7f14d8012040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 0x7f14ec1eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14ec06db90 con 0x7f14ec0b7f00 2024-09-13T18:45:46.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 0x7f14ec1eac00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e400f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400fae0 con 0x7f14ec0b7f00 2024-09-13T18:45:46.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.164+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f14e400fc40 con 0x7f14ec0b7f00 2024-09-13T18:45:46.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.168+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 msgr2=0x7f14ec1eac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.168+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 0x7f14ec1eac00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e400f280 comp rx=0 tx=0).stop 2024-09-13T18:45:46.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.168+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 msgr2=0x7f14ec1eac00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:45:46.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.168+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0b7f00 0x7f14ec1eac00 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e400f280 comp rx=0 tx=0).stop 2024-09-13T18:45:46.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.176+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 0x7f14ec14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.176+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec06d8b0 con 0x7f14ec156070 2024-09-13T18:45:46.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.176+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 0x7f14ec14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.176+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) v1 -- 0x7f14ec150920 con 0x7f14ec156070 2024-09-13T18:45:46.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.176+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 0x7f14ec14af30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e40014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.176+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4023070 con 0x7f14ec156070 2024-09-13T18:45:46.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.0 v2:172.21.15.32:3300/0 2 ==== command_reply(tid 3: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) v1 ==== 82+0+3 (secure 0 0 0) 0x7f14e4013880 con 0x7f14ec156070 2024-09-13T18:45:46.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 msgr2=0x7f14ec14af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 0x7f14ec14af30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e40014d0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 msgr2=0x7f14ec14af30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:45:46.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec156070 0x7f14ec14af30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.185 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-09-13T18:45:46.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 0x7f14ec152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0c77a0 con 0x7f14ec14b470 2024-09-13T18:45:46.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.180+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 0x7f14ec152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- command(tid 4: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14ec0c1930 con 0x7f14ec14b470 2024-09-13T18:45:46.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 0x7f14ec152eb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14e4024000 tx=0x7f14e4001a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4006a90 con 0x7f14ec14b470 2024-09-13T18:45:46.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.1 v2:172.21.15.86:3300/0 2 ==== command_reply(tid 4: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f14e402f040 con 0x7f14ec14b470 2024-09-13T18:45:46.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 msgr2=0x7f14ec152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 0x7f14ec152eb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14e4024000 tx=0x7f14e4001a10 comp rx=0 tx=0).stop 2024-09-13T18:45:46.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 msgr2=0x7f14ec152eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:45:46.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec14b470 0x7f14ec152eb0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14e4024000 tx=0x7f14e4001a10 comp rx=0 tx=0).stop 2024-09-13T18:45:46.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.184+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 reap_dead start 2024-09-13T18:45:46.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.196+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 0x7f14ec0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.196+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1eaa80 con 0x7f14ec1ea6a0 2024-09-13T18:45:46.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.196+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 0x7f14ec0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.200+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- command(tid 5: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) v1 -- 0x7f14ec14b880 con 0x7f14ec1ea6a0 2024-09-13T18:45:46.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.200+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 0x7f14ec0cb810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14e4001510 tx=0x7f14e4028000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.200+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e403edd0 con 0x7f14ec1ea6a0 2024-09-13T18:45:46.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.1 v2:172.21.15.86:3300/0 2 ==== command_reply(tid 5: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) v1 ==== 82+0+3 (secure 0 0 0) 0x7f14e4013e40 con 0x7f14ec1ea6a0 2024-09-13T18:45:46.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 msgr2=0x7f14ec0cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 0x7f14ec0cb810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14e4001510 tx=0x7f14e4028000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 msgr2=0x7f14ec0cb810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:45:46.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14ec1ea6a0 0x7f14ec0cb810 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14e4001510 tx=0x7f14e4028000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.208 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-09-13T18:45:46.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 0x7f14ec1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec074710 con 0x7f14ec1533f0 2024-09-13T18:45:46.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 0x7f14ec1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- command(tid 6: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14ec153d10 con 0x7f14ec1533f0 2024-09-13T18:45:46.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.204+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 0x7f14ec1537d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14e4007c50 tx=0x7f14e4005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.208+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e403d2a0 con 0x7f14ec1533f0 2024-09-13T18:45:46.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.208+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.2 v2:172.21.15.86:3301/0 2 ==== command_reply(tid 6: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f14e4006270 con 0x7f14ec1533f0 2024-09-13T18:45:46.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.208+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 msgr2=0x7f14ec1537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.208+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 0x7f14ec1537d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14e4007c50 tx=0x7f14e4005000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.208+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 msgr2=0x7f14ec1537d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:45:46.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.208+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec1533f0 0x7f14ec1537d0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14e4007c50 tx=0x7f14e4005000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.220+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 0x7f14ec1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.220+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0cbd50 con 0x7f14ec150ce0 2024-09-13T18:45:46.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.220+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 0x7f14ec1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.220+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- command(tid 7: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) v1 -- 0x7f14ec0cbec0 con 0x7f14ec150ce0 2024-09-13T18:45:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.220+0000 7f14eb400700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 0x7f14ec1510c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e4044000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.220+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4056330 con 0x7f14ec150ce0 2024-09-13T18:45:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 <== mon.2 v2:172.21.15.86:3301/0 2 ==== command_reply(tid 7: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) v1 ==== 82+0+3 (secure 0 0 0) 0x7f14e4056130 con 0x7f14ec150ce0 2024-09-13T18:45:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 msgr2=0x7f14ec1510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 0x7f14ec1510c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e4044000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14e2a00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 msgr2=0x7f14ec1510c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:45:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14e2a00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14ec150ce0 0x7f14ec1510c0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f14e40012e0 tx=0x7f14e4044000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.228 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f14cc066730 msgr2=0x7f14cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f14cc066730 0x7f14cc068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14ec155510 tx=0x7f14d8012040 comp rx=0 tx=0).stop 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0c2620 msgr2=0x7f14ec1ee0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 --2- 172.21.15.32:0/1606909584 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14ec0c2620 0x7f14ec1ee0f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0c4c40 tx=0x7f14dc004770 comp rx=0 tx=0).stop 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14eb400700 1 -- 172.21.15.32:0/1606909584 reap_dead start 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 shutdown_connections 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 >> 172.21.15.32:0/1606909584 conn(0x7f14ec073720 msgr2=0x7f14ec14f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 shutdown_connections 2024-09-13T18:45:46.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.224+0000 7f14ebe00700 1 -- 172.21.15.32:0/1606909584 wait complete. 2024-09-13T18:45:46.231 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T18:45:46.231 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T18:45:46.231 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T18:45:46.254 DEBUG:teuthology.orchestra.run.smithi032:> type ceph-objectstore-tool 2024-09-13T18:45:46.267 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T18:45:46.268 DEBUG:teuthology.orchestra.run.smithi086:> type ceph-objectstore-tool 2024-09-13T18:45:46.274 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T18:45:46.275 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T18:45:46.288 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:45:46.288 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:45:46.288 INFO:tasks.workunit:timeout=3h 2024-09-13T18:45:46.288 INFO:tasks.workunit:cleanup=True 2024-09-13T18:45:46.289 DEBUG:teuthology.orchestra.run.smithi032:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:46.289 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-13T18:45:46.289 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:45:46.289 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:45:46.290 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:45:46.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-13T18:45:46.290 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-13T18:45:46.290 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-13T18:45:46.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:45:46.291 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-13T18:45:46.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:45:46.291 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-13T18:45:46.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:45:46.311 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:46.308+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 32h/50d Inode: 1 Links: 2 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-13 18:45:06.312714281 +0000 2024-09-13T18:45:46.329 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-13 18:45:15.776474386 +0000 2024-09-13T18:45:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-13T18:45:46.330 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:46.330 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:45:46.416 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:46.412+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:46.416 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:45:46.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.464+0000 7fc62a600700 1 Processor -- start 2024-09-13T18:45:46.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.464+0000 7fc62a600700 1 -- start start 2024-09-13T18:45:46.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc62a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 0x7fc62415b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc62a600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 0x7fc6241511d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc62a600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62415b8a0 con 0x7fc6240c7070 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc62a600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240c2230 con 0x7fc624071d90 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc62a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c24f0 con 0x7fc6240719b0 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 0x7fc62415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc623e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 0x7fc6241511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 0x7fc62415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57868/0 (socket says 172.21.15.32:57868) 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc623e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 0x7fc6241511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45752/0 (socket says 172.21.15.32:45752) 2024-09-13T18:45:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 -- 172.21.15.32:0/4171492118 learned_addr learned my addr 172.21.15.32:0/4171492118 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 -- 172.21.15.32:0/4171492118 >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 msgr2=0x7fc6241511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 --2- 172.21.15.32:0/4171492118 >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 0x7fc6241511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 -- 172.21.15.32:0/4171492118 >> v1:172.21.15.86:6789/0 conn(0x7fc6240c7070 legacy=0x7fc624157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 -- 172.21.15.32:0/4171492118 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240c3ed0 con 0x7fc6240719b0 2024-09-13T18:45:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc623e00700 1 --2- 172.21.15.32:0/4171492118 >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 0x7fc6241511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc629200700 1 --2- 172.21.15.32:0/4171492118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 0x7fc62415b360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc618009910 tx=0x7fc618009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece4fbad26fe0c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.468+0000 7fc623400700 1 -- 172.21.15.32:0/4171492118 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011830 con 0x7fc6240719b0 2024-09-13T18:45:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc623400700 1 -- 172.21.15.32:0/4171492118 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618011990 con 0x7fc6240719b0 2024-09-13T18:45:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc623400700 1 -- 172.21.15.32:0/4171492118 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011d40 con 0x7fc6240719b0 2024-09-13T18:45:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 Processor -- start 2024-09-13T18:45:46.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 -- start start 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 -- 172.21.15.32:0/4171492118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 msgr2=0x7fc62415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 --2- 172.21.15.32:0/4171492118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 0x7fc62415b360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc618009910 tx=0x7fc618009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 -- 172.21.15.32:0/4171492118 shutdown_connections 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 --2- 172.21.15.32:0/4171492118 >> v2:172.21.15.86:3300/0 conn(0x7fc624071d90 0x7fc6241511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 --2- 172.21.15.32:0/4171492118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240719b0 0x7fc62415b360 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 -- 172.21.15.32:0/4171492118 >> 172.21.15.32:0/4171492118 conn(0x7fc62406a7d0 msgr2=0x7fc62406e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 -- 172.21.15.32:0/4171492118 shutdown_connections 2024-09-13T18:45:46.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7fc62a600700 1 -- 172.21.15.32:0/4171492118 wait complete. 2024-09-13T18:45:46.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39880721b0 0x7f398815a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3988153450 0x7f3988153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398815a620 con 0x7f3988072590 2024-09-13T18:45:46.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880716a0 con 0x7f3988153450 2024-09-13T18:45:46.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3987200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988153e40 con 0x7f39880721b0 2024-09-13T18:45:46.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3985e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39880721b0 0x7f398815a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3985400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3988072590 0x7f39880c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43228/0 (socket says 172.21.15.32:43228) 2024-09-13T18:45:46.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3985400700 1 -- 172.21.15.32:0/1868749862 learned_addr learned my addr 172.21.15.32:0/1868749862 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:46.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.472+0000 7f3986800700 1 --2- 172.21.15.32:0/1868749862 >> v2:172.21.15.86:3300/0 conn(0x7f3988153450 0x7f3988153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3985e00700 1 -- 172.21.15.32:0/1868749862 >> v2:172.21.15.86:3300/0 conn(0x7f3988153450 msgr2=0x7f3988153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:46.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3985e00700 1 --2- 172.21.15.32:0/1868749862 >> v2:172.21.15.86:3300/0 conn(0x7f3988153450 0x7f3988153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3985e00700 1 -- 172.21.15.32:0/1868749862 >> v1:172.21.15.32:6789/0 conn(0x7f3988072590 legacy=0x7f39880c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3985e00700 1 -- 172.21.15.32:0/1868749862 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398815db50 con 0x7f39880721b0 2024-09-13T18:45:46.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3984a00700 1 -- 172.21.15.32:0/1868749862 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177332972 0 0) 0x7f398815a620 con 0x7f3988072590 2024-09-13T18:45:46.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3985e00700 1 --2- 172.21.15.32:0/1868749862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39880721b0 0x7f398815a0e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3970009850 tx=0x7f3970009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a47ff7d708e75fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 Processor -- start 2024-09-13T18:45:46.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 -- start start 2024-09-13T18:45:46.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 Processor -- start 2024-09-13T18:45:46.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3984a00700 1 -- 172.21.15.32:0/1868749862 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970011830 con 0x7f39880721b0 2024-09-13T18:45:46.482 INFO:tasks.workunit.client.0.smithi032.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:45:46.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3984a00700 1 -- 172.21.15.32:0/1868749862 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970011990 con 0x7f39880721b0 2024-09-13T18:45:46.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3984a00700 1 -- 172.21.15.32:0/1868749862 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970011d40 con 0x7f39880721b0 2024-09-13T18:45:46.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 -- start start 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 -- 172.21.15.32:0/1868749862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39880721b0 msgr2=0x7f398815a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 --2- 172.21.15.32:0/1868749862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39880721b0 0x7f398815a0e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3970009850 tx=0x7f3970009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 -- 172.21.15.32:0/1868749862 shutdown_connections 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 --2- 172.21.15.32:0/1868749862 >> v2:172.21.15.86:3300/0 conn(0x7f3988153450 0x7f3988153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 --2- 172.21.15.32:0/1868749862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f39880721b0 0x7f398815a0e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 -- 172.21.15.32:0/1868749862 >> 172.21.15.32:0/1868749862 conn(0x7f39880cbfe0 msgr2=0x7f39880cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 -- 172.21.15.32:0/1868749862 shutdown_connections 2024-09-13T18:45:46.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f3987200700 1 -- 172.21.15.32:0/1868749862 wait complete. 2024-09-13T18:45:46.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6240719b0 0x7fc6240c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc624071d90 0x7fc62414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240c7070 0x7fc62414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c6880 con 0x7fc6240719b0 2024-09-13T18:45:46.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c63f0 con 0x7fc624071d90 2024-09-13T18:45:46.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc62a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c9f00 con 0x7fc6240c7070 2024-09-13T18:45:46.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc629200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6240719b0 0x7fc6240c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc629200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6240719b0 0x7fc6240c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38038/0 (socket says 172.21.15.32:38038) 2024-09-13T18:45:46.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc629200700 1 -- 172.21.15.32:0/3721715889 learned_addr learned my addr 172.21.15.32:0/3721715889 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:46.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5d940c58e0 0x7f5d9406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc624071d90 0x7fc62414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5d94070930 0x7f5d941578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240c7070 0x7fc62414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9415aac0 con 0x7f5d940c5cc0 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9406fa70 con 0x7f5d94070930 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d98c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9415ada0 con 0x7f5d940c58e0 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.476+0000 7f5d93e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5d94070930 0x7f5d941578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5d94070930 0x7f5d941578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38052/0 (socket says 172.21.15.32:38052) 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 -- 172.21.15.32:0/2569351813 learned_addr learned my addr 172.21.15.32:0/2569351813 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:46.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93400700 1 --2- 172.21.15.32:0/2569351813 >> v2:172.21.15.86:3300/0 conn(0x7f5d940c58e0 0x7f5d9406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc623e00700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240c7070 msgr2=0x7fc62414aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6240c7070 0x7fc62414aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc623e00700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6240719b0 msgr2=0x7fc6240c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc6240719b0 0x7fc6240c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc623e00700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100094b0 con 0x7fc624071d90 2024-09-13T18:45:46.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc624071d90 0x7fc62414ff20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc61000e980 tx=0x7fc61000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 -- 172.21.15.32:0/2569351813 >> v2:172.21.15.86:3300/0 conn(0x7f5d940c58e0 msgr2=0x7f5d9406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 --2- 172.21.15.32:0/2569351813 >> v2:172.21.15.86:3300/0 conn(0x7f5d940c58e0 0x7f5d9406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 -- 172.21.15.32:0/2569351813 >> v1:172.21.15.32:6789/0 conn(0x7f5d940c5cc0 legacy=0x7f5d9406e840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:45:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 -- 172.21.15.32:0/2569351813 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9415b080 con 0x7f5d94070930 2024-09-13T18:45:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93400700 1 --2- 172.21.15.32:0/2569351813 >> v2:172.21.15.86:3300/0 conn(0x7f5d940c58e0 0x7f5d9406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:46.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610013680 con 0x7fc624071d90 2024-09-13T18:45:46.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6100137e0 con 0x7fc624071d90 2024-09-13T18:45:46.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc618009570 con 0x7fc624071d90 2024-09-13T18:45:46.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 Processor -- start 2024-09-13T18:45:46.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 -- start start 2024-09-13T18:45:46.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d93e00700 1 --2- 172.21.15.32:0/2569351813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d941578a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d94074730 tx=0x7f5d8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b563ec8c910c7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d92000700 1 -- 172.21.15.32:0/2569351813 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00e070 con 0x7f5d94070930 2024-09-13T18:45:46.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610013b70 con 0x7fc624071d90 2024-09-13T18:45:46.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6240c60f0 con 0x7fc624071d90 2024-09-13T18:45:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d92000700 1 -- 172.21.15.32:0/2569351813 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c003a40 con 0x7f5d94070930 2024-09-13T18:45:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fc62415b360 con 0x7fc624071d90 2024-09-13T18:45:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 0x7f39881f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3988072590 0x7f3988158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3988153450 0x7f3988151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f5d92000700 1 -- 172.21.15.32:0/2569351813 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c003df0 con 0x7f5d94070930 2024-09-13T18:45:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3985e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 0x7f39881f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39881ef750 con 0x7f3988153450 2024-09-13T18:45:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39881f2370 con 0x7f39880721b0 2024-09-13T18:45:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3987200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398814f0a0 con 0x7f3988072590 2024-09-13T18:45:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3985e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 0x7f39881f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45778/0 (socket says 172.21.15.32:45778) 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3985e00700 1 -- 172.21.15.32:0/2291844454 learned_addr learned my addr 172.21.15.32:0/2291844454 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.480+0000 7f3986800700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3988153450 0x7f3988151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985400700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3988072590 0x7f3988158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 -- 172.21.15.32:0/2569351813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 msgr2=0x7f5d941578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 --2- 172.21.15.32:0/2569351813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d941578a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d94074730 tx=0x7f5d8c00b330 comp rx=0 tx=0).stop 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985e00700 1 -- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3988072590 msgr2=0x7f3988158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985e00700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3988072590 0x7f3988158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985e00700 1 -- 172.21.15.32:0/2291844454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3988153450 msgr2=0x7f3988151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985e00700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3988153450 0x7f3988151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985e00700 1 -- 172.21.15.32:0/2291844454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700094b0 con 0x7f39880721b0 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3986800700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3988153450 0x7f3988151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 -- 172.21.15.32:0/2569351813 shutdown_connections 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 --2- 172.21.15.32:0/2569351813 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d941578a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 --2- 172.21.15.32:0/2569351813 >> v2:172.21.15.86:3300/0 conn(0x7f5d940c58e0 0x7f5d9406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 -- 172.21.15.32:0/2569351813 >> 172.21.15.32:0/2569351813 conn(0x7f5d940c8a60 msgr2=0x7f5d940c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 -- 172.21.15.32:0/2569351813 shutdown_connections 2024-09-13T18:45:46.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 -- 172.21.15.32:0/2569351813 wait complete. 2024-09-13T18:45:46.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3985e00700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 0x7f39881f1e30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39700090b0 tx=0x7f3970004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc610013cd0 con 0x7fc624071d90 2024-09-13T18:45:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970004450 con 0x7f39880721b0 2024-09-13T18:45:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397001f070 con 0x7f39880721b0 2024-09-13T18:45:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970003900 con 0x7f39880721b0 2024-09-13T18:45:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39880c6d90 con 0x7f39880721b0 2024-09-13T18:45:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39880c6ab0 con 0x7f39880721b0 2024-09-13T18:45:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc620c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc604066760 0x7fc604068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc610084bb0 con 0x7fc624071d90 2024-09-13T18:45:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 Processor -- start 2024-09-13T18:45:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7f5d98c00700 1 -- start start 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc604066760 0x7fc604068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v28) v1 ==== 54+0+16 (secure 0 0 0) 0x7fc6100850a0 con 0x7fc624071d90 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc6240c5160 0x7fc62414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.484+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc624157470 con 0x7fc6240c5160 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc6240c5160 0x7fc62414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc604066760 0x7fc604068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc618009150 tx=0x7fc618008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3988067a00 con 0x7f39880721b0 2024-09-13T18:45:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc6240c5160 0x7fc62414af40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc61c001f20 con 0x7fc6240c5160 2024-09-13T18:45:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d940c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d940c58e0 0x7f5d940cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d940c5cc0 0x7f5d941ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940aed20 con 0x7f5d94070930 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940ae430 con 0x7f5d940c58e0 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940aef00 con 0x7f5d940c5cc0 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d92a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d940c58e0 0x7f5d940cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d92a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d940c58e0 0x7f5d940cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:45788/0 (socket says 172.21.15.32:45788) 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d92a00700 1 -- 172.21.15.32:0/1618465460 learned_addr learned my addr 172.21.15.32:0/1618465460 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d940c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 -- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d940c5cc0 msgr2=0x7f5d941ef210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:45:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d940c5cc0 0x7f5d941ef210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 -- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d940c58e0 msgr2=0x7f5d940cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d940c58e0 0x7f5d940cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 -- 172.21.15.32:0/1618465460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840094b0 con 0x7f5d94070930 2024-09-13T18:45:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d93400700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d940c0710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9b0 tx=0x7f5d8400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.503 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:46.488+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:46.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400c850 con 0x7f5d94070930 2024-09-13T18:45:46.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400c9b0 con 0x7f5d94070930 2024-09-13T18:45:46.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c009b30 con 0x7f5d94070930 2024-09-13T18:45:46.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d940ae6d0 con 0x7f5d94070930 2024-09-13T18:45:46.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400cd40 con 0x7f5d94070930 2024-09-13T18:45:46.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3970003a60 con 0x7f39880721b0 2024-09-13T18:45:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.488+0000 7f397e000700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3964066730 0x7f3964068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3970021070 con 0x7f39880721b0 2024-09-13T18:45:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f3985400700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3964066730 0x7f3964068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c005310 con 0x7f5d94070930 2024-09-13T18:45:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d84013470 con 0x7f5d94070930 2024-09-13T18:45:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f3985400700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3964066730 0x7f3964068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39880b2ae0 tx=0x7f3978007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f5d8b400700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5d74066760 0x7f5d74068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5d84084420 con 0x7f5d94070930 2024-09-13T18:45:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.492+0000 7f5d92a00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5d74066760 0x7f5d74068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.506 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:45:46.507 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.496+0000 7f5d92a00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5d74066760 0x7f5d74068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d94156760 tx=0x7f5d80009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.496+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3970052d80 con 0x7f39880721b0 2024-09-13T18:45:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.500+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5d840513c0 con 0x7f5d94070930 2024-09-13T18:45:46.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.508+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc6240c7b30 con 0x7fc6240c5160 2024-09-13T18:45:46.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.512+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc61c013390 con 0x7fc6240c5160 2024-09-13T18:45:46.516 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:45:46.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.512+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc624150460 0x7fc624159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.512+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6240c65a0 con 0x7fc624150460 2024-09-13T18:45:46.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.512+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc624150460 0x7fc624159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.512+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc624150460 0x7fc624159520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.516+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc6240c65a0 con 0x7fc624150460 2024-09-13T18:45:46.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:45:46.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.536+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc6240008d0 con 0x7fc624150460 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.540+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc6240008d0 con 0x7fc624150460 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.540+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc6240c43f0 0x7fc624159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.540+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6240c8940 con 0x7fc6240c43f0 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.540+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc6240c43f0 0x7fc624159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.540+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc6240c43f0 0x7fc624159f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.540+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc6240c8940 con 0x7fc6240c43f0 2024-09-13T18:45:46.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.572+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc624060db0 con 0x7fc6240c43f0 2024-09-13T18:45:46.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.572+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc624060db0 con 0x7fc6240c43f0 2024-09-13T18:45:46.578 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:45:46.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.572+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc624061840 0x7fc62406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.572+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc624061c80 con 0x7fc624061840 2024-09-13T18:45:46.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.576+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc624061840 0x7fc62406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.576+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc624061840 0x7fc62406f530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.576+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc624061c80 con 0x7fc624061840 2024-09-13T18:45:46.593 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:46.588+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:46.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.612+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc62406fd30 con 0x7fc624061840 2024-09-13T18:45:46.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.616+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc62406fd30 con 0x7fc624061840 2024-09-13T18:45:46.620 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:45:46.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.616+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc62402b6a0 0x7fc62402bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.616+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc62402c040 con 0x7fc62402b6a0 2024-09-13T18:45:46.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.616+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc62402b6a0 0x7fc62402bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.620+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc62402b6a0 0x7fc62402bb00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.620+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc62402c040 con 0x7fc62402b6a0 2024-09-13T18:45:46.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.648+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc62402c040 con 0x7fc62402b6a0 2024-09-13T18:45:46.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.652+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc62402c040 con 0x7fc62402b6a0 2024-09-13T18:45:46.657 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:45:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.652+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc62402c720 0x7fc624205760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.652+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc62402cb60 con 0x7fc62402c720 2024-09-13T18:45:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.652+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc62402c720 0x7fc624205760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.656+0000 7fc623e00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc62402c720 0x7fc624205760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.656+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc62402cb60 con 0x7fc62402c720 2024-09-13T18:45:46.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.676+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc62402cb60 con 0x7fc62402c720 2024-09-13T18:45:46.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.680+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc62402cb60 con 0x7fc62402c720 2024-09-13T18:45:46.684 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:45:46.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.680+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc6242061b0 0x7fc6242085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.680+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc62402ccd0 con 0x7fc6242061b0 2024-09-13T18:45:46.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.680+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc6242061b0 0x7fc6242085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.680+0000 7fc629c00700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc6242061b0 0x7fc6242085a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.684+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc62402ccd0 con 0x7fc6242061b0 2024-09-13T18:45:46.695 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:46.692+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.704+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc62402ccd0 con 0x7fc6242061b0 2024-09-13T18:45:46.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.708+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc62402ccd0 con 0x7fc6242061b0 2024-09-13T18:45:46.711 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:45:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.708+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc624208ff0 0x7fc62420b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.708+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc62420e260 con 0x7fc624208ff0 2024-09-13T18:45:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.708+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc624208ff0 0x7fc62420b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.708+0000 7fc629200700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc624208ff0 0x7fc62420b3e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.708+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc62420e260 con 0x7fc624208ff0 2024-09-13T18:45:46.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.720+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7f5d6c005b40 con 0x7f5d94070930 2024-09-13T18:45:46.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.728+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd out", "ids": ["3"]} v 0) v1 -- 0x7f398815d870 con 0x7f39880721b0 2024-09-13T18:45:46.733 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-09-13T18:45:46.728+0000 7f8fc4800700 -1 mon.a@0(leader).osd e28 definitely_dead 0 2024-09-13T18:45:46.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.736+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fc62420b920 con 0x7fc624208ff0 2024-09-13T18:45:46.742 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:46.742 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.740+0000 7fc620c00700 1 -- 172.21.15.32:0/3721715889 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc62420b920 con 0x7fc624208ff0 2024-09-13T18:45:46.746 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:45:46.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc6240c5160 msgr2=0x7fc62414af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc6240c5160 0x7fc62414af40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc624150460 msgr2=0x7fc624159520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc624150460 0x7fc624159520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc6240c43f0 msgr2=0x7fc624159f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc6240c43f0 0x7fc624159f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc624061840 msgr2=0x7fc62406f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc624061840 0x7fc62406f530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc62402b6a0 msgr2=0x7fc62402bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc629c00700 1 -- 172.21.15.32:0/3721715889 reap_dead start 2024-09-13T18:45:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc62402b6a0 0x7fc62402bb00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc629c00700 1 -- 172.21.15.32:0/3721715889 reap_dead start 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc62402c720 msgr2=0x7fc624205760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc62402c720 0x7fc624205760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc6242061b0 msgr2=0x7fc6242085a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc6242061b0 0x7fc6242085a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc624208ff0 msgr2=0x7fc62420b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc624208ff0 0x7fc62420b3e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc604066760 msgr2=0x7fc604068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc604066760 0x7fc604068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc618009150 tx=0x7fc618008030 comp rx=0 tx=0).stop 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc624071d90 msgr2=0x7fc62414ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 --2- 172.21.15.32:0/3721715889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc624071d90 0x7fc62414ff20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc61000e980 tx=0x7fc61000ec90 comp rx=0 tx=0).stop 2024-09-13T18:45:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc629c00700 1 -- 172.21.15.32:0/3721715889 reap_dead start 2024-09-13T18:45:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 shutdown_connections 2024-09-13T18:45:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 >> 172.21.15.32:0/3721715889 conn(0x7fc62406a7d0 msgr2=0x7fc6240b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 shutdown_connections 2024-09-13T18:45:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:46.744+0000 7fc62a600700 1 -- 172.21.15.32:0/3721715889 wait complete. 2024-09-13T18:45:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:45:46.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:45:46.817 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:46.812+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:46.897 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:46.892+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:46.998 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:46.992+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:46.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:45:47.099 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:47.096+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:47.168 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:47.168 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:47.183 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:45:47.227 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:47.224+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:47.300 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:47.296+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:47.401 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:47.396+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:47.415 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:47.416 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:47.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:45:47.501 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:47.496+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:47.603 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:47.600+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:47.639 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:47.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:45:47.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.664+0000 7f5d8b400700 1 -- 172.21.15.32:0/1618465460 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v29) v1 ==== 87+0+0 (secure 0 0 0) 0x7f5d840549e0 con 0x7f5d94070930 2024-09-13T18:45:47.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.668+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5d74066760 msgr2=0x7f5d74068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.668+0000 7f5d98c00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5d74066760 0x7f5d74068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d94156760 tx=0x7f5d80009190 comp rx=0 tx=0).stop 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.668+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 msgr2=0x7f5d940c0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.668+0000 7f5d98c00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d940c0710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e9b0 tx=0x7f5d8400ecc0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 shutdown_connections 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5d74066760 0x7f5d74068c20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5d940c5cc0 0x7f5d941ef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d940c58e0 0x7f5d940cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 --2- 172.21.15.32:0/1618465460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d94070930 0x7f5d940c0710 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 >> 172.21.15.32:0/1618465460 conn(0x7f5d940c8a60 msgr2=0x7f5d94157760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 shutdown_connections 2024-09-13T18:45:47.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f5d98c00700 1 -- 172.21.15.32:0/1618465460 wait complete. 2024-09-13T18:45:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.672+0000 7f397e000700 1 -- 172.21.15.32:0/2291844454 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd out", "ids": ["3"]}]=0 marked out osd.3. v29) v1 ==== 87+0+0 (secure 0 0 0) 0x7f3970015080 con 0x7f39880721b0 2024-09-13T18:45:47.677 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:45:47.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3964066730 msgr2=0x7f3964068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3964066730 0x7f3964068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39880b2ae0 tx=0x7f3978007e00 comp rx=0 tx=0).stop 2024-09-13T18:45:47.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 msgr2=0x7f39881f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 0x7f39881f1e30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39700090b0 tx=0x7f3970004770 comp rx=0 tx=0).stop 2024-09-13T18:45:47.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 shutdown_connections 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3964066730 0x7f3964068bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3988153450 0x7f3988151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3988072590 0x7f3988158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 --2- 172.21.15.32:0/2291844454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39880721b0 0x7f39881f1e30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 >> 172.21.15.32:0/2291844454 conn(0x7f39880cbfe0 msgr2=0x7f3988159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 shutdown_connections 2024-09-13T18:45:47.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:47.680+0000 7f3987200700 1 -- 172.21.15.32:0/2291844454 wait complete. 2024-09-13T18:45:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:marked out osd.3. 2024-09-13T18:45:47.716 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:47.708+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:47.805 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:47.800+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:47.843 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:47.844 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:47.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:45:47.906 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:47.900+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:48.007 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:48.004+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:48.082 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:48.082 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:48.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:45:48.107 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:48.104+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:48.209 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:48.204+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:48.268 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:48.268 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:48.281 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:45:48.310 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:48.304+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:48.411 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:48.408+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:48.512 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:48.508+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:48.515 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:48.515 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:48.530 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:45:48.623 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:48.620+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:48.719 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:48.716+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:48.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:45:48.769 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:48.769 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:48.788 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:45:48.831 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:48.828+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:48.915 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:48.912+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:48.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 Processor -- start 2024-09-13T18:45:48.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 -- start start 2024-09-13T18:45:48.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1370156d70 0x7f1370073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137006ef90 0x7f1370073c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13700703f0 con 0x7f13700c2e00 2024-09-13T18:45:48.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13700c6f10 con 0x7f1370156d70 2024-09-13T18:45:48.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f1375000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137006fa50 con 0x7f137006ef90 2024-09-13T18:45:48.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f136fe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f13700c2e00 0x7f137006d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:35356/0 (socket says 172.21.15.32:35356) 2024-09-13T18:45:48.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f136fe00700 1 -- 172.21.15.32:0/923205523 learned_addr learned my addr 172.21.15.32:0/923205523 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:48.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f136f400700 1 --2- 172.21.15.32:0/923205523 >> v2:172.21.15.32:3300/0 conn(0x7f1370156d70 0x7f1370073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.944+0000 7f136ea00700 1 --2- 172.21.15.32:0/923205523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137006ef90 0x7f1370073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136e000700 1 -- 172.21.15.32:0/923205523 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635851917 0 0) 0x7f13700703f0 con 0x7f13700c2e00 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136e000700 1 -- 172.21.15.32:0/923205523 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13540035d0 con 0x7f13700c2e00 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136ea00700 1 -- 172.21.15.32:0/923205523 >> v2:172.21.15.32:3300/0 conn(0x7f1370156d70 msgr2=0x7f1370073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136ea00700 1 --2- 172.21.15.32:0/923205523 >> v2:172.21.15.32:3300/0 conn(0x7f1370156d70 0x7f1370073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136ea00700 1 -- 172.21.15.32:0/923205523 >> v1:172.21.15.86:6789/0 conn(0x7f13700c2e00 legacy=0x7f137006d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136e000700 1 -- 172.21.15.32:0/923205523 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3369349131 0 0) 0x7f13540035d0 con 0x7f13700c2e00 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136ea00700 1 -- 172.21.15.32:0/923205523 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700c6990 con 0x7f137006ef90 2024-09-13T18:45:48.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136f400700 1 --2- 172.21.15.32:0/923205523 >> v2:172.21.15.32:3300/0 conn(0x7f1370156d70 0x7f1370073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:48.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136ea00700 1 --2- 172.21.15.32:0/923205523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137006ef90 0x7f1370073c60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f135c009850 tx=0x7f135c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b31eed709b8285 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136e000700 1 -- 172.21.15.32:0/923205523 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680019f0 con 0x7f137006ef90 2024-09-13T18:45:48.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136e000700 1 -- 172.21.15.32:0/923205523 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c004030 con 0x7f137006ef90 2024-09-13T18:45:48.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f136e000700 1 -- 172.21.15.32:0/923205523 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0043e0 con 0x7f137006ef90 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 -- 172.21.15.32:0/923205523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137006ef90 msgr2=0x7f1370073c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 --2- 172.21.15.32:0/923205523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137006ef90 0x7f1370073c60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f135c009850 tx=0x7f135c009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 -- 172.21.15.32:0/923205523 shutdown_connections 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 --2- 172.21.15.32:0/923205523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137006ef90 0x7f1370073c60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 --2- 172.21.15.32:0/923205523 >> v2:172.21.15.32:3300/0 conn(0x7f1370156d70 0x7f1370073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 -- 172.21.15.32:0/923205523 >> 172.21.15.32:0/923205523 conn(0x7f1370072680 msgr2=0x7f13700cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 -- 172.21.15.32:0/923205523 shutdown_connections 2024-09-13T18:45:48.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.948+0000 7f1375000700 1 -- 172.21.15.32:0/923205523 wait complete. 2024-09-13T18:45:48.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 Processor -- start 2024-09-13T18:45:48.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 -- start start 2024-09-13T18:45:48.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13700c2e00 0x7f13700cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 0x7f13701f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137014ec80 0x7f13701f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13701f26c0 con 0x7f1370156d70 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700ae300 con 0x7f13700c2e00 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f1375000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137014d870 con 0x7f137014ec80 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 0x7f13701f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 0x7f13701f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40488/0 (socket says 172.21.15.32:40488) 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 -- 172.21.15.32:0/2464105452 learned_addr learned my addr 172.21.15.32:0/2464105452 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137014ec80 0x7f13701f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13700c2e00 0x7f13700cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137014ec80 msgr2=0x7f13701f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137014ec80 0x7f13701f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13700c2e00 msgr2=0x7f13700cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13700c2e00 0x7f13700cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094b0 con 0x7f1370156d70 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13700c2e00 0x7f13700cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:48.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.952+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 0x7f13701f2b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f135c0090b0 tx=0x7f135c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c003bf0 con 0x7f1370156d70 2024-09-13T18:45:48.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c01f070 con 0x7f1370156d70 2024-09-13T18:45:48.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0094b0 con 0x7f1370156d70 2024-09-13T18:45:48.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c011630 con 0x7f1370156d70 2024-09-13T18:45:48.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137014ddc0 con 0x7f1370156d70 2024-09-13T18:45:48.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f1370157150 con 0x7f1370156d70 2024-09-13T18:45:48.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.956+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f135c021030 con 0x7f1370156d70 2024-09-13T18:45:48.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f1367400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1350066760 0x7f1350068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f135c085780 con 0x7f1370156d70 2024-09-13T18:45:48.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v30) v1 ==== 54+0+16 (secure 0 0 0) 0x7f135c08c070 con 0x7f1370156d70 2024-09-13T18:45:48.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1350066760 0x7f1350068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f137006ef90 0x7f137014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13700c6c30 con 0x7f137006ef90 2024-09-13T18:45:48.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f137006ef90 0x7f137014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1350066760 0x7f1350068c20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1360009dd0 tx=0x7f1360008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f137006ef90 0x7f137014dfb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.960+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1368002030 con 0x7f137006ef90 2024-09-13T18:45:48.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.984+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f1370070c30 con 0x7f137006ef90 2024-09-13T18:45:48.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.984+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f13680072e0 con 0x7f137006ef90 2024-09-13T18:45:48.989 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:45:48.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.984+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f137014c730 0x7f137014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.984+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13700c7060 con 0x7f137014c730 2024-09-13T18:45:48.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.988+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f137014c730 0x7f137014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.988+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f137014c730 0x7f137014cb10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:48.988+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f13700c7060 con 0x7f137014c730 2024-09-13T18:45:48.994 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:48.994 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:49.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:45:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.008+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f1370070620 con 0x7f137014c730 2024-09-13T18:45:49.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.012+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f1370070620 con 0x7f137014c730 2024-09-13T18:45:49.017 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:45:49.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.012+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f13701e3020 0x7f13701e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.012+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13701e39a0 con 0x7f13701e3020 2024-09-13T18:45:49.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.012+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f13701e3020 0x7f13701e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.012+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f13701e3020 0x7f13701e3460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.012+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f135c0563e0 con 0x7f13701e3020 2024-09-13T18:45:49.019 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:49.012+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:49.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.028+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f13700cb4f0 con 0x7f13701e3020 2024-09-13T18:45:49.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.032+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f13700cb4f0 con 0x7f13701e3020 2024-09-13T18:45:49.038 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:45:49.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.032+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f13700612c0 0x7f13700616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.032+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1370061be0 con 0x7f13700612c0 2024-09-13T18:45:49.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.036+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f13700612c0 0x7f13700616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.036+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f13700612c0 0x7f13700616a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.036+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1370061be0 con 0x7f13700612c0 2024-09-13T18:45:49.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.052+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f13700c11d0 con 0x7f13700612c0 2024-09-13T18:45:49.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.056+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f13700c11d0 con 0x7f13700612c0 2024-09-13T18:45:49.060 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:45:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.056+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f13700c18b0 0x7f137002b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.056+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1370061db0 con 0x7f13700c18b0 2024-09-13T18:45:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.056+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f13700c18b0 0x7f137002b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.056+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f13700c18b0 0x7f137002b6a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.060+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1360023040 con 0x7f13700c18b0 2024-09-13T18:45:49.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.084+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f13700c1cd0 con 0x7f13700c18b0 2024-09-13T18:45:49.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.088+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f13700c1cd0 con 0x7f13700c18b0 2024-09-13T18:45:49.090 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:45:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.088+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f137002c0f0 0x7f137002c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.088+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13700c1e40 con 0x7f137002c0f0 2024-09-13T18:45:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.088+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f137002c0f0 0x7f137002c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.088+0000 7f136ea00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f137002c0f0 0x7f137002c550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.088+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f13700c1e40 con 0x7f137002c0f0 2024-09-13T18:45:49.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.112+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f13700c1e40 con 0x7f137002c0f0 2024-09-13T18:45:49.117 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:49.112+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:49.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.116+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f13700c1e40 con 0x7f137002c0f0 2024-09-13T18:45:49.121 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:45:49.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.116+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1370205f60 0x7f1370208350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.116+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f137002ca90 con 0x7f1370205f60 2024-09-13T18:45:49.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.116+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1370205f60 0x7f1370208350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.120+0000 7f136fe00700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1370205f60 0x7f1370208350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.120+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f137002ca90 con 0x7f1370205f60 2024-09-13T18:45:49.131 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:49.131 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:49.132 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:49.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:45:49.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.140+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f137002ca90 con 0x7f1370205f60 2024-09-13T18:45:49.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.144+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f137002ca90 con 0x7f1370205f60 2024-09-13T18:45:49.150 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:45:49.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.148+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1370208da0 0x7f137020b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.148+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f137020e010 con 0x7f1370208da0 2024-09-13T18:45:49.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.148+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1370208da0 0x7f137020b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.148+0000 7f136f400700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1370208da0 0x7f137020b190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.152+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f137020e010 con 0x7f1370208da0 2024-09-13T18:45:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.172+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f137020b6d0 con 0x7f1370208da0 2024-09-13T18:45:49.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1367400700 1 -- 172.21.15.32:0/2464105452 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f137020b6d0 con 0x7f1370208da0 2024-09-13T18:45:49.179 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:45:49.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f137006ef90 msgr2=0x7f137014dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f137006ef90 0x7f137014dfb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f137014c730 msgr2=0x7f137014cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f137014c730 0x7f137014cb10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f13701e3020 msgr2=0x7f13701e3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f13701e3020 0x7f13701e3460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f13700612c0 msgr2=0x7f13700616a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f13700612c0 0x7f13700616a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f13700c18b0 msgr2=0x7f137002b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f13700c18b0 0x7f137002b6a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f137002c0f0 msgr2=0x7f137002c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f137002c0f0 0x7f137002c550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f136fe00700 1 -- 172.21.15.32:0/2464105452 reap_dead start 2024-09-13T18:45:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1370205f60 msgr2=0x7f1370208350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1370205f60 0x7f1370208350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f136fe00700 1 -- 172.21.15.32:0/2464105452 reap_dead start 2024-09-13T18:45:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1370208da0 msgr2=0x7f137020b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1370208da0 0x7f137020b190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f136fe00700 1 -- 172.21.15.32:0/2464105452 reap_dead start 2024-09-13T18:45:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f136fe00700 1 -- 172.21.15.32:0/2464105452 reap_dead start 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1350066760 msgr2=0x7f1350068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1350066760 0x7f1350068c20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1360009dd0 tx=0x7f1360008040 comp rx=0 tx=0).stop 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 msgr2=0x7f13701f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 0x7f13701f2b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f135c0090b0 tx=0x7f135c004770 comp rx=0 tx=0).stop 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 shutdown_connections 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1350066760 0x7f1350068c20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 --2- 172.21.15.32:0/2464105452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1370156d70 0x7f13701f2b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 >> 172.21.15.32:0/2464105452 conn(0x7f1370072680 msgr2=0x7f13700c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 shutdown_connections 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.176+0000 7f1375000700 1 -- 172.21.15.32:0/2464105452 wait complete. 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:45:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:45:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:45:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:45:49.247 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:49.244+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:49.249 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:49.258 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:45:49.319 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:49.316+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.048333481999997, 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:45:49.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047576728000003, 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:45:49.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047558068999997, 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:45:49.386 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:45:49.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047545980000002, 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:45:49.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:45:49.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047539254999997, 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:45:49.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:45:49.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:45:49.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047532412999999, 2024-09-13T18:45:49.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:45:49.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.407 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047526322000003, 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:45:49.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047501234000002, 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.413 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:45:49.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.418 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047496578000001, 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:45:49.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047482479000003, 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.424 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:45:49.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:45:49.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047470525000001, 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:45:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:45:49.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:45:49.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047462005, 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:45:49.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:45:49.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.0474569, 2024-09-13T18:45:49.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:45:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.047382605000003, 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:45:49.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:45:49.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.046461182999998, 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.457 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.046436026000002, 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:45:49.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.461 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.046379315999999, 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:45:49.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:45:49.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.043015562999997, 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.466 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:45:49.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:49.470 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.042235771999998, 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:45:49.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.547442705000002, 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:45:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:45:49.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:45:49.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.479 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:49.480 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:45:49.480 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:49.428+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:49.534 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:49.528+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:49.593 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:49.593 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:49.593 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:49.594 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:49.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:45:49.635 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:49.632+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:49.710 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:49.710 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:49.711 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:49.711 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:49.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:45:49.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:45:49.735 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:49.732+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:45:49.831 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.489951363000003, 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:45:49.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:45:49.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:45:49.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.838 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.838 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.838 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.478714369000002, 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:45:49.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.415942862999998, 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.385704724, 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.851 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.855 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.385096355999998, 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:45:49.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.016777529000002, 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.860 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:45:49.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.864 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.015995943999997, 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:45:49.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.015228755000003, 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:45:49.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.014393495999997, 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:45:49.873 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:45:49.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.013402884000001, 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:45:49.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:45:49.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 57.012789390000002, 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:45:49.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:45:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.110503284000004, 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:45:49.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.890 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.109229579999997, 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:45:49.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:45:49.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.101425953000003, 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:49.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:45:49.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:45:49.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.100653065000003, 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:45:49.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.502419072999999, 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:45:49.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.502393816000001, 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:49.914 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.502361673000003, 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:45:49.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.499600821000001, 2024-09-13T18:45:49.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:45:49.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:45:49.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.496640050000003, 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:49.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:45:49.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:49.927 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:49.930 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:45:49.930 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:49.924+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:49.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.900+0000 7ff211200700 1 Processor -- start 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.900+0000 7ff211200700 1 -- start start 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff211200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c1536b0 0x7ff20c0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff211200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff20c0c7c60 0x7ff20c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff211200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0c8c20 con 0x7ff20c06e710 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff211200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c0c8ec0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff211200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c159890 con 0x7ff20c1536b0 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c1536b0 0x7ff20c0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff20a800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff20c06e710 0x7ff20c15ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:35370/0 (socket says 172.21.15.32:35370) 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff20a800700 1 -- 172.21.15.32:0/2096087982 learned_addr learned my addr 172.21.15.32:0/2096087982 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209400700 1 --2- 172.21.15.32:0/2096087982 >> v2:172.21.15.32:3300/0 conn(0x7ff20c0c7c60 0x7ff20c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209e00700 1 -- 172.21.15.32:0/2096087982 >> v2:172.21.15.32:3300/0 conn(0x7ff20c0c7c60 msgr2=0x7ff20c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209e00700 1 --2- 172.21.15.32:0/2096087982 >> v2:172.21.15.32:3300/0 conn(0x7ff20c0c7c60 0x7ff20c153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209e00700 1 -- 172.21.15.32:0/2096087982 >> v1:172.21.15.86:6789/0 conn(0x7ff20c06e710 legacy=0x7ff20c15ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209e00700 1 -- 172.21.15.32:0/2096087982 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c159b70 con 0x7ff20c1536b0 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff208a00700 1 -- 172.21.15.32:0/2096087982 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297428330 0 0) 0x7ff20c0c8c20 con 0x7ff20c06e710 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff209e00700 1 --2- 172.21.15.32:0/2096087982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c1536b0 0x7ff20c0c95b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=149380b36d7f6525 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff208a00700 1 -- 172.21.15.32:0/2096087982 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc011830 con 0x7ff20c1536b0 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff208a00700 1 -- 172.21.15.32:0/2096087982 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc011990 con 0x7ff20c1536b0 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.904+0000 7ff208a00700 1 -- 172.21.15.32:0/2096087982 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc011d40 con 0x7ff20c1536b0 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 -- 172.21.15.32:0/2096087982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c1536b0 msgr2=0x7ff20c0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 --2- 172.21.15.32:0/2096087982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c1536b0 0x7ff20c0c95b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:49.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 -- 172.21.15.32:0/2096087982 shutdown_connections 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 --2- 172.21.15.32:0/2096087982 >> v2:172.21.15.32:3300/0 conn(0x7ff20c0c7c60 0x7ff20c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 --2- 172.21.15.32:0/2096087982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c1536b0 0x7ff20c0c95b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 -- 172.21.15.32:0/2096087982 >> 172.21.15.32:0/2096087982 conn(0x7ff20c06b800 msgr2=0x7ff20c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 -- 172.21.15.32:0/2096087982 shutdown_connections 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 -- 172.21.15.32:0/2096087982 wait complete. 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 Processor -- start 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.908+0000 7ff211200700 1 -- start start 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 0x7ff20c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff20c0c7c60 0x7ff20c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c1536b0 0x7ff20c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c35a0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c06f530 con 0x7ff20c1536b0 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c5cc0 con 0x7ff20c06e710 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 0x7ff20c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff20c0c7c60 0x7ff20c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 0x7ff20c151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:33316/0 (socket says 172.21.15.32:33316) 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209e00700 1 -- 172.21.15.32:0/1404813313 learned_addr learned my addr 172.21.15.32:0/1404813313 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff20a800700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c1536b0 0x7ff20c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 -- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 msgr2=0x7ff20c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 0x7ff20c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 -- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c1536b0 msgr2=0x7ff20c0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c1536b0 0x7ff20c0c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 -- 172.21.15.32:0/1404813313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0094b0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209e00700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 0x7ff20c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff209400700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff20c0c7c60 0x7ff20c0c61e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0caa20 tx=0x7ff1f800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8013680 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f80137e0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8013b50 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c1efcd0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.912+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c06fad0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.916+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c0c77c0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.916+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1f8013cb0 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.920+0000 7ff202000700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff1ec066730 0x7ff1ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.920+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff1f8084470 con 0x7ff20c0c7c60 2024-09-13T18:45:49.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.920+0000 7ff209e00700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff1ec066730 0x7ff1ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.920+0000 7ff209e00700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff1ec066730 0x7ff1ec068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009ba0 tx=0x7ff1fc008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:49.924+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1f8051380 con 0x7ff20c0c7c60 2024-09-13T18:45:50.030 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:50.024+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:50.095 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:50.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:50.096 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:50.096 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:50.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:45:50.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.116+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7ff20c0c95b0 con 0x7ff20c0c7c60 2024-09-13T18:45:50.155 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:50.152+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:50.212 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:50.212 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:50.222 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:45:50.231 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:50.228+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:50.329 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.000668476000001, 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:45:50.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:45:50.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.333 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:50.334 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:50.328+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:50.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:45:50.435 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:50.432+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:50.488 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:50.488 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:50.488 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:50.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:45:50.537 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:50.532+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:50.603 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:50.604 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:50.604 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:50.604 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:50.604 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:50.613 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:45:50.637 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:50.632+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:50.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.684+0000 7ff202000700 1 -- 172.21.15.32:0/1404813313 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff1f8017090 con 0x7ff20c0c7c60 2024-09-13T18:45:50.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff1ec066730 msgr2=0x7ff1ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff1ec066730 0x7ff1ec068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009ba0 tx=0x7ff1fc008030 comp rx=0 tx=0).stop 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff20c0c7c60 msgr2=0x7ff20c0c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff20c0c7c60 0x7ff20c0c61e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0caa20 tx=0x7ff1f800ebb0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 shutdown_connections 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff1ec066730 0x7ff1ec068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff20c1536b0 0x7ff20c0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff20c0c7c60 0x7ff20c0c61e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 --2- 172.21.15.32:0/1404813313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff20c06e710 0x7ff20c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 >> 172.21.15.32:0/1404813313 conn(0x7ff20c06b800 msgr2=0x7ff20c06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 shutdown_connections 2024-09-13T18:45:50.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:50.688+0000 7ff211200700 1 -- 172.21.15.32:0/1404813313 wait complete. 2024-09-13T18:45:50.695 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:45:50.725 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:50.725 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:50.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:50.725 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:50.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.398454123, 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:45:50.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:45:50.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.731 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.398430255999997, 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:45:50.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:45:50.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.398419746000002, 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.737 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:45:50.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.742 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.398403746, 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:45:50.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:45:50.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.398396908999999, 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:45:50.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:45:50.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:50.753 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.394838782999997, 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:50.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.393027957000001, 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:45:50.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.392974264999999, 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:45:50.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:45:50.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:45:50.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.391930318, 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:45:50.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.390374629999997, 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:45:50.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.390320883000001, 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:45:50.774 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:45:50.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.389081703000002, 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.778 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.389036468, 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.782 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:45:50.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.389001434000001, 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:45:50.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.388961203999997, 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:45:50.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:45:50.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.388268781999997, 2024-09-13T18:45:50.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:45:50.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:50.799 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.388218094000003, 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:45:50.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:45:50.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.387824453999997, 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.804 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:50.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 44.387427889999998, 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:45:50.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:50.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:50.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:50.813 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:50.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:45:50.815 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:50.812+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:50.916 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:50.912+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:51.013 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:51.013 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:51.013 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:45:51.013 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:51.016 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:51.012+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:51.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:45:51.119 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:51.116+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:51.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:45:51.241 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:51.242 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:51.242 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:45:51.242 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:45:51.242 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:51.242 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:51.236+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:51.257 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:45:51.321 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:51.320+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:51.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.356+0000 7f589f200700 1 Processor -- start 2024-09-13T18:45:51.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.356+0000 7f589f200700 1 -- start start 2024-09-13T18:45:51.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589f200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f58a0151790 0x7f58a0140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589f200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a00cb6a0 con 0x7f58a006ee00 2024-09-13T18:45:51.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589f200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0157480 con 0x7f58a0140880 2024-09-13T18:45:51.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589f200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a0151b70 con 0x7f58a0151790 2024-09-13T18:45:51.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589e800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f58a006ee00 0x7f58a006c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47254/0 (socket says 172.21.15.32:47254) 2024-09-13T18:45:51.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589e800700 1 -- 172.21.15.32:0/1633028947 learned_addr learned my addr 172.21.15.32:0/1633028947 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:51.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589de00700 1 --2- 172.21.15.32:0/1633028947 >> v2:172.21.15.86:3300/0 conn(0x7f58a0151790 0x7f58a0140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f5895400700 1 --1- 172.21.15.32:0/1633028947 >> v1:172.21.15.86:6789/0 conn(0x7f58a0140880 0x7f58a00c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:35372/0 (socket says 172.21.15.32:35372) 2024-09-13T18:45:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589d400700 1 -- 172.21.15.32:0/1633028947 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631011170 0 0) 0x7f58a00cb6a0 con 0x7f58a006ee00 2024-09-13T18:45:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589d400700 1 -- 172.21.15.32:0/1633028947 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58840035d0 con 0x7f58a006ee00 2024-09-13T18:45:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589de00700 1 -- 172.21.15.32:0/1633028947 >> v1:172.21.15.86:6789/0 conn(0x7f58a0140880 legacy=0x7f58a00c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589de00700 1 -- 172.21.15.32:0/1633028947 >> v1:172.21.15.32:6789/0 conn(0x7f58a006ee00 legacy=0x7f58a006c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589de00700 1 -- 172.21.15.32:0/1633028947 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0157760 con 0x7f58a0151790 2024-09-13T18:45:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589de00700 1 --2- 172.21.15.32:0/1633028947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0151790 0x7f58a0140240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d90 tx=0x7f589000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51adfcb9249f12db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589d400700 1 -- 172.21.15.32:0/1633028947 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000e070 con 0x7f58a0151790 2024-09-13T18:45:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589d400700 1 -- 172.21.15.32:0/1633028947 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000bb20 con 0x7f58a0151790 2024-09-13T18:45:51.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.360+0000 7f589d400700 1 -- 172.21.15.32:0/1633028947 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000be90 con 0x7f58a0151790 2024-09-13T18:45:51.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 -- 172.21.15.32:0/1633028947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0151790 msgr2=0x7f58a0140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 --2- 172.21.15.32:0/1633028947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0151790 0x7f58a0140240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5890009d90 tx=0x7f589000b330 comp rx=0 tx=0).stop 2024-09-13T18:45:51.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 -- 172.21.15.32:0/1633028947 shutdown_connections 2024-09-13T18:45:51.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 --2- 172.21.15.32:0/1633028947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0151790 0x7f58a0140240 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 -- 172.21.15.32:0/1633028947 >> 172.21.15.32:0/1633028947 conn(0x7f58a00caae0 msgr2=0x7f58a00caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 -- 172.21.15.32:0/1633028947 shutdown_connections 2024-09-13T18:45:51.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.364+0000 7f589f200700 1 -- 172.21.15.32:0/1633028947 wait complete. 2024-09-13T18:45:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 Processor -- start 2024-09-13T18:45:51.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 -- start start 2024-09-13T18:45:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a006ee00 0x7f58a00ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0140880 0x7f58a0071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a0151790 0x7f58a0072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01f2c20 con 0x7f58a006ee00 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00c22e0 con 0x7f58a0140880 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01f2050 con 0x7f58a0151790 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589de00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a006ee00 0x7f58a00ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0140880 0x7f58a0071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0140880 0x7f58a0071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:57918/0 (socket says 172.21.15.32:57918) 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589de00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a006ee00 0x7f58a00ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40504/0 (socket says 172.21.15.32:40504) 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 -- 172.21.15.32:0/2681245832 learned_addr learned my addr 172.21.15.32:0/2681245832 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:51.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a0151790 0x7f58a0072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a0151790 msgr2=0x7f58a0072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58a0151790 0x7f58a0072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a006ee00 msgr2=0x7f58a00ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a006ee00 0x7f58a00ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009a70 con 0x7f58a0140880 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0140880 0x7f58a0071c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f588800c500 tx=0x7f588800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.368+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888005cd0 con 0x7f58a0140880 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.372+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a00c1a30 con 0x7f58a0140880 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.372+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888005e30 con 0x7f58a0140880 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.372+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880072f0 con 0x7f58a0140880 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.372+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a01f28b0 con 0x7f58a0140880 2024-09-13T18:45:51.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.372+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f58a01f2a40 con 0x7f58a0140880 2024-09-13T18:45:51.377 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.372+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5888007450 con 0x7f58a0140880 2024-09-13T18:45:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f5896a00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f587c066760 0x7f587c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5888084110 con 0x7f58a0140880 2024-09-13T18:45:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v31) v1 ==== 54+0+16 (secure 0 0 0) 0x7f5888084480 con 0x7f58a0140880 2024-09-13T18:45:51.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f587c066760 0x7f587c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f58a0070a20 0x7f58a00bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a0157d20 con 0x7f58a0070a20 2024-09-13T18:45:51.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f587c066760 0x7f587c068c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f589000b370 tx=0x7f5890011000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f58a0070a20 0x7f58a00bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.376+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f58a0070a20 0x7f58a00bfae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.380+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5898006bf0 con 0x7f58a0070a20 2024-09-13T18:45:51.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.400+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a006df40 con 0x7f58a0070a20 2024-09-13T18:45:51.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.404+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f5898004890 con 0x7f58a0070a20 2024-09-13T18:45:51.406 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:45:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.404+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f58a01e1800 0x7f58a01e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.404+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a0156970 con 0x7f58a01e1800 2024-09-13T18:45:51.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.404+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f58a01e1800 0x7f58a01e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.404+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f58a01e1800 0x7f58a01e1be0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.408+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58a0156970 con 0x7f58a01e1800 2024-09-13T18:45:51.422 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:51.420+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:51.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.428+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a00c6f50 con 0x7f58a01e1800 2024-09-13T18:45:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.428+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a00c6f50 con 0x7f58a01e1800 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.428+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f58a013ee70 0x7f58a013f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.428+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a01e2630 con 0x7f58a013ee70 2024-09-13T18:45:51.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.432+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f58a013ee70 0x7f58a013f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.432+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f58a013ee70 0x7f58a013f270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.432+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58a01e2630 con 0x7f58a013ee70 2024-09-13T18:45:51.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.448+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a013fa70 con 0x7f58a013ee70 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.452+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a013fa70 con 0x7f58a013ee70 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.452+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f58a0061430 0x7f58a0061870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.452+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a0061db0 con 0x7f58a0061430 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.452+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f58a0061430 0x7f58a0061870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.452+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f58a0061430 0x7f58a0061870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.452+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58980076e0 con 0x7f58a0061430 2024-09-13T18:45:51.470 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:51.470 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:51.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.472+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a00c8ba0 con 0x7f58a0061430 2024-09-13T18:45:51.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.472+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a00c8ba0 con 0x7f58a0061430 2024-09-13T18:45:51.477 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:45:51.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.472+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f58a00c9220 0x7f58a002b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.472+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a00c9640 con 0x7f58a00c9220 2024-09-13T18:45:51.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.472+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f58a00c9220 0x7f58a002b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.476+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f58a00c9220 0x7f58a002b6a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.476+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58a00c9640 con 0x7f58a00c9220 2024-09-13T18:45:51.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:45:51.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.496+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a00c9640 con 0x7f58a00c9220 2024-09-13T18:45:51.504 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:45:51.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.500+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a00c9640 con 0x7f58a00c9220 2024-09-13T18:45:51.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.500+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f58a002c0f0 0x7f58a002c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.500+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a00c9810 con 0x7f58a002c0f0 2024-09-13T18:45:51.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.500+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f58a002c0f0 0x7f58a002c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.500+0000 7f5895400700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f58a002c0f0 0x7f58a002c510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.500+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58a00c9810 con 0x7f58a002c0f0 2024-09-13T18:45:51.523 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:51.520+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:51.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.520+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a00c97b0 con 0x7f58a002c0f0 2024-09-13T18:45:51.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.524+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a00c97b0 con 0x7f58a002c0f0 2024-09-13T18:45:51.529 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:45:51.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.524+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f58a0205b00 0x7f58a0207ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.524+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a002cb20 con 0x7f58a0205b00 2024-09-13T18:45:51.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.524+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f58a0205b00 0x7f58a0207ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.528+0000 7f589e800700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f58a0205b00 0x7f58a0207ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.528+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58a002cb20 con 0x7f58a0205b00 2024-09-13T18:45:51.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.548+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a002cb20 con 0x7f58a0205b00 2024-09-13T18:45:51.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.552+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a002cb20 con 0x7f58a0205b00 2024-09-13T18:45:51.554 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:45:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.552+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f58a0208940 0x7f58a020ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.552+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58a020ddd0 con 0x7f58a0208940 2024-09-13T18:45:51.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.552+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f58a0208940 0x7f58a020ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.552+0000 7f589de00700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f58a0208940 0x7f58a020ad30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.552+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58a020ddd0 con 0x7f58a0208940 2024-09-13T18:45:51.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.576+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f58a020ddd0 con 0x7f58a0208940 2024-09-13T18:45:51.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f5896a00700 1 -- 172.21.15.32:0/2681245832 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f58a020ddd0 con 0x7f58a0208940 2024-09-13T18:45:51.583 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:45:51.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f58a0070a20 msgr2=0x7f58a00bfae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f58a0070a20 0x7f58a00bfae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f58a01e1800 msgr2=0x7f58a01e1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f58a01e1800 0x7f58a01e1be0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f58a013ee70 msgr2=0x7f58a013f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f58a013ee70 0x7f58a013f270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f58a0061430 msgr2=0x7f58a0061870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f58a0061430 0x7f58a0061870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f58a00c9220 msgr2=0x7f58a002b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f58a00c9220 0x7f58a002b6a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f58a002c0f0 msgr2=0x7f58a002c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f58a002c0f0 0x7f58a002c510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f58a0205b00 msgr2=0x7f58a0207ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f58a0205b00 0x7f58a0207ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f58a0208940 msgr2=0x7f58a020ad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f58a0208940 0x7f58a020ad30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f587c066760 msgr2=0x7f587c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589e800700 1 -- 172.21.15.32:0/2681245832 reap_dead start 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f587c066760 0x7f587c068c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f589000b370 tx=0x7f5890011000 comp rx=0 tx=0).stop 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589e800700 1 -- 172.21.15.32:0/2681245832 reap_dead start 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0140880 msgr2=0x7f58a0071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 --2- 172.21.15.32:0/2681245832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a0140880 0x7f58a0071c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f588800c500 tx=0x7f588800c810 comp rx=0 tx=0).stop 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589e800700 1 -- 172.21.15.32:0/2681245832 reap_dead start 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589e800700 1 -- 172.21.15.32:0/2681245832 reap_dead start 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589e800700 1 -- 172.21.15.32:0/2681245832 reap_dead start 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 shutdown_connections 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 >> 172.21.15.32:0/2681245832 conn(0x7f58a00caae0 msgr2=0x7f58a00caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 shutdown_connections 2024-09-13T18:45:51.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:51.580+0000 7f589f200700 1 -- 172.21.15.32:0/2681245832 wait complete. 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:45:51.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:45:51.651 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:51.648+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:51.666 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:51.666 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:51.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:45:51.727 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:51.724+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:51.826 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:51.824+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:51.895 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:51.895 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:51.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:45:51.959 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:51.956+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:52.028 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:52.028+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:52.129 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:52.128+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:52.132 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:52.132 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:52.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:45:52.231 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:52.228+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:52.319 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:52.319 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:52.331 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:52.328+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:52.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:45:52.432 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:52.428+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:52.533 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:52.528+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:52.554 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:52.554 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:52.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:45:52.633 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:52.632+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:52.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:45:52.728 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:45:52.728 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:45:52.728 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T18:45:52.728 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 1.000000 2024-09-13T18:45:52.729 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-13T18:45:52.771 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:52.768+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:52.799 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:52.799 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:52.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:45:52.858 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:52.856+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:52.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c3000700 1 Processor -- start 2024-09-13T18:45:52.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c3000700 1 -- start start 2024-09-13T18:45:52.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc151680 0x7f61bc06b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c3000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc15aa50 con 0x7f61bc151a60 2024-09-13T18:45:52.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c3000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc15aca0 con 0x7f61bc0cd640 2024-09-13T18:45:52.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c3000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc15af80 con 0x7f61bc151680 2024-09-13T18:45:52.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c1200700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f61bc151a60 0x7f61bc0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47260/0 (socket says 172.21.15.32:47260) 2024-09-13T18:45:52.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c1200700 1 -- 172.21.15.32:0/422943958 learned_addr learned my addr 172.21.15.32:0/422943958 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:52.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.904+0000 7f61c1c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc151680 0x7f61bc06b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c1c00700 1 -- 172.21.15.32:0/422943958 >> v1:172.21.15.86:6789/0 conn(0x7f61bc0cd640 legacy=0x7f61bc157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c1c00700 1 -- 172.21.15.32:0/422943958 >> v1:172.21.15.32:6789/0 conn(0x7f61bc151a60 legacy=0x7f61bc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c1c00700 1 -- 172.21.15.32:0/422943958 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc15b260 con 0x7f61bc151680 2024-09-13T18:45:52.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61bbe00700 1 -- 172.21.15.32:0/422943958 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662139778 0 0) 0x7f61bc15aa50 con 0x7f61bc151a60 2024-09-13T18:45:52.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c1c00700 1 --2- 172.21.15.32:0/422943958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc151680 0x7f61bc06b260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009880 tx=0x7f61b0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b060ac5a74435ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61bbe00700 1 -- 172.21.15.32:0/422943958 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0011830 con 0x7f61bc151680 2024-09-13T18:45:52.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61bbe00700 1 -- 172.21.15.32:0/422943958 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b0011990 con 0x7f61bc151680 2024-09-13T18:45:52.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61bbe00700 1 -- 172.21.15.32:0/422943958 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0011d20 con 0x7f61bc151680 2024-09-13T18:45:52.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 -- 172.21.15.32:0/422943958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc151680 msgr2=0x7f61bc06b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 --2- 172.21.15.32:0/422943958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc151680 0x7f61bc06b260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009880 tx=0x7f61b0009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:52.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 -- 172.21.15.32:0/422943958 shutdown_connections 2024-09-13T18:45:52.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 --2- 172.21.15.32:0/422943958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc151680 0x7f61bc06b260 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 -- 172.21.15.32:0/422943958 >> 172.21.15.32:0/422943958 conn(0x7f61bc071740 msgr2=0x7f61bc071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 -- 172.21.15.32:0/422943958 shutdown_connections 2024-09-13T18:45:52.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.908+0000 7f61c3000700 1 -- 172.21.15.32:0/422943958 wait complete. 2024-09-13T18:45:52.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.912+0000 7f61c3000700 1 Processor -- start 2024-09-13T18:45:52.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.912+0000 7f61c3000700 1 -- start start 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 0x7f61bc1ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61bc151680 0x7f61bc0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc15a1a0 0x7f61bc14e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc1e93c0 con 0x7f61bc0cd640 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc14f750 con 0x7f61bc151680 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc14f1b0 con 0x7f61bc15a1a0 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c1c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 0x7f61bc1ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c1200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61bc151680 0x7f61bc0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c1c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 0x7f61bc1ef5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40518/0 (socket says 172.21.15.32:40518) 2024-09-13T18:45:52.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c1c00700 1 -- 172.21.15.32:0/1931505376 learned_addr learned my addr 172.21.15.32:0/1931505376 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:52.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc15a1a0 0x7f61bc14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 -- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61bc151680 msgr2=0x7f61bc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61bc151680 0x7f61bc0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 -- 172.21.15.32:0/1931505376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 msgr2=0x7f61bc1ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 0x7f61bc1ef5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 -- 172.21.15.32:0/1931505376 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00094b0 con 0x7f61bc15a1a0 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c1c00700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 0x7f61bc1ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c2600700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc15a1a0 0x7f61bc14e570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b2cb0 tx=0x7f61b400ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4003c20 con 0x7f61bc15a1a0 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4003d80 con 0x7f61bc15a1a0 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc14f470 con 0x7f61bc15a1a0 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400a9c0 con 0x7f61bc15a1a0 2024-09-13T18:45:52.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc1ef0a0 con 0x7f61bc15a1a0 2024-09-13T18:45:52.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.916+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc1eec20 con 0x7f61bc15a1a0 2024-09-13T18:45:52.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.920+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61b400ab20 con 0x7f61bc15a1a0 2024-09-13T18:45:52.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.920+0000 7f61b9600700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f619c066760 0x7f619c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.920+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f61b4084490 con 0x7f61bc15a1a0 2024-09-13T18:45:52.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.920+0000 7f61c1c00700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f619c066760 0x7f619c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.924+0000 7f61c1c00700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f619c066760 0x7f619c068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61b0000c00 tx=0x7f61b0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.928+0000 7fb4b1e00700 1 Processor -- start 2024-09-13T18:45:52.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b1e00700 1 -- start start 2024-09-13T18:45:52.935 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:52.932+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:52.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61bc1eec20 con 0x7f61bc15a1a0 2024-09-13T18:45:52.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b1e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0c7820 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b1e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0c6fc0 con 0x7fb4ac157fd0 2024-09-13T18:45:52.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b1e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac157bb0 con 0x7fb4ac0c61b0 2024-09-13T18:45:52.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b0a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb4ac0c5dd0 0x7fb4ac06e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47276/0 (socket says 172.21.15.32:47276) 2024-09-13T18:45:52.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4b0a00700 1 -- 172.21.15.32:0/540851899 learned_addr learned my addr 172.21.15.32:0/540851899 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:52.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4abe00700 1 --2- 172.21.15.32:0/540851899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806287324 0 0) 0x7fb4ac0c7820 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4940035d0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270119720 0 0) 0x7fb4ac0c6fc0 con 0x7fb4ac157fd0 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ac0c7820 con 0x7fb4ac157fd0 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4abe00700 1 -- 172.21.15.32:0/540851899 >> v1:172.21.15.86:6789/0 conn(0x7fb4ac157fd0 legacy=0x7fb4ac06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4abe00700 1 -- 172.21.15.32:0/540851899 >> v1:172.21.15.32:6789/0 conn(0x7fb4ac0c5dd0 legacy=0x7fb4ac06e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168574307 0 0) 0x7fb4940035d0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.932+0000 7fb4abe00700 1 -- 172.21.15.32:0/540851899 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0c7260 con 0x7fb4ac0c61b0 2024-09-13T18:45:52.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4abe00700 1 --2- 172.21.15.32:0/540851899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c6960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb498009880 tx=0x7fb498009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e53ac3815511298 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0001920 con 0x7fb4ac0c61b0 2024-09-13T18:45:52.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498004030 con 0x7fb4ac0c61b0 2024-09-13T18:45:52.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4ab400700 1 -- 172.21.15.32:0/540851899 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4980043c0 con 0x7fb4ac0c61b0 2024-09-13T18:45:52.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 -- 172.21.15.32:0/540851899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac0c61b0 msgr2=0x7fb4ac0c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/540851899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c6960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb498009880 tx=0x7fb498009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:52.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 -- 172.21.15.32:0/540851899 shutdown_connections 2024-09-13T18:45:52.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/540851899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c6960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 -- 172.21.15.32:0/540851899 >> 172.21.15.32:0/540851899 conn(0x7fb4ac0c8a60 msgr2=0x7fb4ac0c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 -- 172.21.15.32:0/540851899 shutdown_connections 2024-09-13T18:45:52.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.936+0000 7fb4b1e00700 1 -- 172.21.15.32:0/540851899 wait complete. 2024-09-13T18:45:52.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 Processor -- start 2024-09-13T18:45:52.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 -- start start 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 0x7fb4ac14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac157fd0 0x7fb4ac1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1ed240 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1ed770 con 0x7fb4ac0c61b0 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1ed490 con 0x7fb4ac157fd0 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 0x7fb4ac14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 0x7fb4ac14af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40530/0 (socket says 172.21.15.32:40530) 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 -- 172.21.15.32:0/1820287344 learned_addr learned my addr 172.21.15.32:0/1820287344 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:52.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1400700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac157fd0 0x7fb4ac1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4abe00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 -- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac157fd0 msgr2=0x7fb4ac1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac157fd0 0x7fb4ac1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 -- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4ac0c61b0 msgr2=0x7fb4ac0c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 -- 172.21.15.32:0/1820287344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980094b0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b0a00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 0x7fb4ac14af10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0002230 tx=0x7fb4a000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a000aaa0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a000ac20 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac1efe60 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00070d0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.940+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac1f0420 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.944+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac0b1e90 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.944+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4a0007230 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.944+0000 7fb4a8c00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb48c066730 0x7fb48c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.944+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb4a0083fe0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:52.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.948+0000 7fb4abe00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb48c066730 0x7fb48c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.948+0000 7fb4abe00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb48c066730 0x7fb48c068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb498009880 tx=0x7fb498010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:52.952+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb4a0050fe0 con 0x7fb4ac0c5dd0 2024-09-13T18:45:53.023 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:53.024 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:53.036 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:53.032+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:53.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:45:53.137 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:53.132+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:53.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.140+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7f61bc1eec20 con 0x7f61bc15a1a0 2024-09-13T18:45:53.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.152+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 6, "weight": 1.0} v 0) v1 -- 0x7fb4ac06e710 con 0x7fb4ac0c5dd0 2024-09-13T18:45:53.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:53.176 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:53.237 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:53.232+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:53.238 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:53.238 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:53.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:45:53.338 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:53.336+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:53.409 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:53.409 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:53.424 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:45:53.438 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:53.432+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:53.538 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:53.539 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:53.539 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:53.536+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:53.548 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:45:53.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:45:53.640 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:53.636+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:53.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.700+0000 7fb4a8c00700 1 -- 172.21.15.32:0/1820287344 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]=0 set osd.6 primary-affinity to 1 (8655362) v32) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb4a0018020 con 0x7fb4ac0c5dd0 2024-09-13T18:45:53.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.704+0000 7f61b9600700 1 -- 172.21.15.32:0/1931505376 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v32) v1 ==== 91+0+0 (secure 0 0 0) 0x7f61bc1eec20 con 0x7f61bc15a1a0 2024-09-13T18:45:53.710 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:53.710 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:53.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.704+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb48c066730 msgr2=0x7fb48c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.704+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb48c066730 0x7fb48c068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb498009880 tx=0x7fb498010000 comp rx=0 tx=0).stop 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.704+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 msgr2=0x7fb4ac14af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.704+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 0x7fb4ac14af10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0002230 tx=0x7fb4a000cee0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.708+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 shutdown_connections 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.708+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb48c066730 0x7fb48c068bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.708+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4ac157fd0 0x7fb4ac1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.708+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4ac0c61b0 0x7fb4ac0c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.708+0000 7fb4b1e00700 1 --2- 172.21.15.32:0/1820287344 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4ac0c5dd0 0x7fb4ac14af10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.708+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 >> 172.21.15.32:0/1820287344 conn(0x7fb4ac0c8a60 msgr2=0x7fb4ac0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 shutdown_connections 2024-09-13T18:45:53.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7fb4b1e00700 1 -- 172.21.15.32:0/1820287344 wait complete. 2024-09-13T18:45:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f619c066760 msgr2=0x7f619c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f619c066760 0x7f619c068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61b0000c00 tx=0x7f61b0008030 comp rx=0 tx=0).stop 2024-09-13T18:45:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc15a1a0 msgr2=0x7f61bc14e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc15a1a0 0x7f61bc14e570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0b2cb0 tx=0x7f61b400ce70 comp rx=0 tx=0).stop 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 shutdown_connections 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f619c066760 0x7f619c068c20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61bc15a1a0 0x7f61bc14e570 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61bc151680 0x7f61bc0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 --2- 172.21.15.32:0/1931505376 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f61bc0cd640 0x7f61bc1ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 >> 172.21.15.32:0/1931505376 conn(0x7f61bc071740 msgr2=0x7f61bc155830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 shutdown_connections 2024-09-13T18:45:53.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.712+0000 7f61c3000700 1 -- 172.21.15.32:0/1931505376 wait complete. 2024-09-13T18:45:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-13T18:45:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:45:53.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:45:53.741 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:53.736+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:53.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.776+0000 7fd423200700 1 Processor -- start 2024-09-13T18:45:53.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.780+0000 7fd423200700 1 -- start start 2024-09-13T18:45:53.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.780+0000 7fd423200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd4241514a0 0x7fd424066c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.780+0000 7fd423200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd4240cb620 0x7fd4240cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.780+0000 7fd423200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4240c61e0 con 0x7fd4240c6440 2024-09-13T18:45:53.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.780+0000 7fd423200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42415b2d0 con 0x7fd4241514a0 2024-09-13T18:45:53.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.780+0000 7fd423200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240cbf70 con 0x7fd4240cb620 2024-09-13T18:45:53.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd4241514a0 0x7fd424066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd422800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd4240cb620 0x7fd4240cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd4240c6440 0x7fd4240c80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47282/0 (socket says 172.21.15.32:47282) 2024-09-13T18:45:53.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421400700 1 -- 172.21.15.32:0/2441969518 learned_addr learned my addr 172.21.15.32:0/2441969518 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:53.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd420a00700 1 -- 172.21.15.32:0/2441969518 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659855893 0 0) 0x7fd4240c61e0 con 0x7fd4240c6440 2024-09-13T18:45:53.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421e00700 1 -- 172.21.15.32:0/2441969518 >> v2:172.21.15.86:3300/0 conn(0x7fd4240cb620 msgr2=0x7fd4240cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:53.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421e00700 1 --2- 172.21.15.32:0/2441969518 >> v2:172.21.15.86:3300/0 conn(0x7fd4240cb620 0x7fd4240cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421e00700 1 -- 172.21.15.32:0/2441969518 >> v1:172.21.15.32:6789/0 conn(0x7fd4240c6440 legacy=0x7fd4240c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421e00700 1 -- 172.21.15.32:0/2441969518 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42415b6f0 con 0x7fd4241514a0 2024-09-13T18:45:53.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd421e00700 1 --2- 172.21.15.32:0/2441969518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4241514a0 0x7fd424066c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd42406b6e0 tx=0x7fd414009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b602b14ffd986fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd420a00700 1 -- 172.21.15.32:0/2441969518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414011830 con 0x7fd4241514a0 2024-09-13T18:45:53.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd420a00700 1 -- 172.21.15.32:0/2441969518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd414011990 con 0x7fd4241514a0 2024-09-13T18:45:53.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd420a00700 1 -- 172.21.15.32:0/2441969518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414011d20 con 0x7fd4241514a0 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 -- 172.21.15.32:0/2441969518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4241514a0 msgr2=0x7fd424066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 --2- 172.21.15.32:0/2441969518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4241514a0 0x7fd424066c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd42406b6e0 tx=0x7fd414009b30 comp rx=0 tx=0).stop 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 -- 172.21.15.32:0/2441969518 shutdown_connections 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 --2- 172.21.15.32:0/2441969518 >> v2:172.21.15.86:3300/0 conn(0x7fd4240cb620 0x7fd4240cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 --2- 172.21.15.32:0/2441969518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4241514a0 0x7fd424066c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 -- 172.21.15.32:0/2441969518 >> 172.21.15.32:0/2441969518 conn(0x7fd424073720 msgr2=0x7fd424073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 -- 172.21.15.32:0/2441969518 shutdown_connections 2024-09-13T18:45:53.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.784+0000 7fd423200700 1 -- 172.21.15.32:0/2441969518 wait complete. 2024-09-13T18:45:53.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 Processor -- start 2024-09-13T18:45:53.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 -- start start 2024-09-13T18:45:53.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 0x7fd42406e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240cb620 0x7fd4241e3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4241514a0 0x7fd42414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4241e3cf0 con 0x7fd4240c6440 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4241f3450 con 0x7fd4241514a0 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.788+0000 7fd423200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4241e26d0 con 0x7fd4240cb620 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 0x7fd42406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 0x7fd42406e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40548/0 (socket says 172.21.15.32:40548) 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 -- 172.21.15.32:0/2468753087 learned_addr learned my addr 172.21.15.32:0/2468753087 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4241514a0 0x7fd42414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240cb620 0x7fd4241e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240cb620 msgr2=0x7fd4241e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4240cb620 0x7fd4241e3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4241514a0 msgr2=0x7fd42414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4241514a0 0x7fd42414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140094b0 con 0x7fd4240c6440 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4241514a0 0x7fd42414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 0x7fd42406e040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd414014040 tx=0x7fd414004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140038c0 con 0x7fd4240c6440 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41401e070 con 0x7fd4240c6440 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4240bef00 con 0x7fd4240c6440 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414003c80 con 0x7fd4240c6440 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4241e41e0 con 0x7fd4240c6440 2024-09-13T18:45:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.792+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fd4241504e0 con 0x7fd4240c6440 2024-09-13T18:45:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd41402d450 con 0x7fd4240c6440 2024-09-13T18:45:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd41a000700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd404066730 0x7fd404068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fd414085470 con 0x7fd4240c6440 2024-09-13T18:45:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v32) v1 ==== 54+0+16 (secure 0 0 0) 0x7fd41408c070 con 0x7fd4240c6440 2024-09-13T18:45:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd404066730 0x7fd404068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd4241e2880 0x7fd42414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd42415a930 con 0x7fd4241e2880 2024-09-13T18:45:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd4241e2880 0x7fd42414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd404066730 0x7fd404068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd42406ef00 tx=0x7fd410007cb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.796+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd4241e2880 0x7fd42414e330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.800+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd41c00f040 con 0x7fd4241e2880 2024-09-13T18:45:53.821 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:53.821 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:53.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.820+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd42415aef0 con 0x7fd4241e2880 2024-09-13T18:45:53.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.824+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd41c007490 con 0x7fd4241e2880 2024-09-13T18:45:53.829 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:45:53.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.824+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd4241ef3f0 0x7fd4241ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.824+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4240c5ad0 con 0x7fd4241ef3f0 2024-09-13T18:45:53.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:45:53.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.828+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd4241ef3f0 0x7fd4241ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.828+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd4241ef3f0 0x7fd4241ef7d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.828+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd4240c5ad0 con 0x7fd4241ef3f0 2024-09-13T18:45:53.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.852+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd424066a90 con 0x7fd4241ef3f0 2024-09-13T18:45:53.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.860+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd424066a90 con 0x7fd4241ef3f0 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.860+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd4240612c0 0x7fd4240616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.860+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd42406e6f0 con 0x7fd4240612c0 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.860+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd4240612c0 0x7fd4240616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.860+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd4240612c0 0x7fd4240616e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.864+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd42406e6f0 con 0x7fd4240612c0 2024-09-13T18:45:53.879 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:53.876+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:53.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.884+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd42406e990 con 0x7fd4240612c0 2024-09-13T18:45:53.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.888+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd42406e990 con 0x7fd4240612c0 2024-09-13T18:45:53.891 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:45:53.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.888+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd42402bbb0 0x7fd42402bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.888+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4240cace0 con 0x7fd42402bbb0 2024-09-13T18:45:53.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.888+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd42402bbb0 0x7fd42402bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.888+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd42402bbb0 0x7fd42402bff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.888+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd4240cace0 con 0x7fd42402bbb0 2024-09-13T18:45:53.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.908+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd42406eb30 con 0x7fd42402bbb0 2024-09-13T18:45:53.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.912+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd42406eb30 con 0x7fd42402bbb0 2024-09-13T18:45:53.915 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:45:53.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.912+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd42402ca40 0x7fd4240c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.912+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4241e3b10 con 0x7fd42402ca40 2024-09-13T18:45:53.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.912+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd42402ca40 0x7fd4240c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.912+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd42402ca40 0x7fd4240c9520 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.912+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd4241e3b10 con 0x7fd42402ca40 2024-09-13T18:45:53.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.936+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd4241e3b10 con 0x7fd42402ca40 2024-09-13T18:45:53.942 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:53.940+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:53.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.940+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd4241e3b10 con 0x7fd42402ca40 2024-09-13T18:45:53.945 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:45:53.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.940+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd4240c9f70 0x7fd4240ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.940+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4240ca910 con 0x7fd4240c9f70 2024-09-13T18:45:53.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.940+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd4240c9f70 0x7fd4240ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.944+0000 7fd421400700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd4240c9f70 0x7fd4240ca3d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.944+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd4240ca910 con 0x7fd4240c9f70 2024-09-13T18:45:53.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.964+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd4240cab10 con 0x7fd4240c9f70 2024-09-13T18:45:53.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.968+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd4240cab10 con 0x7fd4240c9f70 2024-09-13T18:45:53.972 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:45:53.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.968+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd424205d70 0x7fd424208160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.968+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd42420afe0 con 0x7fd424205d70 2024-09-13T18:45:53.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.968+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd424205d70 0x7fd424208160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.968+0000 7fd422800700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd424205d70 0x7fd424208160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.972+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd42420afe0 con 0x7fd424205d70 2024-09-13T18:45:53.989 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:53.989 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:53.990 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:53.990 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:53.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.988+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd4242086a0 con 0x7fd424205d70 2024-09-13T18:45:53.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.992+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd4242086a0 con 0x7fd424205d70 2024-09-13T18:45:53.996 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:45:53.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.992+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd424208d20 0x7fd424209160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.992+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd42420e360 con 0x7fd424208d20 2024-09-13T18:45:53.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.992+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd424208d20 0x7fd424209160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.992+0000 7fd421e00700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd424208d20 0x7fd424209160 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:53.996+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd42420e360 con 0x7fd424208d20 2024-09-13T18:45:54.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:45:54.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.012+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fd4242097b0 con 0x7fd424208d20 2024-09-13T18:45:54.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.016+0000 7fd41a000700 1 -- 172.21.15.32:0/2468753087 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd4242097b0 con 0x7fd424208d20 2024-09-13T18:45:54.022 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:45:54.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.016+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd4241e2880 msgr2=0x7fd42414e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.016+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd4241e2880 0x7fd42414e330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd4241ef3f0 msgr2=0x7fd4241ef7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd4241ef3f0 0x7fd4241ef7d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd4240612c0 msgr2=0x7fd4240616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd4240612c0 0x7fd4240616e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd42402bbb0 msgr2=0x7fd42402bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd42402bbb0 0x7fd42402bff0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd42402ca40 msgr2=0x7fd4240c9520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd42402ca40 0x7fd4240c9520 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd4240c9f70 msgr2=0x7fd4240ca3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd4240c9f70 0x7fd4240ca3d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd424205d70 msgr2=0x7fd424208160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd424205d70 0x7fd424208160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd424208d20 msgr2=0x7fd424209160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd424208d20 0x7fd424209160 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd422800700 1 -- 172.21.15.32:0/2468753087 reap_dead start 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd422800700 1 -- 172.21.15.32:0/2468753087 reap_dead start 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd422800700 1 -- 172.21.15.32:0/2468753087 reap_dead start 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd422800700 1 -- 172.21.15.32:0/2468753087 reap_dead start 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd422800700 1 -- 172.21.15.32:0/2468753087 reap_dead start 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd404066730 msgr2=0x7fd404068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd404066730 0x7fd404068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd42406ef00 tx=0x7fd410007cb0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 msgr2=0x7fd42406e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 0x7fd42406e040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd414014040 tx=0x7fd414004770 comp rx=0 tx=0).stop 2024-09-13T18:45:54.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 shutdown_connections 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd404066730 0x7fd404068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 --2- 172.21.15.32:0/2468753087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd4240c6440 0x7fd42406e040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 >> 172.21.15.32:0/2468753087 conn(0x7fd424073720 msgr2=0x7fd4240c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 shutdown_connections 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:54.020+0000 7fd423200700 1 -- 172.21.15.32:0/2468753087 wait complete. 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:45:54.026 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:45:54.027 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:45:54.027 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:45:54.027 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:45:54.027 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:45:54.027 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:45:54.042 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:54.036+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:54.109 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:54.109 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:54.110 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:54.110 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:54.110 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:54.119 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:45:54.143 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:54.140+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:54.244 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:54.240+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:54.280 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.941331650000002, 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:45:54.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:45:54.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.930094656000001, 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:45:54.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.867323149999997, 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.837085010999999, 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:45:54.295 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.299 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.836476642999997, 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:45:54.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:45:54.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:45:54.304 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.468157816000002, 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:45:54.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:45:54.308 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.467376231000003, 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:45:54.313 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.466609042000002, 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:45:54.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:45:54.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.465773783000003, 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:45:54.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:45:54.322 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.464783171000001, 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:45:54.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.326 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.464169677000001, 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:45:54.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:45:54.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:45:54.331 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.561883571000003, 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:45:54.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.335 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.560609866999997, 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:45:54.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:45:54.340 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.552806240000002, 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:45:54.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:45:54.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 60.552033352000002, 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:45:54.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:54.349 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.953799359999998, 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:45:54.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:45:54.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:45:54.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.953774103000001, 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:45:54.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.953741960000002, 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.950981108000001, 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:45:54.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.948020337000003, 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.372 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:54.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:45:54.374 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:54.368+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:54.475 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:54.472+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:54.526 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:54.526 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:54.526 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:54.536 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:45:54.576 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:54.572+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:54.642 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:54.642 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:54.642 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:54.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:45:54.676 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:54.672+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:54.755 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:54.755 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:54.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:54.755 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.427271748999999, 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:45:54.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:54.759 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:54.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:45:54.807 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:54.804+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:54.878 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:54.872+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:54.916 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:54.916 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:54.916 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:54.916 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:54.926 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:45:54.979 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:54.976+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:55.031 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:55.031 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:55.031 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:55.031 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:55.031 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:55.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:45:55.080 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:55.076+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:55.147 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:55.147 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:55.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:55.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:55.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.821806914, 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:45:55.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.155 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.821783046999997, 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:45:55.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.821772537000001, 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:45:55.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:45:55.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.821756536999999, 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.168 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:45:55.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:45:55.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.174 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.821749699999998, 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.175 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:45:55.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:45:55.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.818191573999997, 2024-09-13T18:45:55.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:45:55.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.816380748, 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:45:55.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.816327055999999, 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:45:55.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.815283108999999, 2024-09-13T18:45:55.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:45:55.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.813727421000003, 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:45:55.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:45:55.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.205 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.813673674, 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:55.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:45:55.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.210 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.812434494000001, 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:55.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:45:55.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.812389259, 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.812354225, 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:45:55.220 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:45:55.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.812313994999997, 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:45:55.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.811621572999996, 2024-09-13T18:45:55.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:45:55.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:45:55.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.811570885000002, 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:45:55.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:45:55.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.811177245000003, 2024-09-13T18:45:55.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:45:55.242 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.242 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.242 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:55.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:45:55.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:45:55.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 48.810780680999997, 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.247 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:55.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:45:55.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:55.251 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:55.252 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:55.253 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:55.252+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:55.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:45:55.354 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:55.352+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:55.431 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:45:55.432 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:55.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:45:55.490 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:55.488+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:55.556 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:55.552+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:55.658 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:55.656+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:55.664 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:55.664 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:55.664 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:45:55.665 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:45:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:55.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:45:55.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:45:55.758 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:55.756+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:55.849 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.525105717999999, 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:55.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:45:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:55.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.525081731999997, 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:45:55.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:45:55.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:45:55.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:45:55.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:45:55.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.525072825999999, 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:45:55.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.525069954000003, 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:55.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:55.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.525067245999999, 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:45:55.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:45:55.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:45:55.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.521940178999998, 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:45:55.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.520889492000002, 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:55.882 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:45:55.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.520534904999998, 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:45:55.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:45:55.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.520389747000003, 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:45:55.890 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:45:55.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:45:55.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.520292333, 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:45:55.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.52021122, 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:45:55.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:45:55.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:45:55.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.519960718, 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.518866443, 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:45:55.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.910 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.518785493999999, 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.516682840999998, 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:45:55.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:45:55.918 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.018691152999999, 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:55.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:55.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:55.923 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:55.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.908+0000 7fdb23e00700 1 Processor -- start 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.908+0000 7fdb23e00700 1 -- start start 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.908+0000 7fdb23e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 0x7fdb2406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.908+0000 7fdb23e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb2415a240 0x7fdb24163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb241599b0 con 0x7fdb24159e40 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240c9090 con 0x7fdb2415a240 2024-09-13T18:45:55.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2415dc20 con 0x7fdb240724c0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 0x7fdb2406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fdb2415a240 0x7fdb24163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 0x7fdb2406fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:33392/0 (socket says 172.21.15.32:33392) 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 -- 172.21.15.32:0/2998755020 learned_addr learned my addr 172.21.15.32:0/2998755020 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 -- 172.21.15.32:0/2998755020 >> v2:172.21.15.86:3300/0 conn(0x7fdb2415a240 msgr2=0x7fdb24163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 --2- 172.21.15.32:0/2998755020 >> v2:172.21.15.86:3300/0 conn(0x7fdb2415a240 0x7fdb24163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 -- 172.21.15.32:0/2998755020 >> v1:172.21.15.32:6789/0 conn(0x7fdb24159e40 legacy=0x7fdb240c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 -- 172.21.15.32:0/2998755020 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240728a0 con 0x7fdb240724c0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb22a00700 1 --2- 172.21.15.32:0/2998755020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 0x7fdb2406fc10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009910 tx=0x7fdb14009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d71e213119b5184f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb21600700 1 -- 172.21.15.32:0/2998755020 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14011830 con 0x7fdb240724c0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb21600700 1 -- 172.21.15.32:0/2998755020 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14011990 con 0x7fdb240724c0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb21600700 1 -- 172.21.15.32:0/2998755020 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14011d40 con 0x7fdb240724c0 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- 172.21.15.32:0/2998755020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 msgr2=0x7fdb2406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 --2- 172.21.15.32:0/2998755020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 0x7fdb2406fc10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009910 tx=0x7fdb14009c20 comp rx=0 tx=0).stop 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- 172.21.15.32:0/2998755020 shutdown_connections 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 --2- 172.21.15.32:0/2998755020 >> v2:172.21.15.86:3300/0 conn(0x7fdb2415a240 0x7fdb24163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 --2- 172.21.15.32:0/2998755020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb240724c0 0x7fdb2406fc10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- 172.21.15.32:0/2998755020 >> 172.21.15.32:0/2998755020 conn(0x7fdb240cac60 msgr2=0x7fdb240cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- 172.21.15.32:0/2998755020 shutdown_connections 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.912+0000 7fdb23e00700 1 -- 172.21.15.32:0/2998755020 wait complete. 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 Processor -- start 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 -- start start 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 0x7fdb2406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb24159e40 0x7fdb241e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb2415a240 0x7fdb240bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb241ef650 con 0x7fdb240724c0 2024-09-13T18:45:55.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2406d1a0 con 0x7fdb24159e40 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.916+0000 7fdb23e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb241f0620 con 0x7fdb2415a240 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 0x7fdb2406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb23400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb2415a240 0x7fdb240bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 0x7fdb2406cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40556/0 (socket says 172.21.15.32:40556) 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 -- 172.21.15.32:0/1727129498 learned_addr learned my addr 172.21.15.32:0/1727129498 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22000700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb24159e40 0x7fdb241e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 -- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb2415a240 msgr2=0x7fdb240bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb2415a240 0x7fdb240bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 -- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb24159e40 msgr2=0x7fdb241e3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb24159e40 0x7fdb241e3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 -- 172.21.15.32:0/1727129498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009570 con 0x7fdb240724c0 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb23400700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb2415a240 0x7fdb240bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb22a00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 0x7fdb2406cc60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009f70 tx=0x7fdb14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400b970 con 0x7fdb240724c0 2024-09-13T18:45:55.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2415aeb0 con 0x7fdb240724c0 2024-09-13T18:45:55.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1401f070 con 0x7fdb240724c0 2024-09-13T18:45:55.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400bcf0 con 0x7fdb240724c0 2024-09-13T18:45:55.932 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:55.920+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.920+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb241efb40 con 0x7fdb240724c0 2024-09-13T18:45:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.924+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2415d660 con 0x7fdb240724c0 2024-09-13T18:45:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.924+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb14026480 con 0x7fdb240724c0 2024-09-13T18:45:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.924+0000 7fdb1b400700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb04066730 0x7fdb04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.924+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fdb14021070 con 0x7fdb240724c0 2024-09-13T18:45:55.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.928+0000 7fdb22000700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb04066730 0x7fdb04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.928+0000 7fdb22000700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb04066730 0x7fdb04068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb24156480 tx=0x7fdb10009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:55.932+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdb14052be0 con 0x7fdb240724c0 2024-09-13T18:45:56.026 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:56.024+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:56.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:45:56.110 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:56.110 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:56.110 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:45:56.110 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:56.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:45:56.127 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:56.124+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:56.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.128+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7fdb2415aeb0 con 0x7fdb240724c0 2024-09-13T18:45:56.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.212+0000 7f06cda00700 1 Processor -- start 2024-09-13T18:45:56.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.212+0000 7f06cda00700 1 -- start start 2024-09-13T18:45:56.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06cda00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f06c80aa430 0x7f06c8154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06cda00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80adbb0 con 0x7f06c80714c0 2024-09-13T18:45:56.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06cda00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80ca400 con 0x7f06c80718a0 2024-09-13T18:45:56.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06cda00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80ad8d0 con 0x7f06c80aa430 2024-09-13T18:45:56.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c7400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f06c80aa430 0x7f06c8154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06bfe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f06c80718a0 0x7f06c81546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:35392/0 (socket says 172.21.15.32:35392) 2024-09-13T18:45:56.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06bfe00700 1 -- 172.21.15.32:0/3331817617 learned_addr learned my addr 172.21.15.32:0/3331817617 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:56.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c6000700 1 -- 172.21.15.32:0/3331817617 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087771571 0 0) 0x7f06c80ca400 con 0x7f06c80718a0 2024-09-13T18:45:56.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c6000700 1 -- 172.21.15.32:0/3331817617 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ac0035d0 con 0x7f06c80718a0 2024-09-13T18:45:56.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c7400700 1 -- 172.21.15.32:0/3331817617 >> v1:172.21.15.86:6789/0 conn(0x7f06c80718a0 legacy=0x7f06c81546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c7400700 1 -- 172.21.15.32:0/3331817617 >> v1:172.21.15.32:6789/0 conn(0x7f06c80714c0 legacy=0x7f06c8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c7400700 1 -- 172.21.15.32:0/3331817617 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80ca6a0 con 0x7f06c80aa430 2024-09-13T18:45:56.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c7400700 1 --2- 172.21.15.32:0/3331817617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80aa430 0x7f06c8154dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009d90 tx=0x7f06c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4628f9bd3fd3e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c6000700 1 -- 172.21.15.32:0/3331817617 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000e070 con 0x7f06c80aa430 2024-09-13T18:45:56.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c6000700 1 -- 172.21.15.32:0/3331817617 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000bb20 con 0x7f06c80aa430 2024-09-13T18:45:56.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.216+0000 7f06c6000700 1 -- 172.21.15.32:0/3331817617 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000be90 con 0x7f06c80aa430 2024-09-13T18:45:56.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 -- 172.21.15.32:0/3331817617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80aa430 msgr2=0x7f06c8154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 --2- 172.21.15.32:0/3331817617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80aa430 0x7f06c8154dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009d90 tx=0x7f06c000b330 comp rx=0 tx=0).stop 2024-09-13T18:45:56.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 -- 172.21.15.32:0/3331817617 shutdown_connections 2024-09-13T18:45:56.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 --2- 172.21.15.32:0/3331817617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80aa430 0x7f06c8154dc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 -- 172.21.15.32:0/3331817617 >> 172.21.15.32:0/3331817617 conn(0x7f06c80accb0 msgr2=0x7f06c80ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:56.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 -- 172.21.15.32:0/3331817617 shutdown_connections 2024-09-13T18:45:56.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.220+0000 7f06cda00700 1 -- 172.21.15.32:0/3331817617 wait complete. 2024-09-13T18:45:56.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 Processor -- start 2024-09-13T18:45:56.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 -- start start 2024-09-13T18:45:56.227 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:56.224+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:56.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80714c0 0x7f06c81f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06c80718a0 0x7f06c80c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 0x7f06c80c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c815bbe0 con 0x7f06c80aa430 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81f1640 con 0x7f06c80714c0 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06cda00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80c3500 con 0x7f06c80718a0 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06bfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06c80718a0 0x7f06c80c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 0x7f06c80c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c6a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80714c0 0x7f06c81f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c6a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80714c0 0x7f06c81f1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:58000/0 (socket says 172.21.15.32:58000) 2024-09-13T18:45:56.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06bfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06c80718a0 0x7f06c80c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:33398/0 (socket says 172.21.15.32:33398) 2024-09-13T18:45:56.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c6a00700 1 -- 172.21.15.32:0/3552567141 learned_addr learned my addr 172.21.15.32:0/3552567141 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:56.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 0x7f06c80c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40560/0 (socket says 172.21.15.32:40560) 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c7400700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06c80718a0 msgr2=0x7f06c80c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06c80718a0 0x7f06c80c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c7400700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80714c0 msgr2=0x7f06c81f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.224+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06c80714c0 0x7f06c81f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06c7400700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009a70 con 0x7f06c80aa430 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 0x7f06c80c3f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06c0016000 tx=0x7f06c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0004980 con 0x7f06c80aa430 2024-09-13T18:45:56.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0012430 con 0x7f06c80aa430 2024-09-13T18:45:56.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00127c0 con 0x7f06c80aa430 2024-09-13T18:45:56.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c80c4cc0 con 0x7f06c80aa430 2024-09-13T18:45:56.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80c3770 con 0x7f06c80aa430 2024-09-13T18:45:56.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.228+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f06c80a9e70 con 0x7f06c80aa430 2024-09-13T18:45:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06c0012920 con 0x7f06c80aa430 2024-09-13T18:45:56.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06bea00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f06a4066730 0x7f06a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f06c00866f0 con 0x7f06c80aa430 2024-09-13T18:45:56.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f06a4066730 0x7f06a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v32) v1 ==== 54+0+16 (secure 0 0 0) 0x7f06c0086a60 con 0x7f06c80aa430 2024-09-13T18:45:56.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f06c80ae1b0 0x7f06c8153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c8072060 con 0x7f06c80ae1b0 2024-09-13T18:45:56.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06bfe00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f06c80ae1b0 0x7f06c8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.232+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f06a4066730 0x7f06a4068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f06b8001830 tx=0x7f06b8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.236+0000 7f06bfe00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f06c80ae1b0 0x7f06c8153810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.236+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06b0006bf0 con 0x7f06c80ae1b0 2024-09-13T18:45:56.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.256+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c80a9940 con 0x7f06c80ae1b0 2024-09-13T18:45:56.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.260+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c80a9940 con 0x7f06c80ae1b0 2024-09-13T18:45:56.263 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:45:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.260+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f06c80c3900 0x7f06c8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.260+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c806d280 con 0x7f06c80c3900 2024-09-13T18:45:56.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.260+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f06c80c3900 0x7f06c8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.260+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f06c80c3900 0x7f06c8151a90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.264+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c806d280 con 0x7f06c80c3900 2024-09-13T18:45:56.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.284+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c8153d50 con 0x7f06c80c3900 2024-09-13T18:45:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.288+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c8153d50 con 0x7f06c80c3900 2024-09-13T18:45:56.291 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:45:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.288+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f06c81ed690 0x7f06c81eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.288+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c81edfb0 con 0x7f06c81ed690 2024-09-13T18:45:56.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.288+0000 7f06bfe00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f06c81ed690 0x7f06c81eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.288+0000 7f06bfe00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f06c81ed690 0x7f06c81eda70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.288+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c81edfb0 con 0x7f06c81ed690 2024-09-13T18:45:56.299 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:56.299 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:56.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:45:56.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.312+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c8157e40 con 0x7f06c81ed690 2024-09-13T18:45:56.319 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:45:56.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.312+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c8157e40 con 0x7f06c81ed690 2024-09-13T18:45:56.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.316+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f06c8061670 0x7f06c80c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.316+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c8061ab0 con 0x7f06c8061670 2024-09-13T18:45:56.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.316+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f06c8061670 0x7f06c80c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.316+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f06c8061670 0x7f06c80c22c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.316+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c8061ab0 con 0x7f06c8061670 2024-09-13T18:45:56.327 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:56.324+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:56.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.332+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c8157fb0 con 0x7f06c8061670 2024-09-13T18:45:56.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.332+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c8157fb0 con 0x7f06c8061670 2024-09-13T18:45:56.338 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:45:56.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.336+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f06c80c2d10 0x7f06c802b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.336+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c8061ab0 con 0x7f06c80c2d10 2024-09-13T18:45:56.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.336+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f06c80c2d10 0x7f06c802b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.336+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f06c80c2d10 0x7f06c802b6a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.336+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c8061ab0 con 0x7f06c80c2d10 2024-09-13T18:45:56.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.356+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c8061ab0 con 0x7f06c80c2d10 2024-09-13T18:45:56.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.360+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c8061ab0 con 0x7f06c80c2d10 2024-09-13T18:45:56.364 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:45:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.360+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f06c80c3110 0x7f06c802c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.360+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c802c630 con 0x7f06c80c3110 2024-09-13T18:45:56.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.360+0000 7f06bfe00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f06c80c3110 0x7f06c802c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.364+0000 7f06bfe00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f06c80c3110 0x7f06c802c0f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.364+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c802c630 con 0x7f06c80c3110 2024-09-13T18:45:56.389 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.384+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c802c630 con 0x7f06c80c3110 2024-09-13T18:45:56.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.388+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c802c630 con 0x7f06c80c3110 2024-09-13T18:45:56.393 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:45:56.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.388+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f06c8203ac0 0x7f06c8205eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.388+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c802ccb0 con 0x7f06c8203ac0 2024-09-13T18:45:56.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.392+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f06c8203ac0 0x7f06c8205eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.392+0000 7f06c7400700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f06c8203ac0 0x7f06c8205eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.392+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c802ccb0 con 0x7f06c8203ac0 2024-09-13T18:45:56.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.412+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c802ccb0 con 0x7f06c8203ac0 2024-09-13T18:45:56.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.416+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c802ccb0 con 0x7f06c8203ac0 2024-09-13T18:45:56.421 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:45:56.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.416+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f06c8206900 0x7f06c8208cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:56.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.416+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c820bc10 con 0x7f06c8206900 2024-09-13T18:45:56.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.416+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f06c8206900 0x7f06c8208cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:56.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.420+0000 7f06c6a00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f06c8206900 0x7f06c8208cf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:56.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.420+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f06c820bc10 con 0x7f06c8206900 2024-09-13T18:45:56.428 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:56.424+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:56.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.440+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f06c82092d0 con 0x7f06c8206900 2024-09-13T18:45:56.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.444+0000 7f06bea00700 1 -- 172.21.15.32:0/3552567141 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f06c82092d0 con 0x7f06c8206900 2024-09-13T18:45:56.450 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:45:56.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f06c80ae1b0 msgr2=0x7f06c8153810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f06c80ae1b0 0x7f06c8153810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f06c80c3900 msgr2=0x7f06c8151a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f06c80c3900 0x7f06c8151a90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f06c81ed690 msgr2=0x7f06c81eda70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f06c81ed690 0x7f06c81eda70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f06c8061670 msgr2=0x7f06c80c22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f06c8061670 0x7f06c80c22c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f06c80c2d10 msgr2=0x7f06c802b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f06c80c2d10 0x7f06c802b6a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06c7400700 1 -- 172.21.15.32:0/3552567141 reap_dead start 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f06c80c3110 msgr2=0x7f06c802c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f06c80c3110 0x7f06c802c0f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06c7400700 1 -- 172.21.15.32:0/3552567141 reap_dead start 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f06c8203ac0 msgr2=0x7f06c8205eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f06c8203ac0 0x7f06c8205eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f06c8206900 msgr2=0x7f06c8208cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f06c8206900 0x7f06c8208cf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06c7400700 1 -- 172.21.15.32:0/3552567141 reap_dead start 2024-09-13T18:45:56.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f06a4066730 msgr2=0x7f06a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f06a4066730 0x7f06a4068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f06b8001830 tx=0x7f06b8009040 comp rx=0 tx=0).stop 2024-09-13T18:45:56.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 msgr2=0x7f06c80c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 0x7f06c80c3f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06c0016000 tx=0x7f06c0004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 shutdown_connections 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f06a4066730 0x7f06a4068bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 --2- 172.21.15.32:0/3552567141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06c80aa430 0x7f06c80c3f70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 >> 172.21.15.32:0/3552567141 conn(0x7f06c80accb0 msgr2=0x7f06c80c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 shutdown_connections 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.448+0000 7f06cda00700 1 -- 172.21.15.32:0/3552567141 wait complete. 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:45:56.454 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:45:56.455 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:45:56.455 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:45:56.455 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:45:56.483 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:56.484 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:56.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:45:56.547 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:56.544+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:56.629 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:56.628+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:56.726 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:56.726 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:56.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.724+0000 7fdb1b400700 1 -- 172.21.15.32:0/1727129498 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v33) v1 ==== 101+0+0 (secure 0 0 0) 0x7fdb2415aeb0 con 0x7fdb240724c0 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb04066730 msgr2=0x7fdb04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb04066730 0x7fdb04068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb24156480 tx=0x7fdb10009040 comp rx=0 tx=0).stop 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 msgr2=0x7fdb2406cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 0x7fdb2406cc60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009f70 tx=0x7fdb14004770 comp rx=0 tx=0).stop 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 shutdown_connections 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fdb04066730 0x7fdb04068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb2415a240 0x7fdb240bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb24159e40 0x7fdb241e3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 --2- 172.21.15.32:0/1727129498 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb240724c0 0x7fdb2406cc60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 >> 172.21.15.32:0/1727129498 conn(0x7fdb240cac60 msgr2=0x7fdb241e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 shutdown_connections 2024-09-13T18:45:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:56.728+0000 7fdb23e00700 1 -- 172.21.15.32:0/1727129498 wait complete. 2024-09-13T18:45:56.732 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:56.723+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:56.733 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:45:56.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:45:56.832 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:56.828+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:56.900 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:56.900 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:56.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:45:56.933 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:56.927+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:57.034 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:57.031+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:57.135 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:57.127+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:57.138 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:57.138 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:57.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:45:57.236 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:57.232+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:57.327 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:57.328 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:57.337 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:57.332+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:57.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:45:57.438 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:57.431+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:57.539 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:57.535+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:57.550 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:57.550 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:57.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:45:57.640 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:57.639+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:57.732 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:57.732 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:57.740 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:57.735+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:57.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:45:57.841 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:57.836+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:57.870 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:57.870 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:57.880 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:45:57.942 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:57.940+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:57.982 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:57.982 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:57.992 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:45:58.043 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:45:58.040+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:45:58.101 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.101 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.110 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:45:58.143 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:45:58.139+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:45:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:45:58.245 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:58.240+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:58.334 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.334 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:45:58.346 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:58.339+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:58.447 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:58.443+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:58.449 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.449 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:45:58.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:45:58.548 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:58.544+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:58.564 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.564 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:45:58.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.640+0000 7f24d7400700 1 Processor -- start 2024-09-13T18:45:58.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.640+0000 7f24d7400700 1 -- start start 2024-09-13T18:45:58.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d006f970 0x7f24d00b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d7400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24d00c6f20 0x7f24d00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d7400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d0070ba0 con 0x7f24d00c6b40 2024-09-13T18:45:58.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d7400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d0070e80 con 0x7f24d00c6f20 2024-09-13T18:45:58.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d7400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d015d2d0 con 0x7f24d006f970 2024-09-13T18:45:58.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d4a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f24d00c6b40 0x7f24d006dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47310/0 (socket says 172.21.15.32:47310) 2024-09-13T18:45:58.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d4a00700 1 -- 172.21.15.32:0/567452451 learned_addr learned my addr 172.21.15.32:0/567452451 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:58.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24cfe00700 1 --2- 172.21.15.32:0/567452451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d006f970 0x7f24d00b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24d5400700 1 --2- 172.21.15.32:0/567452451 >> v2:172.21.15.32:3300/0 conn(0x7f24d00c6f20 0x7f24d00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.650 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:58.644+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:58.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24cfe00700 1 -- 172.21.15.32:0/567452451 >> v2:172.21.15.32:3300/0 conn(0x7f24d00c6f20 msgr2=0x7f24d00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:58.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24cfe00700 1 --2- 172.21.15.32:0/567452451 >> v2:172.21.15.32:3300/0 conn(0x7f24d00c6f20 0x7f24d00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24cfe00700 1 -- 172.21.15.32:0/567452451 >> v1:172.21.15.32:6789/0 conn(0x7f24d00c6b40 legacy=0x7f24d006dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.644+0000 7f24cfe00700 1 -- 172.21.15.32:0/567452451 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d015d5b0 con 0x7f24d006f970 2024-09-13T18:45:58.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24cfe00700 1 --2- 172.21.15.32:0/567452451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d006f970 0x7f24d00b0b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009850 tx=0x7f24bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343194af756b8211 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24cf400700 1 -- 172.21.15.32:0/567452451 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011830 con 0x7f24d006f970 2024-09-13T18:45:58.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24cf400700 1 -- 172.21.15.32:0/567452451 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc011990 con 0x7f24d006f970 2024-09-13T18:45:58.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24cf400700 1 -- 172.21.15.32:0/567452451 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011d40 con 0x7f24d006f970 2024-09-13T18:45:58.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 -- 172.21.15.32:0/567452451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d006f970 msgr2=0x7f24d00b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 --2- 172.21.15.32:0/567452451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d006f970 0x7f24d00b0b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009850 tx=0x7f24bc009b60 comp rx=0 tx=0).stop 2024-09-13T18:45:58.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 -- 172.21.15.32:0/567452451 shutdown_connections 2024-09-13T18:45:58.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 --2- 172.21.15.32:0/567452451 >> v2:172.21.15.32:3300/0 conn(0x7f24d00c6f20 0x7f24d00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 --2- 172.21.15.32:0/567452451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d006f970 0x7f24d00b0b10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 -- 172.21.15.32:0/567452451 >> 172.21.15.32:0/567452451 conn(0x7f24d0072640 msgr2=0x7f24d006b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 -- 172.21.15.32:0/567452451 shutdown_connections 2024-09-13T18:45:58.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.648+0000 7f24d7400700 1 -- 172.21.15.32:0/567452451 wait complete. 2024-09-13T18:45:58.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 Processor -- start 2024-09-13T18:45:58.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 -- start start 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24d006f970 0x7f24d0156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d00c6b40 0x7f24d0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 0x7f24d00ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00ca350 con 0x7f24d006f970 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0156540 con 0x7f24d00c6f20 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d7400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d014f8c0 con 0x7f24d00c6b40 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24cfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d00c6b40 0x7f24d0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 0x7f24d00ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d4a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24d006f970 0x7f24d0156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 0x7f24d00ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:58012/0 (socket says 172.21.15.32:58012) 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.652+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 learned_addr learned my addr 172.21.15.32:0/1148011201 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d00c6b40 msgr2=0x7f24d0155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d00c6b40 0x7f24d0155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24d006f970 msgr2=0x7f24d0156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24d006f970 0x7f24d0156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc0094b0 con 0x7f24d00c6f20 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d00c6b40 0x7f24d0155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24d006f970 0x7f24d0156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 0x7f24d00ca650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24c800ebe0 tx=0x7f24c800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c800ca00 con 0x7f24d00c6f20 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d014f1a0 con 0x7f24d00c6f20 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c800f040 con 0x7f24d00c6f20 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c800cdc0 con 0x7f24d00c6f20 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d0156020 con 0x7f24d00c6f20 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.656+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f24d006d6c0 con 0x7f24d00c6f20 2024-09-13T18:45:58.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24c8014480 con 0x7f24d00c6f20 2024-09-13T18:45:58.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24ccc00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f24b0066730 0x7f24b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f24c8085850 con 0x7f24d00c6f20 2024-09-13T18:45:58.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v33) v1 ==== 54+0+16 (secure 0 0 0) 0x7f24c8085bc0 con 0x7f24d00c6f20 2024-09-13T18:45:58.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f24b0066730 0x7f24b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f24d0155a60 0x7f24d00c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d015db70 con 0x7f24d0155a60 2024-09-13T18:45:58.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f24d0155a60 0x7f24d00c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.660+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f24b0066730 0x7f24b0068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24d01545e0 tx=0x7f24c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.664+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f24d0155a60 0x7f24d00c4dd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.664+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24bc022040 con 0x7f24d0155a60 2024-09-13T18:45:58.684 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.684 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.688+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d015e090 con 0x7f24d0155a60 2024-09-13T18:45:58.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:45:58.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.688+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24bc011630 con 0x7f24d0155a60 2024-09-13T18:45:58.695 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:45:58.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.692+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f24d0151df0 0x7f24d01521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.692+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d0155e40 con 0x7f24d0151df0 2024-09-13T18:45:58.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.692+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f24d0151df0 0x7f24d01521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.692+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f24d0151df0 0x7f24d01521d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.692+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24d0155e40 con 0x7f24d0151df0 2024-09-13T18:45:58.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.716+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d0152710 con 0x7f24d0151df0 2024-09-13T18:45:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.720+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24d0152710 con 0x7f24d0151df0 2024-09-13T18:45:58.726 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:45:58.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.724+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f24d014d510 0x7f24d014d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.724+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d014de30 con 0x7f24d014d510 2024-09-13T18:45:58.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.724+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f24d014d510 0x7f24d014d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.724+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f24d014d510 0x7f24d014d8f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.724+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24d014de30 con 0x7f24d014d510 2024-09-13T18:45:58.742 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:45:58.743 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:45:58.743 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 4, 5, 6, 7] 2024-09-13T18:45:58.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-13T18:45:58.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.744+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d00c33d0 con 0x7f24d014d510 2024-09-13T18:45:58.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.744+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24d00c33d0 con 0x7f24d014d510 2024-09-13T18:45:58.750 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:45:58.750 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:58.748+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.748+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f24d00612c0 0x7f24d00616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.748+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d0154150 con 0x7f24d00612c0 2024-09-13T18:45:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.748+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f24d00612c0 0x7f24d00616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.748+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f24d00612c0 0x7f24d00616e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.748+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24d0154150 con 0x7f24d00612c0 2024-09-13T18:45:58.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:45:58.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.768+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d00ccd00 con 0x7f24d00612c0 2024-09-13T18:45:58.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.772+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24d00ccd00 con 0x7f24d00612c0 2024-09-13T18:45:58.776 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:45:58.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.772+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f24d015b2a0 0x7f24d015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.772+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d00cced0 con 0x7f24d015b2a0 2024-09-13T18:45:58.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.772+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f24d015b2a0 0x7f24d015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.772+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f24d015b2a0 0x7f24d015b700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.776+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24c4026930 con 0x7f24d015b2a0 2024-09-13T18:45:58.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.792+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d015bc40 con 0x7f24d015b2a0 2024-09-13T18:45:58.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.796+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24d015bc40 con 0x7f24d015b2a0 2024-09-13T18:45:58.800 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:45:58.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.796+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f24d002bbb0 0x7f24d002bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.796+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d00c9dd0 con 0x7f24d002bbb0 2024-09-13T18:45:58.801 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:45:58.801 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:45:58.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.796+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f24d002bbb0 0x7f24d002bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.796+0000 7f24cfe00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f24d002bbb0 0x7f24d002bff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.800+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24d00c9dd0 con 0x7f24d002bbb0 2024-09-13T18:45:58.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:45:58.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.820+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d00c9fd0 con 0x7f24d002bbb0 2024-09-13T18:45:58.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.824+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24bc0044a0 con 0x7f24d002bbb0 2024-09-13T18:45:58.828 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:45:58.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.824+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f24d002ca40 0x7f24d02085e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.824+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d020b460 con 0x7f24d002ca40 2024-09-13T18:45:58.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.824+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f24d002ca40 0x7f24d02085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.824+0000 7f24d5400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f24d002ca40 0x7f24d02085e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.828+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24d020b460 con 0x7f24d002ca40 2024-09-13T18:45:58.852 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:58.848+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:58.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.856+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d0208b20 con 0x7f24d002ca40 2024-09-13T18:45:58.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.860+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24d0208b20 con 0x7f24d002ca40 2024-09-13T18:45:58.866 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:45:58.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.860+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f24d02091a0 0x7f24d020b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.864+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24d020e410 con 0x7f24d02091a0 2024-09-13T18:45:58.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.864+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f24d02091a0 0x7f24d020b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.864+0000 7f24d4a00700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f24d02091a0 0x7f24d020b590 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.864+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f24d020e410 con 0x7f24d02091a0 2024-09-13T18:45:58.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.884+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f24d020bad0 con 0x7f24d02091a0 2024-09-13T18:45:58.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24ccc00700 1 -- 172.21.15.32:0/1148011201 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f24d020bad0 con 0x7f24d02091a0 2024-09-13T18:45:58.892 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f24d0155a60 msgr2=0x7f24d00c4dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f24d0155a60 0x7f24d00c4dd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f24d0151df0 msgr2=0x7f24d01521d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f24d0151df0 0x7f24d01521d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f24d014d510 msgr2=0x7f24d014d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f24d014d510 0x7f24d014d8f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f24d00612c0 msgr2=0x7f24d00616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f24d00612c0 0x7f24d00616e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f24d015b2a0 msgr2=0x7f24d015b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f24d015b2a0 0x7f24d015b700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 reap_dead start 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f24d002bbb0 msgr2=0x7f24d002bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f24d002bbb0 0x7f24d002bff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 reap_dead start 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f24d002ca40 msgr2=0x7f24d02085e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f24d002ca40 0x7f24d02085e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f24d02091a0 msgr2=0x7f24d020b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f24d02091a0 0x7f24d020b590 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d5400700 1 -- 172.21.15.32:0/1148011201 reap_dead start 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f24b0066730 msgr2=0x7f24b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f24b0066730 0x7f24b0068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24d01545e0 tx=0x7f24c4009040 comp rx=0 tx=0).stop 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 msgr2=0x7f24d00ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 0x7f24d00ca650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24c800ebe0 tx=0x7f24c800eef0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 shutdown_connections 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f24b0066730 0x7f24b0068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 --2- 172.21.15.32:0/1148011201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d00c6f20 0x7f24d00ca650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 >> 172.21.15.32:0/1148011201 conn(0x7f24d0072640 msgr2=0x7f24d006e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 shutdown_connections 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.888+0000 7f24d7400700 1 -- 172.21.15.32:0/1148011201 wait complete. 2024-09-13T18:45:58.896 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:45:58.897 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:45:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3cb000700 1 Processor -- start 2024-09-13T18:45:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3cb000700 1 -- start start 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3cb000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073d70 0x7fa3c4159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3cb000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c406fd20 con 0x7fa3c40701b0 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3cb000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40c7380 con 0x7fa3c4073990 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3cb000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c7940 con 0x7fa3c4073d70 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3ca600700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa3c40701b0 0x7fa3c4070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54374/0 (socket says 172.21.15.32:54374) 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3ca600700 1 -- 172.21.15.32:0/4102097005 learned_addr learned my addr 172.21.15.32:0/4102097005 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.908+0000 7fa3c9200700 1 --2- 172.21.15.32:0/4102097005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073d70 0x7fa3c4159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.915 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:58.915 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:58.915 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:45:58.915 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694512568 0 0) 0x7fa3c406fd20 con 0x7fa3c40701b0 2024-09-13T18:45:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3ac0035d0 con 0x7fa3c40701b0 2024-09-13T18:45:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569768749 0 0) 0x7fa3c40c7380 con 0x7fa3c4073990 2024-09-13T18:45:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c406fd20 con 0x7fa3c4073990 2024-09-13T18:45:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c9200700 1 -- 172.21.15.32:0/4102097005 >> v1:172.21.15.86:6789/0 conn(0x7fa3c4073990 legacy=0x7fa3c40c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c9200700 1 -- 172.21.15.32:0/4102097005 >> v1:172.21.15.32:6789/0 conn(0x7fa3c40701b0 legacy=0x7fa3c4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c9200700 1 -- 172.21.15.32:0/4102097005 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40c7660 con 0x7fa3c4073d70 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c9200700 1 --2- 172.21.15.32:0/4102097005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073d70 0x7fa3c4159600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009880 tx=0x7fa3b0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf85297c80c16b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0011830 con 0x7fa3c4073d70 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0011990 con 0x7fa3c4073d70 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3c3e00700 1 -- 172.21.15.32:0/4102097005 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0011d00 con 0x7fa3c4073d70 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 -- 172.21.15.32:0/4102097005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073d70 msgr2=0x7fa3c4159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 --2- 172.21.15.32:0/4102097005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073d70 0x7fa3c4159600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009880 tx=0x7fa3b0009b90 comp rx=0 tx=0).stop 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 -- 172.21.15.32:0/4102097005 shutdown_connections 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 --2- 172.21.15.32:0/4102097005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073d70 0x7fa3c4159600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 -- 172.21.15.32:0/4102097005 >> 172.21.15.32:0/4102097005 conn(0x7fa3c40c8a60 msgr2=0x7fa3c40c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 -- 172.21.15.32:0/4102097005 shutdown_connections 2024-09-13T18:45:58.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.912+0000 7fa3cb000700 1 -- 172.21.15.32:0/4102097005 wait complete. 2024-09-13T18:45:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 Processor -- start 2024-09-13T18:45:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 -- start start 2024-09-13T18:45:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 0x7fa3c40cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073990 0x7fa3c41eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c4073d70 0x7fa3c41ef530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41f3290 con 0x7fa3c40701b0 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41f2610 con 0x7fa3c4073d70 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41f28f0 con 0x7fa3c4073990 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 0x7fa3c40cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 0x7fa3c40cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42768/0 (socket says 172.21.15.32:42768) 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 -- 172.21.15.32:0/152561451 learned_addr learned my addr 172.21.15.32:0/152561451 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9200700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073990 0x7fa3c41eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3ca600700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c4073d70 0x7fa3c41ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 -- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073990 msgr2=0x7fa3c41eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073990 0x7fa3c41eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 -- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c4073d70 msgr2=0x7fa3c41ef530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c4073d70 0x7fa3c41ef530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 -- 172.21.15.32:0/152561451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00094b0 con 0x7fa3c40701b0 2024-09-13T18:45:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c9c00700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 0x7fa3c40cb3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c730 tx=0x7fa3b800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80052d0 con 0x7fa3c40701b0 2024-09-13T18:45:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8005450 con 0x7fa3c40701b0 2024-09-13T18:45:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80038e0 con 0x7fa3c40701b0 2024-09-13T18:45:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c41f2bd0 con 0x7fa3c40701b0 2024-09-13T18:45:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.916+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40c0fe0 con 0x7fa3c40701b0 2024-09-13T18:45:58.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.920+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c41f33d0 con 0x7fa3c40701b0 2024-09-13T18:45:58.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.920+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3b8003a40 con 0x7fa3c40701b0 2024-09-13T18:45:58.925 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:45:58.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.924+0000 7fa3c1600700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa3a4066730 0x7fa3a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.924+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fa3b80839f0 con 0x7fa3c40701b0 2024-09-13T18:45:58.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.924+0000 7fa3c9200700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa3a4066730 0x7fa3a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.924+0000 7fa3c9200700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa3a4066730 0x7fa3a4068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009880 tx=0x7fa3b0010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.928+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3c41f33d0 con 0x7fa3c40701b0 2024-09-13T18:45:58.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.932+0000 7ff505000700 1 Processor -- start 2024-09-13T18:45:58.938 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff505000700 1 -- start start 2024-09-13T18:45:58.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff505000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff5000a9700 0x7ff5000c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff505000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5000c5660 0x7ff500159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff505000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000c8060 con 0x7ff5000a9ae0 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff505000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff500071f30 con 0x7ff5000a9700 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff505000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff500071690 con 0x7ff5000c5660 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff4ffe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff5000c5660 0x7ff500159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff4fea00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff5000a9ae0 0x7ff5001594f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54378/0 (socket says 172.21.15.32:54378) 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff4fea00700 1 -- 172.21.15.32:0/1436218238 learned_addr learned my addr 172.21.15.32:0/1436218238 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.936+0000 7ff4ff400700 1 --2- 172.21.15.32:0/1436218238 >> v2:172.21.15.32:3300/0 conn(0x7ff5000a9700 0x7ff5000c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4ffe00700 1 -- 172.21.15.32:0/1436218238 >> v2:172.21.15.32:3300/0 conn(0x7ff5000a9700 msgr2=0x7ff5000c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:58.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4ffe00700 1 --2- 172.21.15.32:0/1436218238 >> v2:172.21.15.32:3300/0 conn(0x7ff5000a9700 0x7ff5000c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4ffe00700 1 -- 172.21.15.32:0/1436218238 >> v1:172.21.15.32:6789/0 conn(0x7ff5000a9ae0 legacy=0x7ff5001594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4ffe00700 1 -- 172.21.15.32:0/1436218238 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500071970 con 0x7ff5000c5660 2024-09-13T18:45:58.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4ffe00700 1 --2- 172.21.15.32:0/1436218238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500159c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5000c7650 tx=0x7ff4f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b1e54a35c5394c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4fe000700 1 -- 172.21.15.32:0/1436218238 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800e070 con 0x7ff5000c5660 2024-09-13T18:45:58.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4fe000700 1 -- 172.21.15.32:0/1436218238 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800bb20 con 0x7ff5000c5660 2024-09-13T18:45:58.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff4fe000700 1 -- 172.21.15.32:0/1436218238 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8012430 con 0x7ff5000c5660 2024-09-13T18:45:58.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 -- 172.21.15.32:0/1436218238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 msgr2=0x7ff500159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 --2- 172.21.15.32:0/1436218238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500159c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5000c7650 tx=0x7ff4f800b330 comp rx=0 tx=0).stop 2024-09-13T18:45:58.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 -- 172.21.15.32:0/1436218238 shutdown_connections 2024-09-13T18:45:58.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 --2- 172.21.15.32:0/1436218238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500159c00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 --2- 172.21.15.32:0/1436218238 >> v2:172.21.15.32:3300/0 conn(0x7ff5000a9700 0x7ff5000c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 -- 172.21.15.32:0/1436218238 >> 172.21.15.32:0/1436218238 conn(0x7ff5000cac60 msgr2=0x7ff5000cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 -- 172.21.15.32:0/1436218238 shutdown_connections 2024-09-13T18:45:58.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.940+0000 7ff505000700 1 -- 172.21.15.32:0/1436218238 wait complete. 2024-09-13T18:45:58.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 Processor -- start 2024-09-13T18:45:58.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 -- start start 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5000a9700 0x7ff5000aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5000a9ae0 0x7ff5001524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000aff60 con 0x7ff5000a9700 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff500147420 con 0x7ff5000c5660 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff505000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50014d0a0 con 0x7ff5000a9ae0 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ff400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5000a9700 0x7ff5000aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:35076/0 (socket says 172.21.15.32:35076) 2024-09-13T18:45:58.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 -- 172.21.15.32:0/3625696083 learned_addr learned my addr 172.21.15.32:0/3625696083 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:45:58.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4fea00700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5000a9ae0 0x7ff5001524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 -- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5000a9ae0 msgr2=0x7ff5001524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5000a9ae0 0x7ff5001524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 -- 172.21.15.32:0/3625696083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5000a9700 msgr2=0x7ff5000aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5000a9700 0x7ff5000aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 -- 172.21.15.32:0/3625696083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8009a70 con 0x7ff5000c5660 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.944+0000 7ff4ffe00700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500152a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8014040 tx=0x7ff4f8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8012430 con 0x7ff5000c5660 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8020070 con 0x7ff5000c5660 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8004040 con 0x7ff5000c5660 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5001468a0 con 0x7ff5000c5660 2024-09-13T18:45:58.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff500146e60 con 0x7ff5000c5660 2024-09-13T18:45:58.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5000aa240 con 0x7ff5000c5660 2024-09-13T18:45:58.953 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:58.948+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:58.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.948+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4f80041a0 con 0x7ff5000c5660 2024-09-13T18:45:58.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.952+0000 7ff4f7400700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff4e0066730 0x7ff4e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.952+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6550+0+0 (secure 0 0 0) 0x7ff4f8022070 con 0x7ff5000c5660 2024-09-13T18:45:58.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.952+0000 7ff4ff400700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff4e0066730 0x7ff4e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.952+0000 7ff4ff400700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff4e0066730 0x7ff4e0068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009bf0 tx=0x7ff4f0009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:58.960+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4f80530b0 con 0x7ff5000c5660 2024-09-13T18:45:59.031 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:45:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:45:59.032 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:45:59.032 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:59.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:45:59.054 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:45:59.047+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:45:59.147 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:45:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:45:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:45:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:45:59.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.824018834, 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:45:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:45:59.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.823994966999997, 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:45:59.153 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:45:59.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:45:59.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.823984457000002, 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:45:59.159 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:45:59.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:45:59.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:45:59.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.823968456999999, 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:45:59.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.170 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.823961619999999, 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:45:59.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:45:59.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.820403493999997, 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:45:59.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:45:59.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.818592668000001, 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:45:59.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.818538975999999, 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:45:59.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:45:59.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.817495029, 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:45:59.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.192 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.815939341000004, 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.815885594000001, 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:45:59.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.814646414000002, 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.204 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.814601179, 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:45:59.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:45:59.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.814566145000001, 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:45:59.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:45:59.213 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.814525914999997, 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:45:59.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:45:59.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.813833492999997, 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:45:59.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:45:59.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.813782805000002, 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:45:59.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:45:59.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.813389164999997, 2024-09-13T18:45:59.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:45:59.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:45:59.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 52.812992600999998, 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:45:59.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:45:59.235 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:45:59.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:45:59.237 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:59.232+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.292+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd out", "ids": ["6"]} v 0) v1 -- 0x7fa3c41f33d0 con 0x7fa3c40701b0 2024-09-13T18:45:59.297 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-09-13T18:45:59.292+0000 7f8fc4800700 -1 mon.a@0(leader).osd e33 definitely_dead 0 2024-09-13T18:45:59.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.316+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7ff5000c97d0 con 0x7ff5000c5660 2024-09-13T18:45:59.338 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:59.335+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:59.413 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:59.413 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:59.413 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:45:59.413 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:59.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:45:59.475 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:45:59.472+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:45:59.539 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:45:59.539+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:45:59.594 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:59.594 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:45:59.594 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:45:59.595 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:45:59.595 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:59.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:45:59.640 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:45:59.635+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:45:59.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.736+0000 7fa3c1600700 1 -- 172.21.15.32:0/152561451 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd out", "ids": ["6"]}]=0 marked out osd.6. v34) v1 ==== 87+0+0 (secure 0 0 0) 0x7fa3c41f33d0 con 0x7fa3c40701b0 2024-09-13T18:45:59.742 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:59.736+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:45:59.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.740+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa3a4066730 msgr2=0x7fa3a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa3a4066730 0x7fa3a4068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009880 tx=0x7fa3b0010000 comp rx=0 tx=0).stop 2024-09-13T18:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 msgr2=0x7fa3c40cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 0x7fa3c40cb3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c730 tx=0x7fa3b800ca40 comp rx=0 tx=0).stop 2024-09-13T18:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 shutdown_connections 2024-09-13T18:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa3a4066730 0x7fa3a4068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3c4073d70 0x7fa3c41ef530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3c4073990 0x7fa3c41eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 --2- 172.21.15.32:0/152561451 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3c40701b0 0x7fa3c40cb3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 >> 172.21.15.32:0/152561451 conn(0x7fa3c40c8a60 msgr2=0x7fa3c4159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 shutdown_connections 2024-09-13T18:45:59.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.744+0000 7fa3cb000700 1 -- 172.21.15.32:0/152561451 wait complete. 2024-09-13T18:45:59.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.748+0000 7ff4f7400700 1 -- 172.21.15.32:0/3625696083 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v34) v1 ==== 87+0+0 (secure 0 0 0) 0x7ff4f80566d0 con 0x7ff5000c5660 2024-09-13T18:45:59.754 INFO:teuthology.orchestra.run.smithi032.stderr:marked out osd.6. 2024-09-13T18:45:59.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff4e0066730 msgr2=0x7ff4e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff4e0066730 0x7ff4e0068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009bf0 tx=0x7ff4f0009240 comp rx=0 tx=0).stop 2024-09-13T18:45:59.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 msgr2=0x7ff500152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500152a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8014040 tx=0x7ff4f8004af0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 shutdown_connections 2024-09-13T18:45:59.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff4e0066730 0x7ff4e0068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5000c5660 0x7ff500152a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5000a9ae0 0x7ff5001524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 --2- 172.21.15.32:0/3625696083 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5000a9700 0x7ff5000aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 >> 172.21.15.32:0/3625696083 conn(0x7ff5000cac60 msgr2=0x7ff50006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 shutdown_connections 2024-09-13T18:45:59.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:45:59.768+0000 7ff505000700 1 -- 172.21.15.32:0/3625696083 wait complete. 2024-09-13T18:45:59.778 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:45:59.843 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:45:59.840+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:45:59.845 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:45:59.845 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:45:59.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:45:59.845 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:45:59.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.845 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.521235062000002, 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:45:59.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:45:59.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:45:59.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.851 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.521211076, 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:45:59.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:45:59.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:45:59.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.858 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.521202170000002, 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:45:59.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:45:59.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.865 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:45:59.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.521199297999999, 2024-09-13T18:45:59.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:45:59.866 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.866 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.866 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:45:59.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:45:59.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:45:59.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:45:59.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:45:59.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:45:59.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:45:59.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:45:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:45:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:45:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:45:59.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:45:59.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:45:59.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:45:59.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:45:59.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:45:59.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:45:59.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:45:59.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:59.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:45:59.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:45:59.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:45:59.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:45:59.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:45:59.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:45:59.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.878 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:45:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.521196590000002, 2024-09-13T18:45:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:45:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.879 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.880 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:59.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:59.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:45:59.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:45:59.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:45:59.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:45:59.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:45:59.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:45:59.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:45:59.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:45:59.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:45:59.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:45:59.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:45:59.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:45:59.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:45:59.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:45:59.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:45:59.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:45:59.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:45:59.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:45:59.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:45:59.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:45:59.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:45:59.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:45:59.891 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.891 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.892 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:59.892 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:59.892 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.518069523000001, 2024-09-13T18:45:59.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:45:59.893 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:45:59.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:45:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.517018835999998, 2024-09-13T18:45:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.516664249000002, 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:45:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:45:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.516519090999999, 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:45:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:45:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.516421676999997, 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.516340563999997, 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:45:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:45:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.516090062000004, 2024-09-13T18:45:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.514995786999997, 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:45:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:45:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.514914838000003, 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:45:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:45:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.512812185000001, 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.014820497000002, 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:45:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:45:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:45:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:45:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:45:59.944 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:45:59.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:45:59.946 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:45:59.940+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:00.046 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:00.040+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:00.147 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:00.144+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:00.160 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:00.160 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:00.160 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:00.177 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:00.248 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:00.243+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:00.349 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:00.344+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:00.392 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:00.392 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:00.392 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:00.392 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:00.392 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:00.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:00.455 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:00.448+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:00.552 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:00.548+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:00.621 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.848921073, 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:00.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:00.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.156529989000006, 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.156416196999999, 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812866068000005, 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812862178000003, 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812650297999994, 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812640814000005, 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812375942000003, 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812178791999997, 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.812174548000002, 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.796119246000003, 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.911731854999999, 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.911156274000007, 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.911144886000002, 2024-09-13T18:46:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.911137288000006, 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.910925871000003, 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.910920097000002, 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.910901056, 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.910668891, 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.037552356000006, 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:00.776 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:00.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:00.779 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:00.776+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:00.880 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:00.876+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:00.913 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:00.944 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:00.944 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:00.944 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:00.944 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:00.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:01.007 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:01.004+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:01.081 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:01.075+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 Processor -- start 2024-09-13T18:46:01.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 -- start start 2024-09-13T18:46:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95bc0719b0 0x7f95bc0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc15b980 con 0x7f95bc071d90 2024-09-13T18:46:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0c4b00 con 0x7f95bc0719b0 2024-09-13T18:46:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c3000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc15ad70 con 0x7f95bc0c6c40 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95bbe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f95bc0719b0 0x7f95bc0c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc0c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54372/0 (socket says 172.21.15.32:54372) 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 -- 172.21.15.32:0/1896956564 learned_addr learned my addr 172.21.15.32:0/1896956564 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 -- 172.21.15.32:0/1896956564 >> v2:172.21.15.86:3300/0 conn(0x7f95bc0719b0 msgr2=0x7f95bc0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 --2- 172.21.15.32:0/1896956564 >> v2:172.21.15.86:3300/0 conn(0x7f95bc0719b0 0x7f95bc0c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 -- 172.21.15.32:0/1896956564 >> v1:172.21.15.86:6789/0 conn(0x7f95bc071d90 legacy=0x7f95bc1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.092+0000 7f95c1000700 1 -- 172.21.15.32:0/1896956564 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc15b050 con 0x7f95bc0c6c40 2024-09-13T18:46:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c1000700 1 --2- 172.21.15.32:0/1896956564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc0c44e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009e50 tx=0x7f95b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e4dc3446d6ec2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95baa00700 1 -- 172.21.15.32:0/1896956564 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400e070 con 0x7f95bc0c6c40 2024-09-13T18:46:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95baa00700 1 -- 172.21.15.32:0/1896956564 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b400b910 con 0x7f95bc0c6c40 2024-09-13T18:46:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95baa00700 1 -- 172.21.15.32:0/1896956564 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400bcc0 con 0x7f95bc0c6c40 2024-09-13T18:46:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 -- 172.21.15.32:0/1896956564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 msgr2=0x7f95bc0c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 --2- 172.21.15.32:0/1896956564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc0c44e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009e50 tx=0x7f95b400b330 comp rx=0 tx=0).stop 2024-09-13T18:46:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 -- 172.21.15.32:0/1896956564 shutdown_connections 2024-09-13T18:46:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 --2- 172.21.15.32:0/1896956564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc0c44e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 --2- 172.21.15.32:0/1896956564 >> v2:172.21.15.86:3300/0 conn(0x7f95bc0719b0 0x7f95bc0c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 -- 172.21.15.32:0/1896956564 >> 172.21.15.32:0/1896956564 conn(0x7f95bc06e6d0 msgr2=0x7f95bc06eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 -- 172.21.15.32:0/1896956564 shutdown_connections 2024-09-13T18:46:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.096+0000 7f95c3000700 1 -- 172.21.15.32:0/1896956564 wait complete. 2024-09-13T18:46:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 Processor -- start 2024-09-13T18:46:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 -- start start 2024-09-13T18:46:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95bc0719b0 0x7f95bc14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95bc071d90 0x7f95bc1e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1e48a0 con 0x7f95bc0719b0 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1e12c0 con 0x7f95bc071d90 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c3000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1f06c0 con 0x7f95bc0c6c40 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c1000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bbe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95bc0719b0 0x7f95bc14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c1000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54384/0 (socket says 172.21.15.32:54384) 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95c1000700 1 -- 172.21.15.32:0/949114572 learned_addr learned my addr 172.21.15.32:0/949114572 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:01.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95bc071d90 0x7f95bc1e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bbe00700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 msgr2=0x7f95bc150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f95bc0c6c40 0x7f95bc150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bbe00700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95bc071d90 msgr2=0x7f95bc1e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95bc071d90 0x7f95bc1e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bbe00700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4009b30 con 0x7f95bc0719b0 2024-09-13T18:46:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.100+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95bc071d90 0x7f95bc1e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95bc0719b0 0x7f95bc14cd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00e8a0 tx=0x7f95ac00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac013680 con 0x7f95bc0719b0 2024-09-13T18:46:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0c09b0 con 0x7f95bc0719b0 2024-09-13T18:46:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac0137e0 con 0x7f95bc0719b0 2024-09-13T18:46:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac013b70 con 0x7f95bc0719b0 2024-09-13T18:46:01.108 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc1e0d20 con 0x7f95bc0719b0 2024-09-13T18:46:01.109 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95ac013cd0 con 0x7f95bc0719b0 2024-09-13T18:46:01.110 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.104+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f95bc067a00 con 0x7f95bc0719b0 2024-09-13T18:46:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95b3e00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f959c066730 0x7f959c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f95ac084340 con 0x7f95bc0719b0 2024-09-13T18:46:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v35) v1 ==== 54+0+16 (secure 0 0 0) 0x7f95ac08b070 con 0x7f95bc0719b0 2024-09-13T18:46:01.111 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f959c066730 0x7f959c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f95bc0c8850 0x7f95bc1e3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc0c4880 con 0x7f95bc0c8850 2024-09-13T18:46:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95c1000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f95bc0c8850 0x7f95bc1e3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f959c066730 0x7f959c068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0cce70 tx=0x7f95a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.112 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95c1000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f95bc0c8850 0x7f95bc1e3b30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.108+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc0c4880 con 0x7f95bc0c8850 2024-09-13T18:46:01.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.128+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc0c7160 con 0x7f95bc0c8850 2024-09-13T18:46:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.128+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc0c7160 con 0x7f95bc0c8850 2024-09-13T18:46:01.134 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.128+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f95bc0c79e0 0x7f95bc150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.128+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc0008d0 con 0x7f95bc0c79e0 2024-09-13T18:46:01.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.132+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f95bc0c79e0 0x7f95bc150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.132+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f95bc0c79e0 0x7f95bc150bd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.132+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc0008d0 con 0x7f95bc0c79e0 2024-09-13T18:46:01.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.152+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc1e4070 con 0x7f95bc0c79e0 2024-09-13T18:46:01.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.156+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc1e4070 con 0x7f95bc0c79e0 2024-09-13T18:46:01.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.156+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f95bc1e1c20 0x7f95bc145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.156+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc151f20 con 0x7f95bc1e1c20 2024-09-13T18:46:01.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.156+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f95bc1e1c20 0x7f95bc145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.156+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f95bc1e1c20 0x7f95bc145250 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.160+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc151f20 con 0x7f95bc1e1c20 2024-09-13T18:46:01.167 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:01.168 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:01.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.176+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc145790 con 0x7f95bc1e1c20 2024-09-13T18:46:01.183 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:01.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.176+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc145790 con 0x7f95bc1e1c20 2024-09-13T18:46:01.183 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:01.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.180+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f95bc0612c0 0x7f95bc0616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.180+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc061c00 con 0x7f95bc0612c0 2024-09-13T18:46:01.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.180+0000 7f95c1000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f95bc0612c0 0x7f95bc0616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.180+0000 7f95c1000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f95bc0612c0 0x7f95bc0616c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.185 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:01.179+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:01.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.180+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc061c00 con 0x7f95bc0612c0 2024-09-13T18:46:01.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.200+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc14bc00 con 0x7f95bc0612c0 2024-09-13T18:46:01.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.204+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc14bc00 con 0x7f95bc0612c0 2024-09-13T18:46:01.207 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:01.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.204+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f95bc14c2b0 0x7f95bc02b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.204+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc14c710 con 0x7f95bc14c2b0 2024-09-13T18:46:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.204+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f95bc14c2b0 0x7f95bc02b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.204+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f95bc14c2b0 0x7f95bc02b6a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.204+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc14c710 con 0x7f95bc14c2b0 2024-09-13T18:46:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.228+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc14c910 con 0x7f95bc14c2b0 2024-09-13T18:46:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.232+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc14c910 con 0x7f95bc14c2b0 2024-09-13T18:46:01.235 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.232+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f95bc02c0f0 0x7f95bc02c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.232+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc14c710 con 0x7f95bc02c0f0 2024-09-13T18:46:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.232+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f95bc02c0f0 0x7f95bc02c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.232+0000 7f95bb400700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f95bc02c0f0 0x7f95bc02c570 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.236+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc14c710 con 0x7f95bc02c0f0 2024-09-13T18:46:01.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.260+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc14c710 con 0x7f95bc02c0f0 2024-09-13T18:46:01.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.264+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc14c710 con 0x7f95bc02c0f0 2024-09-13T18:46:01.267 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.264+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f95bc204170 0x7f95bc206560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.264+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc061d70 con 0x7f95bc204170 2024-09-13T18:46:01.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.264+0000 7f95c1000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f95bc204170 0x7f95bc206560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.264+0000 7f95c1000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f95bc204170 0x7f95bc206560 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.264+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc061d70 con 0x7f95bc204170 2024-09-13T18:46:01.283 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:01.279+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:01.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.288+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc061d70 con 0x7f95bc204170 2024-09-13T18:46:01.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.292+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc061d70 con 0x7f95bc204170 2024-09-13T18:46:01.295 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.292+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f95bc206fb0 0x7f95bc2093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.292+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc02cab0 con 0x7f95bc206fb0 2024-09-13T18:46:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.292+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f95bc206fb0 0x7f95bc2093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.292+0000 7f95bbe00700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f95bc206fb0 0x7f95bc2093a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.296+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95bc02cab0 con 0x7f95bc206fb0 2024-09-13T18:46:01.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.312+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f95bc02cab0 con 0x7f95bc206fb0 2024-09-13T18:46:01.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95b3e00700 1 -- 172.21.15.32:0/949114572 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f95bc02cab0 con 0x7f95bc206fb0 2024-09-13T18:46:01.321 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:01.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f95bc0c8850 msgr2=0x7f95bc1e3b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f95bc0c8850 0x7f95bc1e3b30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f95bc0c79e0 msgr2=0x7f95bc150bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f95bc0c79e0 0x7f95bc150bd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f95bc1e1c20 msgr2=0x7f95bc145250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f95bc1e1c20 0x7f95bc145250 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f95bc0612c0 msgr2=0x7f95bc0616c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f95bc0612c0 0x7f95bc0616c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f95bc14c2b0 msgr2=0x7f95bc02b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f95bc14c2b0 0x7f95bc02b6a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c1000700 1 -- 172.21.15.32:0/949114572 reap_dead start 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f95bc02c0f0 msgr2=0x7f95bc02c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f95bc02c0f0 0x7f95bc02c570 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c1000700 1 -- 172.21.15.32:0/949114572 reap_dead start 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f95bc204170 msgr2=0x7f95bc206560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f95bc204170 0x7f95bc206560 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f95bc206fb0 msgr2=0x7f95bc2093a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f95bc206fb0 0x7f95bc2093a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c1000700 1 -- 172.21.15.32:0/949114572 reap_dead start 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f959c066730 msgr2=0x7f959c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f959c066730 0x7f959c068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0cce70 tx=0x7f95a8009040 comp rx=0 tx=0).stop 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95bc0719b0 msgr2=0x7f95bc14cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.316+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95bc0719b0 0x7f95bc14cd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00e8a0 tx=0x7f95ac00ebb0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 shutdown_connections 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f95bc206fb0 0x7f95bc2093a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f959c066730 0x7f959c068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 --2- 172.21.15.32:0/949114572 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95bc0719b0 0x7f95bc14cd30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 >> 172.21.15.32:0/949114572 conn(0x7f95bc06e6d0 msgr2=0x7f95bc1595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 shutdown_connections 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.320+0000 7f95c3000700 1 -- 172.21.15.32:0/949114572 wait complete. 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:01.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:01.326 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:01.326 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:01.347 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:01.347 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:01.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:01.408 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:01.404+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:01.485 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:01.480+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:01.579 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:01.579 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:01.585 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:01.579+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:01.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:01.687 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:01.683+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:01.788 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:01.784+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:01.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:46:01.810 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:01.810 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:01.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:01.888 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:01.883+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.964+0000 7f9ce1000700 1 Processor -- start 2024-09-13T18:46:01.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.964+0000 7f9ce1000700 1 -- start start 2024-09-13T18:46:01.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9ce1000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cdc0721b0 0x7f9cdc15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9ce1000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc15a620 con 0x7f9cdc072590 2024-09-13T18:46:01.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9ce1000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc15db50 con 0x7f9cdc153450 2024-09-13T18:46:01.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9ce1000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0716a0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdaa00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9cdc072590 0x7f9cdc0c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54392/0 (socket says 172.21.15.32:54392) 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdaa00700 1 -- 172.21.15.32:0/2898091686 learned_addr learned my addr 172.21.15.32:0/2898091686 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdb400700 1 --2- 172.21.15.32:0/2898091686 >> v2:172.21.15.86:3300/0 conn(0x7f9cdc0721b0 0x7f9cdc15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287005759 0 0) 0x7f9cdc15a620 con 0x7f9cdc072590 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc00035d0 con 0x7f9cdc072590 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155861521 0 0) 0x7f9cdc15db50 con 0x7f9cdc153450 2024-09-13T18:46:01.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc15a620 con 0x7f9cdc153450 2024-09-13T18:46:01.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdb400700 1 -- 172.21.15.32:0/2898091686 >> v1:172.21.15.86:6789/0 conn(0x7f9cdc153450 legacy=0x7f9cdc153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdb400700 1 -- 172.21.15.32:0/2898091686 >> v1:172.21.15.32:6789/0 conn(0x7f9cdc072590 legacy=0x7f9cdc0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1727768417 0 0) 0x7f9cc00035d0 con 0x7f9cdc072590 2024-09-13T18:46:01.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdb400700 1 -- 172.21.15.32:0/2898091686 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc15ccf0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.968+0000 7f9cdb400700 1 --2- 172.21.15.32:0/2898091686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc15a0e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009850 tx=0x7f9ccc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f01dc932a6b07a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc011830 con 0x7f9cdc0721b0 2024-09-13T18:46:01.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc011990 con 0x7f9cdc0721b0 2024-09-13T18:46:01.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9cda000700 1 -- 172.21.15.32:0/2898091686 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc011d40 con 0x7f9cdc0721b0 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 -- 172.21.15.32:0/2898091686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc0721b0 msgr2=0x7f9cdc15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 --2- 172.21.15.32:0/2898091686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc15a0e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009850 tx=0x7f9ccc009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 -- 172.21.15.32:0/2898091686 shutdown_connections 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 --2- 172.21.15.32:0/2898091686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc15a0e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 -- 172.21.15.32:0/2898091686 >> 172.21.15.32:0/2898091686 conn(0x7f9cdc0cbfe0 msgr2=0x7f9cdc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 -- 172.21.15.32:0/2898091686 shutdown_connections 2024-09-13T18:46:01.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.972+0000 7f9ce1000700 1 -- 172.21.15.32:0/2898091686 wait complete. 2024-09-13T18:46:01.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 Processor -- start 2024-09-13T18:46:01.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 -- start start 2024-09-13T18:46:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc1f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc072590 0x7f9cdc1f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cdc153450 0x7f9cdc1f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0b2ab0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc150cb0 con 0x7f9cdc072590 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0c9230 con 0x7f9cdc153450 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc1f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc1f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42800/0 (socket says 172.21.15.32:42800) 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 -- 172.21.15.32:0/3691726388 learned_addr learned my addr 172.21.15.32:0/3691726388 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdaa00700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc072590 0x7f9cdc1f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdbe00700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cdc153450 0x7f9cdc1f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 -- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cdc153450 msgr2=0x7f9cdc1f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cdc153450 0x7f9cdc1f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 -- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc072590 msgr2=0x7f9cdc1f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:01.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc072590 0x7f9cdc1f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 -- 172.21.15.32:0/3691726388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc0094b0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cdb400700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc1f23e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009eb0 tx=0x7f9ccc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc01a990 con 0x7f9cdc0721b0 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc01f070 con 0x7f9cdc0721b0 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc01ad30 con 0x7f9cdc0721b0 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc0c97f0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.976+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc1f2ec0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.980+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc067a00 con 0x7f9cdc0721b0 2024-09-13T18:46:01.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.980+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ccc01b430 con 0x7f9cdc0721b0 2024-09-13T18:46:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.980+0000 7f9cd3400700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9cbc066730 0x7f9cbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.980+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f9ccc0853c0 con 0x7f9cdc0721b0 2024-09-13T18:46:01.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.984+0000 7f9cdaa00700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9cbc066730 0x7f9cbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:01.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.984+0000 7f9cdaa00700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9cbc066730 0x7f9cbc068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc066650 tx=0x7f9cc8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:01.989 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:01.983+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:01.988+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ccc052470 con 0x7f9cdc0721b0 2024-09-13T18:46:02.071 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.071 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.090 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:02.083+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:02.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:02.191 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:02.187+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:02.206 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.206 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:02.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.220+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7f9cdc15a0e0 con 0x7f9cdc0721b0 2024-09-13T18:46:02.292 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:02.287+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:02.319 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.319 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:02.394 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:02.388+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:02.434 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.434 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.444 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:02.495 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:02.492+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:02.549 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.550 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:02.596 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:02.592+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:02.667 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.667 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:02.696 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:02.691+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:02.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.748+0000 7f9cd3400700 1 -- 172.21.15.32:0/3691726388 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ccc055a90 con 0x7f9cdc0721b0 2024-09-13T18:46:02.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9cbc066730 msgr2=0x7f9cbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:02.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9cbc066730 0x7f9cbc068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc066650 tx=0x7f9cc8009040 comp rx=0 tx=0).stop 2024-09-13T18:46:02.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 msgr2=0x7f9cdc1f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc1f23e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009eb0 tx=0x7f9ccc004770 comp rx=0 tx=0).stop 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 shutdown_connections 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9cbc066730 0x7f9cbc068bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cdc153450 0x7f9cdc1f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cdc072590 0x7f9cdc1f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 --2- 172.21.15.32:0/3691726388 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cdc0721b0 0x7f9cdc1f23e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 >> 172.21.15.32:0/3691726388 conn(0x7f9cdc0cbfe0 msgr2=0x7f9cdc0c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 shutdown_connections 2024-09-13T18:46:02.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:02.752+0000 7f9ce1000700 1 -- 172.21.15.32:0/3691726388 wait complete. 2024-09-13T18:46:02.757 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:46:02.783 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.783 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:02.827 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:02.824+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:02.896 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:02.897 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:02.898 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:02.896+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:02.906 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:02.999 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:02.996+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:03.009 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:03.009 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:03.019 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:03.100 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:03.095+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:03.124 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:03.124 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:03.134 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:03.201 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:03.196+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:03.241 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:03.242 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:03.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:03.302 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:03.295+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:03.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:03.354 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:03.354 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:03.364 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:03.405 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:03.400+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:03.474 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:03.474 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:03.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:03.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9be00700 1 Processor -- start 2024-09-13T18:46:03.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9be00700 1 -- start start 2024-09-13T18:46:03.524 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:03.520+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:03.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9be00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbe9c1508e0 0x7fbe9c06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9be00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0c1480 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9be00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c159d30 con 0x7fbe9c0c58c0 2024-09-13T18:46:03.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9be00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c7160 con 0x7fbe9c1508e0 2024-09-13T18:46:03.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9aa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbe9c1508e0 0x7fbe9c06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9b400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbe9c0c58c0 0x7fbe9c160d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:33266/0 (socket says 172.21.15.32:33266) 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9a000700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbe9c0c54c0 0x7fbe9c0bfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54402/0 (socket says 172.21.15.32:54402) 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.520+0000 7fbe9b400700 1 -- 172.21.15.32:0/695128729 learned_addr learned my addr 172.21.15.32:0/695128729 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe99600700 1 -- 172.21.15.32:0/695128729 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909459230 0 0) 0x7fbe9c0c1480 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe99600700 1 -- 172.21.15.32:0/695128729 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe800035d0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9aa00700 1 -- 172.21.15.32:0/695128729 >> v1:172.21.15.86:6789/0 conn(0x7fbe9c0c58c0 legacy=0x7fbe9c160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe99600700 1 -- 172.21.15.32:0/695128729 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729071191 0 0) 0x7fbe9c159d30 con 0x7fbe9c0c58c0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9aa00700 1 -- 172.21.15.32:0/695128729 >> v1:172.21.15.32:6789/0 conn(0x7fbe9c0c54c0 legacy=0x7fbe9c0bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9aa00700 1 -- 172.21.15.32:0/695128729 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0c0870 con 0x7fbe9c1508e0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/695128729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c1508e0 0x7fbe9c06cbf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009850 tx=0x7fbe8c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ef1a02896d2045 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe99600700 1 -- 172.21.15.32:0/695128729 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c011830 con 0x7fbe9c1508e0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe99600700 1 -- 172.21.15.32:0/695128729 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c011990 con 0x7fbe9c1508e0 2024-09-13T18:46:03.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe99600700 1 -- 172.21.15.32:0/695128729 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c011d00 con 0x7fbe9c1508e0 2024-09-13T18:46:03.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 -- 172.21.15.32:0/695128729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c1508e0 msgr2=0x7fbe9c06cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 --2- 172.21.15.32:0/695128729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c1508e0 0x7fbe9c06cbf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009850 tx=0x7fbe8c009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:03.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 -- 172.21.15.32:0/695128729 shutdown_connections 2024-09-13T18:46:03.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 --2- 172.21.15.32:0/695128729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c1508e0 0x7fbe9c06cbf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 -- 172.21.15.32:0/695128729 >> 172.21.15.32:0/695128729 conn(0x7fbe9c0caae0 msgr2=0x7fbe9c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:03.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 -- 172.21.15.32:0/695128729 shutdown_connections 2024-09-13T18:46:03.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.524+0000 7fbe9be00700 1 -- 172.21.15.32:0/695128729 wait complete. 2024-09-13T18:46:03.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 Processor -- start 2024-09-13T18:46:03.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 -- start start 2024-09-13T18:46:03.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0c54c0 0x7fbe9c1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c0c58c0 0x7fbe9c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe9c1508e0 0x7fbe9c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c151360 con 0x7fbe9c1508e0 2024-09-13T18:46:03.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1f36d0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0c4550 con 0x7fbe9c0c58c0 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0c54c0 0x7fbe9c1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9b400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe9c1508e0 0x7fbe9c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0c54c0 0x7fbe9c1f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:35132/0 (socket says 172.21.15.32:35132) 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 -- 172.21.15.32:0/3719137374 learned_addr learned my addr 172.21.15.32:0/3719137374 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c0c58c0 0x7fbe9c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c0c58c0 msgr2=0x7fbe9c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe9c0c58c0 0x7fbe9c14c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe9c1508e0 msgr2=0x7fbe9c14cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe9c1508e0 0x7fbe9c14cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.528+0000 7fbe9aa00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0094b0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0c54c0 0x7fbe9c1f2bd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009ba0 tx=0x7fbe8c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0036c0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c01e070 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c003a60 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c0c4830 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c0c4b10 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.532+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fbe9c1599a0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe8c003bc0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe92a00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbe7c066730 0x7fbe7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fbe8c0858d0 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbe7c066730 0x7fbe7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v36) v1 ==== 54+0+16 (secure 0 0 0) 0x7fbe8c085c40 con 0x7fbe9c0c54c0 2024-09-13T18:46:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbe9c0c92e0 0x7fbe9c0c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c0c1110 con 0x7fbe9c0c92e0 2024-09-13T18:46:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbe7c066730 0x7fbe7c068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0c3750 tx=0x7fbe88007da0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.536+0000 7fbe9b400700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbe9c0c92e0 0x7fbe9c0c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.540+0000 7fbe9b400700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbe9c0c92e0 0x7fbe9c0c2510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.540+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe94002060 con 0x7fbe9c0c92e0 2024-09-13T18:46:03.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.560+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c0c0e30 con 0x7fbe9c0c92e0 2024-09-13T18:46:03.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.564+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe94007320 con 0x7fbe9c0c92e0 2024-09-13T18:46:03.568 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:03.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.564+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbe9c0c96c0 0x7fbe9c1ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.564+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c0c2230 con 0x7fbe9c0c96c0 2024-09-13T18:46:03.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.564+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbe9c0c96c0 0x7fbe9c1ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.568+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbe9c0c96c0 0x7fbe9c1ef3f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.568+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c0c2230 con 0x7fbe9c0c96c0 2024-09-13T18:46:03.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.584+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c06c8a0 con 0x7fbe9c0c96c0 2024-09-13T18:46:03.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.588+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c06c8a0 con 0x7fbe9c0c96c0 2024-09-13T18:46:03.594 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:03.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.588+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbe9c1efe40 0x7fbe9c060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.588+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c1f0240 con 0x7fbe9c1efe40 2024-09-13T18:46:03.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.592+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbe9c1efe40 0x7fbe9c060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.592+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbe9c1efe40 0x7fbe9c060db0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.592+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c1f0240 con 0x7fbe9c1efe40 2024-09-13T18:46:03.604 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:03.600+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:03.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.612+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c06e0a0 con 0x7fbe9c1efe40 2024-09-13T18:46:03.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.612+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c06e0a0 con 0x7fbe9c1efe40 2024-09-13T18:46:03.617 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:03.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.612+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbe9c061800 0x7fbe9c0aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.612+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c06e620 con 0x7fbe9c061800 2024-09-13T18:46:03.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.612+0000 7fbe9b400700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbe9c061800 0x7fbe9c0aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.616+0000 7fbe9b400700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbe9c061800 0x7fbe9c0aa7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.616+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c06e620 con 0x7fbe9c061800 2024-09-13T18:46:03.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.636+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c06e210 con 0x7fbe9c061800 2024-09-13T18:46:03.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.640+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c06e210 con 0x7fbe9c061800 2024-09-13T18:46:03.646 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:03.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.640+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbe9c0ab210 0x7fbe9c02b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.640+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c0ab670 con 0x7fbe9c0ab210 2024-09-13T18:46:03.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.644+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbe9c0ab210 0x7fbe9c02b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.644+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbe9c0ab210 0x7fbe9c02b6a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.644+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c0ab670 con 0x7fbe9c0ab210 2024-09-13T18:46:03.663 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:03.663 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:03.663 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:03.664 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:03.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.664+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c0ab670 con 0x7fbe9c0ab210 2024-09-13T18:46:03.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.668+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c0ab670 con 0x7fbe9c0ab210 2024-09-13T18:46:03.672 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:03.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.668+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbe9c02c0f0 0x7fbe9c02c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.668+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c14d3b0 con 0x7fbe9c02c0f0 2024-09-13T18:46:03.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.668+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbe9c02c0f0 0x7fbe9c02c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.668+0000 7fbe9a000700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbe9c02c0f0 0x7fbe9c02c530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.672+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c14d3b0 con 0x7fbe9c02c0f0 2024-09-13T18:46:03.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:03.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.692+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c14d3b0 con 0x7fbe9c02c0f0 2024-09-13T18:46:03.701 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.696+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c14d3b0 con 0x7fbe9c02c0f0 2024-09-13T18:46:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.696+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbe9c02ca70 0x7fbe9c208210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.696+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c14d520 con 0x7fbe9c02ca70 2024-09-13T18:46:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.696+0000 7fbe9b400700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbe9c02ca70 0x7fbe9c208210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.696+0000 7fbe9b400700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbe9c02ca70 0x7fbe9c208210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.700+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c14d520 con 0x7fbe9c02ca70 2024-09-13T18:46:03.705 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:03.700+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:03.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.716+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c14d520 con 0x7fbe9c02ca70 2024-09-13T18:46:03.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.720+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c14d520 con 0x7fbe9c02ca70 2024-09-13T18:46:03.725 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:03.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.720+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbe9c208c60 0x7fbe9c20b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.720+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe9c20ded0 con 0x7fbe9c208c60 2024-09-13T18:46:03.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.724+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbe9c208c60 0x7fbe9c20b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.724+0000 7fbe9aa00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbe9c208c60 0x7fbe9c20b050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.724+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbe9c20ded0 con 0x7fbe9c208c60 2024-09-13T18:46:03.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.748+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fbe9c20b590 con 0x7fbe9c208c60 2024-09-13T18:46:03.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe92a00700 1 -- 172.21.15.32:0/3719137374 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbe9c20b590 con 0x7fbe9c208c60 2024-09-13T18:46:03.757 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:03.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbe9c0c92e0 msgr2=0x7fbe9c0c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbe9c0c92e0 0x7fbe9c0c2510 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbe9c0c96c0 msgr2=0x7fbe9c1ef3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbe9c0c96c0 0x7fbe9c1ef3f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbe9c1efe40 msgr2=0x7fbe9c060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbe9c1efe40 0x7fbe9c060db0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbe9c061800 msgr2=0x7fbe9c0aa7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbe9c061800 0x7fbe9c0aa7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbe9c0ab210 msgr2=0x7fbe9c02b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9b400700 1 -- 172.21.15.32:0/3719137374 reap_dead start 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbe9c0ab210 0x7fbe9c02b6a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9b400700 1 -- 172.21.15.32:0/3719137374 reap_dead start 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbe9c02c0f0 msgr2=0x7fbe9c02c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbe9c02c0f0 0x7fbe9c02c530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbe9c02ca70 msgr2=0x7fbe9c208210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbe9c02ca70 0x7fbe9c208210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbe9c208c60 msgr2=0x7fbe9c20b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbe9c208c60 0x7fbe9c20b050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbe7c066730 msgr2=0x7fbe7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.752+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbe7c066730 0x7fbe7c068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0c3750 tx=0x7fbe88007da0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0c54c0 msgr2=0x7fbe9c1f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9be00700 1 --2- 172.21.15.32:0/3719137374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe9c0c54c0 0x7fbe9c1f2bd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009ba0 tx=0x7fbe8c004770 comp rx=0 tx=0).stop 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9b400700 1 -- 172.21.15.32:0/3719137374 reap_dead start 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 shutdown_connections 2024-09-13T18:46:03.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 >> 172.21.15.32:0/3719137374 conn(0x7fbe9c0caae0 msgr2=0x7fbe9c159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 shutdown_connections 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:03.756+0000 7fbe9be00700 1 -- 172.21.15.32:0/3719137374 wait complete. 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:03.761 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:03.762 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:03.827 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:03.824+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:03.871 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:03.872 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:03.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:03.931 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:03.928+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:04.008 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:04.004+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:04.106 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.781932341999998, 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:46:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:46:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.781908356000002, 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:46:04.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:46:04.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.781899449999997, 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:46:04.120 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:04.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:46:04.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:46:04.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.781896578000001, 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:46:04.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.781893869999998, 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:46:04.133 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:46:04.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:04.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:04.139 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.778766803000003, 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:46:04.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.777716116000001, 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:46:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:46:04.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:04.149 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.777361528999997, 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:46:04.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.777216371000002, 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:46:04.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:04.160 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.777118956999999, 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:46:04.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:46:04.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:46:04.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:46:04.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:04.165 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.777037843999999, 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:46:04.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.776787341999999, 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:46:04.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.775693066999999, 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:04.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:04.181 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:04.181 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.775612117999998, 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:04.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:46:04.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:46:04.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.773509464999997, 2024-09-13T18:46:04.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:04.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.275517776999997, 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:46:04.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(2.7 35/34 [PushReplyOp(2:e0b41d06:::609.00000000:head)])", 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.3108274780000002, 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229566, 2024-09-13T18:46:04.196 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791243+0000", 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791249+0000", 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6380000000000001e-06 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791257+0000", 2024-09-13T18:46:04.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8639999999999996e-06 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791264+0000", 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791309+0000", 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4860000000000001e-05 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791473+0000", 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164644 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.200 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:04.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:04.203 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:04.200+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:04.303 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:04.299+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:04.404 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:04.399+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:04.415 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:04.415 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:04.416 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:04.416 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:04.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:04.506 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:04.500+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:04.593 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:04.594 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:04.606 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:04.604+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:04.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:04.706 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:04.699+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:04.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:46:04.784 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7] out_osds: [3, 6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:04.784 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:04.785 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T18:46:04.785 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 1.000000 2024-09-13T18:46:04.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-13T18:46:04.831 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:04.828+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:04.836 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.064269648999996, 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.371878565000003, 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.371764772999995, 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.028214644000002, 2024-09-13T18:46:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.028210754, 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.027998874000005, 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.027989390000002, 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:04.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:04.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:04.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.027724517999999, 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:04.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:04.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:04.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.027527367999994, 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.894 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:04.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:04.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.027523123999998, 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.901 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:04.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:04.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:04.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.011467822, 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:04.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:04.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:04.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:04.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.127080430999996, 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:04.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126504850000003, 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.922 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:04.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:04.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.927 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126493461999999, 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:04.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:04.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126485864000003, 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.935 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126274447, 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:04.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:04.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126268672999998, 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.949 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126249631999997, 2024-09-13T18:46:04.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:04.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:04.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:04.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:04.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.962 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.126017466999997, 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.963 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:04.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:04.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.252900932000003, 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:04.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:04.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:04.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:04.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:04.976 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:04.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.956+0000 7fe2ae800700 1 Processor -- start 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ae800700 1 -- start start 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ae800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe2a806ea50 0x7fe2a815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ae800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe2a806fac0 0x7fe2a806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ae800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80c9440 con 0x7fe2a80c9e90 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ae800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a80c9a70 con 0x7fe2a806fac0 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ae800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a80c7aa0 con 0x7fe2a806ea50 2024-09-13T18:46:04.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ade00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe2a806fac0 0x7fe2a806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2aca00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe2a80c9e90 0x7fe2a80ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54406/0 (socket says 172.21.15.32:54406) 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2aca00700 1 -- 172.21.15.32:0/3975116308 learned_addr learned my addr 172.21.15.32:0/3975116308 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ad400700 1 --2- 172.21.15.32:0/3975116308 >> v2:172.21.15.86:3300/0 conn(0x7fe2a806ea50 0x7fe2a815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ade00700 1 -- 172.21.15.32:0/3975116308 >> v2:172.21.15.86:3300/0 conn(0x7fe2a806ea50 msgr2=0x7fe2a815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ade00700 1 --2- 172.21.15.32:0/3975116308 >> v2:172.21.15.86:3300/0 conn(0x7fe2a806ea50 0x7fe2a815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ade00700 1 -- 172.21.15.32:0/3975116308 >> v1:172.21.15.32:6789/0 conn(0x7fe2a80c9e90 legacy=0x7fe2a80ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ade00700 1 -- 172.21.15.32:0/3975116308 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a80c7d60 con 0x7fe2a806fac0 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2ade00700 1 --2- 172.21.15.32:0/3975116308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806fac0 0x7fe2a806ff70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80c7640 tx=0x7fe2a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45ae931479ed510 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2a7e00700 1 -- 172.21.15.32:0/3975116308 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000e070 con 0x7fe2a806fac0 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2a7e00700 1 -- 172.21.15.32:0/3975116308 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a000bb20 con 0x7fe2a806fac0 2024-09-13T18:46:04.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.960+0000 7fe2a7e00700 1 -- 172.21.15.32:0/3975116308 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0012430 con 0x7fe2a806fac0 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- 172.21.15.32:0/3975116308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806fac0 msgr2=0x7fe2a806ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 --2- 172.21.15.32:0/3975116308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806fac0 0x7fe2a806ff70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80c7640 tx=0x7fe2a000b330 comp rx=0 tx=0).stop 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- 172.21.15.32:0/3975116308 shutdown_connections 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 --2- 172.21.15.32:0/3975116308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806fac0 0x7fe2a806ff70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 --2- 172.21.15.32:0/3975116308 >> v2:172.21.15.86:3300/0 conn(0x7fe2a806ea50 0x7fe2a815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- 172.21.15.32:0/3975116308 >> 172.21.15.32:0/3975116308 conn(0x7fe2a80cac60 msgr2=0x7fe2a80cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- 172.21.15.32:0/3975116308 shutdown_connections 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- 172.21.15.32:0/3975116308 wait complete. 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 Processor -- start 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- start start 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 0x7fe2a81f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a806fac0 0x7fe2a8151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2a80c9e90 0x7fe2a80c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a815ae50 con 0x7fe2a806ea50 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a81eefc0 con 0x7fe2a806fac0 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.964+0000 7fe2ae800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a81f3430 con 0x7fe2a80c9e90 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 0x7fe2a81f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 0x7fe2a81f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42832/0 (socket says 172.21.15.32:42832) 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 -- 172.21.15.32:0/2866871573 learned_addr learned my addr 172.21.15.32:0/2866871573 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2aca00700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a806fac0 0x7fe2a8151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ade00700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2a80c9e90 0x7fe2a80c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 -- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2a80c9e90 msgr2=0x7fe2a80c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2a80c9e90 0x7fe2a80c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 -- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a806fac0 msgr2=0x7fe2a8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a806fac0 0x7fe2a8151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 -- 172.21.15.32:0/2866871573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a0009a70 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ad400700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 0x7fe2a81f2ef0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00e9d0 tx=0x7fe29c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c009720 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c00ee70 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00ca50 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a815a8d0 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a81ef1d0 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.968+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a815af90 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.972+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe29c00cbb0 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.972+0000 7fe2a5600700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe288066730 0x7fe288068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.972+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fe29c084810 con 0x7fe2a806ea50 2024-09-13T18:46:04.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.972+0000 7fe2aca00700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe288066730 0x7fe288068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.987 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:04.972+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:04.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.976+0000 7fe2aca00700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe288066730 0x7fe288068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80c9e00 tx=0x7fe294009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.976+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2a815af90 con 0x7fe2a806ea50 2024-09-13T18:46:05.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 Processor -- start 2024-09-13T18:46:05.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 -- start start 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3098072590 0x7f30980c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3098153450 0x7f30981538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3098153e00 con 0x7f30980721b0 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980716a0 con 0x7f3098072590 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:04.996+0000 7f3097e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309815db50 con 0x7f3098153450 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3098072590 0x7f30980c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f30980721b0 0x7f309815a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54412/0 (socket says 172.21.15.32:54412) 2024-09-13T18:46:05.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096a00700 1 -- 172.21.15.32:0/2333536056 learned_addr learned my addr 172.21.15.32:0/2333536056 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097400700 1 --2- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3098153450 0x7f30981538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3095600700 1 -- 172.21.15.32:0/2333536056 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191984099 0 0) 0x7f3098153e00 con 0x7f30980721b0 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3095600700 1 -- 172.21.15.32:0/2333536056 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c0035d0 con 0x7f30980721b0 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096000700 1 -- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3098153450 msgr2=0x7f30981538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096000700 1 --2- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3098153450 0x7f30981538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096000700 1 -- 172.21.15.32:0/2333536056 >> v1:172.21.15.32:6789/0 conn(0x7f30980721b0 legacy=0x7f309815a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096000700 1 -- 172.21.15.32:0/2333536056 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309815ccf0 con 0x7f3098072590 2024-09-13T18:46:05.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3096000700 1 --2- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098072590 0x7f30980c9ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3084009850 tx=0x7f3084009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1703f9192f9e6722 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3095600700 1 -- 172.21.15.32:0/2333536056 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011830 con 0x7f3098072590 2024-09-13T18:46:05.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3095600700 1 -- 172.21.15.32:0/2333536056 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3084011990 con 0x7f3098072590 2024-09-13T18:46:05.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3095600700 1 -- 172.21.15.32:0/2333536056 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011d00 con 0x7f3098072590 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 -- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098072590 msgr2=0x7f30980c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 --2- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098072590 0x7f30980c9ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3084009850 tx=0x7f3084009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 -- 172.21.15.32:0/2333536056 shutdown_connections 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 --2- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098072590 0x7f30980c9ac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 --2- 172.21.15.32:0/2333536056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3098153450 0x7f30981538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 -- 172.21.15.32:0/2333536056 >> 172.21.15.32:0/2333536056 conn(0x7f30980cbfe0 msgr2=0x7f30980cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.000+0000 7f3097e00700 1 -- 172.21.15.32:0/2333536056 shutdown_connections 2024-09-13T18:46:05.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.004+0000 7f3097e00700 1 -- 172.21.15.32:0/2333536056 wait complete. 2024-09-13T18:46:05.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.004+0000 7f3097e00700 1 Processor -- start 2024-09-13T18:46:05.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.004+0000 7f3097e00700 1 -- start start 2024-09-13T18:46:05.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30980721b0 0x7f30980c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 0x7f30981eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098153450 0x7f3098145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c79f0 con 0x7f3098072590 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309815c540 con 0x7f3098153450 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c8fa0 con 0x7f30980721b0 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 0x7f30981eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 0x7f30981eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42838/0 (socket says 172.21.15.32:42838) 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 -- 172.21.15.32:0/4158379725 learned_addr learned my addr 172.21.15.32:0/4158379725 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096a00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30980721b0 0x7f30980c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097400700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098153450 0x7f3098145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 -- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30980721b0 msgr2=0x7f30980c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30980721b0 0x7f30980c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 -- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098153450 msgr2=0x7f3098145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098153450 0x7f3098145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 -- 172.21.15.32:0/4158379725 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840094b0 con 0x7f3098072590 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3096000700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 0x7f30981eef30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f30840090b0 tx=0x7f3084004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840044d0 con 0x7f3098072590 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980c94d0 con 0x7f3098072590 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.008+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30980c91f0 con 0x7f3098072590 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.012+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308401f070 con 0x7f3098072590 2024-09-13T18:46:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.012+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840038c0 con 0x7f3098072590 2024-09-13T18:46:05.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.012+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3098067a00 con 0x7f3098072590 2024-09-13T18:46:05.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.012+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3084003a20 con 0x7f3098072590 2024-09-13T18:46:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.016+0000 7f308ea00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3078066730 0x7f3078068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.016+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f3084021070 con 0x7f3098072590 2024-09-13T18:46:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.016+0000 7f3096a00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3078066730 0x7f3078068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.016+0000 7f3096a00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3078066730 0x7f3078068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3088007fd0 tx=0x7f3088009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.020+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3084052cf0 con 0x7f3098072590 2024-09-13T18:46:05.079 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:05.075+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:05.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.172+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7fe2a815af90 con 0x7fe2a806ea50 2024-09-13T18:46:05.179 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:05.176+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:05.224 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:05.225 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:05.225 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:05.225 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:05.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:05.281 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:05.275+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:05.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.324+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 7, "weight": 1.0} v 0) v1 -- 0x7f30981538c0 con 0x7f3098072590 2024-09-13T18:46:05.382 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:05.376+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:05.483 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:05.475+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:05.507 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:05.508 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:05.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:05.619 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:05.616+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:05.685 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:05.680+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:05.739 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:05.739 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.412745674, 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:05.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:05.744 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.411439889999997, 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.410763840999998, 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:05.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.410751521000002, 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:05.754 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:05.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:05.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.410736765999999, 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:05.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.765 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.410731714000001, 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:05.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:05.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.410726414000003, 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:05.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.405000008000002, 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.775 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:05.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.4036781, 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:05.779 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:05.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:05.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.783 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.403639802000001, 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.787 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.399287053000002, 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:05.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:05.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:05.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.794303624000001, 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:05.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:05.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:40 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.791243440999999, 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030269200000000002, 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.799 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944418+0000", 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999905 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944437+0000", 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8647e-05 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944457+0000", 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0009000000000001e-05 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944466+0000", 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944547+0000", 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0204000000000007e-05 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944559+0000", 2024-09-13T18:46:05.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2662e-05 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944731+0000", 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171325 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.957865636999998, 2024-09-13T18:46:05.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:05.809 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.955176565000002, 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045409399999999999, 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780493+0000", 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780505+0000", 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1664e-05 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780533+0000", 2024-09-13T18:46:05.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8541999999999999e-05 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780594+0000", 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0430999999999998e-05 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780702+0000", 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108157 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780719+0000", 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7336000000000001e-05 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780949+0000", 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229798 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:05.813 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.714650796000001, 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:05.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.403448596, 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.819 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:05.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.403419400000001, 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:05.825 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:05.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:05.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.400246076999998, 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:05.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.329088856999999, 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:05.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:05.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:05.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:05.840 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:05.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:05.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.804+0000 7fe2a5600700 1 -- 172.21.15.32:0/2866871573 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v37) v1 ==== 91+0+0 (secure 0 0 0) 0x7fe2a815af90 con 0x7fe2a806ea50 2024-09-13T18:46:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.804+0000 7f308ea00700 1 -- 172.21.15.32:0/4158379725 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]=0 set osd.7 primary-affinity to 1 (8655362) v37) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3084015070 con 0x7f3098072590 2024-09-13T18:46:05.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe288066730 msgr2=0x7fe288068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe288066730 0x7fe288068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80c9e00 tx=0x7fe294009040 comp rx=0 tx=0).stop 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 msgr2=0x7fe2a81f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 0x7fe2a81f2ef0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00e9d0 tx=0x7fe29c00ece0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3078066730 msgr2=0x7f3078068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3078066730 0x7f3078068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3088007fd0 tx=0x7f3088009040 comp rx=0 tx=0).stop 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 msgr2=0x7f30981eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 0x7f30981eef30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f30840090b0 tx=0x7f3084004770 comp rx=0 tx=0).stop 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 shutdown_connections 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe288066730 0x7fe288068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2a80c9e90 0x7fe2a80c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2a806fac0 0x7fe2a8151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 --2- 172.21.15.32:0/2866871573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2a806ea50 0x7fe2a81f2ef0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 >> 172.21.15.32:0/2866871573 conn(0x7fe2a80cac60 msgr2=0x7fe2a806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 shutdown_connections 2024-09-13T18:46:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7fe2ae800700 1 -- 172.21.15.32:0/2866871573 wait complete. 2024-09-13T18:46:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 shutdown_connections 2024-09-13T18:46:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3078066730 0x7f3078068bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3098153450 0x7f3098145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3098072590 0x7f30981eef30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 --2- 172.21.15.32:0/4158379725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30980721b0 0x7f30980c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 >> 172.21.15.32:0/4158379725 conn(0x7f30980cbfe0 msgr2=0x7f309814be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 shutdown_connections 2024-09-13T18:46:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:05.808+0000 7f3097e00700 1 -- 172.21.15.32:0/4158379725 wait complete. 2024-09-13T18:46:05.847 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-13T18:46:05.848 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:46:05.849 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:05.840+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:05.943 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:05.940+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:06.044 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:06.040+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.044+0000 7fb1fb200700 1 Processor -- start 2024-09-13T18:46:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.044+0000 7fb1fb200700 1 -- start start 2024-09-13T18:46:06.050 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:06.050 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:06.051 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:06.051 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1fb200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc15d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1fb200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0c6ea0 con 0x7fb1fc070b50 2024-09-13T18:46:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1fb200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0c85d0 con 0x7fb1fc0b1320 2024-09-13T18:46:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1fb200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0c88b0 con 0x7fb1fc070770 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54442/0 (socket says 172.21.15.32:54442) 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 -- 172.21.15.32:0/3711304714 learned_addr learned my addr 172.21.15.32:0/3711304714 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9400700 1 --1- 172.21.15.32:0/3711304714 >> v1:172.21.15.32:6789/0 conn(0x7fb1fc070b50 0x7fb1fc0b0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54414/0 (socket says 172.21.15.32:54414) 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 -- 172.21.15.32:0/3711304714 >> v1:172.21.15.86:6789/0 conn(0x7fb1fc0b1320 legacy=0x7fb1fc164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 -- 172.21.15.32:0/3711304714 >> v1:172.21.15.32:6789/0 conn(0x7fb1fc070b50 legacy=0x7fb1fc0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 -- 172.21.15.32:0/3711304714 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0c8b90 con 0x7fb1fc070770 2024-09-13T18:46:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/3711304714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc15d120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009940 tx=0x7fb1ec009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea3d0c9cf337220 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.048+0000 7fb1f8a00700 1 -- 172.21.15.32:0/3711304714 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec00ba60 con 0x7fb1fc070770 2024-09-13T18:46:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1f8a00700 1 -- 172.21.15.32:0/3711304714 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec009e90 con 0x7fb1fc070770 2024-09-13T18:46:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1f8a00700 1 -- 172.21.15.32:0/3711304714 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec00bde0 con 0x7fb1fc070770 2024-09-13T18:46:06.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 -- 172.21.15.32:0/3711304714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 msgr2=0x7fb1fc15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 --2- 172.21.15.32:0/3711304714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc15d120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009940 tx=0x7fb1ec009c50 comp rx=0 tx=0).stop 2024-09-13T18:46:06.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 -- 172.21.15.32:0/3711304714 shutdown_connections 2024-09-13T18:46:06.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 --2- 172.21.15.32:0/3711304714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc15d120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 -- 172.21.15.32:0/3711304714 >> 172.21.15.32:0/3711304714 conn(0x7fb1fc072400 msgr2=0x7fb1fc06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:06.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 -- 172.21.15.32:0/3711304714 shutdown_connections 2024-09-13T18:46:06.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.052+0000 7fb1fb200700 1 -- 172.21.15.32:0/3711304714 wait complete. 2024-09-13T18:46:06.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 Processor -- start 2024-09-13T18:46:06.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 -- start start 2024-09-13T18:46:06.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 0x7fb1fc158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1fc0b1320 0x7fb1fc1f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc153160 con 0x7fb1fc0b1320 2024-09-13T18:46:06.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0c4ec0 con 0x7fb1fc070b50 2024-09-13T18:46:06.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1ef120 con 0x7fb1fc070770 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 0x7fb1fc158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fa800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1fc0b1320 0x7fb1fc1f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 0x7fb1fc158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:35168/0 (socket says 172.21.15.32:35168) 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54446/0 (socket says 172.21.15.32:54446) 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 -- 172.21.15.32:0/302952108 learned_addr learned my addr 172.21.15.32:0/302952108 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 msgr2=0x7fb1fc0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1fc070770 0x7fb1fc0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1fc0b1320 msgr2=0x7fb1fc1f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1fc0b1320 0x7fb1fc1f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec009570 con 0x7fb1fc070b50 2024-09-13T18:46:06.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 0x7fb1fc158600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c480 tx=0x7fb1e800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8005cd0 con 0x7fb1fc070b50 2024-09-13T18:46:06.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e800ce90 con 0x7fb1fc070b50 2024-09-13T18:46:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc0c5130 con 0x7fb1fc070b50 2024-09-13T18:46:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80072f0 con 0x7fb1fc070b50 2024-09-13T18:46:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.056+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc1f2870 con 0x7fb1fc070b50 2024-09-13T18:46:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.060+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fb1fc06f1f0 con 0x7fb1fc070b50 2024-09-13T18:46:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.060+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1e8007450 con 0x7fb1fc070b50 2024-09-13T18:46:06.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:06.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1f2000700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1dc066730 0x7fb1dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fb1e8083f40 con 0x7fb1fc070b50 2024-09-13T18:46:06.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v37) v1 ==== 54+0+16 (secure 0 0 0) 0x7fb1e80842b0 con 0x7fb1fc070b50 2024-09-13T18:46:06.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1dc066730 0x7fb1dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fb1fc1f32d0 0x7fb1fc1ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc067fa0 con 0x7fb1fc1f32d0 2024-09-13T18:46:06.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1fa800700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fb1fc1f32d0 0x7fb1fc1ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1dc066730 0x7fb1dc068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009890 tx=0x7fb1ec008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.064+0000 7fb1fa800700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fb1fc1f32d0 0x7fb1fc1ef4f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.068+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc067fa0 con 0x7fb1fc1f32d0 2024-09-13T18:46:06.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.088+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc0c5650 con 0x7fb1fc1f32d0 2024-09-13T18:46:06.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.092+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc0c5650 con 0x7fb1fc1f32d0 2024-09-13T18:46:06.098 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:06.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.092+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fb1fc0af480 0x7fb1fc0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.092+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc06f530 con 0x7fb1fc0af480 2024-09-13T18:46:06.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.096+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fb1fc0af480 0x7fb1fc0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.096+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fb1fc0af480 0x7fb1fc0af860 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.096+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc06f530 con 0x7fb1fc0af480 2024-09-13T18:46:06.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.116+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc06fb80 con 0x7fb1fc0af480 2024-09-13T18:46:06.125 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.120+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc06fb80 con 0x7fb1fc0af480 2024-09-13T18:46:06.125 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:06.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.120+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb1fc060db0 0x7fb1fc061190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.120+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc0b02b0 con 0x7fb1fc060db0 2024-09-13T18:46:06.126 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.120+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb1fc060db0 0x7fb1fc061190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.124+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb1fc060db0 0x7fb1fc061190 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.124+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc0b02b0 con 0x7fb1fc060db0 2024-09-13T18:46:06.145 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:06.140+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:06.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.152+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc158b40 con 0x7fb1fc060db0 2024-09-13T18:46:06.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.156+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc158b40 con 0x7fb1fc060db0 2024-09-13T18:46:06.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:06.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.156+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fb1fc157210 0x7fb1fc157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.156+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc0c62d0 con 0x7fb1fc157210 2024-09-13T18:46:06.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.156+0000 7fb1fa800700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fb1fc157210 0x7fb1fc157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.156+0000 7fb1fa800700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fb1fc157210 0x7fb1fc157610 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.160+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc0c62d0 con 0x7fb1fc157210 2024-09-13T18:46:06.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.188+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc158cb0 con 0x7fb1fc157210 2024-09-13T18:46:06.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.192+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc158cb0 con 0x7fb1fc157210 2024-09-13T18:46:06.195 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:06.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.192+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fb1fc02b6a0 0x7fb1fc02bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.192+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc1580e0 con 0x7fb1fc02b6a0 2024-09-13T18:46:06.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.192+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fb1fc02b6a0 0x7fb1fc02bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.192+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fb1fc02b6a0 0x7fb1fc02bac0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.192+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc1580e0 con 0x7fb1fc02b6a0 2024-09-13T18:46:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.212+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc1580e0 con 0x7fb1fc02b6a0 2024-09-13T18:46:06.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.216+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc1580e0 con 0x7fb1fc02b6a0 2024-09-13T18:46:06.220 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.216+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fb1fc02c510 0x7fb1fc205a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.216+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc154880 con 0x7fb1fc02c510 2024-09-13T18:46:06.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.216+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fb1fc02c510 0x7fb1fc205a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.216+0000 7fb1f9400700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fb1fc02c510 0x7fb1fc205a60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.220+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc154880 con 0x7fb1fc02c510 2024-09-13T18:46:06.228 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:06.228 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:06.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.236+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc154880 con 0x7fb1fc02c510 2024-09-13T18:46:06.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.240+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc154880 con 0x7fb1fc02c510 2024-09-13T18:46:06.245 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:06.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.240+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fb1fc205fa0 0x7fb1fc208390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.240+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc20b210 con 0x7fb1fc205fa0 2024-09-13T18:46:06.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:06.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.240+0000 7fb1fa800700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fb1fc205fa0 0x7fb1fc208390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.244+0000 7fb1fa800700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fb1fc205fa0 0x7fb1fc208390 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.248 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:06.244+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:06.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.244+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc20b210 con 0x7fb1fc205fa0 2024-09-13T18:46:06.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.264+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc2088d0 con 0x7fb1fc205fa0 2024-09-13T18:46:06.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.268+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc2088d0 con 0x7fb1fc205fa0 2024-09-13T18:46:06.274 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:06.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.268+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fb1fc208f50 0x7fb1fc20b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.268+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1fc20e370 con 0x7fb1fc208f50 2024-09-13T18:46:06.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.272+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fb1fc208f50 0x7fb1fc20b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.272+0000 7fb1f9e00700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fb1fc208f50 0x7fb1fc20b340 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.272+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb1fc20e370 con 0x7fb1fc208f50 2024-09-13T18:46:06.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.292+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fb1fc20e370 con 0x7fb1fc208f50 2024-09-13T18:46:06.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1f2000700 1 -- 172.21.15.32:0/302952108 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fb1fc20e370 con 0x7fb1fc208f50 2024-09-13T18:46:06.301 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fb1fc1f32d0 msgr2=0x7fb1fc1ef4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fb1fc1f32d0 0x7fb1fc1ef4f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fb1fc0af480 msgr2=0x7fb1fc0af860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fb1fc0af480 0x7fb1fc0af860 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb1fc060db0 msgr2=0x7fb1fc061190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb1fc060db0 0x7fb1fc061190 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fb1fc157210 msgr2=0x7fb1fc157610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fb1fc157210 0x7fb1fc157610 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fb1fc02b6a0 msgr2=0x7fb1fc02bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fb1fc02b6a0 0x7fb1fc02bac0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fb1fc02c510 msgr2=0x7fb1fc205a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fb1fc02c510 0x7fb1fc205a60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fb1fc205fa0 msgr2=0x7fb1fc208390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fb1fc205fa0 0x7fb1fc208390 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fb1fc208f50 msgr2=0x7fb1fc20b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fb1fc208f50 0x7fb1fc20b340 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fa800700 1 -- 172.21.15.32:0/302952108 reap_dead start 2024-09-13T18:46:06.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fa800700 1 -- 172.21.15.32:0/302952108 reap_dead start 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fa800700 1 -- 172.21.15.32:0/302952108 reap_dead start 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fa800700 1 -- 172.21.15.32:0/302952108 reap_dead start 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fa800700 1 -- 172.21.15.32:0/302952108 reap_dead start 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1dc066730 msgr2=0x7fb1dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1dc066730 0x7fb1dc068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009890 tx=0x7fb1ec008030 comp rx=0 tx=0).stop 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 msgr2=0x7fb1fc158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 0x7fb1fc158600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c480 tx=0x7fb1e800c790 comp rx=0 tx=0).stop 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 shutdown_connections 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1dc066730 0x7fb1dc068bf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 --2- 172.21.15.32:0/302952108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1fc070b50 0x7fb1fc158600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 >> 172.21.15.32:0/302952108 conn(0x7fb1fc072400 msgr2=0x7fb1fc0ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.296+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 shutdown_connections 2024-09-13T18:46:06.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:06.300+0000 7fb1fb200700 1 -- 172.21.15.32:0/302952108 wait complete. 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:06.305 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:06.366 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:06.364+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:06.449 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:06.450 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:06.450 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:06.443+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:06.470 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:06.551 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:06.548+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:06.593 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:06.593 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:06.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:06.652 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:06.647+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:06.710 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:06.710 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:06.721 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:06.753 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:06.748+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:06.830 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:06.830 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:06.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:06.853 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:06.847+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:06.946 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:06.954 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:06.948+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:06.956 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:07.054 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:07.052+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:07.060 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.060 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:07.156 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:07.152+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:07.177 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.177 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.186 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:07.257 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:07.251+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:07.295 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.295 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:07.358 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:07.351+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:07.415 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.415 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:07.459 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:07.456+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:07.525 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.525 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:07.560 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:07.555+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:07.642 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.642 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:07.661 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:07.656+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:07.762 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:07.760+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:07.805 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.805 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.815 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:07.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:46:07.899 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:07.896+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:07.918 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:07.918 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:07.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:07.978 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:07.976+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:08.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.016+0000 7f6063200700 1 Processor -- start 2024-09-13T18:46:08.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.016+0000 7f6063200700 1 -- start start 2024-09-13T18:46:08.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6063200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60640724c0 0x7f606406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6063200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60641599b0 con 0x7f606415a240 2024-09-13T18:46:08.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6063200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60640728a0 con 0x7f6064159e40 2024-09-13T18:46:08.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6063200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60640c9090 con 0x7f60640724c0 2024-09-13T18:46:08.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6061400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6064159e40 0x7f60640c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:33284/0 (socket says 172.21.15.32:33284) 2024-09-13T18:46:08.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6061400700 1 -- 172.21.15.32:0/4028539739 learned_addr learned my addr 172.21.15.32:0/4028539739 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:08.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6061e00700 1 --2- 172.21.15.32:0/4028539739 >> v2:172.21.15.32:3300/0 conn(0x7f60640724c0 0x7f606406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940845982 0 0) 0x7f60640728a0 con 0x7f6064159e40 2024-09-13T18:46:08.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60480035d0 con 0x7f6064159e40 2024-09-13T18:46:08.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048189535 0 0) 0x7f60641599b0 con 0x7f606415a240 2024-09-13T18:46:08.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60640728a0 con 0x7f606415a240 2024-09-13T18:46:08.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6061e00700 1 -- 172.21.15.32:0/4028539739 >> v1:172.21.15.86:6789/0 conn(0x7f6064159e40 legacy=0x7f60640c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6061e00700 1 -- 172.21.15.32:0/4028539739 >> v1:172.21.15.32:6789/0 conn(0x7f606415a240 legacy=0x7f6064163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.020+0000 7f6061e00700 1 -- 172.21.15.32:0/4028539739 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606415a690 con 0x7f60640724c0 2024-09-13T18:46:08.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6061e00700 1 --2- 172.21.15.32:0/4028539739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60640724c0 0x7f606406fc10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6054009850 tx=0x7f6054009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5170055d5d21bfa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054011830 con 0x7f60640724c0 2024-09-13T18:46:08.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054011990 con 0x7f60640724c0 2024-09-13T18:46:08.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6060a00700 1 -- 172.21.15.32:0/4028539739 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054011d40 con 0x7f60640724c0 2024-09-13T18:46:08.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 -- 172.21.15.32:0/4028539739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60640724c0 msgr2=0x7f606406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 --2- 172.21.15.32:0/4028539739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60640724c0 0x7f606406fc10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6054009850 tx=0x7f6054009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:08.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 -- 172.21.15.32:0/4028539739 shutdown_connections 2024-09-13T18:46:08.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 --2- 172.21.15.32:0/4028539739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60640724c0 0x7f606406fc10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 -- 172.21.15.32:0/4028539739 >> 172.21.15.32:0/4028539739 conn(0x7f60640cac60 msgr2=0x7f60640cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 -- 172.21.15.32:0/4028539739 shutdown_connections 2024-09-13T18:46:08.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.024+0000 7f6063200700 1 -- 172.21.15.32:0/4028539739 wait complete. 2024-09-13T18:46:08.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 Processor -- start 2024-09-13T18:46:08.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 -- start start 2024-09-13T18:46:08.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 0x7f60641f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6064159e40 0x7f6064158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f606415a240 0x7f60640ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606415c670 con 0x7f6064159e40 2024-09-13T18:46:08.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60641ef1f0 con 0x7f606415a240 2024-09-13T18:46:08.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6063200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60641ef3e0 con 0x7f60640724c0 2024-09-13T18:46:08.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6064159e40 0x7f6064158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 0x7f60641f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 0x7f60641f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54456/0 (socket says 172.21.15.32:54456) 2024-09-13T18:46:08.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061e00700 1 -- 172.21.15.32:0/2519755975 learned_addr learned my addr 172.21.15.32:0/2519755975 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:08.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6062800700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f606415a240 0x7f60640ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061400700 1 -- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 msgr2=0x7f60641f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061400700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 0x7f60641f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061400700 1 -- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f606415a240 msgr2=0x7f60640ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061400700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f606415a240 0x7f60640ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061400700 1 -- 172.21.15.32:0/2519755975 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540094b0 con 0x7f6064159e40 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.028+0000 7f6061e00700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 0x7f60641f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f6061400700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6064159e40 0x7f6064158bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f605000c4d0 tx=0x7f605000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000cea0 con 0x7f6064159e40 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050005d90 con 0x7f6064159e40 2024-09-13T18:46:08.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500072d0 con 0x7f6064159e40 2024-09-13T18:46:08.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60641ef6c0 con 0x7f6064159e40 2024-09-13T18:46:08.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60641efc80 con 0x7f6064159e40 2024-09-13T18:46:08.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606415d940 con 0x7f6064159e40 2024-09-13T18:46:08.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.032+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6050007430 con 0x7f6064159e40 2024-09-13T18:46:08.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.036+0000 7f605a000700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6044066730 0x7f6044068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.036+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f6050083850 con 0x7f6064159e40 2024-09-13T18:46:08.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.036+0000 7f6061e00700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6044066730 0x7f6044068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.036+0000 7f6061e00700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6044066730 0x7f6044068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6054009ba0 tx=0x7f6054008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.040+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60500507f0 con 0x7f6064159e40 2024-09-13T18:46:08.065 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:08.060+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:08.123 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:08.123 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:08.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:08.183 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:08.180+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:08.267 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:08.264+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:08.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.268+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7f60640c8c60 con 0x7f6064159e40 2024-09-13T18:46:08.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:08.337 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:08.337 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:08.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:08.399 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:08.396+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:08.469 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:08.467+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:08.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.476+0000 7fa72f400700 1 Processor -- start 2024-09-13T18:46:08.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72f400700 1 -- start start 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa7281570f0 0x7fa7280c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280ad930 0x7fa7280a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72f400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72806afd0 con 0x7fa7280aa750 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72f400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7280c7180 con 0x7fa7281570f0 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72f400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72815a450 con 0x7fa7280ad930 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa7281570f0 0x7fa7280c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa7281570f0 0x7fa7280c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42874/0 (socket says 172.21.15.32:42874) 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 -- 172.21.15.32:0/1972403192 learned_addr learned my addr 172.21.15.32:0/1972403192 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa727e00700 1 --2- 172.21.15.32:0/1972403192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280ad930 0x7fa7280a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 -- 172.21.15.32:0/1972403192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280ad930 msgr2=0x7fa7280a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 --2- 172.21.15.32:0/1972403192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280ad930 0x7fa7280a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 -- 172.21.15.32:0/1972403192 >> v1:172.21.15.32:6789/0 conn(0x7fa7280aa750 legacy=0x7fa7280a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 -- 172.21.15.32:0/1972403192 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280c8da0 con 0x7fa7281570f0 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa72ca00700 1 --2- 172.21.15.32:0/1972403192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7281570f0 0x7fa7280c9b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009e50 tx=0x7fa71c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3651ad9aff733ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa727400700 1 -- 172.21.15.32:0/1972403192 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00e070 con 0x7fa7281570f0 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa727400700 1 -- 172.21.15.32:0/1972403192 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c003a40 con 0x7fa7281570f0 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.480+0000 7fa727400700 1 -- 172.21.15.32:0/1972403192 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c003df0 con 0x7fa7281570f0 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 -- 172.21.15.32:0/1972403192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7281570f0 msgr2=0x7fa7280c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 --2- 172.21.15.32:0/1972403192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7281570f0 0x7fa7280c9b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009e50 tx=0x7fa71c00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 -- 172.21.15.32:0/1972403192 shutdown_connections 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 --2- 172.21.15.32:0/1972403192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280ad930 0x7fa7280a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 --2- 172.21.15.32:0/1972403192 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7281570f0 0x7fa7280c9b60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 -- 172.21.15.32:0/1972403192 >> 172.21.15.32:0/1972403192 conn(0x7fa7280accb0 msgr2=0x7fa7280ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 -- 172.21.15.32:0/1972403192 shutdown_connections 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 -- 172.21.15.32:0/1972403192 wait complete. 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 Processor -- start 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.484+0000 7fa72f400700 1 -- start start 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280aa750 0x7fa7281e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 0x7fa7281f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7281570f0 0x7fa7281e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa728072980 con 0x7fa7280ad930 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280721b0 con 0x7fa7281570f0 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7281e0a30 con 0x7fa7280aa750 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 0x7fa7281f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72ca00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280aa750 0x7fa7281e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 0x7fa7281f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:42880/0 (socket says 172.21.15.32:42880) 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 -- 172.21.15.32:0/3937666318 learned_addr learned my addr 172.21.15.32:0/3937666318 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7281570f0 0x7fa7281e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280aa750 msgr2=0x7fa7281e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa7280aa750 0x7fa7281e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7281570f0 msgr2=0x7fa7281e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7281570f0 0x7fa7281e0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c009b30 con 0x7fa7280ad930 2024-09-13T18:46:08.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 0x7fa7281f29d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e790 tx=0x7fa71400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400c070 con 0x7fa7280ad930 2024-09-13T18:46:08.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa714013610 con 0x7fa7280ad930 2024-09-13T18:46:08.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7280c61e0 con 0x7fa7280ad930 2024-09-13T18:46:08.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714013980 con 0x7fa7280ad930 2024-09-13T18:46:08.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.488+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7280723c0 con 0x7fa7280ad930 2024-09-13T18:46:08.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.492+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fa7281e0bc0 con 0x7fa7280ad930 2024-09-13T18:46:08.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.492+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa714013ae0 con 0x7fa7280ad930 2024-09-13T18:46:08.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.492+0000 7fa724c00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa708066760 0x7fa708068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.492+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fa7140847c0 con 0x7fa7280ad930 2024-09-13T18:46:08.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.492+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa708066760 0x7fa708068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v37) v1 ==== 54+0+16 (secure 0 0 0) 0x7fa714084c10 con 0x7fa7280ad930 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa728150d90 0x7fa72814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7280c9360 con 0x7fa728150d90 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa728150d90 0x7fa72814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa708066760 0x7fa708068c20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa71c015040 tx=0x7fa71c009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa728150d90 0x7fa72814f6e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.496+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa7200014e0 con 0x7fa728150d90 2024-09-13T18:46:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.520+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa7280ca0a0 con 0x7fa728150d90 2024-09-13T18:46:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.524+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa720001930 con 0x7fa728150d90 2024-09-13T18:46:08.527 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.524+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa7281599b0 0x7fa728150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.524+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7281574d0 con 0x7fa7281599b0 2024-09-13T18:46:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.524+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa7281599b0 0x7fa728150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.524+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa7281599b0 0x7fa728150130 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.528+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa7281574d0 con 0x7fa7281599b0 2024-09-13T18:46:08.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.548+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa728072760 con 0x7fa7281599b0 2024-09-13T18:46:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.552+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa728072760 con 0x7fa7281599b0 2024-09-13T18:46:08.557 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.552+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa7281ef700 0x7fa7281efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.552+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7280ca920 con 0x7fa7281ef700 2024-09-13T18:46:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.552+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa7281ef700 0x7fa7281efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.552+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa7281ef700 0x7fa7281efae0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.556+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa7280ca920 con 0x7fa7281ef700 2024-09-13T18:46:08.570 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:08.567+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:08.572 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.248155083, 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:46:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:46:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.248131096999998, 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:46:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.248122191, 2024-09-13T18:46:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:46:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.248119318999997, 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:46:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.248116611, 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:46:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:46:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.244989543999999, 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:46:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:46:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.243938857000003, 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:46:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:46:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.243584269999999, 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:46:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:46:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.243439111999997, 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:46:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:46:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.243341698000002, 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:46:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.243260585000002, 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:46:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.243010083000001, 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.241915808000002, 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:46:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.241834859000001, 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:46:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.239732205999999, 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.741740518, 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:46:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:46:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(2.7 35/34 [PushReplyOp(2:e0b41d06:::609.00000000:head)])", 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.7770502190000004, 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229566, 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791243+0000", 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791249+0000", 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6380000000000001e-06 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791257+0000", 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8639999999999996e-06 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791264+0000", 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-13T18:46:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791309+0000", 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4860000000000001e-05 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791473+0000", 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164644 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:08.655 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:08.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.572+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa7280aa530 con 0x7fa7281ef700 2024-09-13T18:46:08.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.576+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa7280aa530 con 0x7fa7281ef700 2024-09-13T18:46:08.657 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:08.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.576+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa728061670 0x7fa72802b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.576+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7280ac510 con 0x7fa728061670 2024-09-13T18:46:08.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.576+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa728061670 0x7fa72802b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.580+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa728061670 0x7fa72802b6a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.580+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa7280ac510 con 0x7fa728061670 2024-09-13T18:46:08.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:08.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.596+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa728061cf0 con 0x7fa728061670 2024-09-13T18:46:08.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.600+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa728061cf0 con 0x7fa728061670 2024-09-13T18:46:08.660 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.600+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa72802c260 0x7fa72802c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.600+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa72802cba0 con 0x7fa72802c260 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.600+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa72802c260 0x7fa72802c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.600+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa72802c260 0x7fa72802c660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.604+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa72802cba0 con 0x7fa72802c260 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.624+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa72802cba0 con 0x7fa72802c260 2024-09-13T18:46:08.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.628+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa72802cba0 con 0x7fa72802c260 2024-09-13T18:46:08.662 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:08.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.628+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa7280ab260 0x7fa7280ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.628+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7280abba0 con 0x7fa7280ab260 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.628+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa7280ab260 0x7fa7280ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.632+0000 7fa727e00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa7280ab260 0x7fa7280ab660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.632+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa7280abba0 con 0x7fa7280ab260 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.648+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa7280abba0 con 0x7fa7280ab260 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.652+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa7280abba0 con 0x7fa7280ab260 2024-09-13T18:46:08.663 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:08.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.652+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa728205d70 0x7fa728208160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.652+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa72820afe0 con 0x7fa728205d70 2024-09-13T18:46:08.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.652+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa728205d70 0x7fa728208160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.656+0000 7fa72d400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa728205d70 0x7fa728208160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.656+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa72820afe0 con 0x7fa728205d70 2024-09-13T18:46:08.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.676+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa7282086a0 con 0x7fa728205d70 2024-09-13T18:46:08.679 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:08.676+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:08.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.680+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa7282086a0 con 0x7fa728205d70 2024-09-13T18:46:08.684 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:08.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.680+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa728208d20 0x7fa72820b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.680+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa72820e1e0 con 0x7fa728208d20 2024-09-13T18:46:08.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.680+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa728208d20 0x7fa72820b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.680+0000 7fa72ca00700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa728208d20 0x7fa72820b110 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.684+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa72820e1e0 con 0x7fa728208d20 2024-09-13T18:46:08.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.708+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa72820e1e0 con 0x7fa728208d20 2024-09-13T18:46:08.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.712+0000 7fa724c00700 1 -- 172.21.15.32:0/3937666318 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa72820e1e0 con 0x7fa728208d20 2024-09-13T18:46:08.718 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:08.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa728150d90 msgr2=0x7fa72814f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa728150d90 0x7fa72814f6e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa7281599b0 msgr2=0x7fa728150130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa7281599b0 0x7fa728150130 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa7281ef700 msgr2=0x7fa7281efae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa7281ef700 0x7fa7281efae0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa728061670 msgr2=0x7fa72802b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa728061670 0x7fa72802b6a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa72802c260 msgr2=0x7fa72802c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa72802c260 0x7fa72802c660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa7280ab260 msgr2=0x7fa7280ab660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa7280ab260 0x7fa7280ab660 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72d400700 1 -- 172.21.15.32:0/3937666318 reap_dead start 2024-09-13T18:46:08.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72d400700 1 -- 172.21.15.32:0/3937666318 reap_dead start 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa728205d70 msgr2=0x7fa728208160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa728205d70 0x7fa728208160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa728208d20 msgr2=0x7fa72820b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa728208d20 0x7fa72820b110 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72d400700 1 -- 172.21.15.32:0/3937666318 reap_dead start 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa708066760 msgr2=0x7fa708068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa708066760 0x7fa708068c20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa71c015040 tx=0x7fa71c009000 comp rx=0 tx=0).stop 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 msgr2=0x7fa7281f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 0x7fa7281f29d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e790 tx=0x7fa71400eaa0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 shutdown_connections 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa708066760 0x7fa708068c20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 --2- 172.21.15.32:0/3937666318 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7280ad930 0x7fa7281f29d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 >> 172.21.15.32:0/3937666318 conn(0x7fa7280accb0 msgr2=0x7fa7280c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 shutdown_connections 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.716+0000 7fa72f400700 1 -- 172.21.15.32:0/3937666318 wait complete. 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:08.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:08.723 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:08.772 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:08.771+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:08.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.808+0000 7f605a000700 1 -- 172.21.15.32:0/2519755975 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v38) v1 ==== 101+0+0 (secure 0 0 0) 0x7f6050053e10 con 0x7f6064159e40 2024-09-13T18:46:08.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6044066730 msgr2=0x7f6044068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6044066730 0x7f6044068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6054009ba0 tx=0x7f6054008030 comp rx=0 tx=0).stop 2024-09-13T18:46:08.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6064159e40 msgr2=0x7f6064158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6064159e40 0x7f6064158bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f605000c4d0 tx=0x7f605000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 shutdown_connections 2024-09-13T18:46:08.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6044066730 0x7f6044068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f606415a240 0x7f60640ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6064159e40 0x7f6064158bc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 --2- 172.21.15.32:0/2519755975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60640724c0 0x7f60641f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 >> 172.21.15.32:0/2519755975 conn(0x7f60640cac60 msgr2=0x7f60640bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 shutdown_connections 2024-09-13T18:46:08.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:08.812+0000 7f6063200700 1 -- 172.21.15.32:0/2519755975 wait complete. 2024-09-13T18:46:08.817 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:08.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:08.873 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:08.871+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:08.974 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:08.971+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:09.075 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:09.072+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:09.081 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:09.081 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:09.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:09.176 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:09.175+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:09.277 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:09.272+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:09.305 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:09.305 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.532572931999994, 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:09.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.312 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.840181848, 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.313 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:09.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:09.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.840068056000007, 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:09.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.324 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.496517926999999, 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:09.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:09.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.496514036999997, 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:09.330 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:09.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.496302157000002, 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:09.336 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:09.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.496292672999999, 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.342 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:09.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:09.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.496027800999997, 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.348 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:09.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:09.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.353 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.495830651000006, 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.354 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.359 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.495826406999996, 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:09.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:09.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.365 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 76.479771104999998, 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:09.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:09.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.595383713999993, 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.372 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:09.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:09.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594808133000001, 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:09.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:09.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594796744999996, 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:09.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:09.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.392 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594789147, 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:09.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:09.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:09.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594577729999997, 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:09.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:09.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594571955999996, 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:09.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594552914999994, 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:09.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.594320749999994, 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:09.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.721204215, 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:09.429 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:09.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:09.432 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:09.428+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:09.531 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:09.528+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:09.632 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:09.631+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:09.640 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:09.641 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:09.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:09.733 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:09.731+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:09.834 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:09.832+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:09.872 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:09.872 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:09.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:09.936 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:09.935+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:10.037 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:10.032+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:10.106 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:10.106 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:10.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:10.106 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:10.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.777868366, 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:10.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:10.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.776562581999997, 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:10.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:10.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.775886532999998, 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:10.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.775874213000002, 2024-09-13T18:46:10.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:10.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:10.125 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.775859457999999, 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:10.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.131 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.775854406000001, 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:10.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:10.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:10.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.775849106000003, 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:10.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:10.141 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.770122700000002, 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:10.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:10.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:10.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.768800792, 2024-09-13T18:46:10.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:10.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:10.150 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.768762494000001, 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:10.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.764409745000002, 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:10.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.159426316000001, 2024-09-13T18:46:10.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:10.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:10.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:10.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:40 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.156366132999999, 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030269200000000002, 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944418+0000", 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999905 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944437+0000", 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8647e-05 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944457+0000", 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0009000000000001e-05 2024-09-13T18:46:10.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944466+0000", 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944547+0000", 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0204000000000007e-05 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944559+0000", 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2662e-05 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944731+0000", 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171325 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.322988328999998, 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:10.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:10.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.320299257000002, 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045409399999999999, 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.176 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780493+0000", 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780505+0000", 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1664e-05 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780533+0000", 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8541999999999999e-05 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780594+0000", 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0430999999999998e-05 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780702+0000", 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108157 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780719+0000", 2024-09-13T18:46:10.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7336000000000001e-05 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780949+0000", 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229798 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:10.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.079773488000001, 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:10.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:10.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:10.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.186 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.768571288, 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:10.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:10.192 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.768542092000001, 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:10.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:10.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:10.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:10.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.765368768999998, 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:10.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:10.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.694211548999998, 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.203 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.209 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:10.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:10.211 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:10.208+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:10.312 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:10.311+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:10.413 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:10.408+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:10.427 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:10.428 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:10.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:10.514 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:10.511+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:10.614 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:10.612+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:10.649 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:10.649 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:10.650 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:10.650 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:10.650 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:10.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:10.716 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:10.715+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:10.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:10.816 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:10.815+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:10.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:46:10.849 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7] out_osds: [3, 6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:10.849 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:10.849 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-13T18:46:10.850 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T18:46:10.850 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T18:46:10.850 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-13T18:46:10.896 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.570213061999993, 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:10.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:10.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:10.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:10.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.570193141000004, 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:10.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:10.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:10.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:10.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.570180715000006, 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:10.911 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:10.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.570172991999996, 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:10.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.922 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.570132807999997, 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:10.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.566152926000001, 2024-09-13T18:46:10.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:10.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.564788379000007, 2024-09-13T18:46:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:10.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:10.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.564750949, 2024-09-13T18:46:10.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:10.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.941 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.564286569000004, 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:10.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.563855204000006, 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:10.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.563246789000004, 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.951 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:10.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:10.955 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.562852371000005, 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:10.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:10.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.960 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.562798350999998, 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:10.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.561313638000001, 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:10.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:10.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:10.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:10.970 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:10.971 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:10.971 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T18:46:10.971 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:10.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:10.977 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:10.971+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 Processor -- start 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 -- start start 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4adc0c56e0 0x7f4adc0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4adc15b240 0x7f4adc06db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0c7820 con 0x7f4adc06d6c0 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc074360 con 0x7f4adc0c56e0 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.936+0000 7f4adb200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0c6000 con 0x7f4adc15b240 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4adc06d6c0 0x7f4adc15ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40402/0 (socket says 172.21.15.32:40402) 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9400700 1 -- 172.21.15.32:0/134276506 learned_addr learned my addr 172.21.15.32:0/134276506 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:10.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/134276506 >> v2:172.21.15.32:3300/0 conn(0x7f4adc0c56e0 0x7f4adc0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ada800700 1 --2- 172.21.15.32:0/134276506 >> v2:172.21.15.86:3300/0 conn(0x7f4adc15b240 0x7f4adc06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9e00700 1 -- 172.21.15.32:0/134276506 >> v2:172.21.15.86:3300/0 conn(0x7f4adc15b240 msgr2=0x7f4adc06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/134276506 >> v2:172.21.15.86:3300/0 conn(0x7f4adc15b240 0x7f4adc06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9e00700 1 -- 172.21.15.32:0/134276506 >> v1:172.21.15.32:6789/0 conn(0x7f4adc06d6c0 legacy=0x7f4adc15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9e00700 1 -- 172.21.15.32:0/134276506 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0c7b00 con 0x7f4adc0c56e0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad8a00700 1 -- 172.21.15.32:0/134276506 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741271950 0 0) 0x7f4adc0c7820 con 0x7f4adc06d6c0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/134276506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc0c5ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0c6660 tx=0x7f4acc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fd46ddac7c7a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad8a00700 1 -- 172.21.15.32:0/134276506 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc011830 con 0x7f4adc0c56e0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad8a00700 1 -- 172.21.15.32:0/134276506 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc011990 con 0x7f4adc0c56e0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4ad8a00700 1 -- 172.21.15.32:0/134276506 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc011d40 con 0x7f4adc0c56e0 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 -- 172.21.15.32:0/134276506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 msgr2=0x7f4adc0c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 --2- 172.21.15.32:0/134276506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc0c5ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0c6660 tx=0x7f4acc009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 -- 172.21.15.32:0/134276506 shutdown_connections 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 --2- 172.21.15.32:0/134276506 >> v2:172.21.15.86:3300/0 conn(0x7f4adc15b240 0x7f4adc06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 --2- 172.21.15.32:0/134276506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc0c5ac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 -- 172.21.15.32:0/134276506 >> 172.21.15.32:0/134276506 conn(0x7f4adc072400 msgr2=0x7f4adc06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 -- 172.21.15.32:0/134276506 shutdown_connections 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.940+0000 7f4adb200700 1 -- 172.21.15.32:0/134276506 wait complete. 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 Processor -- start 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 -- start start 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4adc06d6c0 0x7f4adc1f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc1f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4adc15b240 0x7f4adc1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc1f4710 con 0x7f4adc0c56e0 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc14bdc0 con 0x7f4adc06d6c0 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4adb200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc159db0 con 0x7f4adc15b240 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc1f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4adc06d6c0 0x7f4adc1f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc1f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40856/0 (socket says 172.21.15.32:40856) 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 -- 172.21.15.32:0/1768985351 learned_addr learned my addr 172.21.15.32:0/1768985351 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4adc15b240 0x7f4adc1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4adc15b240 msgr2=0x7f4adc1f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4adc15b240 0x7f4adc1f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4adc06d6c0 msgr2=0x7f4adc1f7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4adc06d6c0 0x7f4adc1f7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0094b0 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.944+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc1f4c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c510 tx=0x7f4ac800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8004ca0 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8004e20 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8007310 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc15a050 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc15a5b0 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f4adc0c74c0 con 0x7f4adc0c56e0 2024-09-13T18:46:10.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.948+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ac8007470 con 0x7f4adc0c56e0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ad2000700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4abc066730 0x7f4abc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f4ac80840c0 con 0x7f4adc0c56e0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4abc066730 0x7f4abc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v38) v1 ==== 54+0+16 (secure 0 0 0) 0x7f4ac808b070 con 0x7f4adc0c56e0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f4adc14f920 0x7f4adc1f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc073ca0 con 0x7f4adc14f920 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f4adc14f920 0x7f4adc1f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4abc066730 0x7f4abc068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0090b0 tx=0x7f4acc01c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f4adc14f920 0x7f4adc1f6d40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.952+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4ad4009cb0 con 0x7f4adc14f920 2024-09-13T18:46:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.972+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc151ce0 con 0x7f4adc14f920 2024-09-13T18:46:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.976+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4ad40073f0 con 0x7f4adc14f920 2024-09-13T18:46:10.985 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.976+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f4adc14fd00 0x7f4adc0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.976+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc0c0290 con 0x7f4adc14fd00 2024-09-13T18:46:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.976+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f4adc14fd00 0x7f4adc0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.976+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f4adc14fd00 0x7f4adc0cc900 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.976+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc0c0290 con 0x7f4adc14fd00 2024-09-13T18:46:10.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 Processor -- start 2024-09-13T18:46:10.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 -- start start 2024-09-13T18:46:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff980156cc0 0x7ff98006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff98006ca70 0x7ff98006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff980070f50 con 0x7ff9800c79e0 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98006f900 con 0x7ff980156cc0 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98015a120 con 0x7ff98006ca70 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff97fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff980156cc0 0x7ff98006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff97fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff980156cc0 0x7ff98006a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40862/0 (socket says 172.21.15.32:40862) 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff97fe00700 1 -- 172.21.15.32:0/1947228560 learned_addr learned my addr 172.21.15.32:0/1947228560 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:10.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff985000700 1 --2- 172.21.15.32:0/1947228560 >> v2:172.21.15.86:3300/0 conn(0x7ff98006ca70 0x7ff98006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:10.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff97fe00700 1 -- 172.21.15.32:0/1947228560 >> v2:172.21.15.86:3300/0 conn(0x7ff98006ca70 msgr2=0x7ff98006a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:10.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff97fe00700 1 --2- 172.21.15.32:0/1947228560 >> v2:172.21.15.86:3300/0 conn(0x7ff98006ca70 0x7ff98006a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.988+0000 7ff97fe00700 1 -- 172.21.15.32:0/1947228560 >> v1:172.21.15.86:6789/0 conn(0x7ff9800c79e0 legacy=0x7ff98006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:10.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff97fe00700 1 -- 172.21.15.32:0/1947228560 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98015a400 con 0x7ff980156cc0 2024-09-13T18:46:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff97fe00700 1 --2- 172.21.15.32:0/1947228560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff980156cc0 0x7ff98006a390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9800cae90 tx=0x7ff970009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3ad4af21d9b81b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff97ea00700 1 -- 172.21.15.32:0/1947228560 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970011830 con 0x7ff980156cc0 2024-09-13T18:46:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff97ea00700 1 -- 172.21.15.32:0/1947228560 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970011990 con 0x7ff980156cc0 2024-09-13T18:46:10.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff97ea00700 1 -- 172.21.15.32:0/1947228560 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970011d20 con 0x7ff980156cc0 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 -- 172.21.15.32:0/1947228560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff980156cc0 msgr2=0x7ff98006a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 --2- 172.21.15.32:0/1947228560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff980156cc0 0x7ff98006a390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9800cae90 tx=0x7ff970009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 -- 172.21.15.32:0/1947228560 shutdown_connections 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 --2- 172.21.15.32:0/1947228560 >> v2:172.21.15.86:3300/0 conn(0x7ff98006ca70 0x7ff98006a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 --2- 172.21.15.32:0/1947228560 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff980156cc0 0x7ff98006a390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 -- 172.21.15.32:0/1947228560 >> 172.21.15.32:0/1947228560 conn(0x7ff980073d50 msgr2=0x7ff98006e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 -- 172.21.15.32:0/1947228560 shutdown_connections 2024-09-13T18:46:10.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 -- 172.21.15.32:0/1947228560 wait complete. 2024-09-13T18:46:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.992+0000 7ff985a00700 1 Processor -- start 2024-09-13T18:46:10.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 -- start start 2024-09-13T18:46:11.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff98006ca70 0x7ff9801e2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 0x7ff9800c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff980156cc0 0x7ff9800c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c40b0 con 0x7ff9800c79e0 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c6840 con 0x7ff98006ca70 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c6ab0 con 0x7ff980156cc0 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 0x7ff9800c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 0x7ff9800c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40872/0 (socket says 172.21.15.32:40872) 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 -- 172.21.15.32:0/2002611526 learned_addr learned my addr 172.21.15.32:0/2002611526 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97fe00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff98006ca70 0x7ff9801e2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985000700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff980156cc0 0x7ff9800c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 -- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff980156cc0 msgr2=0x7ff9800c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff980156cc0 0x7ff9800c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 -- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff98006ca70 msgr2=0x7ff9801e2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff98006ca70 0x7ff9801e2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 -- 172.21.15.32:0/2002611526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970009570 con 0x7ff9800c79e0 2024-09-13T18:46:11.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97fe00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff98006ca70 0x7ff9801e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:11.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985000700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff980156cc0 0x7ff9800c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:46:11.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff97f400700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 0x7ff9800c9120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c530 tx=0x7ff96c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0052d0 con 0x7ff9800c79e0 2024-09-13T18:46:11.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c005430 con 0x7ff9800c79e0 2024-09-13T18:46:11.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9800c6d90 con 0x7ff9800c79e0 2024-09-13T18:46:11.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:10.996+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0055a0 con 0x7ff9800c79e0 2024-09-13T18:46:11.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.000+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9800c7350 con 0x7ff9800c79e0 2024-09-13T18:46:11.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.000+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9800c4260 con 0x7ff9800c79e0 2024-09-13T18:46:11.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.000+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc06fd50 con 0x7f4adc14fd00 2024-09-13T18:46:11.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.000+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff96c0038e0 con 0x7ff9800c79e0 2024-09-13T18:46:11.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7ff977e00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff960066730 0x7ff960068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4adc06fd50 con 0x7f4adc14fd00 2024-09-13T18:46:11.007 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:11.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6550+0+0 (secure 0 0 0) 0x7ff96c083930 con 0x7ff9800c79e0 2024-09-13T18:46:11.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f4adc0cb330 0x7f4adc0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc0cbc50 con 0x7f4adc0cb330 2024-09-13T18:46:11.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7ff97fe00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff960066730 0x7ff960068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f4adc0cb330 0x7f4adc0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f4adc0cb330 0x7f4adc0cb710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7ff97fe00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff960066730 0x7ff960068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff970000c00 tx=0x7ff970008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.004+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc0cbc50 con 0x7f4adc0cb330 2024-09-13T18:46:11.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.012+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff96c0509e0 con 0x7ff9800c79e0 2024-09-13T18:46:11.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.024+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc152510 con 0x7f4adc0cb330 2024-09-13T18:46:11.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.024+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4ac8054660 con 0x7f4adc0cb330 2024-09-13T18:46:11.029 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.024+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f4adc0612c0 0x7f4adc0616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.024+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc061c20 con 0x7f4adc0612c0 2024-09-13T18:46:11.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.024+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f4adc0612c0 0x7f4adc0616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.024+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f4adc0612c0 0x7f4adc0616e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.028+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc061c20 con 0x7f4adc0612c0 2024-09-13T18:46:11.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.052+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc1589e0 con 0x7f4adc0612c0 2024-09-13T18:46:11.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.056+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4adc1589e0 con 0x7f4adc0612c0 2024-09-13T18:46:11.061 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:11.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.056+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f4adc159060 0x7f4adc02b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.056+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc1594c0 con 0x7f4adc159060 2024-09-13T18:46:11.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.056+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f4adc159060 0x7f4adc02b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.060+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f4adc159060 0x7f4adc02b6a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.060+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc1594c0 con 0x7f4adc159060 2024-09-13T18:46:11.072 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:11.068+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:11.083 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:11.083 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:11.083 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:11.083 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:11.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.084+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc1594c0 con 0x7f4adc159060 2024-09-13T18:46:11.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.088+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4adc1594c0 con 0x7f4adc159060 2024-09-13T18:46:11.092 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:11.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.088+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f4adc02c0f0 0x7f4adc02c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.088+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc1596c0 con 0x7f4adc02c0f0 2024-09-13T18:46:11.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.088+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f4adc02c0f0 0x7f4adc02c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.088+0000 7f4ad9400700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f4adc02c0f0 0x7f4adc02c550 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.094 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:11.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.088+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc1596c0 con 0x7f4adc02c0f0 2024-09-13T18:46:11.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.116+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc1596c0 con 0x7f4adc02c0f0 2024-09-13T18:46:11.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.116+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4adc1596c0 con 0x7f4adc02c0f0 2024-09-13T18:46:11.122 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:11.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.116+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f4adc20a640 0x7f4adc20ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.122 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.116+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc02ca90 con 0x7f4adc20a640 2024-09-13T18:46:11.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.120+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f4adc20a640 0x7f4adc20ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.120+0000 7f4ada800700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f4adc20a640 0x7f4adc20ca30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.124 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.120+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc02ca90 con 0x7f4adc20a640 2024-09-13T18:46:11.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.136+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc02ca90 con 0x7f4adc20a640 2024-09-13T18:46:11.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.140+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4adc02ca90 con 0x7f4adc20a640 2024-09-13T18:46:11.145 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:11.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.140+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f4adc20d480 0x7f4adc20f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:11.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.140+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4adc02cc00 con 0x7f4adc20d480 2024-09-13T18:46:11.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.140+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f4adc20d480 0x7f4adc20f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:11.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.144+0000 7f4ad9e00700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f4adc20d480 0x7f4adc20f870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:11.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.144+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4adc02cc00 con 0x7f4adc20d480 2024-09-13T18:46:11.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.164+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f4adc02cc00 con 0x7f4adc20d480 2024-09-13T18:46:11.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4ad2000700 1 -- 172.21.15.32:0/1768985351 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4adc02cc00 con 0x7f4adc20d480 2024-09-13T18:46:11.173 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:11.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f4adc14f920 msgr2=0x7f4adc1f6d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f4adc14f920 0x7f4adc1f6d40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f4adc14fd00 msgr2=0x7f4adc0cc900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f4adc14fd00 0x7f4adc0cc900 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f4adc0cb330 msgr2=0x7f4adc0cb710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f4adc0cb330 0x7f4adc0cb710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f4adc0612c0 msgr2=0x7f4adc0616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f4adc0612c0 0x7f4adc0616e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f4adc159060 msgr2=0x7f4adc02b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f4adc159060 0x7f4adc02b6a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f4adc02c0f0 msgr2=0x7f4adc02c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f4adc02c0f0 0x7f4adc02c550 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f4adc20a640 msgr2=0x7f4adc20ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f4adc20a640 0x7f4adc20ca30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4ada800700 1 -- 172.21.15.32:0/1768985351 reap_dead start 2024-09-13T18:46:11.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f4adc20d480 msgr2=0x7f4adc20f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f4adc20d480 0x7f4adc20f870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4ada800700 1 -- 172.21.15.32:0/1768985351 reap_dead start 2024-09-13T18:46:11.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4ada800700 1 -- 172.21.15.32:0/1768985351 reap_dead start 2024-09-13T18:46:11.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4ada800700 1 -- 172.21.15.32:0/1768985351 reap_dead start 2024-09-13T18:46:11.175 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:11.168+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4abc066730 msgr2=0x7f4abc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4abc066730 0x7f4abc068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0090b0 tx=0x7f4acc01c040 comp rx=0 tx=0).stop 2024-09-13T18:46:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 msgr2=0x7f4adc1f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc1f4c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c510 tx=0x7f4ac800c820 comp rx=0 tx=0).stop 2024-09-13T18:46:11.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 shutdown_connections 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f4adc20d480 0x7f4adc20f870 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4abc066730 0x7f4abc068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 --2- 172.21.15.32:0/1768985351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4adc0c56e0 0x7f4adc1f4c40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 >> 172.21.15.32:0/1768985351 conn(0x7f4adc072400 msgr2=0x7f4adc156160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 shutdown_connections 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.168+0000 7f4adb200700 1 -- 172.21.15.32:0/1768985351 wait complete. 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:11.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:11.178 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:11.201 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.201 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.211 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:11.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.228+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7ff9801570a0 con 0x7ff9800c79e0 2024-09-13T18:46:11.274 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:11.271+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:11.318 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.318 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:11.375 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:11.372+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:11.436 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.437 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:11.476 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:11.472+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:11.555 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.556 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:11.576 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:11.572+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:11.672 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.672 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.678 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:11.672+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:11.682 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:11.779 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:11.776+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:11.788 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.788 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:11.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.816+0000 7ff977e00700 1 -- 172.21.15.32:0/2002611526 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v39) v1 ==== 87+0+0 (secure 0 0 0) 0x7ff96c054000 con 0x7ff9800c79e0 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff960066730 msgr2=0x7ff960068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff960066730 0x7ff960068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff970000c00 tx=0x7ff970008030 comp rx=0 tx=0).stop 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 msgr2=0x7ff9800c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 0x7ff9800c9120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c530 tx=0x7ff96c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 shutdown_connections 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff960066730 0x7ff960068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff980156cc0 0x7ff9800c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9800c79e0 0x7ff9800c9120 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 --2- 172.21.15.32:0/2002611526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff98006ca70 0x7ff9801e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 >> 172.21.15.32:0/2002611526 conn(0x7ff980073d50 msgr2=0x7ff9800cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 shutdown_connections 2024-09-13T18:46:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:11.820+0000 7ff985a00700 1 -- 172.21.15.32:0/2002611526 wait complete. 2024-09-13T18:46:11.830 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:46:11.880 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:11.879+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:11.912 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:11.912 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:11.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:11.981 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:11.976+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:12.074 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:12.074 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:12.082 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:12.076+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:12.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:12.183 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:12.183+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:12.195 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:12.195 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:12.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:12.284 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:12.280+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:12.311 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:12.311 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:12.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:12.385 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:12.383+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:12.423 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:12.423 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:12.433 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:12.486 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:12.483+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:12.587 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:12.584+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:12.608 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:12.609 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:12.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:12.688 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:12.687+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:12.789 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:12.787+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:12.839 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:12.839 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:12.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:12.906 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:12.904+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:12.994 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:12.988+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:13.027 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:13.027 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:13.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:13.092 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:13.088+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:13.191 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:13.188+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:13.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:13.263 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:13.263 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:13.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:13.330 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:13.328+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:13.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 Processor -- start 2024-09-13T18:46:13.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 -- start start 2024-09-13T18:46:13.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f484c156d70 0x7f484c073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f484c06ef90 0x7f484c073c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0703f0 con 0x7f484c0c2e00 2024-09-13T18:46:13.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c0c6f10 con 0x7f484c06ef90 2024-09-13T18:46:13.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4852800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c06fa50 con 0x7f484c156d70 2024-09-13T18:46:13.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f484c06ef90 0x7f484c073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f484c06ef90 0x7f484c073c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40878/0 (socket says 172.21.15.32:40878) 2024-09-13T18:46:13.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 -- 172.21.15.32:0/3489457818 learned_addr learned my addr 172.21.15.32:0/3489457818 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:13.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4851400700 1 --2- 172.21.15.32:0/3489457818 >> v2:172.21.15.86:3300/0 conn(0x7f484c156d70 0x7f484c073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 -- 172.21.15.32:0/3489457818 >> v2:172.21.15.86:3300/0 conn(0x7f484c156d70 msgr2=0x7f484c073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 --2- 172.21.15.32:0/3489457818 >> v2:172.21.15.86:3300/0 conn(0x7f484c156d70 0x7f484c073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 -- 172.21.15.32:0/3489457818 >> v1:172.21.15.86:6789/0 conn(0x7f484c0c2e00 legacy=0x7f484c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 -- 172.21.15.32:0/3489457818 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0c6990 con 0x7f484c06ef90 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f4850a00700 1 --2- 172.21.15.32:0/3489457818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c06ef90 0x7f484c073c60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f484c06bf30 tx=0x7f4838009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c809c1b2d0f3b2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f484be00700 1 -- 172.21.15.32:0/3489457818 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011830 con 0x7f484c06ef90 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f484be00700 1 -- 172.21.15.32:0/3489457818 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838011990 con 0x7f484c06ef90 2024-09-13T18:46:13.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.352+0000 7f484be00700 1 -- 172.21.15.32:0/3489457818 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011d20 con 0x7f484c06ef90 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 -- 172.21.15.32:0/3489457818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c06ef90 msgr2=0x7f484c073c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 --2- 172.21.15.32:0/3489457818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c06ef90 0x7f484c073c60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f484c06bf30 tx=0x7f4838009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 -- 172.21.15.32:0/3489457818 shutdown_connections 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 --2- 172.21.15.32:0/3489457818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c06ef90 0x7f484c073c60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 --2- 172.21.15.32:0/3489457818 >> v2:172.21.15.86:3300/0 conn(0x7f484c156d70 0x7f484c073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 -- 172.21.15.32:0/3489457818 >> 172.21.15.32:0/3489457818 conn(0x7f484c072680 msgr2=0x7f484c0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 -- 172.21.15.32:0/3489457818 shutdown_connections 2024-09-13T18:46:13.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 -- 172.21.15.32:0/3489457818 wait complete. 2024-09-13T18:46:13.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 Processor -- start 2024-09-13T18:46:13.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.356+0000 7f4852800700 1 -- start start 2024-09-13T18:46:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f484c0c2e00 0x7f484c14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c156d70 0x7f484c0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f484c1e2ae0 0x7f484c1e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c1f33e0 con 0x7f484c156d70 2024-09-13T18:46:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c14e1a0 con 0x7f484c1e2ae0 2024-09-13T18:46:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c150f80 con 0x7f484c0c2e00 2024-09-13T18:46:13.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c156d70 0x7f484c0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4851400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f484c0c2e00 0x7f484c14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4851400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f484c0c2e00 0x7f484c14dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:34470/0 (socket says 172.21.15.32:34470) 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4851e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f484c1e2ae0 0x7f484c1e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c156d70 0x7f484c0c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40880/0 (socket says 172.21.15.32:40880) 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4851400700 1 -- 172.21.15.32:0/2887628870 learned_addr learned my addr 172.21.15.32:0/2887628870 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f484c0c2e00 msgr2=0x7f484c14dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f484c0c2e00 0x7f484c14dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f484c1e2ae0 msgr2=0x7f484c1e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f484c1e2ae0 0x7f484c1e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009570 con 0x7f484c156d70 2024-09-13T18:46:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c156d70 0x7f484c0c8bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4838016000 tx=0x7f4838004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838004510 con 0x7f484c156d70 2024-09-13T18:46:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483801e070 con 0x7f484c156d70 2024-09-13T18:46:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838003900 con 0x7f484c156d70 2024-09-13T18:46:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c151ae0 con 0x7f484c156d70 2024-09-13T18:46:13.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c1511b0 con 0x7f484c156d70 2024-09-13T18:46:13.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.360+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f484c1e34f0 con 0x7f484c156d70 2024-09-13T18:46:13.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4838003a60 con 0x7f484c156d70 2024-09-13T18:46:13.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4849600700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f482c066760 0x7f482c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f4838085240 con 0x7f484c156d70 2024-09-13T18:46:13.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f482c066760 0x7f482c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v39) v1 ==== 54+0+16 (secure 0 0 0) 0x7f483808c070 con 0x7f484c156d70 2024-09-13T18:46:13.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f484c06ef90 0x7f484c14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.364+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c0c6c30 con 0x7f484c06ef90 2024-09-13T18:46:13.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.368+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f482c066760 0x7f482c068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4840009cb0 tx=0x7f4840009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.368+0000 7f4851e00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f484c06ef90 0x7f484c14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.368+0000 7f4851e00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f484c06ef90 0x7f484c14a2c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.368+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4844001fc0 con 0x7f484c06ef90 2024-09-13T18:46:13.394 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:13.391+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:13.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.400+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c070c30 con 0x7f484c06ef90 2024-09-13T18:46:13.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.400+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f4844013390 con 0x7f484c06ef90 2024-09-13T18:46:13.406 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:13.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.404+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f484c14ad10 0x7f484c1eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.404+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c0b0e60 con 0x7f484c14ad10 2024-09-13T18:46:13.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.404+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f484c14ad10 0x7f484c1eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.404+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f484c14ad10 0x7f484c1eeec0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.404+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c0b0e60 con 0x7f484c14ad10 2024-09-13T18:46:13.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.436+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c14b0f0 con 0x7f484c14ad10 2024-09-13T18:46:13.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.440+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c14b0f0 con 0x7f484c14ad10 2024-09-13T18:46:13.446 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:13.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.440+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f484c1ef910 0x7f484c060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.440+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c1f2e40 con 0x7f484c1ef910 2024-09-13T18:46:13.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.444+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f484c1ef910 0x7f484c060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.444+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f484c1ef910 0x7f484c060db0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.444+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c1f2e40 con 0x7f484c1ef910 2024-09-13T18:46:13.454 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:13.454 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:13.455 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:13.455 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:13.455 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:13.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:13.477 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.472+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c0c7060 con 0x7f484c1ef910 2024-09-13T18:46:13.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.476+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c0c7060 con 0x7f484c1ef910 2024-09-13T18:46:13.482 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:13.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.476+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f484c061800 0x7f484c0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.476+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c061c00 con 0x7f484c061800 2024-09-13T18:46:13.482 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.480+0000 7f4851e00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f484c061800 0x7f484c0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.480+0000 7f4851e00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f484c061800 0x7f484c0c0f10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.480+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c061c00 con 0x7f484c061800 2024-09-13T18:46:13.494 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:13.491+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:13.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.508+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c154600 con 0x7f484c061800 2024-09-13T18:46:13.519 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.516+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c154600 con 0x7f484c061800 2024-09-13T18:46:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.516+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f484c0c1ad0 0x7f484c02b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.516+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c2051c0 con 0x7f484c0c1ad0 2024-09-13T18:46:13.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.516+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f484c0c1ad0 0x7f484c02b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.516+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f484c0c1ad0 0x7f484c02b6a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.520+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c2051c0 con 0x7f484c0c1ad0 2024-09-13T18:46:13.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.548+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c02bbe0 con 0x7f484c0c1ad0 2024-09-13T18:46:13.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.552+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c02bbe0 con 0x7f484c0c1ad0 2024-09-13T18:46:13.554 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:13.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.552+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f484c02c260 0x7f484c02c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.552+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c02cbc0 con 0x7f484c02c260 2024-09-13T18:46:13.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.552+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f484c02c260 0x7f484c02c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.552+0000 7f4850a00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f484c02c260 0x7f484c02c680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.552+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c02cbc0 con 0x7f484c02c260 2024-09-13T18:46:13.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.572+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c02cbc0 con 0x7f484c02c260 2024-09-13T18:46:13.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.576+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c02cbc0 con 0x7f484c02c260 2024-09-13T18:46:13.581 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:13.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.576+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f484c205f20 0x7f484c208310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.576+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c20b190 con 0x7f484c205f20 2024-09-13T18:46:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.576+0000 7f4851e00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f484c205f20 0x7f484c208310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.580+0000 7f4851e00700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f484c205f20 0x7f484c208310 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.580+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c20b190 con 0x7f484c205f20 2024-09-13T18:46:13.596 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:13.592+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:13.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.596+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c208850 con 0x7f484c205f20 2024-09-13T18:46:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.600+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c208850 con 0x7f484c205f20 2024-09-13T18:46:13.606 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.600+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f484c208ed0 0x7f484c20b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:13.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.600+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f484c20e1c0 con 0x7f484c208ed0 2024-09-13T18:46:13.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.604+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f484c208ed0 0x7f484c20b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:13.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.604+0000 7f4851400700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f484c208ed0 0x7f484c20b2c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:13.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.604+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f484c20e1c0 con 0x7f484c208ed0 2024-09-13T18:46:13.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.628+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f484c20b880 con 0x7f484c208ed0 2024-09-13T18:46:13.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4849600700 1 -- 172.21.15.32:0/2887628870 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f484c20b880 con 0x7f484c208ed0 2024-09-13T18:46:13.637 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f484c06ef90 msgr2=0x7f484c14a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f484c06ef90 0x7f484c14a2c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f484c14ad10 msgr2=0x7f484c1eeec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f484c14ad10 0x7f484c1eeec0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f484c1ef910 msgr2=0x7f484c060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f484c1ef910 0x7f484c060db0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f484c061800 msgr2=0x7f484c0c0f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f484c061800 0x7f484c0c0f10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f484c0c1ad0 msgr2=0x7f484c02b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4851e00700 1 -- 172.21.15.32:0/2887628870 reap_dead start 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f484c0c1ad0 0x7f484c02b6a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4851e00700 1 -- 172.21.15.32:0/2887628870 reap_dead start 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f484c02c260 msgr2=0x7f484c02c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f484c02c260 0x7f484c02c680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f484c205f20 msgr2=0x7f484c208310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f484c205f20 0x7f484c208310 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f484c208ed0 msgr2=0x7f484c20b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.632+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f484c208ed0 0x7f484c20b2c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f482c066760 msgr2=0x7f482c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f482c066760 0x7f482c068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4840009cb0 tx=0x7f4840009240 comp rx=0 tx=0).stop 2024-09-13T18:46:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c156d70 msgr2=0x7f484c0c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 --2- 172.21.15.32:0/2887628870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c156d70 0x7f484c0c8bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4838016000 tx=0x7f4838004770 comp rx=0 tx=0).stop 2024-09-13T18:46:13.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4851e00700 1 -- 172.21.15.32:0/2887628870 reap_dead start 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 shutdown_connections 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 >> 172.21.15.32:0/2887628870 conn(0x7f484c072680 msgr2=0x7f484c14cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 shutdown_connections 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:13.636+0000 7f4852800700 1 -- 172.21.15.32:0/2887628870 wait complete. 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:13.641 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:13.642 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:13.656 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 81.885145016999999, 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 81.192753933000006, 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:13.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:13.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:13.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.680 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 81.192640140999998, 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.682 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:13.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:13.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:13.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:13.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.849090012000005, 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:13.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.849086122000003, 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:13.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:13.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:13.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.848874241999994, 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:13.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:13.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:13.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.848864758000005, 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.720 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.848599886000002, 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:13.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:13.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.726 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.848402735999997, 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.727 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:13.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:13.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.848398492000001, 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:13.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:13.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.742 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.832343190000003, 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:13.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:13.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:13.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947955798999999, 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:13.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:13.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:13.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947380218000006, 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:13.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:13.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:13.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947368830000002, 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:13.765 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:13.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947361232000006, 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:13.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:13.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.779 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947149815000003, 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:13.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947144041000001, 2024-09-13T18:46:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:13.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:13.794 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.947125, 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:13.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:13.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.802 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.946892835, 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.803 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:13.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:13.810 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.073776300000006, 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:13.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:13.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:13.816 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:13.818 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:13.818 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:13.735+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:13.837 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:13.835+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:13.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:46:13.938 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:13.932+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:14.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 Processor -- start 2024-09-13T18:46:14.036 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:14.036 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:14.036 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:14.036 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:14.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 -- start start 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08ec0c6d90 0x7f08ec0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f08ec0c7c30 0x7f08ec070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ec161ff0 con 0x7f08ec072210 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0c8040 con 0x7f08ec0c6d90 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f2800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0c6540 con 0x7f08ec0c7c30 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f1400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f08ec072210 0x7f08ec06fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40414/0 (socket says 172.21.15.32:40414) 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f1400700 1 -- 172.21.15.32:0/1140107094 learned_addr learned my addr 172.21.15.32:0/1140107094 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f0a00700 1 --2- 172.21.15.32:0/1140107094 >> v2:172.21.15.32:3300/0 conn(0x7f08ec0c6d90 0x7f08ec0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:14.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08f1e00700 1 --2- 172.21.15.32:0/1140107094 >> v2:172.21.15.86:3300/0 conn(0x7f08ec0c7c30 0x7f08ec070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08ebe00700 1 -- 172.21.15.32:0/1140107094 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589353557 0 0) 0x7f08ec161ff0 con 0x7f08ec072210 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.032+0000 7f08ebe00700 1 -- 172.21.15.32:0/1140107094 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d40035d0 con 0x7f08ec072210 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f0a00700 1 -- 172.21.15.32:0/1140107094 >> v2:172.21.15.86:3300/0 conn(0x7f08ec0c7c30 msgr2=0x7f08ec070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f0a00700 1 --2- 172.21.15.32:0/1140107094 >> v2:172.21.15.86:3300/0 conn(0x7f08ec0c7c30 0x7f08ec070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f0a00700 1 -- 172.21.15.32:0/1140107094 >> v1:172.21.15.32:6789/0 conn(0x7f08ec072210 legacy=0x7f08ec06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f0a00700 1 -- 172.21.15.32:0/1140107094 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec161190 con 0x7f08ec0c6d90 2024-09-13T18:46:14.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f0a00700 1 --2- 172.21.15.32:0/1140107094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c6d90 0x7f08ec0c76f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08ec06eda0 tx=0x7f08d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad2a1c349ab933e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:14.041 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:14.036+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08ebe00700 1 -- 172.21.15.32:0/1140107094 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0001670 con 0x7f08ec0c6d90 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08ebe00700 1 -- 172.21.15.32:0/1140107094 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8010590 con 0x7f08ec0c6d90 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08ebe00700 1 -- 172.21.15.32:0/1140107094 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8010940 con 0x7f08ec0c6d90 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 -- 172.21.15.32:0/1140107094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c6d90 msgr2=0x7f08ec0c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 --2- 172.21.15.32:0/1140107094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c6d90 0x7f08ec0c76f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08ec06eda0 tx=0x7f08d8009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 -- 172.21.15.32:0/1140107094 shutdown_connections 2024-09-13T18:46:14.042 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 --2- 172.21.15.32:0/1140107094 >> v2:172.21.15.86:3300/0 conn(0x7f08ec0c7c30 0x7f08ec070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 --2- 172.21.15.32:0/1140107094 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c6d90 0x7f08ec0c76f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 -- 172.21.15.32:0/1140107094 >> 172.21.15.32:0/1140107094 conn(0x7f08ec0cac60 msgr2=0x7f08ec0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:14.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 -- 172.21.15.32:0/1140107094 shutdown_connections 2024-09-13T18:46:14.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.036+0000 7f08f2800700 1 -- 172.21.15.32:0/1140107094 wait complete. 2024-09-13T18:46:14.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 Processor -- start 2024-09-13T18:46:14.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 -- start start 2024-09-13T18:46:14.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec072210 0x7f08ec06d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:14.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 0x7f08ec157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:14.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c7c30 0x7f08ec1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:14.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec157d50 con 0x7f08ec0c7c30 2024-09-13T18:46:14.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec06e1a0 con 0x7f08ec072210 2024-09-13T18:46:14.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f2800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec06e440 con 0x7f08ec0c6d90 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f1400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec072210 0x7f08ec06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f0a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 0x7f08ec157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f1400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec072210 0x7f08ec06d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:42664/0 (socket says 172.21.15.32:42664) 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f1400700 1 -- 172.21.15.32:0/4076830727 learned_addr learned my addr 172.21.15.32:0/4076830727 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f0a00700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 0x7f08ec157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:34476/0 (socket says 172.21.15.32:34476) 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.040+0000 7f08f1e00700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c7c30 0x7f08ec1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f0a00700 1 -- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec072210 msgr2=0x7f08ec06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f0a00700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec072210 0x7f08ec06d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f0a00700 1 -- 172.21.15.32:0/4076830727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c7c30 msgr2=0x7f08ec1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f0a00700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c7c30 0x7f08ec1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f0a00700 1 -- 172.21.15.32:0/4076830727 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80094b0 con 0x7f08ec0c6d90 2024-09-13T18:46:14.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f1e00700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c7c30 0x7f08ec1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:14.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f0a00700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 0x7f08ec157810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08d8015000 tx=0x7f08d8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:14.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8004450 con 0x7f08ec0c6d90 2024-09-13T18:46:14.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80045d0 con 0x7f08ec0c6d90 2024-09-13T18:46:14.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec06c560 con 0x7f08ec0c6d90 2024-09-13T18:46:14.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8003900 con 0x7f08ec0c6d90 2024-09-13T18:46:14.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec06cb20 con 0x7f08ec0c6d90 2024-09-13T18:46:14.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.044+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec06c3c0 con 0x7f08ec0c6d90 2024-09-13T18:46:14.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:14.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.048+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08d8003a60 con 0x7f08ec0c6d90 2024-09-13T18:46:14.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.048+0000 7f08e9600700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f08cc066730 0x7f08cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:14.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.048+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f08d8085cc0 con 0x7f08ec0c6d90 2024-09-13T18:46:14.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.048+0000 7f08f1400700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f08cc066730 0x7f08cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:14.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.052+0000 7f08f1400700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f08cc066730 0x7f08cc068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08e00017a0 tx=0x7f08e00019c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:14.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.056+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08d8052d50 con 0x7f08ec0c6d90 2024-09-13T18:46:14.140 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:14.139+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:14.218 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:14.219 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:14.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:14.279 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:14.276+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:14.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.304+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7f08ec06c3c0 con 0x7f08ec0c6d90 2024-09-13T18:46:14.342 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:14.339+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:14.442 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.115384996000003, 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:14.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.447 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.114079211999993, 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:14.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:14.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.113403163000001, 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.113390843000005, 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.113376087999995, 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.113371036000004, 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.113365736000006, 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:14.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:14.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:14.481 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.107639329999998, 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:14.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.106317422000004, 2024-09-13T18:46:14.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:14.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:14.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:14.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:14.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:14.494 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.106279123999997, 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:14.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.101926375000005, 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:14.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.496942945999997, 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:14.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:14.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:40 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.493882763000002, 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030269200000000002, 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944428+0000", 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944418+0000", 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999905 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944437+0000", 2024-09-13T18:46:14.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8647e-05 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944457+0000", 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0009000000000001e-05 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944466+0000", 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5850000000000006e-06 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944547+0000", 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0204000000000007e-05 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944559+0000", 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2662e-05 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944731+0000", 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171325 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.514 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.660504959000001, 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:14.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:14.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.657815886999998, 2024-09-13T18:46:14.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045409399999999999, 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780495+0000", 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780493+0000", 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780505+0000", 2024-09-13T18:46:14.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1664e-05 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780533+0000", 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8541999999999999e-05 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780594+0000", 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0430999999999998e-05 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780702+0000", 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108157 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780719+0000", 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7336000000000001e-05 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780949+0000", 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229798 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.417290117999997, 2024-09-13T18:46:14.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:14.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:14.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.106087918, 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:14.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.106058722, 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.538 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:14.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:14.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:14.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.544 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.102885399000002, 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:14.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.031728179000002, 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:14.549 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:14.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:14.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.555 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.556 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.556 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:14.556 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:14.556 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:14.556 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:14.440+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:14.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:14.599 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:14.596+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:14.659 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:14.656+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:14.760 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:14.759+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:14.771 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:14.772 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:14.772 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:14.772 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:14.786 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:14.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.836+0000 7f08e9600700 1 -- 172.21.15.32:0/4076830727 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7f08ec06c3c0 con 0x7f08ec0c6d90 2024-09-13T18:46:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.840+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f08cc066730 msgr2=0x7f08cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.840+0000 7f08f2800700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f08cc066730 0x7f08cc068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08e00017a0 tx=0x7f08e00019c0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.840+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 msgr2=0x7f08ec157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:14.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.840+0000 7f08f2800700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 0x7f08ec157810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08d8015000 tx=0x7f08d8004770 comp rx=0 tx=0).stop 2024-09-13T18:46:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 shutdown_connections 2024-09-13T18:46:14.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f08cc066730 0x7f08cc068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08ec0c7c30 0x7f08ec1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08ec0c6d90 0x7f08ec157810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 --2- 172.21.15.32:0/4076830727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08ec072210 0x7f08ec06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 >> 172.21.15.32:0/4076830727 conn(0x7f08ec0cac60 msgr2=0x7f08ec0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 shutdown_connections 2024-09-13T18:46:14.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:14.844+0000 7f08f2800700 1 -- 172.21.15.32:0/4076830727 wait complete. 2024-09-13T18:46:14.848 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:46:14.861 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:14.859+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:14.962 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:14.959+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:14.994 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:14.994 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:14.994 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:14.994 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:14.994 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:15.009 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:15.063 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:15.059+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:15.164 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:15.160+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:15.176 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:15.176 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:15.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.851477469000002, 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:15.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:15.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:15.182 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.851457547999999, 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:15.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.851445122000001, 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:15.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:15.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:15.195 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.851437399000005, 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:15.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:15.200 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.851397215000006, 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:15.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.847417332999996, 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.208 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.846052786000001, 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.846015355999995, 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:15.213 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.845550975999998, 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:15.218 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.845119611000001, 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:15.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.227 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.844511195999999, 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.231 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.844116778, 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.235 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.844062758000007, 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:15.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:15.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.842578044999996, 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.244 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:15.244 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:15.244 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:15.245 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:15.291 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:15.291+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:15.361 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:15.361 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:15.361 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:15.366 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:15.363+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:15.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:15.466 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:15.463+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:15.475 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:15.475 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:15.475 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:15.475 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:15.475 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:15.485 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:15.567 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:15.564+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:15.591 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.262127921000001, 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:15.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:15.595 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261371166999993, 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:15.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261352508000002, 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:15.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:15.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261340419000007, 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:15.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:15.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261333694000001, 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:15.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:15.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:15.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261326851999996, 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:15.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:15.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261320760999993, 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.625 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:15.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:15.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:15.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:15.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.631 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261295673000006, 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:15.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.637 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261291017000005, 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:15.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.643 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261276917999993, 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:15.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:15.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:15.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:15.649 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261264964000006, 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:15.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:15.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:15.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261256443999997, 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:15.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:15.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.660 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261251338999998, 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:15.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.261177043999993, 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.666 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:15.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.260255622000003, 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:15.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:15.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:15.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:15.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.260230465000006, 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:15.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.260173754999997, 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:15.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:15.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.256810001999995, 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:15.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:15.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.256030210999995, 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:15.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 63.761237143999999, 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:15.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:15.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:15.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:15.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.699 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:15.699 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:15.699 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:15.701 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:15.701 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:15.699+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:15.801 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:15.799+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:15.816 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:15.816 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:15.816 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:15.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:15.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:15.903 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:15.900+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:15.984 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:15.984 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:15.984 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:15.984 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:15.984 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:15.986 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7] out_osds: [3, 6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:15.986 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:15.986 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-13T18:46:15.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-13T18:46:15.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.984+0000 7f3df5400700 1 Processor -- start 2024-09-13T18:46:15.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.984+0000 7f3df5400700 1 -- start start 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3df5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3df006eef0 0x7f3df014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3df5400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00c1fc0 con 0x7f3df00ad7a0 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3df5400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00c6140 con 0x7f3df006eb10 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3df5400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00c0930 con 0x7f3df006eef0 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dee800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f3df006eb10 0x7f3df00c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:35410/0 (socket says 172.21.15.32:35410) 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dee800700 1 -- 172.21.15.32:0/846847565 learned_addr learned my addr 172.21.15.32:0/846847565 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dede00700 1 --2- 172.21.15.32:0/846847565 >> v2:172.21.15.86:3300/0 conn(0x7f3df006eef0 0x7f3df014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3ded400700 1 -- 172.21.15.32:0/846847565 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465036563 0 0) 0x7f3df00c6140 con 0x7f3df006eb10 2024-09-13T18:46:15.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3ded400700 1 -- 172.21.15.32:0/846847565 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd40035d0 con 0x7f3df006eb10 2024-09-13T18:46:15.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dede00700 1 -- 172.21.15.32:0/846847565 >> v1:172.21.15.86:6789/0 conn(0x7f3df006eb10 legacy=0x7f3df00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:15.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dede00700 1 -- 172.21.15.32:0/846847565 >> v1:172.21.15.32:6789/0 conn(0x7f3df00ad7a0 legacy=0x7f3df0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:15.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3ded400700 1 -- 172.21.15.32:0/846847565 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745230020 0 0) 0x7f3df00c1fc0 con 0x7f3df00ad7a0 2024-09-13T18:46:15.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dede00700 1 -- 172.21.15.32:0/846847565 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00c1690 con 0x7f3df006eef0 2024-09-13T18:46:15.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:15.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3dede00700 1 --2- 172.21.15.32:0/846847565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df014fcd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00a9f0 tx=0x7f3ddc00ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839149ef60d6fe95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:15.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3ded400700 1 -- 172.21.15.32:0/846847565 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00cb70 con 0x7f3df006eef0 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3ded400700 1 -- 172.21.15.32:0/846847565 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc00ccd0 con 0x7f3df006eef0 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.988+0000 7f3ded400700 1 -- 172.21.15.32:0/846847565 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00ae30 con 0x7f3df006eef0 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 -- 172.21.15.32:0/846847565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 msgr2=0x7f3df014fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 --2- 172.21.15.32:0/846847565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df014fcd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00a9f0 tx=0x7f3ddc00ad00 comp rx=0 tx=0).stop 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 -- 172.21.15.32:0/846847565 shutdown_connections 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 --2- 172.21.15.32:0/846847565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df014fcd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 -- 172.21.15.32:0/846847565 >> 172.21.15.32:0/846847565 conn(0x7f3df00accb0 msgr2=0x7f3df00ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 -- 172.21.15.32:0/846847565 shutdown_connections 2024-09-13T18:46:15.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 -- 172.21.15.32:0/846847565 wait complete. 2024-09-13T18:46:15.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 Processor -- start 2024-09-13T18:46:15.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.992+0000 7f3df5400700 1 -- start start 2024-09-13T18:46:15.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3df006eb10 0x7f3df00c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:15.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:15.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df00ad7a0 0x7f3df006df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c92c0 con 0x7f3df00ad7a0 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c8980 con 0x7f3df006eef0 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c6a80 con 0x7f3df006eb10 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3def200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df00ad7a0 0x7f3df006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dee800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3df006eb10 0x7f3df00c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df00c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:42672/0 (socket says 172.21.15.32:42672) 2024-09-13T18:46:16.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 -- 172.21.15.32:0/548748834 learned_addr learned my addr 172.21.15.32:0/548748834 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:16.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3df006eb10 msgr2=0x7f3df00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3df006eb10 0x7f3df00c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df00ad7a0 msgr2=0x7f3df006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3df00ad7a0 0x7f3df006df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc00a650 con 0x7f3df006eef0 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df00c6540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc000c00 tx=0x7f3ddc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc003ad0 con 0x7f3df006eef0 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc003c30 con 0x7f3df006eef0 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc022480 con 0x7f3df006eef0 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00c4c00 con 0x7f3df006eef0 2024-09-13T18:46:16.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:15.996+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00c8fe0 con 0x7f3df006eef0 2024-09-13T18:46:16.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.000+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f3df00c5900 con 0x7f3df006eef0 2024-09-13T18:46:16.004 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:16.000+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:16.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.000+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ddc005a40 con 0x7f3df006eef0 2024-09-13T18:46:16.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.000+0000 7f3de6a00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066730 0x7f3dd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.000+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f3ddc013070 con 0x7f3df006eef0 2024-09-13T18:46:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066730 0x7f3dd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v40) v1 ==== 54+0+16 (secure 0 0 0) 0x7f3ddc0865c0 con 0x7f3df006eef0 2024-09-13T18:46:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3df014d760 0x7f3df014a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df00c87e0 con 0x7f3df014d760 2024-09-13T18:46:16.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3def200700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3df014d760 0x7f3df014a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066730 0x7f3dd0068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3de0007fd0 tx=0x7f3de0007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3def200700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3df014d760 0x7f3df014a750 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.004+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df00c87e0 con 0x7f3df014d760 2024-09-13T18:46:16.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.024+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df0073af0 con 0x7f3df014d760 2024-09-13T18:46:16.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.024+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df0073af0 con 0x7f3df014d760 2024-09-13T18:46:16.029 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:16.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.024+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f3df014db40 0x7f3df01f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.024+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df014b1a0 con 0x7f3df014db40 2024-09-13T18:46:16.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.024+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f3df014db40 0x7f3df01f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.028+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f3df014db40 0x7f3df01f21f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.028+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df014b1a0 con 0x7f3df014db40 2024-09-13T18:46:16.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.044+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df0072900 con 0x7f3df014db40 2024-09-13T18:46:16.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.048+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df0072900 con 0x7f3df014db40 2024-09-13T18:46:16.053 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.048+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3df01f2c40 0x7f3df0060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.048+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df006e5e0 con 0x7f3df01f2c40 2024-09-13T18:46:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.048+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3df01f2c40 0x7f3df0060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.052+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3df01f2c40 0x7f3df0060db0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.052+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df006e5e0 con 0x7f3df01f2c40 2024-09-13T18:46:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.084+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df01f3020 con 0x7f3df01f2c40 2024-09-13T18:46:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.088+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df01f3020 con 0x7f3df01f2c40 2024-09-13T18:46:16.092 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.088+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f3df0061800 0x7f3df006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.088+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df00b1250 con 0x7f3df0061800 2024-09-13T18:46:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.088+0000 7f3def200700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f3df0061800 0x7f3df006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.092+0000 7f3def200700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f3df0061800 0x7f3df006c5a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.092+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df00b1250 con 0x7f3df0061800 2024-09-13T18:46:16.105 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:16.103+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:16.110 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.769145983000001, 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.114 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.757908989000001, 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:16.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:46:16.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.695137482999996, 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.664899344000005, 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.664290976000004, 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.128 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:46:16.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:16.132 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.295972148999994, 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:46:16.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.136 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.295190563999995, 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:46:16.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.294423374999994, 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:46:16.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.293588115999995, 2024-09-13T18:46:16.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:46:16.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.292597504, 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.153 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.291984009999993, 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:46:16.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.389697904000002, 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.158 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:46:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:16.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.388424200000003, 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:46:16.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:46:16.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.380620573000002, 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:46:16.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:46:16.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.379847685000001, 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:46:16.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:46:16.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.781613692999997, 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:46:16.175 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:46:16.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.781588436000007, 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:16.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:16.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:46:16.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.781556292999994, 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:16.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:46:16.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.778795441, 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:46:16.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 69.775834669999995, 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:16.196 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:16.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:16.200 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:16.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.112+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df006cae0 con 0x7f3df0061800 2024-09-13T18:46:16.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.116+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df006cae0 con 0x7f3df0061800 2024-09-13T18:46:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:16.203 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.116+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f3df006d160 0x7f3df002b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.116+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df006d580 con 0x7f3df006d160 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.116+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f3df006d160 0x7f3df002b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.116+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f3df006d160 0x7f3df002b6a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.120+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df006d580 con 0x7f3df006d160 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.140+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df006d580 con 0x7f3df006d160 2024-09-13T18:46:16.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.144+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df006d580 con 0x7f3df006d160 2024-09-13T18:46:16.205 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:16.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.144+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f3df002c0f0 0x7f3df002c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.144+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df002ca90 con 0x7f3df002c0f0 2024-09-13T18:46:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.144+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f3df002c0f0 0x7f3df002c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.144+0000 7f3dede00700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f3df002c0f0 0x7f3df002c550 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.148+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df002ca90 con 0x7f3df002c0f0 2024-09-13T18:46:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.172+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df002ca90 con 0x7f3df002c0f0 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.172+0000 7f35f1800700 1 Processor -- start 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.172+0000 7f35f1800700 1 -- start start 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35ec0c8f10 0x7f35ec0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0c8370 con 0x7f35ec153840 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec06b810 con 0x7f35ec0c8f10 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0c8650 con 0x7f35ec0c8950 2024-09-13T18:46:16.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35ec0c8f10 0x7f35ec0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f35ec0c8f10 0x7f35ec0c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:42686/0 (socket says 172.21.15.32:42686) 2024-09-13T18:46:16.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 -- 172.21.15.32:0/3606098444 learned_addr learned my addr 172.21.15.32:0/3606098444 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:16.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f0e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df002ca90 con 0x7f3df002c0f0 2024-09-13T18:46:16.208 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:16.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 -- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 msgr2=0x7f35ec15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 --2- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 -- 172.21.15.32:0/3606098444 >> v1:172.21.15.86:6789/0 conn(0x7f35ec153840 legacy=0x7f35ec0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 -- 172.21.15.32:0/3606098444 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec06ae70 con 0x7f35ec0c8f10 2024-09-13T18:46:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f3df0205a90 0x7f3df0207e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df020ad00 con 0x7f3df0205a90 2024-09-13T18:46:16.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f3def200700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f3df0205a90 0x7f3df0207e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35e3e00700 1 --2- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec0c93e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009910 tx=0x7f35d4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158888b8976e4692 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35eb400700 1 -- 172.21.15.32:0/3606098444 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4011830 con 0x7f35ec0c8f10 2024-09-13T18:46:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35eb400700 1 -- 172.21.15.32:0/3606098444 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4011990 con 0x7f35ec0c8f10 2024-09-13T18:46:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35eb400700 1 -- 172.21.15.32:0/3606098444 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4011d40 con 0x7f35ec0c8f10 2024-09-13T18:46:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f3def200700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f3df0205a90 0x7f3df0207e80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 -- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 msgr2=0x7f35ec0c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 --2- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec0c93e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009910 tx=0x7f35d4009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 -- 172.21.15.32:0/3606098444 shutdown_connections 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 --2- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 --2- 172.21.15.32:0/3606098444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec0c93e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.176+0000 7f35f1800700 1 -- 172.21.15.32:0/3606098444 >> 172.21.15.32:0/3606098444 conn(0x7f35ec071740 msgr2=0x7f35ec071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 -- 172.21.15.32:0/3606098444 shutdown_connections 2024-09-13T18:46:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 -- 172.21.15.32:0/3606098444 wait complete. 2024-09-13T18:46:16.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df020ad00 con 0x7f3df0205a90 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 Processor -- start 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 -- start start 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 0x7f35ec158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec14caa0 con 0x7f35ec153840 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec14a7d0 con 0x7f35ec0c8f10 2024-09-13T18:46:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.180+0000 7f35f1800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec158a90 con 0x7f35ec0c8950 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 0x7f35ec158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 0x7f35ec158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40930/0 (socket says 172.21.15.32:40930) 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 -- 172.21.15.32:0/1290176840 learned_addr learned my addr 172.21.15.32:0/1290176840 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35ebe00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35e3e00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 -- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 msgr2=0x7f35ec14bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec14bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 -- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 msgr2=0x7f35ec1501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec1501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 -- 172.21.15.32:0/1290176840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009570 con 0x7f35ec153840 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f0e00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 0x7f35ec158f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f35e400efc0 tx=0x7f35e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4009ea0 con 0x7f35ec153840 2024-09-13T18:46:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e400f040 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec150720 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec14a9e0 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400ced0 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.184+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c4005310 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.188+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35e4014480 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.188+0000 7f35e8c00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f35c8066730 0x7f35c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.188+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f35e4085410 con 0x7f35ec153840 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.192+0000 7f35ebe00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f35c8066730 0x7f35c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.192+0000 7f35ebe00700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f35c8066730 0x7f35c8068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f60 tx=0x7f35dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.196+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35e40525a0 con 0x7f35ec153840 2024-09-13T18:46:16.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.204+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df02083c0 con 0x7f3df0205a90 2024-09-13T18:46:16.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.208+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df02083c0 con 0x7f3df0205a90 2024-09-13T18:46:16.217 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:16.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.208+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f3df0208a40 0x7f3df020ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.208+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df020ded0 con 0x7f3df0208a40 2024-09-13T18:46:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.208+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f3df0208a40 0x7f3df020ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.208+0000 7f3dee800700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f3df0208a40 0x7f3df020ae30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.208+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3df020ded0 con 0x7f3df0208a40 2024-09-13T18:46:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.236+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f3df020ded0 con 0x7f3df0208a40 2024-09-13T18:46:16.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3de6a00700 1 -- 172.21.15.32:0/548748834 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f3df020ded0 con 0x7f3df0208a40 2024-09-13T18:46:16.243 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3df014d760 msgr2=0x7f3df014a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3df014d760 0x7f3df014a750 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f3df014db40 msgr2=0x7f3df01f21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f3df014db40 0x7f3df01f21f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3df01f2c40 msgr2=0x7f3df0060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3df01f2c40 0x7f3df0060db0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f3df0061800 msgr2=0x7f3df006c5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f3df0061800 0x7f3df006c5a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f3df006d160 msgr2=0x7f3df002b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f3df006d160 0x7f3df002b6a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f3df002c0f0 msgr2=0x7f3df002c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f3df002c0f0 0x7f3df002c550 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f3df0205a90 msgr2=0x7f3df0207e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f3df0205a90 0x7f3df0207e80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f3df0208a40 msgr2=0x7f3df020ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f3df0208a40 0x7f3df020ae30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3def200700 1 -- 172.21.15.32:0/548748834 reap_dead start 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3def200700 1 -- 172.21.15.32:0/548748834 reap_dead start 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3def200700 1 -- 172.21.15.32:0/548748834 reap_dead start 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3def200700 1 -- 172.21.15.32:0/548748834 reap_dead start 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3def200700 1 -- 172.21.15.32:0/548748834 reap_dead start 2024-09-13T18:46:16.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066730 msgr2=0x7f3dd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066730 0x7f3dd0068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3de0007fd0 tx=0x7f3de0007de0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 msgr2=0x7f3df00c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df00c6540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc000c00 tx=0x7f3ddc004770 comp rx=0 tx=0).stop 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 shutdown_connections 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066730 0x7f3dd0068bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 --2- 172.21.15.32:0/548748834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3df006eef0 0x7f3df00c6540 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 >> 172.21.15.32:0/548748834 conn(0x7f3df00accb0 msgr2=0x7f3df00ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 shutdown_connections 2024-09-13T18:46:16.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.240+0000 7f3df5400700 1 -- 172.21.15.32:0/548748834 wait complete. 2024-09-13T18:46:16.248 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:16.243+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:16.248 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:16.248 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:16.248 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:16.248 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:16.248 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:16.248 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:16.249 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:16.249 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:16.308 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:16.304+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:16.364 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:16.364 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:16.374 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:16.409 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:16.404+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:16.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.412+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd in", "ids": ["6"]} v 0) v1 -- 0x7f35c4005890 con 0x7f35ec153840 2024-09-13T18:46:16.418 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-09-13T18:46:16.412+0000 7f8fc4800700 -1 mon.a@0(leader).osd e40 definitely_dead 0 2024-09-13T18:46:16.484 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:16.484 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:16.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:16.510 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:16.504+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:16.601 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:16.601 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:16.610 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:16.608+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:16.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:16.710 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:16.707+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:16.719 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:16.719 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:16.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:16.811 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:16.811+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:16.838 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:16.839 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:16.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:16.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.844+0000 7f35e8c00700 1 -- 172.21.15.32:0/1290176840 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd in", "ids": ["6"]}]=0 marked in osd.6. v41) v1 ==== 85+0+0 (secure 0 0 0) 0x7f35e4055bc0 con 0x7f35ec153840 2024-09-13T18:46:16.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f35c8066730 msgr2=0x7f35c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f35c8066730 0x7f35c8068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f60 tx=0x7f35dc009040 comp rx=0 tx=0).stop 2024-09-13T18:46:16.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 msgr2=0x7f35ec158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 0x7f35ec158f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f35e400efc0 tx=0x7f35e400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 shutdown_connections 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f35c8066730 0x7f35c8068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35ec153840 0x7f35ec158f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0c8f10 0x7f35ec1501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 --2- 172.21.15.32:0/1290176840 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0c8950 0x7f35ec14bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.852+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 >> 172.21.15.32:0/1290176840 conn(0x7f35ec071740 msgr2=0x7f35ec0cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.856+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 shutdown_connections 2024-09-13T18:46:16.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:16.856+0000 7f35f1800700 1 -- 172.21.15.32:0/1290176840 wait complete. 2024-09-13T18:46:16.862 INFO:teuthology.orchestra.run.smithi032.stderr:marked in osd.6. 2024-09-13T18:46:16.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:46:16.888 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-13T18:46:16.913 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:16.911+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:16.991 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:16.991 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:17.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:17.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e0a600700 1 Processor -- start 2024-09-13T18:46:17.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e0a600700 1 -- start start 2024-09-13T18:46:17.035 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:17.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e0a600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3e040c8f10 0x7f3e040c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e0a600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040c8370 con 0x7f3e040c8950 2024-09-13T18:46:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e0a600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040c8650 con 0x7f3e04153840 2024-09-13T18:46:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e0a600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0406b810 con 0x7f3e040c8f10 2024-09-13T18:46:17.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e09c00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3e040c8950 0x7f3e0415cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:40438/0 (socket says 172.21.15.32:40438) 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e09c00700 1 -- 172.21.15.32:0/1165620748 learned_addr learned my addr 172.21.15.32:0/1165620748 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e03e00700 1 --2- 172.21.15.32:0/1165620748 >> v2:172.21.15.86:3300/0 conn(0x7f3e040c8f10 0x7f3e040c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e03400700 1 -- 172.21.15.32:0/1165620748 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595095770 0 0) 0x7f3e040c8370 con 0x7f3e040c8950 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e03400700 1 -- 172.21.15.32:0/1165620748 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dec0035d0 con 0x7f3e040c8950 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e03e00700 1 -- 172.21.15.32:0/1165620748 >> v1:172.21.15.86:6789/0 conn(0x7f3e04153840 legacy=0x7f3e040ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e03e00700 1 -- 172.21.15.32:0/1165620748 >> v1:172.21.15.32:6789/0 conn(0x7f3e040c8950 legacy=0x7f3e0415cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.032+0000 7f3e03e00700 1 -- 172.21.15.32:0/1165620748 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0406ae70 con 0x7f3e040c8f10 2024-09-13T18:46:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e03e00700 1 --2- 172.21.15.32:0/1165620748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e040c93e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009850 tx=0x7f3df8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0cb37bfd848c429 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e03400700 1 -- 172.21.15.32:0/1165620748 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011830 con 0x7f3e040c8f10 2024-09-13T18:46:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e03400700 1 -- 172.21.15.32:0/1165620748 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8011990 con 0x7f3e040c8f10 2024-09-13T18:46:17.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e03400700 1 -- 172.21.15.32:0/1165620748 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011d40 con 0x7f3e040c8f10 2024-09-13T18:46:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 -- 172.21.15.32:0/1165620748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 msgr2=0x7f3e040c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 --2- 172.21.15.32:0/1165620748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e040c93e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009850 tx=0x7f3df8009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 -- 172.21.15.32:0/1165620748 shutdown_connections 2024-09-13T18:46:17.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 --2- 172.21.15.32:0/1165620748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e040c93e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 -- 172.21.15.32:0/1165620748 >> 172.21.15.32:0/1165620748 conn(0x7f3e04071740 msgr2=0x7f3e04071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:17.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 -- 172.21.15.32:0/1165620748 shutdown_connections 2024-09-13T18:46:17.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.036+0000 7f3e0a600700 1 -- 172.21.15.32:0/1165620748 wait complete. 2024-09-13T18:46:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 Processor -- start 2024-09-13T18:46:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 -- start start 2024-09-13T18:46:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 0x7f3e0414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e04143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04153840 0x7f3e041f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0414d160 con 0x7f3e040c8950 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04143280 con 0x7f3e040c8f10 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.040+0000 7f3e0a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0414a720 con 0x7f3e04153840 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 0x7f3e0414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 0x7f3e0414cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40944/0 (socket says 172.21.15.32:40944) 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 -- 172.21.15.32:0/3351187705 learned_addr learned my addr 172.21.15.32:0/3351187705 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e03e00700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e04143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09c00700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04153840 0x7f3e041f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 -- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04153840 msgr2=0x7f3e041f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04153840 0x7f3e041f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 -- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 msgr2=0x7f3e04143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e04143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 -- 172.21.15.32:0/3351187705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80094b0 con 0x7f3e040c8950 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e09200700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 0x7f3e0414cc20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c530 tx=0x7f3df000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000cea0 con 0x7f3e040c8950 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df00052d0 con 0x7f3e040c8950 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00036a0 con 0x7f3e040c8950 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e04142a50 con 0x7f3e040c8950 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e04142cf0 con 0x7f3e040c8950 2024-09-13T18:46:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.044+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e04143550 con 0x7f3e040c8950 2024-09-13T18:46:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.048+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3df0003800 con 0x7f3e040c8950 2024-09-13T18:46:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.048+0000 7f3e00c00700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3de4066760 0x7f3de4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.048+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f3df0083900 con 0x7f3e040c8950 2024-09-13T18:46:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.048+0000 7f3e03e00700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3de4066760 0x7f3de4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:17.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.052+0000 7f3e03e00700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3de4066760 0x7f3de4068c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3df80090b0 tx=0x7f3df8008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:17.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.056+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3df00507f0 con 0x7f3e040c8950 2024-09-13T18:46:17.114 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:17.111+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:17.182 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:17.183 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:17.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:17.215 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:17.215+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:17.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.276+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7f3e04153c20 con 0x7f3e040c8950 2024-09-13T18:46:17.316 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:17.312+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:17.416 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:17.416 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:17.417 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:17.415+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:17.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:17.526 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:17.523+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:17.618 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:17.615+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:17.671 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:17.672 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:17.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:17.719 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:17.719+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:17.820 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:17.819+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:17.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.847+0000 7f3e00c00700 1 -- 172.21.15.32:0/3351187705 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v42) v1 ==== 91+0+0 (secure 0 0 0) 0x7f3df0017090 con 0x7f3e040c8950 2024-09-13T18:46:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.851+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3de4066760 msgr2=0x7f3de4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.851+0000 7f3e0a600700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3de4066760 0x7f3de4068c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3df80090b0 tx=0x7f3df8008030 comp rx=0 tx=0).stop 2024-09-13T18:46:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.851+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 msgr2=0x7f3e0414cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.851+0000 7f3e0a600700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 0x7f3e0414cc20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c530 tx=0x7f3df000c840 comp rx=0 tx=0).stop 2024-09-13T18:46:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 shutdown_connections 2024-09-13T18:46:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3de4066760 0x7f3de4068c20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e04153840 0x7f3e041f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e040c8f10 0x7f3e04143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 --2- 172.21.15.32:0/3351187705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3e040c8950 0x7f3e0414cc20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 >> 172.21.15.32:0/3351187705 conn(0x7f3e04071740 msgr2=0x7f3e04151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 shutdown_connections 2024-09-13T18:46:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:17.855+0000 7f3e0a600700 1 -- 172.21.15.32:0/3351187705 wait complete. 2024-09-13T18:46:17.869 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:46:17.922 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:17.915+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:17.933 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:17.933 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:17.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:18.042 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:18.039+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:18.123 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:18.119+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:18.149 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:18.150 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:18.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:18.255 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:18.251+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:18.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:18.325 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:18.319+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:18.356 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:18.356 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:18.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:18.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.435+0000 7f7509c00700 1 Processor -- start 2024-09-13T18:46:18.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.435+0000 7f7509c00700 1 -- start start 2024-09-13T18:46:18.442 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:18.435+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:18.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75040c3400 0x7f75040ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f75040c7a50 0x7f75040cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75040c7f70 con 0x7f7504156e30 2024-09-13T18:46:18.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750415cb70 con 0x7f75040c7a50 2024-09-13T18:46:18.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750415cd80 con 0x7f75040c3400 2024-09-13T18:46:18.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7503400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75040c3400 0x7f75040ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f75040c7a50 0x7f75040cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7503400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f75040c3400 0x7f75040ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:42726/0 (socket says 172.21.15.32:42726) 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7503400700 1 -- 172.21.15.32:0/3729043499 learned_addr learned my addr 172.21.15.32:0/3729043499 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f75040c7a50 0x7f75040cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40956/0 (socket says 172.21.15.32:40956) 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 -- 172.21.15.32:0/3729043499 >> v2:172.21.15.86:3300/0 conn(0x7f75040c3400 msgr2=0x7f75040ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 --2- 172.21.15.32:0/3729043499 >> v2:172.21.15.86:3300/0 conn(0x7f75040c3400 0x7f75040ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 -- 172.21.15.32:0/3729043499 >> v1:172.21.15.86:6789/0 conn(0x7f7504156e30 legacy=0x7f75041575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 -- 172.21.15.32:0/3729043499 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750415d060 con 0x7f75040c7a50 2024-09-13T18:46:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7509200700 1 --2- 172.21.15.32:0/3729043499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75040c7a50 0x7f75040cd520 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75040ce020 tx=0x7f74fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0b97b847ffa31b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7502a00700 1 -- 172.21.15.32:0/3729043499 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00e070 con 0x7f75040c7a50 2024-09-13T18:46:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7502a00700 1 -- 172.21.15.32:0/3729043499 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc00bb20 con 0x7f75040c7a50 2024-09-13T18:46:18.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.439+0000 7f7502a00700 1 -- 172.21.15.32:0/3729043499 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc012430 con 0x7f75040c7a50 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- 172.21.15.32:0/3729043499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75040c7a50 msgr2=0x7f75040cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 --2- 172.21.15.32:0/3729043499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75040c7a50 0x7f75040cd520 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75040ce020 tx=0x7f74fc00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- 172.21.15.32:0/3729043499 shutdown_connections 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 --2- 172.21.15.32:0/3729043499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75040c7a50 0x7f75040cd520 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 --2- 172.21.15.32:0/3729043499 >> v2:172.21.15.86:3300/0 conn(0x7f75040c3400 0x7f75040ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- 172.21.15.32:0/3729043499 >> 172.21.15.32:0/3729043499 conn(0x7f750406a7d0 msgr2=0x7f750406e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- 172.21.15.32:0/3729043499 shutdown_connections 2024-09-13T18:46:18.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- 172.21.15.32:0/3729043499 wait complete. 2024-09-13T18:46:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 Processor -- start 2024-09-13T18:46:18.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- start start 2024-09-13T18:46:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75040c3400 0x7f75041e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75040c7a50 0x7f7504155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7504156e30 0x7f75041e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75041e3ee0 con 0x7f7504156e30 2024-09-13T18:46:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75041e41c0 con 0x7f75040c7a50 2024-09-13T18:46:18.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.443+0000 7f7509c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75041e44a0 con 0x7f75040c3400 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7504156e30 0x7f75041e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7504156e30 0x7f75041e5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40966/0 (socket says 172.21.15.32:40966) 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 learned_addr learned my addr 172.21.15.32:0/2736695397 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75040c3400 0x7f75041e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75040c7a50 0x7f7504155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75040c3400 msgr2=0x7f75041e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75040c3400 0x7f75041e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75040c7a50 msgr2=0x7f7504155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75040c7a50 0x7f7504155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009a70 con 0x7f7504156e30 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7504156e30 0x7f75041e5960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f74fc014040 tx=0x7f74fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc012430 con 0x7f7504156e30 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc020070 con 0x7f7504156e30 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0098f0 con 0x7f7504156e30 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75041e4780 con 0x7f7504156e30 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7504156010 con 0x7f7504156e30 2024-09-13T18:46:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.447+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f75041e4940 con 0x7f7504156e30 2024-09-13T18:46:18.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74fc004040 con 0x7f7504156e30 2024-09-13T18:46:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f74fbe00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f74e4066730 0x7f74e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f74fc022070 con 0x7f7504156e30 2024-09-13T18:46:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v42) v1 ==== 54+0+16 (secure 0 0 0) 0x7f74fc088460 con 0x7f7504156e30 2024-09-13T18:46:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f74e4066730 0x7f74e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f75040cb3e0 0x7f750415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f750415d620 con 0x7f75040cb3e0 2024-09-13T18:46:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f75040cb3e0 0x7f750415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f74e4066730 0x7f74e4068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74f4000f60 tx=0x7f74f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.451+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f75040cb3e0 0x7f750415bdb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.455+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f74f0009cb0 con 0x7f75040cb3e0 2024-09-13T18:46:18.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.475+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f7504157210 con 0x7f75040cb3e0 2024-09-13T18:46:18.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.479+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f74f0016420 con 0x7f75040cb3e0 2024-09-13T18:46:18.485 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.479+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f75041e63b0 0x7f75040c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.479+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75040c2410 con 0x7f75041e63b0 2024-09-13T18:46:18.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.479+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f75041e63b0 0x7f75040c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.479+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f75041e63b0 0x7f75040c9570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.483+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f75040c2410 con 0x7f75041e63b0 2024-09-13T18:46:18.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.499+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f75040c9d70 con 0x7f75041e63b0 2024-09-13T18:46:18.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.503+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f75040c9d70 con 0x7f75041e63b0 2024-09-13T18:46:18.508 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:18.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.503+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f75041531b0 0x7f75041535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.503+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7504153b30 con 0x7f75041531b0 2024-09-13T18:46:18.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.503+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f75041531b0 0x7f75041535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.503+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f75041531b0 0x7f75041535f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.503+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7504153b30 con 0x7f75041531b0 2024-09-13T18:46:18.527 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:18.527+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:18.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.535+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f750406ef60 con 0x7f75041531b0 2024-09-13T18:46:18.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.535+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f750406ef60 con 0x7f75041531b0 2024-09-13T18:46:18.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:18.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.535+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f7504061670 0x7f75041546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.535+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75040c8300 con 0x7f7504061670 2024-09-13T18:46:18.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.535+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f7504061670 0x7f75041546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.539+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f7504061670 0x7f75041546e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.539+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f75040c8300 con 0x7f7504061670 2024-09-13T18:46:18.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.563+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f7504061d90 con 0x7f7504061670 2024-09-13T18:46:18.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.563+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f7504061d90 con 0x7f7504061670 2024-09-13T18:46:18.570 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:18.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.563+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f7504155370 0x7f750402b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.563+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7504205040 con 0x7f7504155370 2024-09-13T18:46:18.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.567+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f7504155370 0x7f750402b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.567+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f7504155370 0x7f750402b6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.567+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7504205040 con 0x7f7504155370 2024-09-13T18:46:18.584 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:18.584 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:18.584 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:18.584 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:18.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.595+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f750402bbe0 con 0x7f7504155370 2024-09-13T18:46:18.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:18.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.599+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f750402bbe0 con 0x7f7504155370 2024-09-13T18:46:18.605 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:18.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.599+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f750402c260 0x7f750402c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.599+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f750402cc00 con 0x7f750402c260 2024-09-13T18:46:18.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.599+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f750402c260 0x7f750402c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.603+0000 7f7503400700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f750402c260 0x7f750402c6c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.603+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f750402cc00 con 0x7f750402c260 2024-09-13T18:46:18.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.627+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f750402cc00 con 0x7f750402c260 2024-09-13T18:46:18.631 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:18.627+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:18.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.631+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f750402cc00 con 0x7f750402c260 2024-09-13T18:46:18.635 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.631+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f7504205da0 0x7f7504208190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.631+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f750420b010 con 0x7f7504205da0 2024-09-13T18:46:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.631+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f7504205da0 0x7f7504208190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.631+0000 7f7509200700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f7504205da0 0x7f7504208190 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.631+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f750420b010 con 0x7f7504205da0 2024-09-13T18:46:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.651+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f75042086d0 con 0x7f7504205da0 2024-09-13T18:46:18.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.655+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f75042086d0 con 0x7f7504205da0 2024-09-13T18:46:18.660 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:18.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.655+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7504208d50 0x7f75042091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:18.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.655+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f750420e390 con 0x7f7504208d50 2024-09-13T18:46:18.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.655+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7504208d50 0x7f75042091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:18.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.655+0000 7f7503e00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7504208d50 0x7f75042091b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:18.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.659+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f750420e390 con 0x7f7504208d50 2024-09-13T18:46:18.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.687+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f7504209880 con 0x7f7504208d50 2024-09-13T18:46:18.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f74fbe00700 1 -- 172.21.15.32:0/2736695397 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f7504209880 con 0x7f7504208d50 2024-09-13T18:46:18.696 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f75040cb3e0 msgr2=0x7f750415bdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f75040cb3e0 0x7f750415bdb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f75041e63b0 msgr2=0x7f75040c9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f75041e63b0 0x7f75040c9570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f75041531b0 msgr2=0x7f75041535f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f75041531b0 0x7f75041535f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f7504061670 msgr2=0x7f75041546e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f7504061670 0x7f75041546e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f7504155370 msgr2=0x7f750402b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f7504155370 0x7f750402b6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f750402c260 msgr2=0x7f750402c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f750402c260 0x7f750402c6c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f7504205da0 msgr2=0x7f7504208190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f7504205da0 0x7f7504208190 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7504208d50 msgr2=0x7f75042091b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f7504208d50 0x7f75042091b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f74e4066730 msgr2=0x7f74e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f74e4066730 0x7f74e4068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74f4000f60 tx=0x7f74f4009040 comp rx=0 tx=0).stop 2024-09-13T18:46:18.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7504156e30 msgr2=0x7f75041e5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 --2- 172.21.15.32:0/2736695397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7504156e30 0x7f75041e5960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f74fc014040 tx=0x7f74fc004af0 comp rx=0 tx=0).stop 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 reap_dead start 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 reap_dead start 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 reap_dead start 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 reap_dead start 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 reap_dead start 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509200700 1 -- 172.21.15.32:0/2736695397 reap_dead start 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 shutdown_connections 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 >> 172.21.15.32:0/2736695397 conn(0x7f750406a7d0 msgr2=0x7f75040c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 shutdown_connections 2024-09-13T18:46:18.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:18.691+0000 7f7509c00700 1 -- 172.21.15.32:0/2736695397 wait complete. 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:18.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:18.759 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:18.755+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:18.786 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:18.786 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:18.786 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:18.787 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:18.787 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:18.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:18.829 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:18.827+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:18.930 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:18.927+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.701022593000005, 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.699716808999995, 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.699040760000003, 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.699028440000006, 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.699013684999997, 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:19.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.054 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.699008633000005, 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:19.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:19.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.699003332999993, 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.060 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:19.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:19.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.693276926999999, 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.068 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.691955019000005, 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.072 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.691916720999998, 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:19.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.076 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.687563972000007, 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:19.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:19.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 65.082580543000006, 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:19.082 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:19.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:19.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.246142556000002, 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:19.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.002927714999998, 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:19.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.691725515000002, 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.099 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:19.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:19.104 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.691696319000002, 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:19.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:19.110 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.688522996000003, 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:19.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.617365776, 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:19.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:19.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.120 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5398~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.16568471400000001, 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031271250000000001, 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858261+0000", 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858278+0000", 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858331+0000", 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2884999999999999e-05 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858345+0000", 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4154e-05 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858429+0000", 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3588e-05 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858547+0000", 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011875 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858693+0000", 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001461 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860297+0000", 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603033 2024-09-13T18:46:19.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861283+0000", 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098661600000000006 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861346+0000", 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2866000000000004e-05 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861391+0000", 2024-09-13T18:46:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4713999999999999e-05 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.165657259, 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038877360000000001, 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858295+0000", 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.656e-06 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858375+0000", 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9847999999999999e-05 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858386+0000", 2024-09-13T18:46:19.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0665999999999999e-05 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859128+0000", 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074182399999999998 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859200+0000", 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2170999999999997e-05 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859298+0000", 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8455000000000005e-05 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860602+0000", 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013036510000000001 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862094+0000", 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492581 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862141+0000", 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6585999999999997e-05 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862179+0000", 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7796000000000002e-05 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.131 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.132 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:19.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:19.133 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:19.127+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:19.234 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:19.231+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:19.333 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:19.334 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:19.334 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:19.334 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:19.335 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:19.331+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:19.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:19.442 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:19.439+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:19.537 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:19.531+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:19.556 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:19.556 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:19.556 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:19.556 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:19.556 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:19.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:19.638 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:19.634+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:19.739 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:19.734+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.803 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.477404601000003, 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:19.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.812 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:19.812 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.47738468, 2024-09-13T18:46:19.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:19.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:19.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.477372254000002, 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:19.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:19.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.477364531000006, 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:19.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.477324347000007, 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:19.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:19.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.473344464999997, 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:19.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.471979918000002, 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:19.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:19.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.471942487999996, 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:19.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:19.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.471478107999999, 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:19.846 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.471046743000002, 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:19.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.470438328, 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:19.851 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.470043910000001, 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:19.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:19.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.469989889999994, 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:19.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.863 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.468505176999997, 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:19.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:19.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:19.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:19.867 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:19.869 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:19.869 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:19.863+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:19.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:46:19.969 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:19.966+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:19.986 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:19.986 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:19.986 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:19.986 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:19.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:20.070 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:20.066+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:20.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 Processor -- start 2024-09-13T18:46:20.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 -- start start 2024-09-13T18:46:20.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 0x7f259406b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2594151a60 0x7f259406b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259415aa50 con 0x7f25940ccf30 2024-09-13T18:46:20.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259415aca0 con 0x7f2594151a60 2024-09-13T18:46:20.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2598e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259415af80 con 0x7f2594151680 2024-09-13T18:46:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 0x7f259406b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2592a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2594151a60 0x7f259406b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 0x7f259406b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51278/0 (socket says 172.21.15.32:51278) 2024-09-13T18:46:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 -- 172.21.15.32:0/4114784503 learned_addr learned my addr 172.21.15.32:0/4114784503 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 -- 172.21.15.32:0/4114784503 >> v2:172.21.15.86:3300/0 conn(0x7f2594151a60 msgr2=0x7f259406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 --2- 172.21.15.32:0/4114784503 >> v2:172.21.15.86:3300/0 conn(0x7f2594151a60 0x7f259406b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2592000700 1 -- 172.21.15.32:0/4114784503 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152059858 0 0) 0x7f259415aa50 con 0x7f25940ccf30 2024-09-13T18:46:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 -- 172.21.15.32:0/4114784503 >> v1:172.21.15.32:6789/0 conn(0x7f25940ccf30 legacy=0x7f2594157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 -- 172.21.15.32:0/4114784503 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259415b260 con 0x7f2594151680 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.067+0000 7f2593400700 1 --2- 172.21.15.32:0/4114784503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 0x7f259406b260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2584009910 tx=0x7f2584009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24adb22afc622a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2592000700 1 -- 172.21.15.32:0/4114784503 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584011830 con 0x7f2594151680 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2592000700 1 -- 172.21.15.32:0/4114784503 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584011990 con 0x7f2594151680 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2592000700 1 -- 172.21.15.32:0/4114784503 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584011d40 con 0x7f2594151680 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 -- 172.21.15.32:0/4114784503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 msgr2=0x7f259406b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 --2- 172.21.15.32:0/4114784503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 0x7f259406b260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2584009910 tx=0x7f2584009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:20.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 -- 172.21.15.32:0/4114784503 shutdown_connections 2024-09-13T18:46:20.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 --2- 172.21.15.32:0/4114784503 >> v2:172.21.15.86:3300/0 conn(0x7f2594151a60 0x7f259406b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 --2- 172.21.15.32:0/4114784503 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2594151680 0x7f259406b260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 -- 172.21.15.32:0/4114784503 >> 172.21.15.32:0/4114784503 conn(0x7f2594071740 msgr2=0x7f2594071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:20.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 -- 172.21.15.32:0/4114784503 shutdown_connections 2024-09-13T18:46:20.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 -- 172.21.15.32:0/4114784503 wait complete. 2024-09-13T18:46:20.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 Processor -- start 2024-09-13T18:46:20.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.071+0000 7f2598e00700 1 -- start start 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25940ccf30 0x7f25941ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 0x7f25941538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2594153df0 0x7f2594158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259414ea50 con 0x7f2594151680 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594151e50 con 0x7f2594153df0 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594154790 con 0x7f25940ccf30 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 0x7f25941538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2593400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25940ccf30 0x7f25941ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 0x7f25941538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39122/0 (socket says 172.21.15.32:39122) 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 -- 172.21.15.32:0/4001207450 learned_addr learned my addr 172.21.15.32:0/4001207450 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:20.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2593e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2594153df0 0x7f2594158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 -- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25940ccf30 msgr2=0x7f25941ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25940ccf30 0x7f25941ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 -- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2594153df0 msgr2=0x7f2594158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2594153df0 0x7f2594158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 -- 172.21.15.32:0/4001207450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584009570 con 0x7f2594151680 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2592a00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 0x7f25941538b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f258000e8a0 tx=0x7f258000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580009540 con 0x7f2594151680 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580013680 con 0x7f2594151680 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2594154a70 con 0x7f2594151680 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25800139f0 con 0x7f2594151680 2024-09-13T18:46:20.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2594155030 con 0x7f2594151680 2024-09-13T18:46:20.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.075+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2594152000 con 0x7f2594151680 2024-09-13T18:46:20.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.079+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2580013b50 con 0x7f2594151680 2024-09-13T18:46:20.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.079+0000 7f258b400700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2574066730 0x7f2574068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.079+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f2580084780 con 0x7f2594151680 2024-09-13T18:46:20.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.079+0000 7f2593400700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2574066730 0x7f2574068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.083+0000 7f2593400700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2574066730 0x7f2574068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f2584008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.087+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2594152000 con 0x7f2594151680 2024-09-13T18:46:20.108 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:20.108 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:20.108 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:20.108 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:20.108 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:20.118 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:20.171 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:20.166+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:20.230 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:20.230 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:20.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:20.230 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:20.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.901251361999996, 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:20.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:20.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:20.236 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900494608000002, 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:20.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.242 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900475948999997, 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:20.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:20.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900463860000002, 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:20.248 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:20.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900457134999996, 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:20.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900450293000006, 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.259 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:20.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900444202000003, 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:20.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:20.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:20.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900419114000002, 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:20.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:20.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900414458, 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:20.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:20.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:20.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:20.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900400359000002, 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:20.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.288 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900388405000001, 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:20.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900379885000007, 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:20.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:20.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900374780000007, 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:20.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:20.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.900300485000002, 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.305 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:20.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.899379062999998, 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:20.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:20.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.899353906000002, 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:20.315 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:20.319 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.899297196000006, 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:20.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.895933443000004, 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:20.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 73.895153652000005, 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:20.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:20.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:20.332 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 68.400360585000001, 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:20.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.337 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.338 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.338 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:20.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.327+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7f2594152000 con 0x7f2594151680 2024-09-13T18:46:20.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:20.340 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:20.335+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:20.441 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:20.435+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:20.452 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:20.452 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:20.452 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:20.452 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:20.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:20.541 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:20.535+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:20.567 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:20.567 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:20.567 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:20.567 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:20.567 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:20.577 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:20.642 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:20.635+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:20.688 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.347404023999999, 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:46:20.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:20.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.336167029999999, 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:46:20.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.273395523999994, 2024-09-13T18:46:20.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:20.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:46:20.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:46:20.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.703 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.243157385000004, 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:46:20.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.242549017000002, 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:46:20.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.874230190000006, 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:46:20.714 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:46:20.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:46:20.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.873448604999993, 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:46:20.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:46:20.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:46:20.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.872681416000006, 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:46:20.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:20.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.871846156999993, 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:46:20.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.870855544999998, 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:46:20.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.870242051000005, 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.739 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 86.967955945, 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:20.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:46:20.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.748 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 86.966682241000001, 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:46:20.749 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 86.958878614, 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:46:20.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:46:20.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.759 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 86.958105725999999, 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:46:20.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.764 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.359871733999995, 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:20.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:20.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.359846477000005, 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.770 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:46:20.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.774 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.359814334000006, 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:46:20.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.779 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.357053481999998, 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:46:20.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:46:20.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:46:20.784 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.354092711000007, 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:20.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:20.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:46:20.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.789 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:20.790 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:20.790 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:20.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:20.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:20.792 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:20.790+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:20.892 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:20.890+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:20.913 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:20.913 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:20.913 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:20.913 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:20.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:20.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.943+0000 7f915da00700 1 Processor -- start 2024-09-13T18:46:20.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.943+0000 7f915da00700 1 -- start start 2024-09-13T18:46:20.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9158140880 0x7f9158140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f915806ee00 0x7f915806c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580cb6a0 con 0x7f9158151790 2024-09-13T18:46:20.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9158151b70 con 0x7f9158140880 2024-09-13T18:46:20.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9158157480 con 0x7f915806ee00 2024-09-13T18:46:20.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9158140880 0x7f9158140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9158140880 0x7f9158140240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39128/0 (socket says 172.21.15.32:39128) 2024-09-13T18:46:20.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 -- 172.21.15.32:0/818316590 learned_addr learned my addr 172.21.15.32:0/818316590 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:20.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f9157e00700 1 --1- 172.21.15.32:0/818316590 >> v1:172.21.15.32:6789/0 conn(0x7f9158151790 0x7f91580c6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41404/0 (socket says 172.21.15.32:41404) 2024-09-13T18:46:20.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915d000700 1 --2- 172.21.15.32:0/818316590 >> v2:172.21.15.86:3300/0 conn(0x7f915806ee00 0x7f915806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 -- 172.21.15.32:0/818316590 >> v2:172.21.15.86:3300/0 conn(0x7f915806ee00 msgr2=0x7f915806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 --2- 172.21.15.32:0/818316590 >> v2:172.21.15.86:3300/0 conn(0x7f915806ee00 0x7f915806c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f9157400700 1 -- 172.21.15.32:0/818316590 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697316442 0 0) 0x7f91580cb6a0 con 0x7f9158151790 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 -- 172.21.15.32:0/818316590 >> v1:172.21.15.32:6789/0 conn(0x7f9158151790 legacy=0x7f91580c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 -- 172.21.15.32:0/818316590 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158157760 con 0x7f9158140880 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f914f400700 1 --2- 172.21.15.32:0/818316590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158140880 0x7f9158140240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91580aa770 tx=0x7f9140009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d87d4cc4b66b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f9157400700 1 -- 172.21.15.32:0/818316590 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140011830 con 0x7f9158140880 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f9157400700 1 -- 172.21.15.32:0/818316590 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140011990 con 0x7f9158140880 2024-09-13T18:46:20.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f9157400700 1 -- 172.21.15.32:0/818316590 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140011d20 con 0x7f9158140880 2024-09-13T18:46:20.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- 172.21.15.32:0/818316590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158140880 msgr2=0x7f9158140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 --2- 172.21.15.32:0/818316590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158140880 0x7f9158140240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91580aa770 tx=0x7f9140009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- 172.21.15.32:0/818316590 shutdown_connections 2024-09-13T18:46:20.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 --2- 172.21.15.32:0/818316590 >> v2:172.21.15.86:3300/0 conn(0x7f915806ee00 0x7f915806c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 --2- 172.21.15.32:0/818316590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158140880 0x7f9158140240 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- 172.21.15.32:0/818316590 >> 172.21.15.32:0/818316590 conn(0x7f91580caae0 msgr2=0x7f91580caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:20.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- 172.21.15.32:0/818316590 shutdown_connections 2024-09-13T18:46:20.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.947+0000 7f915da00700 1 -- 172.21.15.32:0/818316590 wait complete. 2024-09-13T18:46:20.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.951+0000 7f915da00700 1 Processor -- start 2024-09-13T18:46:20.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.951+0000 7f915da00700 1 -- start start 2024-09-13T18:46:20.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 0x7f91581eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9158140880 0x7f91580c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158151790 0x7f91580c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580c4b40 con 0x7f9158151790 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581ee9c0 con 0x7f915806ee00 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91580c4d50 con 0x7f9158140880 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 0x7f91581eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 0x7f91581eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37814/0 (socket says 172.21.15.32:37814) 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 -- 172.21.15.32:0/141769134 learned_addr learned my addr 172.21.15.32:0/141769134 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158151790 0x7f91580c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9158140880 0x7f91580c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9158140880 msgr2=0x7f91580c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9158140880 0x7f91580c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158151790 msgr2=0x7f91580c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9158151790 0x7f91580c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009570 con 0x7f915806ee00 2024-09-13T18:46:20.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 0x7f91581eee50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4e0 tx=0x7f914800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148004ca0 con 0x7f915806ee00 2024-09-13T18:46:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148004e20 con 0x7f915806ee00 2024-09-13T18:46:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915806e590 con 0x7f915806ee00 2024-09-13T18:46:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148007310 con 0x7f915806ee00 2024-09-13T18:46:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.955+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91580710f0 con 0x7f915806ee00 2024-09-13T18:46:20.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.959+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f9158158240 con 0x7f915806ee00 2024-09-13T18:46:20.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.959+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9148007470 con 0x7f915806ee00 2024-09-13T18:46:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f9154c00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9134066730 0x7f9134068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f9148084ac0 con 0x7f915806ee00 2024-09-13T18:46:20.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9134066730 0x7f9134068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v42) v1 ==== 54+0+16 (secure 0 0 0) 0x7f91480850c0 con 0x7f915806ee00 2024-09-13T18:46:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f91581ee5e0 0x7f91580aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9158157d20 con 0x7f91581ee5e0 2024-09-13T18:46:20.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f91581ee5e0 0x7f91580aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9134066730 0x7f9134068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9140000c00 tx=0x7f9140008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f91581ee5e0 0x7f91580aa7c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.963+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f915000f040 con 0x7f91581ee5e0 2024-09-13T18:46:20.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.983+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f915806df40 con 0x7f91581ee5e0 2024-09-13T18:46:20.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.987+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9150011480 con 0x7f91581ee5e0 2024-09-13T18:46:20.993 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:20.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.987+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f91581ef390 0x7f91580c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:20.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.987+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91580c2ad0 con 0x7f91581ef390 2024-09-13T18:46:20.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.987+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f91581ef390 0x7f91580c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:20.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.987+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f91581ef390 0x7f91580c2590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:20.994 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:20.990+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:20.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:20.991+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f91580c2ad0 con 0x7f91581ef390 2024-09-13T18:46:21.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.015+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f91580c2c40 con 0x7f91581ef390 2024-09-13T18:46:21.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.019+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f91580c2c40 con 0x7f91581ef390 2024-09-13T18:46:21.026 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.019+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f91581f2490 0x7f9158060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.019+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91581f2870 con 0x7f91581f2490 2024-09-13T18:46:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.023+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f91581f2490 0x7f9158060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:21.027 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.023+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f91581f2490 0x7f9158060db0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:21.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.023+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f91581f2870 con 0x7f91581f2490 2024-09-13T18:46:21.030 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:21.030 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:21.030 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:21.030 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:21.030 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:21.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:21.055 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.051+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f91580615b0 con 0x7f91581f2490 2024-09-13T18:46:21.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.055+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f91580615b0 con 0x7f91581f2490 2024-09-13T18:46:21.059 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:21.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.055+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9158061ad0 0x7f91580c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:21.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.055+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91581f2a40 con 0x7f9158061ad0 2024-09-13T18:46:21.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.055+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9158061ad0 0x7f91580c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:21.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.055+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9158061ad0 0x7f91580c8dd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:21.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.059+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f91581f2a40 con 0x7f9158061ad0 2024-09-13T18:46:21.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.083+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f91580c95d0 con 0x7f9158061ad0 2024-09-13T18:46:21.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.087+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f91580c95d0 con 0x7f9158061ad0 2024-09-13T18:46:21.092 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:21.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.087+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f915802bbb0 0x7f915802c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:21.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.087+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91580c9740 con 0x7f915802bbb0 2024-09-13T18:46:21.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.087+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f915802bbb0 0x7f915802c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:21.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.087+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f915802bbb0 0x7f915802c010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:21.094 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:21.087+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:21.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.091+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f91580c9740 con 0x7f915802bbb0 2024-09-13T18:46:21.123 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.119+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f91580c9740 con 0x7f915802bbb0 2024-09-13T18:46:21.127 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.123+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f91580c9740 con 0x7f915802bbb0 2024-09-13T18:46:21.127 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:21.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.123+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f915802ca60 0x7f9158204fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:21.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.123+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91580c98b0 con 0x7f915802ca60 2024-09-13T18:46:21.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.123+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f915802ca60 0x7f9158204fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:21.129 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.123+0000 7f914f400700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f915802ca60 0x7f9158204fc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:21.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.127+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f91580c98b0 con 0x7f915802ca60 2024-09-13T18:46:21.147 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:21.147 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:21.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:21.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:21.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 74.818300152999996, 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:46:21.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:46:21.151 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:21.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:21.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:21.152 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:21.152 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:21.152 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:21.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.143+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f91580c98b0 con 0x7f915802ca60 2024-09-13T18:46:21.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.147+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f91580c98b0 con 0x7f915802ca60 2024-09-13T18:46:21.153 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.147+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f9158205a10 0x7f9158207e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.147+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f915820ac80 con 0x7f9158205a10 2024-09-13T18:46:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.147+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f9158205a10 0x7f9158207e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.147+0000 7f915d000700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f9158205a10 0x7f9158207e00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.147+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f915820ac80 con 0x7f9158205a10 2024-09-13T18:46:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.151+0000 7f258b400700 1 -- 172.21.15.32:0/4001207450 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v43) v1 ==== 101+0+0 (secure 0 0 0) 0x7f2594152000 con 0x7f2594151680 2024-09-13T18:46:21.158 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2574066730 msgr2=0x7f2574068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2574066730 0x7f2574068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f2584008030 comp rx=0 tx=0).stop 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 msgr2=0x7f25941538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 0x7f25941538b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f258000e8a0 tx=0x7f258000ebb0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 shutdown_connections 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2574066730 0x7f2574068bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2594153df0 0x7f2594158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2594151680 0x7f25941538b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 --2- 172.21.15.32:0/4001207450 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f25940ccf30 0x7f25941ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 >> 172.21.15.32:0/4001207450 conn(0x7f2594071740 msgr2=0x7f259414f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 shutdown_connections 2024-09-13T18:46:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.155+0000 7f2598e00700 1 -- 172.21.15.32:0/4001207450 wait complete. 2024-09-13T18:46:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:46:21.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.175+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f9158208340 con 0x7f9158205a10 2024-09-13T18:46:21.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.175+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9158208340 con 0x7f9158205a10 2024-09-13T18:46:21.181 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:21.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.175+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f91582089c0 0x7f915820adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:21.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.175+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f915820dd40 con 0x7f91582089c0 2024-09-13T18:46:21.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.175+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f91582089c0 0x7f915820adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:21.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.179+0000 7f9157e00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f91582089c0 0x7f915820adb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:21.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.179+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f915820dd40 con 0x7f91582089c0 2024-09-13T18:46:21.203 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:21.202+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:21.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.199+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f915820dd40 con 0x7f91582089c0 2024-09-13T18:46:21.209 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:21.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f9154c00700 1 -- 172.21.15.32:0/141769134 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f915820dd40 con 0x7f91582089c0 2024-09-13T18:46:21.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f91581ee5e0 msgr2=0x7f91580aa7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f91581ee5e0 0x7f91580aa7c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f91581ef390 msgr2=0x7f91580c2590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f91581ef390 0x7f91580c2590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f91581f2490 msgr2=0x7f9158060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f91581f2490 0x7f9158060db0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9158061ad0 msgr2=0x7f91580c8dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9158061ad0 0x7f91580c8dd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f915802bbb0 msgr2=0x7f915802c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f915802bbb0 0x7f915802c010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f915802ca60 msgr2=0x7f9158204fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f915802ca60 0x7f9158204fc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f9158205a10 msgr2=0x7f9158207e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f9158205a10 0x7f9158207e00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f91582089c0 msgr2=0x7f915820adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f91582089c0 0x7f915820adb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915d000700 1 -- 172.21.15.32:0/141769134 reap_dead start 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915d000700 1 -- 172.21.15.32:0/141769134 reap_dead start 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915d000700 1 -- 172.21.15.32:0/141769134 reap_dead start 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915d000700 1 -- 172.21.15.32:0/141769134 reap_dead start 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915d000700 1 -- 172.21.15.32:0/141769134 reap_dead start 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9134066730 msgr2=0x7f9134068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9134066730 0x7f9134068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9140000c00 tx=0x7f9140008030 comp rx=0 tx=0).stop 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 msgr2=0x7f91581eee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 0x7f91581eee50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f914800c4e0 tx=0x7f914800c7f0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 shutdown_connections 2024-09-13T18:46:21.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9134066730 0x7f9134068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 --2- 172.21.15.32:0/141769134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f915806ee00 0x7f91581eee50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 >> 172.21.15.32:0/141769134 conn(0x7f91580caae0 msgr2=0x7f91580ac140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 shutdown_connections 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:21.203+0000 7f915da00700 1 -- 172.21.15.32:0/141769134 wait complete. 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:21.213 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:21.214 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:21.214 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:21.214 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:21.261 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:21.262 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:21.271 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:21.295 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:21.294+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:21.381 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:21.381 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:21.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:21.432 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:21.430+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:21.496 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:21.494+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:21.542 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:21.542 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:21.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:21.598 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:21.594+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:21.698 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:21.695+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:21.716 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:21.717 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:21.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:21.830 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:21.827+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:21.889 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:21.889 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:21.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:46:21.900 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:21.898+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:21.930 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:21.930 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:21.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:22.042 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:22.039+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:22.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.059+0000 7f9b17200700 1 Processor -- start 2024-09-13T18:46:22.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.059+0000 7f9b17200700 1 -- start start 2024-09-13T18:46:22.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b17200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b10071bd0 0x7f9b1006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:22.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b17200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b100c7300 0x7f9b100c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:22.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b17200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b10159e50 con 0x7f9b10071fb0 2024-09-13T18:46:22.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b17200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b100705f0 con 0x7f9b10071bd0 2024-09-13T18:46:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b17200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b10070890 con 0x7f9b100c7300 2024-09-13T18:46:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b15e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b10071bd0 0x7f9b1006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b15e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b10071bd0 0x7f9b1006ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39150/0 (socket says 172.21.15.32:39150) 2024-09-13T18:46:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b15e00700 1 -- 172.21.15.32:0/2404873569 learned_addr learned my addr 172.21.15.32:0/2404873569 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.063+0000 7f9b16800700 1 --2- 172.21.15.32:0/2404873569 >> v2:172.21.15.86:3300/0 conn(0x7f9b100c7300 0x7f9b100c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b15e00700 1 -- 172.21.15.32:0/2404873569 >> v2:172.21.15.86:3300/0 conn(0x7f9b100c7300 msgr2=0x7f9b100c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:22.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b15e00700 1 --2- 172.21.15.32:0/2404873569 >> v2:172.21.15.86:3300/0 conn(0x7f9b100c7300 0x7f9b100c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b15e00700 1 -- 172.21.15.32:0/2404873569 >> v1:172.21.15.32:6789/0 conn(0x7f9b10071fb0 legacy=0x7f9b10155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:22.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b15e00700 1 -- 172.21.15.32:0/2404873569 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10159090 con 0x7f9b10071bd0 2024-09-13T18:46:22.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b15e00700 1 --2- 172.21.15.32:0/2404873569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071bd0 0x7f9b1006ed90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b100aaa10 tx=0x7f9b0800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3b74d341facbdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:22.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b14a00700 1 -- 172.21.15.32:0/2404873569 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800ca80 con 0x7f9b10071bd0 2024-09-13T18:46:22.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b14a00700 1 -- 172.21.15.32:0/2404873569 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800cbe0 con 0x7f9b10071bd0 2024-09-13T18:46:22.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b14a00700 1 -- 172.21.15.32:0/2404873569 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08008500 con 0x7f9b10071bd0 2024-09-13T18:46:22.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 -- 172.21.15.32:0/2404873569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071bd0 msgr2=0x7f9b1006ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:22.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 --2- 172.21.15.32:0/2404873569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071bd0 0x7f9b1006ed90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b100aaa10 tx=0x7f9b0800c330 comp rx=0 tx=0).stop 2024-09-13T18:46:22.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 -- 172.21.15.32:0/2404873569 shutdown_connections 2024-09-13T18:46:22.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 --2- 172.21.15.32:0/2404873569 >> v2:172.21.15.86:3300/0 conn(0x7f9b100c7300 0x7f9b100c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 --2- 172.21.15.32:0/2404873569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071bd0 0x7f9b1006ed90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 -- 172.21.15.32:0/2404873569 >> 172.21.15.32:0/2404873569 conn(0x7f9b100cad40 msgr2=0x7f9b100cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:22.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 -- 172.21.15.32:0/2404873569 shutdown_connections 2024-09-13T18:46:22.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.067+0000 7f9b17200700 1 -- 172.21.15.32:0/2404873569 wait complete. 2024-09-13T18:46:22.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.071+0000 7f9b17200700 1 Processor -- start 2024-09-13T18:46:22.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.071+0000 7f9b17200700 1 -- start start 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 0x7f9b10154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071fb0 0x7f9b1014c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b100c7300 0x7f9b1014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100aaa40 con 0x7f9b10071fb0 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100ad970 con 0x7f9b10071bd0 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100abc40 con 0x7f9b100c7300 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 0x7f9b10154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:22.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071fb0 0x7f9b1014c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 0x7f9b10154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37828/0 (socket says 172.21.15.32:37828) 2024-09-13T18:46:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15e00700 1 -- 172.21.15.32:0/760212097 learned_addr learned my addr 172.21.15.32:0/760212097 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:22.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b16800700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b100c7300 0x7f9b1014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 -- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b100c7300 msgr2=0x7f9b1014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b100c7300 0x7f9b1014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 -- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 msgr2=0x7f9b10154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 0x7f9b10154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 -- 172.21.15.32:0/760212097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0800ac40 con 0x7f9b10071fb0 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15e00700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 0x7f9b10154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:22.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b15400700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071fb0 0x7f9b1014c6c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000c400 tx=0x7f9b0000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000052d0 con 0x7f9b10071fb0 2024-09-13T18:46:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b00005450 con 0x7f9b10071fb0 2024-09-13T18:46:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b100ad690 con 0x7f9b10071fb0 2024-09-13T18:46:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00006ac0 con 0x7f9b10071fb0 2024-09-13T18:46:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.075+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b101f2c60 con 0x7f9b10071fb0 2024-09-13T18:46:22.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.079+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b100cab40 con 0x7f9b10071fb0 2024-09-13T18:46:22.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.079+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b000036a0 con 0x7f9b10071fb0 2024-09-13T18:46:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.083+0000 7f9b06000700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9af4066760 0x7f9af4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:22.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.083+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f9b00083620 con 0x7f9b10071fb0 2024-09-13T18:46:22.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.083+0000 7f9b15e00700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9af4066760 0x7f9af4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:22.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.083+0000 7f9b15e00700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9af4066760 0x7f9af4068c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000f80 tx=0x7f9b0801c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:22.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.087+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b000505a0 con 0x7f9b10071fb0 2024-09-13T18:46:22.101 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:22.098+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:22.160 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:22.161 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:22.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:22.202 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:22.198+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:22.303 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:22.299+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:22.335 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.331+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b10159930 con 0x7f9af4066760 2024-09-13T18:46:22.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.351+0000 7f9b06000700 1 -- 172.21.15.32:0/760212097 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363153 (secure 0 0 0) 0x7f9b0800a2e0 con 0x7f9af4066760 2024-09-13T18:46:22.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:22.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9af4066760 msgr2=0x7f9af4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:22.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9af4066760 0x7f9af4068c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000f80 tx=0x7f9b0801c040 comp rx=0 tx=0).stop 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071fb0 msgr2=0x7f9b1014c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071fb0 0x7f9b1014c6c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000c400 tx=0x7f9b0000c710 comp rx=0 tx=0).stop 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 shutdown_connections 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9af4066760 0x7f9af4068c20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b100c7300 0x7f9b1014cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b10071fb0 0x7f9b1014c6c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 --2- 172.21.15.32:0/760212097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b10071bd0 0x7f9b10154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 >> 172.21.15.32:0/760212097 conn(0x7f9b100cad40 msgr2=0x7f9b100c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 shutdown_connections 2024-09-13T18:46:22.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:22.359+0000 7f9b17200700 1 -- 172.21.15.32:0/760212097 wait complete. 2024-09-13T18:46:22.367 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:46:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-13T18:46:22.091929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598905,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":214,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":209960,"kb_used_data":4424,"kb_used_omap":10,"kb_used_meta":205429,"kb_avail":660392920,"statfs":{"total":676457349120,"available":676242350080,"internally_reserved":0,"allocated":4530176,"data_stored":2715848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11152,"internal_metadata":210359408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002361"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870466+0000","last_change":"2024-09-13T18:45:48.732188+0000","last_active":"2024-09-13T18:46:16.870466+0000","last_peered":"2024-09-13T18:46:16.870466+0000","last_clean":"2024-09-13T18:46:16.870466+0000","last_became_active":"2024-09-13T18:45:48.724352+0000","last_became_peered":"2024-09-13T18:45:48.724352+0000","last_unstale":"2024-09-13T18:46:16.870466+0000","last_undegraded":"2024-09-13T18:46:16.870466+0000","last_fullsized":"2024-09-13T18:46:16.870466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:36.623175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.869525+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:46:16.869525+0000","last_peered":"2024-09-13T18:46:16.869525+0000","last_clean":"2024-09-13T18:46:16.869525+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:46:16.869525+0000","last_undegraded":"2024-09-13T18:46:16.869525+0000","last_fullsized":"2024-09-13T18:46:16.869525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.888737+0000","last_change":"2024-09-13T18:46:17.888737+0000","last_active":"2024-09-13T18:46:17.888737+0000","last_peered":"2024-09-13T18:46:17.888737+0000","last_clean":"2024-09-13T18:46:17.888737+0000","last_became_active":"2024-09-13T18:46:17.888200+0000","last_became_peered":"2024-09-13T18:46:17.888200+0000","last_unstale":"2024-09-13T18:46:17.888737+0000","last_undegraded":"2024-09-13T18:46:17.888737+0000","last_fullsized":"2024-09-13T18:46:17.888737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:47.183329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.869666+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:46:16.869666+0000","last_peered":"2024-09-13T18:46:16.869666+0000","last_clean":"2024-09-13T18:46:16.869666+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:46:16.869666+0000","last_undegraded":"2024-09-13T18:46:16.869666+0000","last_fullsized":"2024-09-13T18:46:16.869666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866767+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:46:16.866767+0000","last_peered":"2024-09-13T18:46:16.866767+0000","last_clean":"2024-09-13T18:46:16.866767+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:46:16.866767+0000","last_undegraded":"2024-09-13T18:46:16.866767+0000","last_fullsized":"2024-09-13T18:46:16.866767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.874482+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:46:17.874482+0000","last_peered":"2024-09-13T18:46:17.874482+0000","last_clean":"2024-09-13T18:46:17.874482+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:46:17.874482+0000","last_undegraded":"2024-09-13T18:46:17.874482+0000","last_fullsized":"2024-09-13T18:46:17.874482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.878116+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:46:16.878116+0000","last_peered":"2024-09-13T18:46:16.878116+0000","last_clean":"2024-09-13T18:46:16.878116+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:46:16.878116+0000","last_undegraded":"2024-09-13T18:46:16.878116+0000","last_fullsized":"2024-09-13T18:46:16.878116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.854941+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:46:16.854941+0000","last_peered":"2024-09-13T18:46:16.854941+0000","last_clean":"2024-09-13T18:46:16.854941+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:46:16.854941+0000","last_undegraded":"2024-09-13T18:46:16.854941+0000","last_fullsized":"2024-09-13T18:46:16.854941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.877004+0000","last_change":"2024-09-13T18:46:17.877004+0000","last_active":"2024-09-13T18:46:17.877004+0000","last_peered":"2024-09-13T18:46:17.877004+0000","last_clean":"2024-09-13T18:46:17.877004+0000","last_became_active":"2024-09-13T18:46:17.876650+0000","last_became_peered":"2024-09-13T18:46:17.876650+0000","last_unstale":"2024-09-13T18:46:17.877004+0000","last_undegraded":"2024-09-13T18:46:17.877004+0000","last_fullsized":"2024-09-13T18:46:17.877004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:25.387441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.877714+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:46:16.877714+0000","last_peered":"2024-09-13T18:46:16.877714+0000","last_clean":"2024-09-13T18:46:16.877714+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:46:16.877714+0000","last_undegraded":"2024-09-13T18:46:16.877714+0000","last_fullsized":"2024-09-13T18:46:16.877714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.874921+0000","last_change":"2024-09-13T18:45:48.709789+0000","last_active":"2024-09-13T18:46:16.874921+0000","last_peered":"2024-09-13T18:46:16.874921+0000","last_clean":"2024-09-13T18:46:16.874921+0000","last_became_active":"2024-09-13T18:45:48.709474+0000","last_became_peered":"2024-09-13T18:45:48.709474+0000","last_unstale":"2024-09-13T18:46:16.874921+0000","last_undegraded":"2024-09-13T18:46:16.874921+0000","last_fullsized":"2024-09-13T18:46:16.874921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:22.361841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.875664+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:46:17.875664+0000","last_peered":"2024-09-13T18:46:17.875664+0000","last_clean":"2024-09-13T18:46:17.875664+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:46:17.875664+0000","last_undegraded":"2024-09-13T18:46:17.875664+0000","last_fullsized":"2024-09-13T18:46:17.875664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.856340+0000","last_change":"2024-09-13T18:45:48.700741+0000","last_active":"2024-09-13T18:46:16.856340+0000","last_peered":"2024-09-13T18:46:16.856340+0000","last_clean":"2024-09-13T18:46:16.856340+0000","last_became_active":"2024-09-13T18:45:48.700396+0000","last_became_peered":"2024-09-13T18:45:48.700396+0000","last_unstale":"2024-09-13T18:46:16.856340+0000","last_undegraded":"2024-09-13T18:46:16.856340+0000","last_fullsized":"2024-09-13T18:46:16.856340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:47.391756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.865694+0000","last_change":"2024-09-13T18:45:48.727552+0000","last_active":"2024-09-13T18:46:16.865694+0000","last_peered":"2024-09-13T18:46:16.865694+0000","last_clean":"2024-09-13T18:46:16.865694+0000","last_became_active":"2024-09-13T18:45:48.717660+0000","last_became_peered":"2024-09-13T18:45:48.717660+0000","last_unstale":"2024-09-13T18:46:16.865694+0000","last_undegraded":"2024-09-13T18:46:16.865694+0000","last_fullsized":"2024-09-13T18:46:16.865694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:14.298852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.874759+0000","last_change":"2024-09-13T18:45:48.709291+0000","last_active":"2024-09-13T18:46:16.874759+0000","last_peered":"2024-09-13T18:46:16.874759+0000","last_clean":"2024-09-13T18:46:16.874759+0000","last_became_active":"2024-09-13T18:45:48.708380+0000","last_became_peered":"2024-09-13T18:45:48.708380+0000","last_unstale":"2024-09-13T18:46:16.874759+0000","last_undegraded":"2024-09-13T18:46:16.874759+0000","last_fullsized":"2024-09-13T18:46:16.874759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:25.084648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.883647+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:46:17.883647+0000","last_peered":"2024-09-13T18:46:17.883647+0000","last_clean":"2024-09-13T18:46:17.883647+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:46:17.883647+0000","last_undegraded":"2024-09-13T18:46:17.883647+0000","last_fullsized":"2024-09-13T18:46:17.883647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.891408+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:46:17.891408+0000","last_peered":"2024-09-13T18:46:17.891408+0000","last_clean":"2024-09-13T18:46:17.891408+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:46:17.891408+0000","last_undegraded":"2024-09-13T18:46:17.891408+0000","last_fullsized":"2024-09-13T18:46:17.891408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.888387+0000","last_change":"2024-09-13T18:46:17.888387+0000","last_active":"2024-09-13T18:46:17.888387+0000","last_peered":"2024-09-13T18:46:17.888387+0000","last_clean":"2024-09-13T18:46:17.888387+0000","last_became_active":"2024-09-13T18:46:17.887921+0000","last_became_peered":"2024-09-13T18:46:17.887921+0000","last_unstale":"2024-09-13T18:46:17.888387+0000","last_undegraded":"2024-09-13T18:46:17.888387+0000","last_fullsized":"2024-09-13T18:46:17.888387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:36.763250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.857931+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:46:16.857931+0000","last_peered":"2024-09-13T18:46:16.857931+0000","last_clean":"2024-09-13T18:46:16.857931+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:46:16.857931+0000","last_undegraded":"2024-09-13T18:46:16.857931+0000","last_fullsized":"2024-09-13T18:46:16.857931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860859+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:46:16.860859+0000","last_peered":"2024-09-13T18:46:16.860859+0000","last_clean":"2024-09-13T18:46:16.860859+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:46:16.860859+0000","last_undegraded":"2024-09-13T18:46:16.860859+0000","last_fullsized":"2024-09-13T18:46:16.860859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868283+0000","last_change":"2024-09-13T18:45:48.700850+0000","last_active":"2024-09-13T18:46:16.868283+0000","last_peered":"2024-09-13T18:46:16.868283+0000","last_clean":"2024-09-13T18:46:16.868283+0000","last_became_active":"2024-09-13T18:45:48.700457+0000","last_became_peered":"2024-09-13T18:45:48.700457+0000","last_unstale":"2024-09-13T18:46:16.868283+0000","last_undegraded":"2024-09-13T18:46:16.868283+0000","last_fullsized":"2024-09-13T18:46:16.868283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:15.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.858718+0000","last_change":"2024-09-13T18:45:48.693594+0000","last_active":"2024-09-13T18:46:16.858718+0000","last_peered":"2024-09-13T18:46:16.858718+0000","last_clean":"2024-09-13T18:46:16.858718+0000","last_became_active":"2024-09-13T18:45:48.693254+0000","last_became_peered":"2024-09-13T18:45:48.693254+0000","last_unstale":"2024-09-13T18:46:16.858718+0000","last_undegraded":"2024-09-13T18:46:16.858718+0000","last_fullsized":"2024-09-13T18:46:16.858718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:16.258059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868788+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:46:16.868788+0000","last_peered":"2024-09-13T18:46:16.868788+0000","last_clean":"2024-09-13T18:46:16.868788+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:46:16.868788+0000","last_undegraded":"2024-09-13T18:46:16.868788+0000","last_fullsized":"2024-09-13T18:46:16.868788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864684+0000","last_change":"2024-09-13T18:45:48.714100+0000","last_active":"2024-09-13T18:46:16.864684+0000","last_peered":"2024-09-13T18:46:16.864684+0000","last_clean":"2024-09-13T18:46:16.864684+0000","last_became_active":"2024-09-13T18:45:48.713617+0000","last_became_peered":"2024-09-13T18:45:48.713617+0000","last_unstale":"2024-09-13T18:46:16.864684+0000","last_undegraded":"2024-09-13T18:46:16.864684+0000","last_fullsized":"2024-09-13T18:46:16.864684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:15.374153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870096+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:46:16.870096+0000","last_peered":"2024-09-13T18:46:16.870096+0000","last_clean":"2024-09-13T18:46:16.870096+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:46:16.870096+0000","last_undegraded":"2024-09-13T18:46:16.870096+0000","last_fullsized":"2024-09-13T18:46:16.870096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":64,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.900244+0000","last_change":"2024-09-13T18:46:17.900244+0000","last_active":"2024-09-13T18:46:17.900244+0000","last_peered":"2024-09-13T18:46:17.900244+0000","last_clean":"2024-09-13T18:46:17.900244+0000","last_became_active":"2024-09-13T18:46:17.892529+0000","last_became_peered":"2024-09-13T18:46:17.892529+0000","last_unstale":"2024-09-13T18:46:17.900244+0000","last_undegraded":"2024-09-13T18:46:17.900244+0000","last_fullsized":"2024-09-13T18:46:17.900244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:45.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.878313+0000","last_change":"2024-09-13T18:46:17.878313+0000","last_active":"2024-09-13T18:46:17.878313+0000","last_peered":"2024-09-13T18:46:17.878313+0000","last_clean":"2024-09-13T18:46:17.878313+0000","last_became_active":"2024-09-13T18:46:17.877892+0000","last_became_peered":"2024-09-13T18:46:17.877892+0000","last_unstale":"2024-09-13T18:46:17.878313+0000","last_undegraded":"2024-09-13T18:46:17.878313+0000","last_fullsized":"2024-09-13T18:46:17.878313+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:44.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0,1],"acting":[2,6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.889766+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:46:17.889766+0000","last_peered":"2024-09-13T18:46:17.889766+0000","last_clean":"2024-09-13T18:46:17.889766+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:46:17.889766+0000","last_undegraded":"2024-09-13T18:46:17.889766+0000","last_fullsized":"2024-09-13T18:46:17.889766+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870220+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:46:16.870220+0000","last_peered":"2024-09-13T18:46:16.870220+0000","last_clean":"2024-09-13T18:46:16.870220+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:46:16.870220+0000","last_undegraded":"2024-09-13T18:46:16.870220+0000","last_fullsized":"2024-09-13T18:46:16.870220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.881885+0000","last_change":"2024-09-13T18:46:17.881885+0000","last_active":"2024-09-13T18:46:17.881885+0000","last_peered":"2024-09-13T18:46:17.881885+0000","last_clean":"2024-09-13T18:46:17.881885+0000","last_became_active":"2024-09-13T18:46:17.881414+0000","last_became_peered":"2024-09-13T18:46:17.881414+0000","last_unstale":"2024-09-13T18:46:17.881885+0000","last_undegraded":"2024-09-13T18:46:17.881885+0000","last_fullsized":"2024-09-13T18:46:17.881885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:39.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,0],"acting":[4,1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.891685+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:46:17.891685+0000","last_peered":"2024-09-13T18:46:17.891685+0000","last_clean":"2024-09-13T18:46:17.891685+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:46:17.891685+0000","last_undegraded":"2024-09-13T18:46:17.891685+0000","last_fullsized":"2024-09-13T18:46:17.891685+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.889774+0000","last_change":"2024-09-13T18:46:17.889774+0000","last_active":"2024-09-13T18:46:17.889774+0000","last_peered":"2024-09-13T18:46:17.889774+0000","last_clean":"2024-09-13T18:46:17.889774+0000","last_became_active":"2024-09-13T18:46:17.889427+0000","last_became_peered":"2024-09-13T18:46:17.889427+0000","last_unstale":"2024-09-13T18:46:17.889774+0000","last_undegraded":"2024-09-13T18:46:17.889774+0000","last_fullsized":"2024-09-13T18:46:17.889774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:57.918514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.888171+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:46:17.888171+0000","last_peered":"2024-09-13T18:46:17.888171+0000","last_clean":"2024-09-13T18:46:17.888171+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:46:17.888171+0000","last_undegraded":"2024-09-13T18:46:17.888171+0000","last_fullsized":"2024-09-13T18:46:17.888171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.882740+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:46:17.882740+0000","last_peered":"2024-09-13T18:46:17.882740+0000","last_clean":"2024-09-13T18:46:17.882740+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:46:17.882740+0000","last_undegraded":"2024-09-13T18:46:17.882740+0000","last_fullsized":"2024-09-13T18:46:17.882740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.889689+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:46:17.889689+0000","last_peered":"2024-09-13T18:46:17.889689+0000","last_clean":"2024-09-13T18:46:17.889689+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:46:17.889689+0000","last_undegraded":"2024-09-13T18:46:17.889689+0000","last_fullsized":"2024-09-13T18:46:17.889689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.891865+0000","last_change":"2024-09-13T18:46:17.886007+0000","last_active":"2024-09-13T18:46:17.891865+0000","last_peered":"2024-09-13T18:46:17.891865+0000","last_clean":"2024-09-13T18:46:17.891865+0000","last_became_active":"2024-09-13T18:46:17.882573+0000","last_became_peered":"2024-09-13T18:46:17.882573+0000","last_unstale":"2024-09-13T18:46:17.891865+0000","last_undegraded":"2024-09-13T18:46:17.891865+0000","last_fullsized":"2024-09-13T18:46:17.891865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:57.731521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7],"acting":[6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.869913+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:46:16.869913+0000","last_peered":"2024-09-13T18:46:16.869913+0000","last_clean":"2024-09-13T18:46:16.869913+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:46:16.869913+0000","last_undegraded":"2024-09-13T18:46:16.869913+0000","last_fullsized":"2024-09-13T18:46:16.869913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.891351+0000","last_change":"2024-09-13T18:46:17.884606+0000","last_active":"2024-09-13T18:46:17.891351+0000","last_peered":"2024-09-13T18:46:17.891351+0000","last_clean":"2024-09-13T18:46:17.891351+0000","last_became_active":"2024-09-13T18:46:17.881486+0000","last_became_peered":"2024-09-13T18:46:17.881486+0000","last_unstale":"2024-09-13T18:46:17.891351+0000","last_undegraded":"2024-09-13T18:46:17.891351+0000","last_fullsized":"2024-09-13T18:46:17.891351+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:47.512371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.891169+0000","last_change":"2024-09-13T18:46:17.884448+0000","last_active":"2024-09-13T18:46:17.891169+0000","last_peered":"2024-09-13T18:46:17.891169+0000","last_clean":"2024-09-13T18:46:17.891169+0000","last_became_active":"2024-09-13T18:46:17.878803+0000","last_became_peered":"2024-09-13T18:46:17.878803+0000","last_unstale":"2024-09-13T18:46:17.891169+0000","last_undegraded":"2024-09-13T18:46:17.891169+0000","last_fullsized":"2024-09-13T18:46:17.891169+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:38.985812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,2],"acting":[6,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864552+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:46:16.864552+0000","last_peered":"2024-09-13T18:46:16.864552+0000","last_clean":"2024-09-13T18:46:16.864552+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:46:16.864552+0000","last_undegraded":"2024-09-13T18:46:16.864552+0000","last_fullsized":"2024-09-13T18:46:16.864552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868636+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:46:16.868636+0000","last_peered":"2024-09-13T18:46:16.868636+0000","last_clean":"2024-09-13T18:46:16.868636+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:46:16.868636+0000","last_undegraded":"2024-09-13T18:46:16.868636+0000","last_fullsized":"2024-09-13T18:46:16.868636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.890451+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:46:17.890451+0000","last_peered":"2024-09-13T18:46:17.890451+0000","last_clean":"2024-09-13T18:46:17.890451+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:46:17.890451+0000","last_undegraded":"2024-09-13T18:46:17.890451+0000","last_fullsized":"2024-09-13T18:46:17.890451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.872597+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:46:17.872597+0000","last_peered":"2024-09-13T18:46:17.872597+0000","last_clean":"2024-09-13T18:46:17.872597+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:46:17.872597+0000","last_undegraded":"2024-09-13T18:46:17.872597+0000","last_fullsized":"2024-09-13T18:46:17.872597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.877938+0000","last_change":"2024-09-13T18:46:17.877938+0000","last_active":"2024-09-13T18:46:17.877938+0000","last_peered":"2024-09-13T18:46:17.877938+0000","last_clean":"2024-09-13T18:46:17.877938+0000","last_became_active":"2024-09-13T18:46:17.877614+0000","last_became_peered":"2024-09-13T18:46:17.877614+0000","last_unstale":"2024-09-13T18:46:17.877938+0000","last_undegraded":"2024-09-13T18:46:17.877938+0000","last_fullsized":"2024-09-13T18:46:17.877938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:56.027082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.878416+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:46:17.878416+0000","last_peered":"2024-09-13T18:46:17.878416+0000","last_clean":"2024-09-13T18:46:17.878416+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:46:17.878416+0000","last_undegraded":"2024-09-13T18:46:17.878416+0000","last_fullsized":"2024-09-13T18:46:17.878416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.867690+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:46:16.867690+0000","last_peered":"2024-09-13T18:46:16.867690+0000","last_clean":"2024-09-13T18:46:16.867690+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:46:16.867690+0000","last_undegraded":"2024-09-13T18:46:16.867690+0000","last_fullsized":"2024-09-13T18:46:16.867690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.865824+0000","last_change":"2024-09-13T18:45:48.705448+0000","last_active":"2024-09-13T18:46:16.865824+0000","last_peered":"2024-09-13T18:46:16.865824+0000","last_clean":"2024-09-13T18:46:16.865824+0000","last_became_active":"2024-09-13T18:45:48.697443+0000","last_became_peered":"2024-09-13T18:45:48.697443+0000","last_unstale":"2024-09-13T18:46:16.865824+0000","last_undegraded":"2024-09-13T18:46:16.865824+0000","last_fullsized":"2024-09-13T18:46:16.865824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.436727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.853552+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:46:16.853552+0000","last_peered":"2024-09-13T18:46:16.853552+0000","last_clean":"2024-09-13T18:46:16.853552+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:46:16.853552+0000","last_undegraded":"2024-09-13T18:46:16.853552+0000","last_fullsized":"2024-09-13T18:46:16.853552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.892553+0000","last_change":"2024-09-13T18:46:17.886012+0000","last_active":"2024-09-13T18:46:17.892553+0000","last_peered":"2024-09-13T18:46:17.892553+0000","last_clean":"2024-09-13T18:46:17.892553+0000","last_became_active":"2024-09-13T18:46:17.879270+0000","last_became_peered":"2024-09-13T18:46:17.879270+0000","last_unstale":"2024-09-13T18:46:17.892553+0000","last_undegraded":"2024-09-13T18:46:17.892553+0000","last_fullsized":"2024-09-13T18:46:17.892553+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:42.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,0],"acting":[6,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.855605+0000","last_change":"2024-09-13T18:45:48.702409+0000","last_active":"2024-09-13T18:46:16.855605+0000","last_peered":"2024-09-13T18:46:16.855605+0000","last_clean":"2024-09-13T18:46:16.855605+0000","last_became_active":"2024-09-13T18:45:48.701419+0000","last_became_peered":"2024-09-13T18:45:48.701419+0000","last_unstale":"2024-09-13T18:46:16.855605+0000","last_undegraded":"2024-09-13T18:46:16.855605+0000","last_fullsized":"2024-09-13T18:46:16.855605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:21.717101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.890557+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:46:17.890557+0000","last_peered":"2024-09-13T18:46:17.890557+0000","last_clean":"2024-09-13T18:46:17.890557+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:46:17.890557+0000","last_undegraded":"2024-09-13T18:46:17.890557+0000","last_fullsized":"2024-09-13T18:46:17.890557+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860824+0000","last_change":"2024-09-13T18:45:48.717635+0000","last_active":"2024-09-13T18:46:16.860824+0000","last_peered":"2024-09-13T18:46:16.860824+0000","last_clean":"2024-09-13T18:46:16.860824+0000","last_became_active":"2024-09-13T18:45:48.717239+0000","last_became_peered":"2024-09-13T18:45:48.717239+0000","last_unstale":"2024-09-13T18:46:16.860824+0000","last_undegraded":"2024-09-13T18:46:16.860824+0000","last_fullsized":"2024-09-13T18:46:16.860824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:35.309870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.877588+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:46:16.877588+0000","last_peered":"2024-09-13T18:46:16.877588+0000","last_clean":"2024-09-13T18:46:16.877588+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:46:16.877588+0000","last_undegraded":"2024-09-13T18:46:16.877588+0000","last_fullsized":"2024-09-13T18:46:16.877588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866438+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:46:16.866438+0000","last_peered":"2024-09-13T18:46:16.866438+0000","last_clean":"2024-09-13T18:46:16.866438+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:46:16.866438+0000","last_undegraded":"2024-09-13T18:46:16.866438+0000","last_fullsized":"2024-09-13T18:46:16.866438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866404+0000","last_change":"2024-09-13T18:45:48.722124+0000","last_active":"2024-09-13T18:46:16.866404+0000","last_peered":"2024-09-13T18:46:16.866404+0000","last_clean":"2024-09-13T18:46:16.866404+0000","last_became_active":"2024-09-13T18:45:48.721727+0000","last_became_peered":"2024-09-13T18:45:48.721727+0000","last_unstale":"2024-09-13T18:46:16.866404+0000","last_undegraded":"2024-09-13T18:46:16.866404+0000","last_fullsized":"2024-09-13T18:46:16.866404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:28.066907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,2],"acting":[5,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.877624+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:46:16.877624+0000","last_peered":"2024-09-13T18:46:16.877624+0000","last_clean":"2024-09-13T18:46:16.877624+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:46:16.877624+0000","last_undegraded":"2024-09-13T18:46:16.877624+0000","last_fullsized":"2024-09-13T18:46:16.877624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870303+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:46:16.870303+0000","last_peered":"2024-09-13T18:46:16.870303+0000","last_clean":"2024-09-13T18:46:16.870303+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:46:16.870303+0000","last_undegraded":"2024-09-13T18:46:16.870303+0000","last_fullsized":"2024-09-13T18:46:16.870303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.859962+0000","last_change":"2024-09-13T18:45:48.714847+0000","last_active":"2024-09-13T18:46:16.859962+0000","last_peered":"2024-09-13T18:46:16.859962+0000","last_clean":"2024-09-13T18:46:16.859962+0000","last_became_active":"2024-09-13T18:45:48.714426+0000","last_became_peered":"2024-09-13T18:45:48.714426+0000","last_unstale":"2024-09-13T18:46:16.859962+0000","last_undegraded":"2024-09-13T18:46:16.859962+0000","last_fullsized":"2024-09-13T18:46:16.859962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:11.990795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864933+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:46:16.864933+0000","last_peered":"2024-09-13T18:46:16.864933+0000","last_clean":"2024-09-13T18:46:16.864933+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:46:16.864933+0000","last_undegraded":"2024-09-13T18:46:16.864933+0000","last_fullsized":"2024-09-13T18:46:16.864933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.877714+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:46:16.877714+0000","last_peered":"2024-09-13T18:46:16.877714+0000","last_clean":"2024-09-13T18:46:16.877714+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:46:16.877714+0000","last_undegraded":"2024-09-13T18:46:16.877714+0000","last_fullsized":"2024-09-13T18:46:16.877714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.854115+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:46:16.854115+0000","last_peered":"2024-09-13T18:46:16.854115+0000","last_clean":"2024-09-13T18:46:16.854115+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:46:16.854115+0000","last_undegraded":"2024-09-13T18:46:16.854115+0000","last_fullsized":"2024-09-13T18:46:16.854115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860300+0000","last_change":"2024-09-13T18:45:48.689956+0000","last_active":"2024-09-13T18:46:16.860300+0000","last_peered":"2024-09-13T18:46:16.860300+0000","last_clean":"2024-09-13T18:46:16.860300+0000","last_became_active":"2024-09-13T18:45:48.689409+0000","last_became_peered":"2024-09-13T18:45:48.689409+0000","last_unstale":"2024-09-13T18:46:16.860300+0000","last_undegraded":"2024-09-13T18:46:16.860300+0000","last_fullsized":"2024-09-13T18:46:16.860300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:02.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.858019+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:46:16.858019+0000","last_peered":"2024-09-13T18:46:16.858019+0000","last_clean":"2024-09-13T18:46:16.858019+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:46:16.858019+0000","last_undegraded":"2024-09-13T18:46:16.858019+0000","last_fullsized":"2024-09-13T18:46:16.858019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.892954+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:46:17.892954+0000","last_peered":"2024-09-13T18:46:17.892954+0000","last_clean":"2024-09-13T18:46:17.892954+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:46:17.892954+0000","last_undegraded":"2024-09-13T18:46:17.892954+0000","last_fullsized":"2024-09-13T18:46:17.892954+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.853087+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:46:16.853087+0000","last_peered":"2024-09-13T18:46:16.853087+0000","last_clean":"2024-09-13T18:46:16.853087+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:46:16.853087+0000","last_undegraded":"2024-09-13T18:46:16.853087+0000","last_fullsized":"2024-09-13T18:46:16.853087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870083+0000","last_change":"2024-09-13T18:45:48.707772+0000","last_active":"2024-09-13T18:46:16.870083+0000","last_peered":"2024-09-13T18:46:16.870083+0000","last_clean":"2024-09-13T18:46:16.870083+0000","last_became_active":"2024-09-13T18:45:48.707514+0000","last_became_peered":"2024-09-13T18:45:48.707514+0000","last_unstale":"2024-09-13T18:46:16.870083+0000","last_undegraded":"2024-09-13T18:46:16.870083+0000","last_fullsized":"2024-09-13T18:46:16.870083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:29.071230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.878917+0000","last_change":"2024-09-13T18:46:17.878917+0000","last_active":"2024-09-13T18:46:17.878917+0000","last_peered":"2024-09-13T18:46:17.878917+0000","last_clean":"2024-09-13T18:46:17.878917+0000","last_became_active":"2024-09-13T18:46:17.878462+0000","last_became_peered":"2024-09-13T18:46:17.878462+0000","last_unstale":"2024-09-13T18:46:17.878917+0000","last_undegraded":"2024-09-13T18:46:17.878917+0000","last_fullsized":"2024-09-13T18:46:17.878917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.130945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.869780+0000","last_change":"2024-09-13T18:45:48.725411+0000","last_active":"2024-09-13T18:46:16.869780+0000","last_peered":"2024-09-13T18:46:16.869780+0000","last_clean":"2024-09-13T18:46:16.869780+0000","last_became_active":"2024-09-13T18:45:48.724382+0000","last_became_peered":"2024-09-13T18:45:48.724382+0000","last_unstale":"2024-09-13T18:46:16.869780+0000","last_undegraded":"2024-09-13T18:46:16.869780+0000","last_fullsized":"2024-09-13T18:46:16.869780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:42.389416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.869469+0000","last_change":"2024-09-13T18:45:48.728662+0000","last_active":"2024-09-13T18:46:16.869469+0000","last_peered":"2024-09-13T18:46:16.869469+0000","last_clean":"2024-09-13T18:46:16.869469+0000","last_became_active":"2024-09-13T18:45:48.728376+0000","last_became_peered":"2024-09-13T18:45:48.728376+0000","last_unstale":"2024-09-13T18:46:16.869469+0000","last_undegraded":"2024-09-13T18:46:16.869469+0000","last_fullsized":"2024-09-13T18:46:16.869469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.005563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.890601+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:46:17.890601+0000","last_peered":"2024-09-13T18:46:17.890601+0000","last_clean":"2024-09-13T18:46:17.890601+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:46:17.890601+0000","last_undegraded":"2024-09-13T18:46:17.890601+0000","last_fullsized":"2024-09-13T18:46:17.890601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.887826+0000","last_change":"2024-09-13T18:46:17.873929+0000","last_active":"2024-09-13T18:46:17.887826+0000","last_peered":"2024-09-13T18:46:17.887826+0000","last_clean":"2024-09-13T18:46:17.887826+0000","last_became_active":"2024-09-13T18:46:17.873625+0000","last_became_peered":"2024-09-13T18:46:17.873625+0000","last_unstale":"2024-09-13T18:46:17.887826+0000","last_undegraded":"2024-09-13T18:46:17.887826+0000","last_fullsized":"2024-09-13T18:46:17.887826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:59.562319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864066+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:46:16.864066+0000","last_peered":"2024-09-13T18:46:16.864066+0000","last_clean":"2024-09-13T18:46:16.864066+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:46:16.864066+0000","last_undegraded":"2024-09-13T18:46:16.864066+0000","last_fullsized":"2024-09-13T18:46:16.864066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.886302+0000","last_change":"2024-09-13T18:46:17.886302+0000","last_active":"2024-09-13T18:46:17.886302+0000","last_peered":"2024-09-13T18:46:17.886302+0000","last_clean":"2024-09-13T18:46:17.886302+0000","last_became_active":"2024-09-13T18:46:17.885969+0000","last_became_peered":"2024-09-13T18:46:17.885969+0000","last_unstale":"2024-09-13T18:46:17.886302+0000","last_undegraded":"2024-09-13T18:46:17.886302+0000","last_fullsized":"2024-09-13T18:46:17.886302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:10.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.892850+0000","last_change":"2024-09-13T18:46:17.892850+0000","last_active":"2024-09-13T18:46:17.892850+0000","last_peered":"2024-09-13T18:46:17.892850+0000","last_clean":"2024-09-13T18:46:17.892850+0000","last_became_active":"2024-09-13T18:46:17.892525+0000","last_became_peered":"2024-09-13T18:46:17.892525+0000","last_unstale":"2024-09-13T18:46:17.892850+0000","last_undegraded":"2024-09-13T18:46:17.892850+0000","last_fullsized":"2024-09-13T18:46:17.892850+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:57.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"42'14","reported_seq":44,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:18.861348+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:46:18.861348+0000","last_peered":"2024-09-13T18:46:18.861348+0000","last_clean":"2024-09-13T18:46:18.861348+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:46:18.861348+0000","last_undegraded":"2024-09-13T18:46:18.861348+0000","last_fullsized":"2024-09-13T18:46:18.861348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.867591+0000","last_change":"2024-09-13T18:45:48.702097+0000","last_active":"2024-09-13T18:46:16.867591+0000","last_peered":"2024-09-13T18:46:16.867591+0000","last_clean":"2024-09-13T18:46:16.867591+0000","last_became_active":"2024-09-13T18:45:48.701675+0000","last_became_peered":"2024-09-13T18:45:48.701675+0000","last_unstale":"2024-09-13T18:46:16.867591+0000","last_undegraded":"2024-09-13T18:46:16.867591+0000","last_fullsized":"2024-09-13T18:46:16.867591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:39.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5,0],"acting":[4,7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.863461+0000","last_change":"2024-09-13T18:45:48.712004+0000","last_active":"2024-09-13T18:46:16.863461+0000","last_peered":"2024-09-13T18:46:16.863461+0000","last_clean":"2024-09-13T18:46:16.863461+0000","last_became_active":"2024-09-13T18:45:48.711706+0000","last_became_peered":"2024-09-13T18:45:48.711706+0000","last_unstale":"2024-09-13T18:46:16.863461+0000","last_undegraded":"2024-09-13T18:46:16.863461+0000","last_fullsized":"2024-09-13T18:46:16.863461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:54.843576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864477+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:46:16.864477+0000","last_peered":"2024-09-13T18:46:16.864477+0000","last_clean":"2024-09-13T18:46:16.864477+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:46:16.864477+0000","last_undegraded":"2024-09-13T18:46:16.864477+0000","last_fullsized":"2024-09-13T18:46:16.864477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.865494+0000","last_change":"2024-09-13T18:45:48.718535+0000","last_active":"2024-09-13T18:46:16.865494+0000","last_peered":"2024-09-13T18:46:16.865494+0000","last_clean":"2024-09-13T18:46:16.865494+0000","last_became_active":"2024-09-13T18:45:48.718213+0000","last_became_peered":"2024-09-13T18:45:48.718213+0000","last_unstale":"2024-09-13T18:46:16.865494+0000","last_undegraded":"2024-09-13T18:46:16.865494+0000","last_fullsized":"2024-09-13T18:46:16.865494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:22.172956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866830+0000","last_change":"2024-09-13T18:45:48.699228+0000","last_active":"2024-09-13T18:46:16.866830+0000","last_peered":"2024-09-13T18:46:16.866830+0000","last_clean":"2024-09-13T18:46:16.866830+0000","last_became_active":"2024-09-13T18:45:48.698943+0000","last_became_peered":"2024-09-13T18:45:48.698943+0000","last_unstale":"2024-09-13T18:46:16.866830+0000","last_undegraded":"2024-09-13T18:46:16.866830+0000","last_fullsized":"2024-09-13T18:46:16.866830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:44.992708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.874969+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:46:16.874969+0000","last_peered":"2024-09-13T18:46:16.874969+0000","last_clean":"2024-09-13T18:46:16.874969+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:46:16.874969+0000","last_undegraded":"2024-09-13T18:46:16.874969+0000","last_fullsized":"2024-09-13T18:46:16.874969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860646+0000","last_change":"2024-09-13T18:45:48.718613+0000","last_active":"2024-09-13T18:46:16.860646+0000","last_peered":"2024-09-13T18:46:16.860646+0000","last_clean":"2024-09-13T18:46:16.860646+0000","last_became_active":"2024-09-13T18:45:48.718087+0000","last_became_peered":"2024-09-13T18:45:48.718087+0000","last_unstale":"2024-09-13T18:46:16.860646+0000","last_undegraded":"2024-09-13T18:46:16.860646+0000","last_fullsized":"2024-09-13T18:46:16.860646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4,2],"acting":[7,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864857+0000","last_change":"2024-09-13T18:45:48.698690+0000","last_active":"2024-09-13T18:46:16.864857+0000","last_peered":"2024-09-13T18:46:16.864857+0000","last_clean":"2024-09-13T18:46:16.864857+0000","last_became_active":"2024-09-13T18:45:48.697966+0000","last_became_peered":"2024-09-13T18:45:48.697966+0000","last_unstale":"2024-09-13T18:46:16.864857+0000","last_undegraded":"2024-09-13T18:46:16.864857+0000","last_fullsized":"2024-09-13T18:46:16.864857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:13.604007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.865019+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:46:16.865019+0000","last_peered":"2024-09-13T18:46:16.865019+0000","last_clean":"2024-09-13T18:46:16.865019+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:46:16.865019+0000","last_undegraded":"2024-09-13T18:46:16.865019+0000","last_fullsized":"2024-09-13T18:46:16.865019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860456+0000","last_change":"2024-09-13T18:45:48.702521+0000","last_active":"2024-09-13T18:46:16.860456+0000","last_peered":"2024-09-13T18:46:16.860456+0000","last_clean":"2024-09-13T18:46:16.860456+0000","last_became_active":"2024-09-13T18:45:48.701942+0000","last_became_peered":"2024-09-13T18:45:48.701942+0000","last_unstale":"2024-09-13T18:46:16.860456+0000","last_undegraded":"2024-09-13T18:46:16.860456+0000","last_fullsized":"2024-09-13T18:46:16.860456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:37.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7,1],"acting":[4,0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870022+0000","last_change":"2024-09-13T18:45:48.715907+0000","last_active":"2024-09-13T18:46:16.870022+0000","last_peered":"2024-09-13T18:46:16.870022+0000","last_clean":"2024-09-13T18:46:16.870022+0000","last_became_active":"2024-09-13T18:45:48.715518+0000","last_became_peered":"2024-09-13T18:45:48.715518+0000","last_unstale":"2024-09-13T18:46:16.870022+0000","last_undegraded":"2024-09-13T18:46:16.870022+0000","last_fullsized":"2024-09-13T18:46:16.870022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:40.192039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,2],"acting":[4,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860675+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:46:16.860675+0000","last_peered":"2024-09-13T18:46:16.860675+0000","last_clean":"2024-09-13T18:46:16.860675+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:46:16.860675+0000","last_undegraded":"2024-09-13T18:46:16.860675+0000","last_fullsized":"2024-09-13T18:46:16.860675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.852991+0000","last_change":"2024-09-13T18:45:48.692116+0000","last_active":"2024-09-13T18:46:16.852991+0000","last_peered":"2024-09-13T18:46:16.852991+0000","last_clean":"2024-09-13T18:46:16.852991+0000","last_became_active":"2024-09-13T18:45:48.691790+0000","last_became_peered":"2024-09-13T18:45:48.691790+0000","last_unstale":"2024-09-13T18:46:16.852991+0000","last_undegraded":"2024-09-13T18:46:16.852991+0000","last_fullsized":"2024-09-13T18:46:16.852991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:43.012450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866381+0000","last_change":"2024-09-13T18:45:48.711809+0000","last_active":"2024-09-13T18:46:16.866381+0000","last_peered":"2024-09-13T18:46:16.866381+0000","last_clean":"2024-09-13T18:46:16.866381+0000","last_became_active":"2024-09-13T18:45:48.710783+0000","last_became_peered":"2024-09-13T18:45:48.710783+0000","last_unstale":"2024-09-13T18:46:16.866381+0000","last_undegraded":"2024-09-13T18:46:16.866381+0000","last_fullsized":"2024-09-13T18:46:16.866381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:39.637386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5,1],"acting":[2,4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.878016+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:46:17.878016+0000","last_peered":"2024-09-13T18:46:17.878016+0000","last_clean":"2024-09-13T18:46:17.878016+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:46:17.878016+0000","last_undegraded":"2024-09-13T18:46:17.878016+0000","last_fullsized":"2024-09-13T18:46:17.878016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.873556+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:46:17.873556+0000","last_peered":"2024-09-13T18:46:17.873556+0000","last_clean":"2024-09-13T18:46:17.873556+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:46:17.873556+0000","last_undegraded":"2024-09-13T18:46:17.873556+0000","last_fullsized":"2024-09-13T18:46:17.873556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868536+0000","last_change":"2024-09-13T18:45:48.712120+0000","last_active":"2024-09-13T18:46:16.868536+0000","last_peered":"2024-09-13T18:46:16.868536+0000","last_clean":"2024-09-13T18:46:16.868536+0000","last_became_active":"2024-09-13T18:45:48.711759+0000","last_became_peered":"2024-09-13T18:45:48.711759+0000","last_unstale":"2024-09-13T18:46:16.868536+0000","last_undegraded":"2024-09-13T18:46:16.868536+0000","last_fullsized":"2024-09-13T18:46:16.868536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:32.142963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.869066+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:46:16.869066+0000","last_peered":"2024-09-13T18:46:16.869066+0000","last_clean":"2024-09-13T18:46:16.869066+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:46:16.869066+0000","last_undegraded":"2024-09-13T18:46:16.869066+0000","last_fullsized":"2024-09-13T18:46:16.869066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.887291+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:46:17.887291+0000","last_peered":"2024-09-13T18:46:17.887291+0000","last_clean":"2024-09-13T18:46:17.887291+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:46:17.887291+0000","last_undegraded":"2024-09-13T18:46:17.887291+0000","last_fullsized":"2024-09-13T18:46:17.887291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.892289+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:46:17.892289+0000","last_peered":"2024-09-13T18:46:17.892289+0000","last_clean":"2024-09-13T18:46:17.892289+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:46:17.892289+0000","last_undegraded":"2024-09-13T18:46:17.892289+0000","last_fullsized":"2024-09-13T18:46:17.892289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.856687+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:46:16.856687+0000","last_peered":"2024-09-13T18:46:16.856687+0000","last_clean":"2024-09-13T18:46:16.856687+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:46:16.856687+0000","last_undegraded":"2024-09-13T18:46:16.856687+0000","last_fullsized":"2024-09-13T18:46:16.856687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860932+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:46:16.860932+0000","last_peered":"2024-09-13T18:46:16.860932+0000","last_clean":"2024-09-13T18:46:16.860932+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:46:16.860932+0000","last_undegraded":"2024-09-13T18:46:16.860932+0000","last_fullsized":"2024-09-13T18:46:16.860932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.875394+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:46:17.875394+0000","last_peered":"2024-09-13T18:46:17.875394+0000","last_clean":"2024-09-13T18:46:17.875394+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:46:17.875394+0000","last_undegraded":"2024-09-13T18:46:17.875394+0000","last_fullsized":"2024-09-13T18:46:17.875394+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868531+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:46:16.868531+0000","last_peered":"2024-09-13T18:46:16.868531+0000","last_clean":"2024-09-13T18:46:16.868531+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:46:16.868531+0000","last_undegraded":"2024-09-13T18:46:16.868531+0000","last_fullsized":"2024-09-13T18:46:16.868531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.867969+0000","last_change":"2024-09-13T18:45:48.701844+0000","last_active":"2024-09-13T18:46:16.867969+0000","last_peered":"2024-09-13T18:46:16.867969+0000","last_clean":"2024-09-13T18:46:16.867969+0000","last_became_active":"2024-09-13T18:45:48.701424+0000","last_became_peered":"2024-09-13T18:45:48.701424+0000","last_unstale":"2024-09-13T18:46:16.867969+0000","last_undegraded":"2024-09-13T18:46:16.867969+0000","last_fullsized":"2024-09-13T18:46:16.867969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:06.472145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866424+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:46:16.866424+0000","last_peered":"2024-09-13T18:46:16.866424+0000","last_clean":"2024-09-13T18:46:16.866424+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:46:16.866424+0000","last_undegraded":"2024-09-13T18:46:16.866424+0000","last_fullsized":"2024-09-13T18:46:16.866424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.890514+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:46:17.890514+0000","last_peered":"2024-09-13T18:46:17.890514+0000","last_clean":"2024-09-13T18:46:17.890514+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:46:17.890514+0000","last_undegraded":"2024-09-13T18:46:17.890514+0000","last_fullsized":"2024-09-13T18:46:17.890514+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.878696+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:46:17.878696+0000","last_peered":"2024-09-13T18:46:17.878696+0000","last_clean":"2024-09-13T18:46:17.878696+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:46:17.878696+0000","last_undegraded":"2024-09-13T18:46:17.878696+0000","last_fullsized":"2024-09-13T18:46:17.878696+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864772+0000","last_change":"2024-09-13T18:45:48.698886+0000","last_active":"2024-09-13T18:46:16.864772+0000","last_peered":"2024-09-13T18:46:16.864772+0000","last_clean":"2024-09-13T18:46:16.864772+0000","last_became_active":"2024-09-13T18:45:48.698416+0000","last_became_peered":"2024-09-13T18:45:48.698416+0000","last_unstale":"2024-09-13T18:46:16.864772+0000","last_undegraded":"2024-09-13T18:46:16.864772+0000","last_fullsized":"2024-09-13T18:46:16.864772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:54.636986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866672+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:46:16.866672+0000","last_peered":"2024-09-13T18:46:16.866672+0000","last_clean":"2024-09-13T18:46:16.866672+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:46:16.866672+0000","last_undegraded":"2024-09-13T18:46:16.866672+0000","last_fullsized":"2024-09-13T18:46:16.866672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.863529+0000","last_change":"2024-09-13T18:45:48.696609+0000","last_active":"2024-09-13T18:46:16.863529+0000","last_peered":"2024-09-13T18:46:16.863529+0000","last_clean":"2024-09-13T18:46:16.863529+0000","last_became_active":"2024-09-13T18:45:48.696261+0000","last_became_peered":"2024-09-13T18:45:48.696261+0000","last_unstale":"2024-09-13T18:46:16.863529+0000","last_undegraded":"2024-09-13T18:46:16.863529+0000","last_fullsized":"2024-09-13T18:46:16.863529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:26.988762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.865733+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:46:16.865733+0000","last_peered":"2024-09-13T18:46:16.865733+0000","last_clean":"2024-09-13T18:46:16.865733+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:46:16.865733+0000","last_undegraded":"2024-09-13T18:46:16.865733+0000","last_fullsized":"2024-09-13T18:46:16.865733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.856553+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:46:16.856553+0000","last_peered":"2024-09-13T18:46:16.856553+0000","last_clean":"2024-09-13T18:46:16.856553+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:46:16.856553+0000","last_undegraded":"2024-09-13T18:46:16.856553+0000","last_fullsized":"2024-09-13T18:46:16.856553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868972+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:46:16.868972+0000","last_peered":"2024-09-13T18:46:16.868972+0000","last_clean":"2024-09-13T18:46:16.868972+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:46:16.868972+0000","last_undegraded":"2024-09-13T18:46:16.868972+0000","last_fullsized":"2024-09-13T18:46:16.868972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.877509+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:46:16.877509+0000","last_peered":"2024-09-13T18:46:16.877509+0000","last_clean":"2024-09-13T18:46:16.877509+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:46:16.877509+0000","last_undegraded":"2024-09-13T18:46:16.877509+0000","last_fullsized":"2024-09-13T18:46:16.877509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870271+0000","last_change":"2024-09-13T18:45:48.717665+0000","last_active":"2024-09-13T18:46:16.870271+0000","last_peered":"2024-09-13T18:46:16.870271+0000","last_clean":"2024-09-13T18:46:16.870271+0000","last_became_active":"2024-09-13T18:45:48.717331+0000","last_became_peered":"2024-09-13T18:45:48.717331+0000","last_unstale":"2024-09-13T18:46:16.870271+0000","last_undegraded":"2024-09-13T18:46:16.870271+0000","last_fullsized":"2024-09-13T18:46:16.870271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:50.696835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864291+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:46:16.864291+0000","last_peered":"2024-09-13T18:46:16.864291+0000","last_clean":"2024-09-13T18:46:16.864291+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:46:16.864291+0000","last_undegraded":"2024-09-13T18:46:16.864291+0000","last_fullsized":"2024-09-13T18:46:16.864291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.876666+0000","last_change":"2024-09-13T18:45:48.724958+0000","last_active":"2024-09-13T18:46:16.876666+0000","last_peered":"2024-09-13T18:46:16.876666+0000","last_clean":"2024-09-13T18:46:16.876666+0000","last_became_active":"2024-09-13T18:45:48.724614+0000","last_became_peered":"2024-09-13T18:45:48.724614+0000","last_unstale":"2024-09-13T18:46:16.876666+0000","last_undegraded":"2024-09-13T18:46:16.876666+0000","last_fullsized":"2024-09-13T18:46:16.876666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:44.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.874895+0000","last_change":"2024-09-13T18:46:17.874895+0000","last_active":"2024-09-13T18:46:17.874895+0000","last_peered":"2024-09-13T18:46:17.874895+0000","last_clean":"2024-09-13T18:46:17.874895+0000","last_became_active":"2024-09-13T18:46:17.874620+0000","last_became_peered":"2024-09-13T18:46:17.874620+0000","last_unstale":"2024-09-13T18:46:17.874895+0000","last_undegraded":"2024-09-13T18:46:17.874895+0000","last_fullsized":"2024-09-13T18:46:17.874895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:58.761015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.865635+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:46:16.865635+0000","last_peered":"2024-09-13T18:46:16.865635+0000","last_clean":"2024-09-13T18:46:16.865635+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:46:16.865635+0000","last_undegraded":"2024-09-13T18:46:16.865635+0000","last_fullsized":"2024-09-13T18:46:16.865635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.890667+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:46:17.890667+0000","last_peered":"2024-09-13T18:46:17.890667+0000","last_clean":"2024-09-13T18:46:17.890667+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:46:17.890667+0000","last_undegraded":"2024-09-13T18:46:17.890667+0000","last_fullsized":"2024-09-13T18:46:17.890667+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.874741+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:46:17.874741+0000","last_peered":"2024-09-13T18:46:17.874741+0000","last_clean":"2024-09-13T18:46:17.874741+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:46:17.874741+0000","last_undegraded":"2024-09-13T18:46:17.874741+0000","last_fullsized":"2024-09-13T18:46:17.874741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.877425+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:46:16.877425+0000","last_peered":"2024-09-13T18:46:16.877425+0000","last_clean":"2024-09-13T18:46:16.877425+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:46:16.877425+0000","last_undegraded":"2024-09-13T18:46:16.877425+0000","last_fullsized":"2024-09-13T18:46:16.877425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.875008+0000","last_change":"2024-09-13T18:45:48.721113+0000","last_active":"2024-09-13T18:46:16.875008+0000","last_peered":"2024-09-13T18:46:16.875008+0000","last_clean":"2024-09-13T18:46:16.875008+0000","last_became_active":"2024-09-13T18:45:48.720617+0000","last_became_peered":"2024-09-13T18:45:48.720617+0000","last_unstale":"2024-09-13T18:46:16.875008+0000","last_undegraded":"2024-09-13T18:46:16.875008+0000","last_fullsized":"2024-09-13T18:46:16.875008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:42.694597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.874697+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:46:16.874697+0000","last_peered":"2024-09-13T18:46:16.874697+0000","last_clean":"2024-09-13T18:46:16.874697+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:46:16.874697+0000","last_undegraded":"2024-09-13T18:46:16.874697+0000","last_fullsized":"2024-09-13T18:46:16.874697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864940+0000","last_change":"2024-09-13T18:45:48.694951+0000","last_active":"2024-09-13T18:46:16.864940+0000","last_peered":"2024-09-13T18:46:16.864940+0000","last_clean":"2024-09-13T18:46:16.864940+0000","last_became_active":"2024-09-13T18:45:48.694647+0000","last_became_peered":"2024-09-13T18:45:48.694647+0000","last_unstale":"2024-09-13T18:46:16.864940+0000","last_undegraded":"2024-09-13T18:46:16.864940+0000","last_fullsized":"2024-09-13T18:46:16.864940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:04.005346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.864471+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:46:16.864471+0000","last_peered":"2024-09-13T18:46:16.864471+0000","last_clean":"2024-09-13T18:46:16.864471+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:46:16.864471+0000","last_undegraded":"2024-09-13T18:46:16.864471+0000","last_fullsized":"2024-09-13T18:46:16.864471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.868415+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:46:16.868415+0000","last_peered":"2024-09-13T18:46:16.868415+0000","last_clean":"2024-09-13T18:46:16.868415+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:46:16.868415+0000","last_undegraded":"2024-09-13T18:46:16.868415+0000","last_fullsized":"2024-09-13T18:46:16.868415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.860923+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:46:16.860923+0000","last_peered":"2024-09-13T18:46:16.860923+0000","last_clean":"2024-09-13T18:46:16.860923+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:46:16.860923+0000","last_undegraded":"2024-09-13T18:46:16.860923+0000","last_fullsized":"2024-09-13T18:46:16.860923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.870097+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:46:16.870097+0000","last_peered":"2024-09-13T18:46:16.870097+0000","last_clean":"2024-09-13T18:46:16.870097+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:46:16.870097+0000","last_undegraded":"2024-09-13T18:46:16.870097+0000","last_fullsized":"2024-09-13T18:46:16.870097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.863539+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:46:16.863539+0000","last_peered":"2024-09-13T18:46:16.863539+0000","last_clean":"2024-09-13T18:46:16.863539+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:46:16.863539+0000","last_undegraded":"2024-09-13T18:46:16.863539+0000","last_fullsized":"2024-09-13T18:46:16.863539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.866378+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:46:16.866378+0000","last_peered":"2024-09-13T18:46:16.866378+0000","last_clean":"2024-09-13T18:46:16.866378+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:46:16.866378+0000","last_undegraded":"2024-09-13T18:46:16.866378+0000","last_fullsized":"2024-09-13T18:46:16.866378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-13T18:46:17.892047+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:46:17.892047+0000","last_peered":"2024-09-13T18:46:17.892047+0000","last_clean":"2024-09-13T18:46:17.892047+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:46:17.892047+0000","last_undegraded":"2024-09-13T18:46:17.892047+0000","last_fullsized":"2024-09-13T18:46:17.892047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:46:16.880324+0000","last_change":"2024-09-13T18:45:48.713439+0000","last_active":"2024-09-13T18:46:16.880324+0000","last_peered":"2024-09-13T18:46:16.880324+0000","last_clean":"2024-09-13T18:46:16.880324+0000","last_became_active":"2024-09-13T18:45:48.713131+0000","last_became_peered":"2024-09-13T18:45:48.713131+0000","last_unstale":"2024-09-13T18:46:16.880324+0000","last_undegraded":"2024-09-13T18:46:16.880324+0000","last_fullsized":"2024-09-13T18:46:16.880324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:38.704083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8537,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":17656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":0,"seq":64424509460,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":487424,"data_stored":225422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.879},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.012}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1064960,"data_stored":807539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.0469999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.96699999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.135},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.5979999999999999,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.228}]},{"osd":7,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.264,"5min":1.264,"15min":1.264},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.93400000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":475136,"data_stored":217157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.095}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.80500000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":217225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.622},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.93000000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0269999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.006},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.2689999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":217101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.99199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.88900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.294}]},{"osd":7,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.252},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0189999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1069056,"data_stored":807561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.84199999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.012},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.022}]},{"osd":4,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":223843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0529999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.3879999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":10.058999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.732,"5min":1.732,"15min":1.732},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":10.223000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.155}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.089},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.232}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":8411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:46:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:22.404 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:22.399+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:22.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:22.505 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:22.502+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:22.606 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:22.602+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:22.628 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:22.628 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:22.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:22.707 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:22.703+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:22.807 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:22.803+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:22.829 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:22.829 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:22.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:22.935 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:22.931+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:23.009 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:23.003+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:23.046 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:23.046 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:23.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:23.111 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:23.107+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:23.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:46:23.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:23.235 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:23.231+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:23.294 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:23.294 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:23.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:23.314 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:23.307+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:23.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:23.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 Processor -- start 2024-09-13T18:46:23.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 -- start start 2024-09-13T18:46:23.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f840c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1f840c8950 0x7f1f8415cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f840c8370 con 0x7f1f84153840 2024-09-13T18:46:23.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8406b810 con 0x7f1f840c8950 2024-09-13T18:46:23.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8ac00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c8650 con 0x7f1f840c8f10 2024-09-13T18:46:23.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f88e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f840c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f89800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1f84153840 0x7f1f840ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:32956/0 (socket says 172.21.15.32:32956) 2024-09-13T18:46:23.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f89800700 1 -- 172.21.15.32:0/3447327507 learned_addr learned my addr 172.21.15.32:0/3447327507 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:23.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.351+0000 7f1f8a200700 1 --2- 172.21.15.32:0/3447327507 >> v2:172.21.15.32:3300/0 conn(0x7f1f840c8950 0x7f1f8415cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8a200700 1 -- 172.21.15.32:0/3447327507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 msgr2=0x7f1f840c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:23.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8a200700 1 --2- 172.21.15.32:0/3447327507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f840c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8a200700 1 -- 172.21.15.32:0/3447327507 >> v1:172.21.15.86:6789/0 conn(0x7f1f84153840 legacy=0x7f1f840ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:23.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f83e00700 1 -- 172.21.15.32:0/3447327507 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644244378 0 0) 0x7f1f840c8370 con 0x7f1f84153840 2024-09-13T18:46:23.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8a200700 1 -- 172.21.15.32:0/3447327507 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8406ae70 con 0x7f1f840c8950 2024-09-13T18:46:23.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8a200700 1 --2- 172.21.15.32:0/3447327507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8415cbe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009d90 tx=0x7f1f7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af5ef14846fecea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f83e00700 1 -- 172.21.15.32:0/3447327507 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00e070 con 0x7f1f840c8950 2024-09-13T18:46:23.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f83e00700 1 -- 172.21.15.32:0/3447327507 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c00bb20 con 0x7f1f840c8950 2024-09-13T18:46:23.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f83e00700 1 -- 172.21.15.32:0/3447327507 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c012430 con 0x7f1f840c8950 2024-09-13T18:46:23.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 -- 172.21.15.32:0/3447327507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 msgr2=0x7f1f8415cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:23.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/3447327507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8415cbe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009d90 tx=0x7f1f7c00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:23.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 -- 172.21.15.32:0/3447327507 shutdown_connections 2024-09-13T18:46:23.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/3447327507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8415cbe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/3447327507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f840c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 -- 172.21.15.32:0/3447327507 >> 172.21.15.32:0/3447327507 conn(0x7f1f84071740 msgr2=0x7f1f84071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:23.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 -- 172.21.15.32:0/3447327507 shutdown_connections 2024-09-13T18:46:23.365 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.355+0000 7f1f8ac00700 1 -- 172.21.15.32:0/3447327507 wait complete. 2024-09-13T18:46:23.366 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:23.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 Processor -- start 2024-09-13T18:46:23.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 -- start start 2024-09-13T18:46:23.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f8414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f84153840 0x7f1f8414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84147130 con 0x7f1f840c8950 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84147c70 con 0x7f1f84153840 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8ac00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84148130 con 0x7f1f840c8f10 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8a200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f84153840 0x7f1f8414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8a200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f84153840 0x7f1f8414ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37838/0 (socket says 172.21.15.32:37838) 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f8a200700 1 -- 172.21.15.32:0/2684759452 learned_addr learned my addr 172.21.15.32:0/2684759452 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f88e00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f8414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f89800700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f88e00700 1 -- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f84153840 msgr2=0x7f1f8414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f88e00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f84153840 0x7f1f8414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f88e00700 1 -- 172.21.15.32:0/2684759452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 msgr2=0x7f1f8414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:23.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f88e00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.359+0000 7f1f88e00700 1 -- 172.21.15.32:0/2684759452 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c009a70 con 0x7f1f840c8f10 2024-09-13T18:46:23.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.363+0000 7f1f88e00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f8414a740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000e900 tx=0x7f1f7000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.363+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70013680 con 0x7f1f840c8f10 2024-09-13T18:46:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.363+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f700137e0 con 0x7f1f840c8f10 2024-09-13T18:46:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.363+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70013b50 con 0x7f1f840c8f10 2024-09-13T18:46:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.363+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f84147340 con 0x7f1f840c8f10 2024-09-13T18:46:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.363+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f84147900 con 0x7f1f840c8f10 2024-09-13T18:46:23.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.367+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f84147e00 con 0x7f1f840c8f10 2024-09-13T18:46:23.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.367+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f70013cb0 con 0x7f1f840c8f10 2024-09-13T18:46:23.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.371+0000 7f1f81600700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1f64066730 0x7f1f64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.371+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f1f70084460 con 0x7f1f840c8f10 2024-09-13T18:46:23.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.371+0000 7f1f89800700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1f64066730 0x7f1f64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.376 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.371+0000 7f1f89800700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1f64066730 0x7f1f64068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000f60 tx=0x7f1f78007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.386 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.379+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f70051350 con 0x7f1f840c8f10 2024-09-13T18:46:23.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.395+0000 7f0c6fe00700 1 Processor -- start 2024-09-13T18:46:23.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6fe00700 1 -- start start 2024-09-13T18:46:23.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 0x7f0c70066c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0c700cb620 0x7f0c700cba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6fe00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700c61e0 con 0x7f0c700c6440 2024-09-13T18:46:23.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6fe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7015b2d0 con 0x7f0c700cb620 2024-09-13T18:46:23.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7015b6f0 con 0x7f0c701514a0 2024-09-13T18:46:23.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 0x7f0c70066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 0x7f0c70066c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51330/0 (socket says 172.21.15.32:51330) 2024-09-13T18:46:23.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 -- 172.21.15.32:0/55133454 learned_addr learned my addr 172.21.15.32:0/55133454 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:23.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 -- 172.21.15.32:0/55133454 >> v2:172.21.15.32:3300/0 conn(0x7f0c700cb620 msgr2=0x7f0c700cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:23.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/55133454 >> v2:172.21.15.32:3300/0 conn(0x7f0c700cb620 0x7f0c700cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 -- 172.21.15.32:0/55133454 >> v1:172.21.15.32:6789/0 conn(0x7f0c700c6440 legacy=0x7f0c700c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:23.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 -- 172.21.15.32:0/55133454 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700c57f0 con 0x7f0c701514a0 2024-09-13T18:46:23.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.399+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/55133454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 0x7f0c70066c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009910 tx=0x7f0c60009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c94cc4a478f4722 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6d600700 1 -- 172.21.15.32:0/55133454 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60004230 con 0x7f0c701514a0 2024-09-13T18:46:23.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6d600700 1 -- 172.21.15.32:0/55133454 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c60004390 con 0x7f0c701514a0 2024-09-13T18:46:23.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6d600700 1 -- 172.21.15.32:0/55133454 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009e60 con 0x7f0c701514a0 2024-09-13T18:46:23.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 -- 172.21.15.32:0/55133454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 msgr2=0x7f0c70066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:23.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/55133454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 0x7f0c70066c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009910 tx=0x7f0c60009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:23.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 -- 172.21.15.32:0/55133454 shutdown_connections 2024-09-13T18:46:23.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/55133454 >> v2:172.21.15.32:3300/0 conn(0x7f0c700cb620 0x7f0c700cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/55133454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c701514a0 0x7f0c70066c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 -- 172.21.15.32:0/55133454 >> 172.21.15.32:0/55133454 conn(0x7f0c70073720 msgr2=0x7f0c70073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:23.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 -- 172.21.15.32:0/55133454 shutdown_connections 2024-09-13T18:46:23.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 -- 172.21.15.32:0/55133454 wait complete. 2024-09-13T18:46:23.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 Processor -- start 2024-09-13T18:46:23.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.403+0000 7f0c6fe00700 1 -- start start 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c700c6440 0x7f0c70145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c700cb620 0x7f0c70144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c701514a0 0x7f0c7006dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7014c710 con 0x7f0c701514a0 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7006d970 con 0x7f0c700cb620 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7006cd80 con 0x7f0c700c6440 2024-09-13T18:46:23.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c701514a0 0x7f0c7006dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c700cb620 0x7f0c70144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c700cb620 0x7f0c70144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:37854/0 (socket says 172.21.15.32:37854) 2024-09-13T18:46:23.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6e000700 1 -- 172.21.15.32:0/3639814138 learned_addr learned my addr 172.21.15.32:0/3639814138 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:23.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c700c6440 msgr2=0x7f0c70145390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:46:23.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c700c6440 0x7f0c70145390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c700cb620 msgr2=0x7f0c70144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:23.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c700cb620 0x7f0c70144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:23.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60009570 con 0x7f0c701514a0 2024-09-13T18:46:23.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c701514a0 0x7f0c7006dd90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800be20 tx=0x7f0c68009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.413 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:23.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800cc10 con 0x7f0c701514a0 2024-09-13T18:46:23.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6800cd90 con 0x7f0c701514a0 2024-09-13T18:46:23.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.407+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68014680 con 0x7f0c701514a0 2024-09-13T18:46:23.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.411+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c701ebd00 con 0x7f0c701514a0 2024-09-13T18:46:23.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.411+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7006d2b0 con 0x7f0c701514a0 2024-09-13T18:46:23.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.411+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f0c700c6840 con 0x7f0c701514a0 2024-09-13T18:46:23.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c6801e440 con 0x7f0c701514a0 2024-09-13T18:46:23.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c66a00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0c50066780 0x7f0c50068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f0c680844a0 con 0x7f0c701514a0 2024-09-13T18:46:23.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v43) v1 ==== 54+0+16 (secure 0 0 0) 0x7f0c6808b070 con 0x7f0c701514a0 2024-09-13T18:46:23.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0c50066780 0x7f0c50068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0c70144f50 0x7f0c700c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c7015ac10 con 0x7f0c70144f50 2024-09-13T18:46:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c6e000700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0c70144f50 0x7f0c700c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.415+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0c50066780 0x7f0c50068c40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009910 tx=0x7f0c60008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.419+0000 7f0c6e000700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0c70144f50 0x7f0c700c20a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.419+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c5c0096a0 con 0x7f0c70144f50 2024-09-13T18:46:23.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.451+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c700c8800 con 0x7f0c70144f50 2024-09-13T18:46:23.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.455+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c5c009ba0 con 0x7f0c70144f50 2024-09-13T18:46:23.459 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:23.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.455+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0c701eea00 0x7f0c701eede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.455+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c701ef320 con 0x7f0c701eea00 2024-09-13T18:46:23.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.455+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0c701eea00 0x7f0c701eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.455+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0c701eea00 0x7f0c701eede0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.455+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c701ef320 con 0x7f0c701eea00 2024-09-13T18:46:23.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.487+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c700667c0 con 0x7f0c701eea00 2024-09-13T18:46:23.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.491+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c700667c0 con 0x7f0c701eea00 2024-09-13T18:46:23.495 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:23.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.491+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0c7014d6d0 0x7f0c7014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.491+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c7006ec30 con 0x7f0c7014d6d0 2024-09-13T18:46:23.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.491+0000 7f0c6e000700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0c7014d6d0 0x7f0c7014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.491+0000 7f0c6e000700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0c7014d6d0 0x7f0c7014dad0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.491+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c7006ec30 con 0x7f0c7014d6d0 2024-09-13T18:46:23.514 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:23.510+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:23.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.519+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c7014e010 con 0x7f0c7014d6d0 2024-09-13T18:46:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.523+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c7014e010 con 0x7f0c7014d6d0 2024-09-13T18:46:23.527 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.523+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0c70061430 0x7f0c70061870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.523+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c70061db0 con 0x7f0c70061430 2024-09-13T18:46:23.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.527+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0c70061430 0x7f0c70061870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.527+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0c70061430 0x7f0c70061870 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.527+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c680557d0 con 0x7f0c70061430 2024-09-13T18:46:23.562 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:23.562 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:23.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:23.562 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.235866496, 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:23.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:23.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:23.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.234560712000004, 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:23.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:23.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.574 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.233884662999998, 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:23.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:23.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.233872343000002, 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:23.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:23.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.589 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:23.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:23.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.233857588000006, 2024-09-13T18:46:23.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:23.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.590 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:23.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:23.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.233852536000001, 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.603 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.233847236000003, 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:23.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.228120829999995, 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:23.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:23.613 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.226798922, 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:23.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:23.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.226760623999994, 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:23.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.222407875000002, 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:23.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:23.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 69.617424446000001, 2024-09-13T18:46:23.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:23.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:23.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:23.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:23.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.555+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c700c9a80 con 0x7f0c70061430 2024-09-13T18:46:23.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:23.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:23.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.780986459000005, 2024-09-13T18:46:23.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:23.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:23.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:23.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:23.644 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.537771618000001, 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:23.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:23.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.650 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.226569417999997, 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:23.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:23.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.226540221999997, 2024-09-13T18:46:23.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:23.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.663 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.223366898999998, 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:23.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.152209679000002, 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:23.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:23.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:23.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5398~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7005286169999998, 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031271250000000001, 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.675 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858261+0000", 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858278+0000", 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858331+0000", 2024-09-13T18:46:23.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2884999999999999e-05 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858345+0000", 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4154e-05 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858429+0000", 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3588e-05 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858547+0000", 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011875 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858693+0000", 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001461 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860297+0000", 2024-09-13T18:46:23.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603033 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861283+0000", 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098661600000000006 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861346+0000", 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2866000000000004e-05 2024-09-13T18:46:23.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861391+0000", 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4713999999999999e-05 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:23.681 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7005011620000001, 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038877360000000001, 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:23.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858295+0000", 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.656e-06 2024-09-13T18:46:23.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858375+0000", 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9847999999999999e-05 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858386+0000", 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0665999999999999e-05 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859128+0000", 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074182399999999998 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859200+0000", 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2170999999999997e-05 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859298+0000", 2024-09-13T18:46:23.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8455000000000005e-05 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860602+0000", 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013036510000000001 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862094+0000", 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492581 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862141+0000", 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6585999999999997e-05 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862179+0000", 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7796000000000002e-05 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:23.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:23.688 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:23.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.559+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c700c9a80 con 0x7f0c70061430 2024-09-13T18:46:23.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:23.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.563+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0c700ca100 0x7f0c7002b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.563+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c700ca560 con 0x7f0c700ca100 2024-09-13T18:46:23.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.563+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0c700ca100 0x7f0c7002b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.563+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0c700ca100 0x7f0c7002b6a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.563+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c700ca560 con 0x7f0c700ca100 2024-09-13T18:46:23.691 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:23.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.595+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c700ca560 con 0x7f0c700ca100 2024-09-13T18:46:23.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.599+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c700ca560 con 0x7f0c700ca100 2024-09-13T18:46:23.691 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:23.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.599+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0c7002c0f0 0x7f0c7002c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:23.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.599+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c700ca6d0 con 0x7f0c7002c0f0 2024-09-13T18:46:23.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.599+0000 7f0c6e000700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0c7002c0f0 0x7f0c7002c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:23.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.599+0000 7f0c6e000700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0c7002c0f0 0x7f0c7002c570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:23.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:23.667+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7f1f84153c20 con 0x7f1f840c8f10 2024-09-13T18:46:23.735 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:23.731+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:23.793 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:23.787+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:23.894 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:23.890+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:23.913 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:23.913 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:23.913 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:23.913 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:23.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:24.047 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:24.043+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:24.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.083+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c700ca6d0 con 0x7f0c7002c0f0 2024-09-13T18:46:24.096 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:24.094+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:24.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.107+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c700ca6d0 con 0x7f0c7002c0f0 2024-09-13T18:46:24.116 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.111+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c700ca6d0 con 0x7f0c7002c0f0 2024-09-13T18:46:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:24.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.111+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0c70201df0 0x7f0c702041e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:24.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.111+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c7002cab0 con 0x7f0c70201df0 2024-09-13T18:46:24.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.111+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0c70201df0 0x7f0c702041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:24.117 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.111+0000 7f0c6f400700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0c70201df0 0x7f0c702041e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:24.119 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.115+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c7002cab0 con 0x7f0c70201df0 2024-09-13T18:46:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.143+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c7002cab0 con 0x7f0c70201df0 2024-09-13T18:46:24.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.147+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c7002cab0 con 0x7f0c70201df0 2024-09-13T18:46:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:24.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.147+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0c70204c30 0x7f0c70207020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:24.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.147+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c70209ea0 con 0x7f0c70204c30 2024-09-13T18:46:24.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.147+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0c70204c30 0x7f0c70207020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:24.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.147+0000 7f0c6ea00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0c70204c30 0x7f0c70207020 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:24.155 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:24.155 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:24.155 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:24.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.151+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0c70209ea0 con 0x7f0c70204c30 2024-09-13T18:46:24.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:24.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.171+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0c70207560 con 0x7f0c70204c30 2024-09-13T18:46:24.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f1f81600700 1 -- 172.21.15.32:0/2684759452 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v44) v1 ==== 87+0+0 (secure 0 0 0) 0x7f1f70017090 con 0x7f1f840c8f10 2024-09-13T18:46:24.182 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c66a00700 1 -- 172.21.15.32:0/3639814138 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0c70207560 con 0x7f0c70204c30 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0c70144f50 msgr2=0x7f0c700c20a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0c70144f50 0x7f0c700c20a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0c701eea00 msgr2=0x7f0c701eede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0c701eea00 0x7f0c701eede0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0c7014d6d0 msgr2=0x7f0c7014dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0c7014d6d0 0x7f0c7014dad0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0c70061430 msgr2=0x7f0c70061870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0c70061430 0x7f0c70061870 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0c700ca100 msgr2=0x7f0c7002b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0c700ca100 0x7f0c7002b6a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 reap_dead start 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 reap_dead start 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0c7002c0f0 msgr2=0x7f0c7002c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0c7002c0f0 0x7f0c7002c570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0c70201df0 msgr2=0x7f0c702041e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0c70201df0 0x7f0c702041e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0c70204c30 msgr2=0x7f0c70207020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0c70204c30 0x7f0c70207020 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0c50066780 msgr2=0x7f0c50068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0c50066780 0x7f0c50068c40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009910 tx=0x7f0c60008030 comp rx=0 tx=0).stop 2024-09-13T18:46:24.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c701514a0 msgr2=0x7f0c7006dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.175+0000 7f0c6fe00700 1 --2- 172.21.15.32:0/3639814138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c701514a0 0x7f0c7006dd90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800be20 tx=0x7f0c68009ed0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 reap_dead start 2024-09-13T18:46:24.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f0c6f400700 1 -- 172.21.15.32:0/3639814138 reap_dead start 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 shutdown_connections 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 >> 172.21.15.32:0/3639814138 conn(0x7f0c70073720 msgr2=0x7f0c700c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 shutdown_connections 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f0c6fe00700 1 -- 172.21.15.32:0/3639814138 wait complete. 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1f64066730 msgr2=0x7f1f64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1f64066730 0x7f1f64068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000f60 tx=0x7f1f78007e90 comp rx=0 tx=0).stop 2024-09-13T18:46:24.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 msgr2=0x7f1f8414a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f8414a740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000e900 tx=0x7f1f7000ec10 comp rx=0 tx=0).stop 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:24.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:24.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 shutdown_connections 2024-09-13T18:46:24.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1f64066730 0x7f1f64068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f84153840 0x7f1f8414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f840c8f10 0x7f1f8414a740 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 --2- 172.21.15.32:0/2684759452 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f840c8950 0x7f1f8414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:24.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 >> 172.21.15.32:0/2684759452 conn(0x7f1f84071740 msgr2=0x7f1f840ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:24.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 shutdown_connections 2024-09-13T18:46:24.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:24.179+0000 7f1f8ac00700 1 -- 172.21.15.32:0/2684759452 wait complete. 2024-09-13T18:46:24.189 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:46:24.197 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:24.191+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:24.298 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:24.294+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:24.374 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:24.374 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.049813345999993, 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:24.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:24.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:24.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.049793425000004, 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:24.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.386 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.049780999000006, 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:24.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:24.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:24.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.049773275999996, 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:24.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.049733091999997, 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:24.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.045753210000001, 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:24.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.044388663000007, 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:24.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.044351233, 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.043886853000004, 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:24.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.043455488000006, 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:24.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:24.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.042847073000004, 2024-09-13T18:46:24.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:24.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:24.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.042452655000005, 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:24.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:24.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.042398634999998, 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:24.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:24.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 78.040913922000001, 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:24.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:24.438 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:24.439 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:24.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:24.441 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:24.435+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:24.541 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:24.538+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:24.559 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:24.559 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:24.559 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:24.559 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:24.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:24.642 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:24.635+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:24.670 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:24.670 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:24.670 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:24.670 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:24.670 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:24.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:24.744 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:24.739+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:24.790 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:24.790 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:24.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:24.790 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:24.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.461277387999999, 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:24.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:24.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460520634000005, 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:24.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:24.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:24.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.800 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460501975, 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:24.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:24.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:24.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460489886000005, 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:24.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:24.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.811 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460483160999999, 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:24.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:24.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:24.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460476318999994, 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:24.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.822 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460470228000005, 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:24.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.827 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460445140000004, 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:24.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460440484000003, 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:24.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:24.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460426385000005, 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:24.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:24.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460414431000004, 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:24.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:24.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.850 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460405910999995, 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:24.855 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460400805999996, 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:24.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.460326511000005, 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.861 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.459405089000001, 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:24.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:24.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.459379932000004, 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:24.871 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:24.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:24.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:24.875 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.459323221999995, 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:24.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.455959469000007, 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:24.880 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.884 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.455179677999993, 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:24.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 72.960386611000004, 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:24.888 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:24.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:24.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:24.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:24.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:24.893 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:24.895 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:24.895 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:24.890+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:24.995 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:24.994+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:25.050 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.051 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:25.051 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:25.051 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:25.096 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:25.091+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:25.163 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.163 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:25.163 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:25.164 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:25.164 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.173 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:25.197 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:25.191+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:25.280 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.280 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:25.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:25.280 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:25.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.939067188999999, 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:46:25.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:46:25.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.927830194999999, 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:25.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:46:25.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:25.289 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.865058688999994, 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:25.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.293 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.834820550000003, 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:25.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:46:25.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.834212182000002, 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:46:25.298 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:46:25.302 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.465893355000006, 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:46:25.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:46:25.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.465111769999993, 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:46:25.310 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.464344581000006, 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:46:25.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:46:25.315 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.463509321999993, 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:25.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.319 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.462518709999998, 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:25.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 92.461905216000005, 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.328 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 91.55961911, 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 91.558345406000001, 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:46:25.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:46:25.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 91.550541779, 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:25.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:46:25.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.340 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 91.549768890999999, 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.341 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.951534898999995, 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:46:25.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.951509642000005, 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:25.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:46:25.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:46:25.354 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.951477499000006, 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:25.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:46:25.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.358 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.948716646999998, 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:46:25.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:46:25.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 78.945755876000007, 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:25.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:46:25.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:46:25.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:46:25.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.367 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:25.369 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:25.363+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:25.469 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:25.463+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:25.480 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.480 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:25.480 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:25.480 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:25.571 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:25.566+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:25.591 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.591 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:25.591 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:25.591 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:25.591 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.601 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:25.671 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:25.670+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:25.709 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.380346132, 2024-09-13T18:46:25.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:25.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:25.714 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.725 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:25.772 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:25.770+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:25.874 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:25.867+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:25.884 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.884 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:25.884 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:25.884 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:25.894 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:25.974 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:25.971+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:25.996 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:25.996 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:25.996 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:25.996 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:25.997 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:26.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:26.075 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:26.074+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:26.114 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.789631709000005, 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.115 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:46:26.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.789607841999995, 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:46:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.789597332, 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:26.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:46:26.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.789581331999997, 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:46:26.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:46:26.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:26.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.789574494999997, 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.137 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:46:26.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.786016368999995, 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:46:26.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.784205542999999, 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:26.147 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.150 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.784151851000004, 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:26.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:26.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.783107904000005, 2024-09-13T18:46:26.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:46:26.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:46:26.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.781552215999994, 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:26.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.163 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.781498468999999, 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:26.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.780259289, 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:46:26.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.780214053999998, 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:26.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.780179020000006, 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:46:26.176 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:46:26.180 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.780138789999995, 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:26.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.184 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.779446367999995, 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:26.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.779395679999993, 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:26.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:46:26.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.779002039999995, 2024-09-13T18:46:26.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:46:26.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:46:26.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 79.778605475999996, 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:46:26.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:26.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:26.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:26.202 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:26.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:26.204 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:26.199+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:26.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:26.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:46:26.304 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:26.299+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:26.405 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:26.402+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:26.426 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:26.426 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:26.426 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:26.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 Processor -- start 2024-09-13T18:46:26.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 -- start start 2024-09-13T18:46:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f21640c5dd0 0x7f21640c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2164157fd0 0x7f216406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21640c7820 con 0x7f21640c61b0 2024-09-13T18:46:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2164157bb0 con 0x7f2164157fd0 2024-09-13T18:46:26.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.435+0000 7f216a400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2164157300 con 0x7f21640c5dd0 2024-09-13T18:46:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2163e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f21640c61b0 0x7f216406e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:32970/0 (socket says 172.21.15.32:32970) 2024-09-13T18:46:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2163e00700 1 -- 172.21.15.32:0/849962694 learned_addr learned my addr 172.21.15.32:0/849962694 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169000700 1 --2- 172.21.15.32:0/849962694 >> v2:172.21.15.86:3300/0 conn(0x7f21640c5dd0 0x7f21640c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169a00700 1 --2- 172.21.15.32:0/849962694 >> v2:172.21.15.32:3300/0 conn(0x7f2164157fd0 0x7f216406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169000700 1 -- 172.21.15.32:0/849962694 >> v2:172.21.15.32:3300/0 conn(0x7f2164157fd0 msgr2=0x7f216406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169000700 1 --2- 172.21.15.32:0/849962694 >> v2:172.21.15.32:3300/0 conn(0x7f2164157fd0 0x7f216406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2163400700 1 -- 172.21.15.32:0/849962694 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675315630 0 0) 0x7f21640c7820 con 0x7f21640c61b0 2024-09-13T18:46:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169000700 1 -- 172.21.15.32:0/849962694 >> v1:172.21.15.86:6789/0 conn(0x7f21640c61b0 legacy=0x7f216406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169000700 1 -- 172.21.15.32:0/849962694 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21640c6fc0 con 0x7f21640c5dd0 2024-09-13T18:46:26.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2169000700 1 --2- 172.21.15.32:0/849962694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21640c5dd0 0x7f21640c6960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f21640c3290 tx=0x7f2158009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ece88eef7fd556 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2163400700 1 -- 172.21.15.32:0/849962694 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158010a90 con 0x7f21640c5dd0 2024-09-13T18:46:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2163400700 1 -- 172.21.15.32:0/849962694 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158010bf0 con 0x7f21640c5dd0 2024-09-13T18:46:26.445 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f2163400700 1 -- 172.21.15.32:0/849962694 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158018440 con 0x7f21640c5dd0 2024-09-13T18:46:26.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f15a5c00700 1 Processor -- start 2024-09-13T18:46:26.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f15a5c00700 1 -- start start 2024-09-13T18:46:26.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 -- 172.21.15.32:0/849962694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21640c5dd0 msgr2=0x7f21640c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 --2- 172.21.15.32:0/849962694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21640c5dd0 0x7f21640c6960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f21640c3290 tx=0x7f2158009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 -- 172.21.15.32:0/849962694 shutdown_connections 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 --2- 172.21.15.32:0/849962694 >> v2:172.21.15.32:3300/0 conn(0x7f2164157fd0 0x7f216406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 --2- 172.21.15.32:0/849962694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21640c5dd0 0x7f21640c6960 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f21640c3290 tx=0x7f2158009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 -- 172.21.15.32:0/849962694 >> 172.21.15.32:0/849962694 conn(0x7f21640c8a60 msgr2=0x7f21640c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 -- 172.21.15.32:0/849962694 shutdown_connections 2024-09-13T18:46:26.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.439+0000 7f216a400700 1 -- 172.21.15.32:0/849962694 wait complete. 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f15a5c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f15980361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f15a5c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f15980366e0 0x7f159800daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f15a5c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15980d6d90 con 0x7f15980d69b0 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f15a5c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15980e0bb0 con 0x7f15980366e0 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f15a5c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159804d3d0 con 0x7f159804e400 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159fe00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f15980d69b0 0x7f15980dd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41426/0 (socket says 172.21.15.32:41426) 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159fe00700 1 -- 172.21.15.32:0/2586197907 learned_addr learned my addr 172.21.15.32:0/2586197907 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159f400700 1 --2- 172.21.15.32:0/2586197907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f15980361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f15a5200700 1 --2- 172.21.15.32:0/2586197907 >> v2:172.21.15.32:3300/0 conn(0x7f15980366e0 0x7f159800daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 Processor -- start 2024-09-13T18:46:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159ea00700 1 -- 172.21.15.32:0/2586197907 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097134708 0 0) 0x7f15980d6d90 con 0x7f15980d69b0 2024-09-13T18:46:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159ea00700 1 -- 172.21.15.32:0/2586197907 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15880035d0 con 0x7f15980d69b0 2024-09-13T18:46:26.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 -- start start 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159f400700 1 -- 172.21.15.32:0/2586197907 >> v2:172.21.15.32:3300/0 conn(0x7f15980366e0 msgr2=0x7f159800daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159f400700 1 --2- 172.21.15.32:0/2586197907 >> v2:172.21.15.32:3300/0 conn(0x7f15980366e0 0x7f159800daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159f400700 1 -- 172.21.15.32:0/2586197907 >> v1:172.21.15.32:6789/0 conn(0x7f15980d69b0 legacy=0x7f15980dd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159f400700 1 -- 172.21.15.32:0/2586197907 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15980dfdf0 con 0x7f159804e400 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159f400700 1 --2- 172.21.15.32:0/2586197907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f15980361a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f158c009850 tx=0x7f158c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfb74858550398a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159ea00700 1 -- 172.21.15.32:0/2586197907 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c010a90 con 0x7f159804e400 2024-09-13T18:46:26.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159ea00700 1 -- 172.21.15.32:0/2586197907 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c010bf0 con 0x7f159804e400 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f159ea00700 1 -- 172.21.15.32:0/2586197907 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c018440 con 0x7f159804e400 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21640c61b0 0x7f2164073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 0x7f2164146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2164146f40 0x7f21641ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c4c20 con 0x7f2164157fd0 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640c46f0 con 0x7f2164146f40 2024-09-13T18:46:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.443+0000 7f216a400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21641556f0 con 0x7f21640c61b0 2024-09-13T18:46:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 -- 172.21.15.32:0/2586197907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 msgr2=0x7f15980361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2586197907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f15980361a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f158c009850 tx=0x7f158c009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 -- 172.21.15.32:0/2586197907 shutdown_connections 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2586197907 >> v2:172.21.15.32:3300/0 conn(0x7f15980366e0 0x7f159800daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2586197907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f15980361a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 -- 172.21.15.32:0/2586197907 >> 172.21.15.32:0/2586197907 conn(0x7f1598009a60 msgr2=0x7f1598009e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 -- 172.21.15.32:0/2586197907 shutdown_connections 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 -- 172.21.15.32:0/2586197907 wait complete. 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 0x7f2164146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 0x7f2164146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39236/0 (socket says 172.21.15.32:39236) 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 -- 172.21.15.32:0/3741813716 learned_addr learned my addr 172.21.15.32:0/3741813716 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2169000700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21640c61b0 0x7f2164073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2169a00700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2164146f40 0x7f21641ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 -- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21640c61b0 msgr2=0x7f2164073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21640c61b0 0x7f2164073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 -- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2164146f40 msgr2=0x7f21641ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2164146f40 0x7f21641ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 -- 172.21.15.32:0/3741813716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21580094b0 con 0x7f2164157fd0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2163e00700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 0x7f2164146a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f215000c4e0 tx=0x7f215000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150004ca0 con 0x7f2164157fd0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2150004e00 con 0x7f2164157fd0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21500072d0 con 0x7f2164157fd0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2164155210 con 0x7f2164157fd0 2024-09-13T18:46:26.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21641eb7f0 con 0x7f2164157fd0 2024-09-13T18:46:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.447+0000 7f15a5c00700 1 Processor -- start 2024-09-13T18:46:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 -- start start 2024-09-13T18:46:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21640745b0 con 0x7f2164157fd0 2024-09-13T18:46:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2150007430 con 0x7f2164157fd0 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15980366e0 0x7f1598173dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f1598051dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15980d69b0 0x7f1598047f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598174310 con 0x7f15980d69b0 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598173390 con 0x7f15980366e0 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1598170a80 con 0x7f159804e400 2024-09-13T18:46:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f1598051dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f1598051dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51370/0 (socket says 172.21.15.32:51370) 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 -- 172.21.15.32:0/2625948065 learned_addr learned my addr 172.21.15.32:0/2625948065 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15980d69b0 0x7f1598047f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15980366e0 msgr2=0x7f1598173dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15980366e0 0x7f1598173dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15980d69b0 msgr2=0x7f1598047f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f15980d69b0 0x7f1598047f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0094b0 con 0x7f159804e400 2024-09-13T18:46:26.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f1598051dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f159804d510 tx=0x7f158c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c018440 con 0x7f159804e400 2024-09-13T18:46:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c003af0 con 0x7f159804e400 2024-09-13T18:46:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c003ea0 con 0x7f159804e400 2024-09-13T18:46:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15981735c0 con 0x7f159804e400 2024-09-13T18:46:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1598170430 con 0x7f159804e400 2024-09-13T18:46:26.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f159804d7e0 con 0x7f159804e400 2024-09-13T18:46:26.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f2160c00700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2144066760 0x7f2144068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f2150084100 con 0x7f2164157fd0 2024-09-13T18:46:26.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.451+0000 7f2169000700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2144066760 0x7f2144068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.455+0000 7f2169000700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2144066760 0x7f2144068c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f21640c3260 tx=0x7f2158014000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f158c01f040 con 0x7f159804e400 2024-09-13T18:46:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f1593e00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1580066730 0x7f1580068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f158c08a1a0 con 0x7f159804e400 2024-09-13T18:46:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v44) v1 ==== 54+0+16 (secure 0 0 0) 0x7f158c08a510 con 0x7f159804e400 2024-09-13T18:46:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1580066730 0x7f1580068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f15981705f0 0x7f15980377e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15980e0690 con 0x7f15981705f0 2024-09-13T18:46:26.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f15981705f0 0x7f15980377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1580066730 0x7f1580068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1594000f60 tx=0x7f15940010a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f15981705f0 0x7f15980377e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.459+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2150051090 con 0x7f2164157fd0 2024-09-13T18:46:26.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.463+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f15a004ec20 con 0x7f15981705f0 2024-09-13T18:46:26.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.483+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f15980e03b0 con 0x7f15981705f0 2024-09-13T18:46:26.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.483+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f15a004ef50 con 0x7f15981705f0 2024-09-13T18:46:26.490 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.487+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f1598052300 0x7f15980ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.487+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1598170bc0 con 0x7f1598052300 2024-09-13T18:46:26.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.487+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f1598052300 0x7f15980ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.487+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f1598052300 0x7f15980ceea0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.487+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1594005de0 con 0x7f1598052300 2024-09-13T18:46:26.506 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:26.502+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:26.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.507+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f15980361a0 con 0x7f1598052300 2024-09-13T18:46:26.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.507+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f15980361a0 con 0x7f1598052300 2024-09-13T18:46:26.514 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:26.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.511+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f159804bff0 0x7f15980cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.511+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f159804daf0 con 0x7f159804bff0 2024-09-13T18:46:26.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.511+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f159804bff0 0x7f15980cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.511+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f159804bff0 0x7f15980cdbe0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.511+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f159804daf0 con 0x7f159804bff0 2024-09-13T18:46:26.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.527+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f15980ce120 con 0x7f159804bff0 2024-09-13T18:46:26.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.531+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f15980ce120 con 0x7f159804bff0 2024-09-13T18:46:26.536 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:26.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.531+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f1598007d60 0x7f1598008180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.531+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15980086c0 con 0x7f1598007d60 2024-09-13T18:46:26.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.531+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f1598007d60 0x7f1598008180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.531+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f1598007d60 0x7f1598008180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.535+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f15980086c0 con 0x7f1598007d60 2024-09-13T18:46:26.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.563+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f1598002bb0 con 0x7f1598007d60 2024-09-13T18:46:26.569 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.563+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f1598002bb0 con 0x7f1598007d60 2024-09-13T18:46:26.570 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:26.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.563+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1598003230 0x7f1598001180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.563+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1598003690 con 0x7f1598003230 2024-09-13T18:46:26.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.567+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1598003230 0x7f1598001180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.567+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1598003230 0x7f1598001180 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.567+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1598003690 con 0x7f1598003230 2024-09-13T18:46:26.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.599+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f1598003690 con 0x7f1598003230 2024-09-13T18:46:26.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.603+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f1598003690 con 0x7f1598003230 2024-09-13T18:46:26.607 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:26.602+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:26.607 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:26.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.603+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f1598001bd0 0x7f1598002030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.603+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1598008830 con 0x7f1598001bd0 2024-09-13T18:46:26.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.603+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f1598001bd0 0x7f1598002030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.603+0000 7f159f400700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f1598001bd0 0x7f1598002030 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.603+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1598008830 con 0x7f1598001bd0 2024-09-13T18:46:26.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.631+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f1598008830 con 0x7f1598001bd0 2024-09-13T18:46:26.638 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:26.638 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:26.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.635+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f1598008830 con 0x7f1598001bd0 2024-09-13T18:46:26.641 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:26.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.635+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1598186c30 0x7f1598189020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.635+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1598003900 con 0x7f1598186c30 2024-09-13T18:46:26.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.639+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1598186c30 0x7f1598189020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.639+0000 7f15a5200700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1598186c30 0x7f1598189020 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.645 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.639+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1598003900 con 0x7f1598186c30 2024-09-13T18:46:26.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:26.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.663+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f1598003900 con 0x7f1598186c30 2024-09-13T18:46:26.673 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:26.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.667+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f1598003900 con 0x7f1598186c30 2024-09-13T18:46:26.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.667+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1598189a70 0x7f159818be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:26.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.667+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15980027b0 con 0x7f1598189a70 2024-09-13T18:46:26.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.667+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1598189a70 0x7f159818be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:26.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.667+0000 7f159fe00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1598189a70 0x7f159818be60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:26.674 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.671+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f15980027b0 con 0x7f1598189a70 2024-09-13T18:46:26.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.691+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f15980027b0 con 0x7f1598189a70 2024-09-13T18:46:26.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f1593e00700 1 -- 172.21.15.32:0/2625948065 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f15980027b0 con 0x7f1598189a70 2024-09-13T18:46:26.701 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f15981705f0 msgr2=0x7f15980377e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f15981705f0 0x7f15980377e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f1598052300 msgr2=0x7f15980ceea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f1598052300 0x7f15980ceea0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f159804bff0 msgr2=0x7f15980cdbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f159804bff0 0x7f15980cdbe0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f1598007d60 msgr2=0x7f1598008180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f1598007d60 0x7f1598008180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1598003230 msgr2=0x7f1598001180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1598003230 0x7f1598001180 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f1598001bd0 msgr2=0x7f1598002030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f1598001bd0 0x7f1598002030 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1598186c30 msgr2=0x7f1598189020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f1598186c30 0x7f1598189020 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1598189a70 msgr2=0x7f159818be60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f1598189a70 0x7f159818be60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.695+0000 7f15a5200700 1 -- 172.21.15.32:0/2625948065 reap_dead start 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5200700 1 -- 172.21.15.32:0/2625948065 reap_dead start 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1580066730 msgr2=0x7f1580068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1580066730 0x7f1580068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1594000f60 tx=0x7f15940010a0 comp rx=0 tx=0).stop 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5200700 1 -- 172.21.15.32:0/2625948065 reap_dead start 2024-09-13T18:46:26.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5200700 1 -- 172.21.15.32:0/2625948065 reap_dead start 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 msgr2=0x7f1598051dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 --2- 172.21.15.32:0/2625948065 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f159804e400 0x7f1598051dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f159804d510 tx=0x7f158c004770 comp rx=0 tx=0).stop 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5200700 1 -- 172.21.15.32:0/2625948065 reap_dead start 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 shutdown_connections 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 >> 172.21.15.32:0/2625948065 conn(0x7f1598009a60 msgr2=0x7f15980d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 shutdown_connections 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.699+0000 7f15a5c00700 1 -- 172.21.15.32:0/2625948065 wait complete. 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:26.705 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:26.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:26.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:26.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:26.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:26.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:26.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:26.707 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:26.703+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:26.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:26.743+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7f21640c57f0 con 0x7f2164157fd0 2024-09-13T18:46:26.808 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:26.803+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:26.853 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:26.853 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:26.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:26.911 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:26.907+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:27.010 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:27.003+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:27.111 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:27.107+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:27.121 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:27.121 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:27.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:27.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.175+0000 7f2160c00700 1 -- 172.21.15.32:0/3741813716 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f21500546b0 con 0x7f2164157fd0 2024-09-13T18:46:27.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2144066760 msgr2=0x7f2144068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:27.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2144066760 0x7f2144068c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f21640c3260 tx=0x7f2158014000 comp rx=0 tx=0).stop 2024-09-13T18:46:27.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 msgr2=0x7f2164146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:27.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 0x7f2164146a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f215000c4e0 tx=0x7f215000c7f0 comp rx=0 tx=0).stop 2024-09-13T18:46:27.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 shutdown_connections 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2144066760 0x7f2144068c20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2164146f40 0x7f21641ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2164157fd0 0x7f2164146a00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 --2- 172.21.15.32:0/3741813716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21640c61b0 0x7f2164073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 >> 172.21.15.32:0/3741813716 conn(0x7f21640c8a60 msgr2=0x7f21640b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 shutdown_connections 2024-09-13T18:46:27.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:27.179+0000 7f216a400700 1 -- 172.21.15.32:0/3741813716 wait complete. 2024-09-13T18:46:27.187 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:46:27.211 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:27.210+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:27.312 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:27.310+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:27.347 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:27.347 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:27.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:27.397 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:27.397 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:27.397 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-13T18:46:27.397 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T18:46:27.398 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T18:46:27.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-13T18:46:27.444 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:27.442+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:27.514 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:27.507+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:27.515 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:27.515 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T18:46:27.515 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:27.523 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:27.523 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:27.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:27.643 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:27.639+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:27.715 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:27.714+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:27.771 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:27.771 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:27.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:27.816 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:27.814+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:27.917 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:27.914+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:27.988 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:27.988 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:28.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:28.051 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:28.047+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:28.119 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:28.118+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:28.166 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:28.166 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:28.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:28.222 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:28.219+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:28.321 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:28.318+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:28.379 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:28.379 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:28.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:28.446 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:28.443+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:28.522 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:28.519+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:28.544 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:28.544 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:28.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:28.623 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:28.622+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:28.724 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:28.722+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:28.727 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:28.769 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:28.769 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:28.790 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:28.836 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:28.834+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.879+0000 7f6a1ac00700 1 Processor -- start 2024-09-13T18:46:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.879+0000 7f6a1ac00700 1 -- start start 2024-09-13T18:46:28.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6a140719b0 0x7f6a1415b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a14071d90 0x7f6a141511d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1415b8a0 con 0x7f6a140c7070 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140c2230 con 0x7f6a14071d90 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140c24f0 con 0x7f6a140719b0 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a14071d90 0x7f6a141511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a14071d90 0x7f6a141511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35232/0 (socket says 172.21.15.32:35232) 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 -- 172.21.15.32:0/36207448 learned_addr learned my addr 172.21.15.32:0/36207448 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1a200700 1 --1- 172.21.15.32:0/36207448 >> v1:172.21.15.32:6789/0 conn(0x7f6a140c7070 0x7f6a14157990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44828/0 (socket says 172.21.15.32:44828) 2024-09-13T18:46:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a19800700 1 --2- 172.21.15.32:0/36207448 >> v2:172.21.15.86:3300/0 conn(0x7f6a140719b0 0x7f6a1415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 -- 172.21.15.32:0/36207448 >> v2:172.21.15.86:3300/0 conn(0x7f6a140719b0 msgr2=0x7f6a1415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 --2- 172.21.15.32:0/36207448 >> v2:172.21.15.86:3300/0 conn(0x7f6a140719b0 0x7f6a1415b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 -- 172.21.15.32:0/36207448 >> v1:172.21.15.32:6789/0 conn(0x7f6a140c7070 legacy=0x7f6a14157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 -- 172.21.15.32:0/36207448 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140c3ed0 con 0x7f6a14071d90 2024-09-13T18:46:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a18e00700 1 --2- 172.21.15.32:0/36207448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141511d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a14072290 tx=0x7f6a00009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8854cd80cf668d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a13e00700 1 -- 172.21.15.32:0/36207448 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00004230 con 0x7f6a14071d90 2024-09-13T18:46:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a13e00700 1 -- 172.21.15.32:0/36207448 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00004390 con 0x7f6a14071d90 2024-09-13T18:46:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a13e00700 1 -- 172.21.15.32:0/36207448 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000036c0 con 0x7f6a14071d90 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- 172.21.15.32:0/36207448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 msgr2=0x7f6a141511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 --2- 172.21.15.32:0/36207448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141511d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a14072290 tx=0x7f6a00009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- 172.21.15.32:0/36207448 shutdown_connections 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 --2- 172.21.15.32:0/36207448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141511d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 --2- 172.21.15.32:0/36207448 >> v2:172.21.15.86:3300/0 conn(0x7f6a140719b0 0x7f6a1415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- 172.21.15.32:0/36207448 >> 172.21.15.32:0/36207448 conn(0x7f6a1406a7d0 msgr2=0x7f6a1406e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- 172.21.15.32:0/36207448 shutdown_connections 2024-09-13T18:46:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.883+0000 7f6a1ac00700 1 -- 172.21.15.32:0/36207448 wait complete. 2024-09-13T18:46:28.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 Processor -- start 2024-09-13T18:46:28.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 -- start start 2024-09-13T18:46:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a140719b0 0x7f6a140c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a140c7070 0x7f6a140cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a141f0960 con 0x7f6a14071d90 2024-09-13T18:46:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140c5340 con 0x7f6a140719b0 2024-09-13T18:46:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1ac00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140c9b40 con 0x7f6a140c7070 2024-09-13T18:46:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35248/0 (socket says 172.21.15.32:35248) 2024-09-13T18:46:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 -- 172.21.15.32:0/1789767425 learned_addr learned my addr 172.21.15.32:0/1789767425 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a140719b0 0x7f6a140c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a140c7070 0x7f6a140cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a140c7070 msgr2=0x7f6a140cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a140c7070 0x7f6a140cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a140719b0 msgr2=0x7f6a140c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a140719b0 0x7f6a140c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.887+0000 7f6a18e00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009570 con 0x7f6a14071d90 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141553f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6a00004000 tx=0x7f6a00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00011630 con 0x7f6a14071d90 2024-09-13T18:46:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00011790 con 0x7f6a14071d90 2024-09-13T18:46:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a1ac00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a14155930 con 0x7f6a14071d90 2024-09-13T18:46:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00011b40 con 0x7f6a14071d90 2024-09-13T18:46:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a1ac00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a141f0b70 con 0x7f6a14071d90 2024-09-13T18:46:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f69e80052f0 con 0x7f6a14071d90 2024-09-13T18:46:28.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.891+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a00022070 con 0x7f6a14071d90 2024-09-13T18:46:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a11600700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f69f4066730 0x7f69f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f6a00085f40 con 0x7f6a14071d90 2024-09-13T18:46:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v45) v1 ==== 54+0+16 (secure 0 0 0) 0x7f6a000884a0 con 0x7f6a14071d90 2024-09-13T18:46:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f69f4066730 0x7f69f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f69e8000f90 0x7f69e8004660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e8005590 con 0x7f69e8000f90 2024-09-13T18:46:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f69e8000f90 0x7f69e8004660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f69f4066730 0x7f69f4068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009bf0 tx=0x7f6a08009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f69e8000f90 0x7f69e8004660 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.895+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e8005590 con 0x7f69e8000f90 2024-09-13T18:46:28.906 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:28.907 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:28.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:28.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.915+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e8004ef0 con 0x7f69e8000f90 2024-09-13T18:46:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.915+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e8004ef0 con 0x7f69e8000f90 2024-09-13T18:46:28.922 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.919+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f69e8001cb0 0x7f69e8002960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.919+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e8002140 con 0x7f69e8001cb0 2024-09-13T18:46:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.919+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f69e8001cb0 0x7f69e8002960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.919+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f69e8001cb0 0x7f69e8002960 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.919+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e8002140 con 0x7f69e8001cb0 2024-09-13T18:46:28.926 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:28.923+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:28.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.935+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e8003160 con 0x7f69e8001cb0 2024-09-13T18:46:28.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.939+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e8003160 con 0x7f69e8001cb0 2024-09-13T18:46:28.944 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:28.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.939+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f69e8003b90 0x7f69e800bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.939+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e800ec50 con 0x7f69e8003b90 2024-09-13T18:46:28.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.939+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f69e8003b90 0x7f69e800bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.939+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f69e8003b90 0x7f69e800bcd0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.943+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e800ec50 con 0x7f69e8003b90 2024-09-13T18:46:28.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.963+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e800c4d0 con 0x7f69e8003b90 2024-09-13T18:46:28.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.963+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e800c4d0 con 0x7f69e8003b90 2024-09-13T18:46:28.969 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:28.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.963+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f69e800cf00 0x7f69e800d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:28.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.963+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e800daf0 con 0x7f69e800cf00 2024-09-13T18:46:28.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.963+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f69e800cf00 0x7f69e800d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:28.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.963+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f69e800cf00 0x7f69e800d360 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:28.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.967+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e800daf0 con 0x7f69e800cf00 2024-09-13T18:46:28.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.991+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e800df30 con 0x7f69e800cf00 2024-09-13T18:46:29.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.995+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e800df30 con 0x7f69e800cf00 2024-09-13T18:46:29.000 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.995+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f69e800e660 0x7f69e8012de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.995+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e8015d30 con 0x7f69e800e660 2024-09-13T18:46:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.995+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f69e800e660 0x7f69e8012de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.995+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f69e800e660 0x7f69e8012de0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:28.999+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e8015d30 con 0x7f69e800e660 2024-09-13T18:46:29.020 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:29.020 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:29.027 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:29.023+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.023+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e8013320 con 0x7f69e800e660 2024-09-13T18:46:29.034 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.027+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e8013320 con 0x7f69e800e660 2024-09-13T18:46:29.035 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.027+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f69e8013a00 0x7f69e8013e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.031+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e80190c0 con 0x7f69e8013a00 2024-09-13T18:46:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.031+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f69e8013a00 0x7f69e8013e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.031+0000 7f6a18e00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f69e8013a00 0x7f69e8013e60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.031+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e80190c0 con 0x7f69e8013a00 2024-09-13T18:46:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.059+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e8017f40 con 0x7f69e8013a00 2024-09-13T18:46:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.063+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e8017f40 con 0x7f69e8013a00 2024-09-13T18:46:29.067 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.063+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f69e80185e0 0x7f69e8018a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.063+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e801c470 con 0x7f69e80185e0 2024-09-13T18:46:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.063+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f69e80185e0 0x7f69e8018a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.063+0000 7f6a1a200700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f69e80185e0 0x7f69e8018a40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.063+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e801c470 con 0x7f69e80185e0 2024-09-13T18:46:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.091+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e80143a0 con 0x7f69e80185e0 2024-09-13T18:46:29.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.095+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e80143a0 con 0x7f69e80185e0 2024-09-13T18:46:29.100 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.095+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 0x7f69e8014d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.095+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e8015250 con 0x7f69e80148b0 2024-09-13T18:46:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.095+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 0x7f69e8014d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.095+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 0x7f69e8014d10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.099+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e8015250 con 0x7f69e80148b0 2024-09-13T18:46:29.129 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:29.126+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e8015250 con 0x7f69e80148b0 2024-09-13T18:46:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a19800700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 msgr2=0x7f69e8014d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 28 2024-09-13T18:46:29.130 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a19800700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 msgr2=0x7f69e8014d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 0x7f69e8014d10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 0x7f69e8014d10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 msgr2=0x7f69e8014d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.123+0000 7f6a11600700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69e80148b0 0x7f69e8014d10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.127+0000 7f6a11600700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69f4071a00 0x7f69f4073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.127+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f69e800daf0 con 0x7f69f4071a00 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.127+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=46}) v3 -- 0x7f69f4074330 con 0x7f6a14071d90 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.127+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69f4071a00 0x7f69f4073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.127+0000 7f6a19800700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69f4071a00 0x7f69f4073df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a11600700 1 -- 172.21.15.32:0/1789767425 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f69e800daf0 con 0x7f69f4071a00 2024-09-13T18:46:29.135 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f69e8000f90 msgr2=0x7f69e8004660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f69e8000f90 0x7f69e8004660 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f69e8001cb0 msgr2=0x7f69e8002960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f69e8001cb0 0x7f69e8002960 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f69e8003b90 msgr2=0x7f69e800bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f69e8003b90 0x7f69e800bcd0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f69e800cf00 msgr2=0x7f69e800d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f69e800cf00 0x7f69e800d360 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f69e800e660 msgr2=0x7f69e8012de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f69e800e660 0x7f69e8012de0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f69e8013a00 msgr2=0x7f69e8013e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f69e8013a00 0x7f69e8013e60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f69e80185e0 msgr2=0x7f69e8018a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f69e80185e0 0x7f69e8018a40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69f4071a00 msgr2=0x7f69f4073df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f69f4071a00 0x7f69f4073df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a1a200700 1 -- 172.21.15.32:0/1789767425 reap_dead start 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a1a200700 1 -- 172.21.15.32:0/1789767425 reap_dead start 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a1a200700 1 -- 172.21.15.32:0/1789767425 reap_dead start 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a1a200700 1 -- 172.21.15.32:0/1789767425 reap_dead start 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a1a200700 1 -- 172.21.15.32:0/1789767425 reap_dead start 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f69f4066730 msgr2=0x7f69f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f69f4066730 0x7f69f4068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009bf0 tx=0x7f6a08009240 comp rx=0 tx=0).stop 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 msgr2=0x7f6a141553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141553f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6a00004000 tx=0x7f6a00004770 comp rx=0 tx=0).stop 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 shutdown_connections 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f69f4066730 0x7f69f4068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 --2- 172.21.15.32:0/1789767425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a14071d90 0x7f6a141553f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 >> 172.21.15.32:0/1789767425 conn(0x7f6a1406a7d0 msgr2=0x7f6a1414a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 shutdown_connections 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.131+0000 7f6a06a00700 1 -- 172.21.15.32:0/1789767425 wait complete. 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:29.140 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.815246641000002, 2024-09-13T18:46:29.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.148 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814489886999993, 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:29.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:29.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814471228000002, 2024-09-13T18:46:29.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:29.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:29.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.159 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814459138999993, 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:29.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:29.165 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814452414000002, 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:29.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814445571999997, 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:29.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:29.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:29.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814439480999994, 2024-09-13T18:46:29.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:29.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814414393000007, 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:29.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814409737000005, 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:29.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:29.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814395637999993, 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:29.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:29.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:29.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814383684000006, 2024-09-13T18:46:29.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:29.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:29.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.205 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814375163999998, 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:29.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:29.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814370058999998, 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:29.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.216 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.814295763999993, 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:29.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.813374342000003, 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:29.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:29.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.813349185000007, 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:29.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:29.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.230 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.813292474999997, 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:29.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.809928721999995, 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.235 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:29.239 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 82.809148930999996, 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:29.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:29.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 77.314355864000007, 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:29.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:29.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:29.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.248 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:29.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:46:29.251 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:29.251 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:29.246+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:29.351 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:29.347+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:29.366 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:29.366 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:29.366 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:29.366 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:29.376 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.439+0000 7f225f200700 1 Processor -- start 2024-09-13T18:46:29.444 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.439+0000 7f225f200700 1 -- start start 2024-09-13T18:46:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2258048bc0 0x7f225804cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22580e2c30 con 0x7f225804d4d0 2024-09-13T18:46:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22580e2020 con 0x7f22580d89f0 2024-09-13T18:46:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225804d8d0 con 0x7f2258048bc0 2024-09-13T18:46:29.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225d400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2258048bc0 0x7f225804cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225de00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f22580d89f0 0x7f225800daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52086/0 (socket says 172.21.15.32:52086) 2024-09-13T18:46:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225e800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f225804d4d0 0x7f22580dea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44844/0 (socket says 172.21.15.32:44844) 2024-09-13T18:46:29.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225de00700 1 -- 172.21.15.32:0/2089956689 learned_addr learned my addr 172.21.15.32:0/2089956689 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225ca00700 1 -- 172.21.15.32:0/2089956689 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783143752 0 0) 0x7f22580e2c30 con 0x7f225804d4d0 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225d400700 1 -- 172.21.15.32:0/2089956689 >> v1:172.21.15.86:6789/0 conn(0x7f22580d89f0 legacy=0x7f225800daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225d400700 1 -- 172.21.15.32:0/2089956689 >> v1:172.21.15.32:6789/0 conn(0x7f225804d4d0 legacy=0x7f22580dea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225d400700 1 -- 172.21.15.32:0/2089956689 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580e2300 con 0x7f2258048bc0 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225d400700 1 --2- 172.21.15.32:0/2089956689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2258048bc0 0x7f225804cf90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097d0 tx=0x7f224c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa48af8f8ae4b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225ca00700 1 -- 172.21.15.32:0/2089956689 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c004230 con 0x7f2258048bc0 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225ca00700 1 -- 172.21.15.32:0/2089956689 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c004390 con 0x7f2258048bc0 2024-09-13T18:46:29.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225ca00700 1 -- 172.21.15.32:0/2089956689 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c0036c0 con 0x7f2258048bc0 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- 172.21.15.32:0/2089956689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2258048bc0 msgr2=0x7f225804cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 --2- 172.21.15.32:0/2089956689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2258048bc0 0x7f225804cf90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097d0 tx=0x7f224c009ae0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- 172.21.15.32:0/2089956689 shutdown_connections 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 --2- 172.21.15.32:0/2089956689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2258048bc0 0x7f225804cf90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- 172.21.15.32:0/2089956689 >> 172.21.15.32:0/2089956689 conn(0x7f2258009a80 msgr2=0x7f2258009e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- 172.21.15.32:0/2089956689 shutdown_connections 2024-09-13T18:46:29.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.443+0000 7f225f200700 1 -- 172.21.15.32:0/2089956689 wait complete. 2024-09-13T18:46:29.451 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:29.450+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 Processor -- start 2024-09-13T18:46:29.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 -- start start 2024-09-13T18:46:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 0x7f2258168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f225804d4d0 0x7f225804fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22580d89f0 0x7f22580c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580517d0 con 0x7f22580d89f0 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580514a0 con 0x7f2258048bc0 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.447+0000 7f225f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22580dfe90 con 0x7f225804d4d0 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 0x7f2258168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f225804d4d0 0x7f225804fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 0x7f2258168f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52828/0 (socket says 172.21.15.32:52828) 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 -- 172.21.15.32:0/2311277819 learned_addr learned my addr 172.21.15.32:0/2311277819 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:29.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225e800700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22580d89f0 0x7f22580c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 -- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f225804d4d0 msgr2=0x7f225804fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f225804d4d0 0x7f225804fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 -- 172.21.15.32:0/2311277819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22580d89f0 msgr2=0x7f22580c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22580d89f0 0x7f22580c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 -- 172.21.15.32:0/2311277819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0094b0 con 0x7f2258048bc0 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225e800700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22580d89f0 0x7f22580c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225d400700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f225804d4d0 0x7f225804fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225de00700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 0x7f2258168f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f225000c780 tx=0x7f225000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250004ca0 con 0x7f2258048bc0 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250004e00 con 0x7f2258048bc0 2024-09-13T18:46:29.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22580e18d0 con 0x7f2258048bc0 2024-09-13T18:46:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500072f0 con 0x7f2258048bc0 2024-09-13T18:46:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2258008e50 con 0x7f2258048bc0 2024-09-13T18:46:29.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.451+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2258051610 con 0x7f2258048bc0 2024-09-13T18:46:29.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.455+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2250007450 con 0x7f2258048bc0 2024-09-13T18:46:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.455+0000 7f2256000700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2240066760 0x7f2240068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:29.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.455+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f2250084190 con 0x7f2258048bc0 2024-09-13T18:46:29.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.455+0000 7f225d400700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2240066760 0x7f2240068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:29.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.455+0000 7f225d400700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2240066760 0x7f2240068c20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097d0 tx=0x7f224c010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:29.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.459+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2258051610 con 0x7f2258048bc0 2024-09-13T18:46:29.487 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:29.487 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:29.487 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:29.497 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:29.553 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:29.547+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:29.606 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 97.265403857999999, 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:29.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:46:29.611 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 97.254166863999998, 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.615 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 97.191395357999994, 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:46:29.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 97.161157219000003, 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:46:29.620 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:29.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:46:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 97.160548851000001, 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:46:29.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 96.792230024000006, 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:46:29.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:46:29.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:46:29.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 96.791448439000007, 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:46:29.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 96.790681250000006, 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:46:29.642 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:46:29.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.646 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 96.789845990999993, 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:29.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:46:29.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 96.788855378999997, 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.651 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:46:29.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:46:29.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 96.788241885000005, 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 95.885955779, 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:46:29.660 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:46:29.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:46:29.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.664 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 95.884682075000001, 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:46:29.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 95.876878447999999, 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.669 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:46:29.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.673 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 95.876105559999999, 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:46:29.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.277871567999995, 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.678 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:46:29.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.683 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.277846311000005, 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:46:29.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.277814168000006, 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:46:29.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.691 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.275053315999997, 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:46:29.695 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.272092545000007, 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:46:29.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:29.700 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:29.702 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:29.702 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:29.695+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:29.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:29.727+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7f22580515e0 con 0x7f2258048bc0 2024-09-13T18:46:29.803 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:29.799+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:29.813 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:29.813 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:29.814 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:29.814 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:29.824 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:29.904 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:29.899+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:29.927 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:29.927 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:29.927 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:29.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:30.006 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:29.999+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:30.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 83.717373882999993, 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:30.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:46:30.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.050 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:30.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:30.106 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:30.103+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:30.165 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:30.165 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:30.165 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:30.175 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:30.207 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:30.203+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:30.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.211+0000 7f2256000700 1 -- 172.21.15.32:0/2311277819 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v46) v1 ==== 91+0+0 (secure 0 0 0) 0x7f2250051110 con 0x7f2258048bc0 2024-09-13T18:46:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2240066760 msgr2=0x7f2240068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2240066760 0x7f2240068c20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097d0 tx=0x7f224c010000 comp rx=0 tx=0).stop 2024-09-13T18:46:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 msgr2=0x7f2258168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:30.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 0x7f2258168f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f225000c780 tx=0x7f225000ca90 comp rx=0 tx=0).stop 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 shutdown_connections 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2240066760 0x7f2240068c20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22580d89f0 0x7f22580c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f225804d4d0 0x7f225804fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 --2- 172.21.15.32:0/2311277819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2258048bc0 0x7f2258168f90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 >> 172.21.15.32:0/2311277819 conn(0x7f2258009a80 msgr2=0x7f225800daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 shutdown_connections 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:30.215+0000 7f225f200700 1 -- 172.21.15.32:0/2311277819 wait complete. 2024-09-13T18:46:30.221 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:46:30.282 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:30.282 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:30.282 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:30.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:30.308 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:30.306+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:30.400 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.075600984000005, 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.401 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:46:30.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:46:30.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:46:30.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.075577116999995, 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:30.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:30.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:46:30.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.075566606999999, 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:46:30.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:46:30.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:30.418 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.075550606999997, 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:30.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:46:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:30.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.424 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.075543769999996, 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:46:30.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:46:30.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:46:30.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.071985643999994, 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:46:30.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:46:30.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.434 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.070174817999998, 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:46:30.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:30.438 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.070121126000004, 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.442 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.069077179000004, 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:46:30.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:46:30.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.067521490999994, 2024-09-13T18:46:30.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:46:30.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:46:30.451 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.067467743999998, 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:30.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.066228563999999, 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:46:30.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.066183328999998, 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:30.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.066148295000005, 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:46:30.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.066108064999995, 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.469 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.473 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.065415642999994, 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:46:30.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:46:30.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.065364955000007, 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:46:30.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.064971314999994, 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:46:30.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 84.064574750999995, 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:46:30.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:30.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:30.491 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:30.493 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:30.490+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:30.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:30.594 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:30.591+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:30.647 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:30.647 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:30.647 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:30.647 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:30.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:30.702 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:30.699+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:30.796 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:30.794+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:30.850 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:30.850 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:30.850 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:30.850 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:30.850 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:30.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:30.910 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:30.907+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:30.997 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:30.991+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:31.013 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.690002851000003, 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:46:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.689978865, 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:46:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.689969958999995, 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:46:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:46:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.689967086999999, 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:46:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:46:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.689964379000003, 2024-09-13T18:46:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:46:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.686837311999994, 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:46:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.685786625000006, 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:46:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:46:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:46:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.685432038000002, 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:46:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:46:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:46:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.685286880000007, 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.685189465999997, 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:46:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:46:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:46:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.685108353000004, 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.684857851000004, 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.683763576000004, 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:46:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:46:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.683682626999996, 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:46:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.681579974000002, 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 79.183588286000003, 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:46:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(2.7 35/34 [PushReplyOp(2:e0b41d06:::609.00000000:head)])", 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.218897986999998, 2024-09-13T18:46:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229566, 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791243+0000", 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791249+0000", 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6380000000000001e-06 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791257+0000", 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8639999999999996e-06 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791264+0000", 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791309+0000", 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4860000000000001e-05 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791473+0000", 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164644 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:31.096 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:31.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:31.098 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:31.091+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:31.199 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:31.194+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:31.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:31.299 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:31.295+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:31.302 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:31.302 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:31.302 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:31.302 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:31.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:31.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.395+0000 7f937b400700 1 Processor -- start 2024-09-13T18:46:31.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.395+0000 7f937b400700 1 -- start start 2024-09-13T18:46:31.401 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:31.398+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:31.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f937b400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9374066c20 0x7f93740c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f937b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93740cb620 0x7f93740cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f937b400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740c61e0 con 0x7f93741514a0 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f937b400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937415b2d0 con 0x7f9374066c20 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f937b400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740cbf70 con 0x7f93740cb620 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9374066c20 0x7f93740c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9374066c20 0x7f93740c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52830/0 (socket says 172.21.15.32:52830) 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 -- 172.21.15.32:0/418813137 learned_addr learned my addr 172.21.15.32:0/418813137 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:31.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9379400700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93740cb620 0x7f93740cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 -- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93740cb620 msgr2=0x7f93740cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:31.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93740cb620 0x7f93740cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 -- 172.21.15.32:0/418813137 >> v1:172.21.15.32:6789/0 conn(0x7f93741514a0 legacy=0x7f93740c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 -- 172.21.15.32:0/418813137 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937415b6f0 con 0x7f9374066c20 2024-09-13T18:46:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9379400700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93740cb620 0x7f93740cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.399+0000 7f9373e00700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9374066c20 0x7f93740c6440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9360009910 tx=0x7f9360009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ccb3bfa12724e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f9373400700 1 -- 172.21.15.32:0/418813137 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360011830 con 0x7f9374066c20 2024-09-13T18:46:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f9373400700 1 -- 172.21.15.32:0/418813137 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360011990 con 0x7f9374066c20 2024-09-13T18:46:31.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f9373400700 1 -- 172.21.15.32:0/418813137 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360011d40 con 0x7f9374066c20 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 -- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9374066c20 msgr2=0x7f93740c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9374066c20 0x7f93740c6440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9360009910 tx=0x7f9360009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 -- 172.21.15.32:0/418813137 shutdown_connections 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9374066c20 0x7f93740c6440 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 --2- 172.21.15.32:0/418813137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f93740cb620 0x7f93740cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 -- 172.21.15.32:0/418813137 >> 172.21.15.32:0/418813137 conn(0x7f9374073720 msgr2=0x7f9374073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 -- 172.21.15.32:0/418813137 shutdown_connections 2024-09-13T18:46:31.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.403+0000 7f937b400700 1 -- 172.21.15.32:0/418813137 wait complete. 2024-09-13T18:46:31.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 Processor -- start 2024-09-13T18:46:31.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 -- start start 2024-09-13T18:46:31.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 0x7f93741e4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740cb620 0x7f93741498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93741514a0 0x7f937414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374148ee0 con 0x7f93741514a0 2024-09-13T18:46:31.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374149430 con 0x7f93740cb620 2024-09-13T18:46:31.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f937b400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93741f10e0 con 0x7f9374066c20 2024-09-13T18:46:31.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 0x7f93741e4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9373e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740cb620 0x7f93741498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 0x7f93741e4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:56616/0 (socket says 172.21.15.32:56616) 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9373e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740cb620 0x7f93741498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52842/0 (socket says 172.21.15.32:52842) 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 -- 172.21.15.32:0/3316511433 learned_addr learned my addr 172.21.15.32:0/3316511433 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9379400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93741514a0 0x7f937414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740cb620 msgr2=0x7f93741498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93740cb620 0x7f93741498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93741514a0 msgr2=0x7f937414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93741514a0 0x7f937414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c009a70 con 0x7f9374066c20 2024-09-13T18:46:31.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93741514a0 0x7f937414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 0x7f93741e4340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f936800c500 tx=0x7f936800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.407+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680052d0 con 0x7f9374066c20 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.411+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9360009570 con 0x7f9374066c20 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.411+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93741f1350 con 0x7f9374066c20 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.411+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368005430 con 0x7f9374066c20 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.411+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93680055a0 con 0x7f9374066c20 2024-09-13T18:46:31.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.411+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f93500052f0 con 0x7f9374066c20 2024-09-13T18:46:31.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.411+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93680038e0 con 0x7f9374066c20 2024-09-13T18:46:31.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f9370c00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9354066760 0x7f9354068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f9368083900 con 0x7f9374066c20 2024-09-13T18:46:31.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v46) v1 ==== 54+0+16 (secure 0 0 0) 0x7f9368083be0 con 0x7f9374066c20 2024-09-13T18:46:31.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f9373e00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9354066760 0x7f9354068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f9350000f90 0x7f9350004660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9350005590 con 0x7f9350000f90 2024-09-13T18:46:31.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f9373e00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9354066760 0x7f9354068c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9360000c00 tx=0x7f9360008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.415+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f9350000f90 0x7f9350004660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.419+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f9350000f90 0x7f9350004660 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.419+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9350005590 con 0x7f9350000f90 2024-09-13T18:46:31.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.451+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f9350004ef0 con 0x7f9350000f90 2024-09-13T18:46:31.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.455+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9350004ef0 con 0x7f9350000f90 2024-09-13T18:46:31.461 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:31.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.455+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f9350001cb0 0x7f9350002960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.455+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9350002140 con 0x7f9350001cb0 2024-09-13T18:46:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.455+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f9350001cb0 0x7f9350002960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.459+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f9350001cb0 0x7f9350002960 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.459+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9350002140 con 0x7f9350001cb0 2024-09-13T18:46:31.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.479+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f9350003160 con 0x7f9350001cb0 2024-09-13T18:46:31.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.483+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9350003160 con 0x7f9350001cb0 2024-09-13T18:46:31.487 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:31.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.483+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f9350003b90 0x7f935000bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.483+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f935000eb50 con 0x7f9350003b90 2024-09-13T18:46:31.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.483+0000 7f9373e00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f9350003b90 0x7f935000bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.483+0000 7f9373e00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f9350003b90 0x7f935000bcd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.483+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f935000eb50 con 0x7f9350003b90 2024-09-13T18:46:31.501 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:31.495+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:31.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.511+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f935000c4d0 con 0x7f9350003b90 2024-09-13T18:46:31.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.515+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f935000c4d0 con 0x7f9350003b90 2024-09-13T18:46:31.521 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.515+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f935000cf00 0x7f935000d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.515+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f935000dae0 con 0x7f935000cf00 2024-09-13T18:46:31.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.515+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f935000cf00 0x7f935000d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.515+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f935000cf00 0x7f935000d360 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.519+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f935000dae0 con 0x7f935000cf00 2024-09-13T18:46:31.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.547+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f935000dfa0 con 0x7f935000cf00 2024-09-13T18:46:31.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.547+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f935000dfa0 con 0x7f935000cf00 2024-09-13T18:46:31.553 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:31.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.547+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f935000e5a0 0x7f9350012ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.547+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9350015cf0 con 0x7f935000e5a0 2024-09-13T18:46:31.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.547+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f935000e5a0 0x7f9350012ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.551+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f935000e5a0 0x7f9350012ce0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.551+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9350015cf0 con 0x7f935000e5a0 2024-09-13T18:46:31.569 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:31.569 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:31.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.579+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f9350015cc0 con 0x7f935000e5a0 2024-09-13T18:46:31.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.583+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9350015cc0 con 0x7f935000e5a0 2024-09-13T18:46:31.587 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:31.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.583+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f9350014f20 0x7f9350015380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.583+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93500190b0 con 0x7f9350014f20 2024-09-13T18:46:31.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.583+0000 7f9373e00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f9350014f20 0x7f9350015380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.583+0000 7f9373e00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f9350014f20 0x7f9350015380 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:31.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.587+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f93500190b0 con 0x7f9350014f20 2024-09-13T18:46:31.602 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:31.598+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:31.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.611+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f9350013220 con 0x7f9350014f20 2024-09-13T18:46:31.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.615+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9350013220 con 0x7f9350014f20 2024-09-13T18:46:31.621 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:31.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.615+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f93500138a0 0x7f9350013ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.615+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9350014400 con 0x7f93500138a0 2024-09-13T18:46:31.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.615+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f93500138a0 0x7f9350013ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.619+0000 7f9379400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f93500138a0 0x7f9350013ce0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.619+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9350014400 con 0x7f93500138a0 2024-09-13T18:46:31.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.647+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f9350014400 con 0x7f93500138a0 2024-09-13T18:46:31.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.651+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f9350014400 con 0x7f93500138a0 2024-09-13T18:46:31.655 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:31.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.651+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f93500144f0 0x7f935001c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:31.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.651+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f935001f4c0 con 0x7f93500144f0 2024-09-13T18:46:31.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.651+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f93500144f0 0x7f935001c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:31.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.651+0000 7f9378a00700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f93500144f0 0x7f935001c460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:31.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.651+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f935001f4c0 con 0x7f93500144f0 2024-09-13T18:46:31.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.679+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f935001f4c0 con 0x7f93500144f0 2024-09-13T18:46:31.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f9370c00700 1 -- 172.21.15.32:0/3316511433 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f935001f4c0 con 0x7f93500144f0 2024-09-13T18:46:31.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f9350000f90 msgr2=0x7f9350004660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f9350000f90 0x7f9350004660 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f9350001cb0 msgr2=0x7f9350002960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f9350001cb0 0x7f9350002960 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f9350003b90 msgr2=0x7f935000bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f9350003b90 0x7f935000bcd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f935000cf00 msgr2=0x7f935000d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f935000cf00 0x7f935000d360 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f935000e5a0 msgr2=0x7f9350012ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f935000e5a0 0x7f9350012ce0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f9350014f20 msgr2=0x7f9350015380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f9350014f20 0x7f9350015380 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f93500138a0 msgr2=0x7f9350013ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f93500138a0 0x7f9350013ce0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f93500144f0 msgr2=0x7f935001c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f93500144f0 0x7f935001c460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f9379400700 1 -- 172.21.15.32:0/3316511433 reap_dead start 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f9379400700 1 -- 172.21.15.32:0/3316511433 reap_dead start 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f9379400700 1 -- 172.21.15.32:0/3316511433 reap_dead start 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f9379400700 1 -- 172.21.15.32:0/3316511433 reap_dead start 2024-09-13T18:46:31.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f9379400700 1 -- 172.21.15.32:0/3316511433 reap_dead start 2024-09-13T18:46:31.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9354066760 msgr2=0x7f9354068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9354066760 0x7f9354068c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9360000c00 tx=0x7f9360008030 comp rx=0 tx=0).stop 2024-09-13T18:46:31.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 msgr2=0x7f93741e4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 0x7f93741e4340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f936800c500 tx=0x7f936800c810 comp rx=0 tx=0).stop 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 shutdown_connections 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9354066760 0x7f9354068c20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 --2- 172.21.15.32:0/3316511433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9374066c20 0x7f93741e4340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 >> 172.21.15.32:0/3316511433 conn(0x7f9374073720 msgr2=0x7f93740c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 shutdown_connections 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:31.683+0000 7f937b400700 1 -- 172.21.15.32:0/3316511433 wait complete. 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:31.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:31.693 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:31.693 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:31.693 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:31.703 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:31.699+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:31.735 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:31.735 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:31.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:31.843 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:31.839+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:31.905 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:31.902+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:31.933 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:31.933 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:31.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:32.042 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:32.039+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:32.108 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:32.103+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:32.132 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:32.132 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:32.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:32.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:46:32.243 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:32.239+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:32.310 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:32.307+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:32.338 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:32.339 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:32.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:32.411 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:32.410+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 Processor -- start 2024-09-13T18:46:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 -- start start 2024-09-13T18:46:32.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7960 0x7f021015a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02100c7d40 0x7f0210071b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021015a840 con 0x7f02100c5870 2024-09-13T18:46:32.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0210156e30 con 0x7f02100c7d40 2024-09-13T18:46:32.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210072410 con 0x7f02100c7960 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02100c7d40 0x7f0210071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020de00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7960 0x7f021015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02100c7d40 0x7f0210071b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52844/0 (socket says 172.21.15.32:52844) 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 -- 172.21.15.32:0/4133230821 learned_addr learned my addr 172.21.15.32:0/4133230821 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 -- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7960 msgr2=0x7f021015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 --2- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7960 0x7f021015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 -- 172.21.15.32:0/4133230821 >> v1:172.21.15.86:6789/0 conn(0x7f02100c5870 legacy=0x7f0210153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.443+0000 7f020d400700 1 -- 172.21.15.32:0/4133230821 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100726f0 con 0x7f02100c7d40 2024-09-13T18:46:32.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020d400700 1 --2- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c7d40 0x7f0210071b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00bbb0 tx=0x7f01fc00bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8886944bd4cbd7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:32.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020ca00700 1 -- 172.21.15.32:0/4133230821 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00dd30 con 0x7f02100c7d40 2024-09-13T18:46:32.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020ca00700 1 -- 172.21.15.32:0/4133230821 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00de90 con 0x7f02100c7d40 2024-09-13T18:46:32.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020ca00700 1 -- 172.21.15.32:0/4133230821 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc010670 con 0x7f02100c7d40 2024-09-13T18:46:32.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 -- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c7d40 msgr2=0x7f0210071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 --2- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c7d40 0x7f0210071b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00bbb0 tx=0x7f01fc00bec0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 -- 172.21.15.32:0/4133230821 shutdown_connections 2024-09-13T18:46:32.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 --2- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c7d40 0x7f0210071b40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 --2- 172.21.15.32:0/4133230821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7960 0x7f021015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 -- 172.21.15.32:0/4133230821 >> 172.21.15.32:0/4133230821 conn(0x7f02100cac60 msgr2=0x7f02100cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 -- 172.21.15.32:0/4133230821 shutdown_connections 2024-09-13T18:46:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.447+0000 7f020f200700 1 -- 172.21.15.32:0/4133230821 wait complete. 2024-09-13T18:46:32.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 Processor -- start 2024-09-13T18:46:32.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 -- start start 2024-09-13T18:46:32.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c5870 0x7f02101546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 0x7f02100bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7d40 0x7f02101508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101f30c0 con 0x7f02100c7960 2024-09-13T18:46:32.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100aa9b0 con 0x7f02100c5870 2024-09-13T18:46:32.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02101f2790 con 0x7f02100c7d40 2024-09-13T18:46:32.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 0x7f02100bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c5870 0x7f02101546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 0x7f02100bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35290/0 (socket says 172.21.15.32:35290) 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7d40 0x7f02101508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020d400700 1 -- 172.21.15.32:0/4120826685 learned_addr learned my addr 172.21.15.32:0/4120826685 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 -- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c5870 msgr2=0x7f02101546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c5870 0x7f02101546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 -- 172.21.15.32:0/4120826685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 msgr2=0x7f02100bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 0x7f02100bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 -- 172.21.15.32:0/4120826685 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc00b810 con 0x7f02100c7d40 2024-09-13T18:46:32.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020d400700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 0x7f02100bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:32.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.451+0000 7f020e800700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7d40 0x7f02101508b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f020800cb90 tx=0x7f020800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:32.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208003c20 con 0x7f02100c7d40 2024-09-13T18:46:32.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208003d80 con 0x7f02100c7d40 2024-09-13T18:46:32.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800aa80 con 0x7f02100c7d40 2024-09-13T18:46:32.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02101f2a70 con 0x7f02100c7d40 2024-09-13T18:46:32.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02100abbc0 con 0x7f02100c7d40 2024-09-13T18:46:32.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021015a300 con 0x7f02100c7d40 2024-09-13T18:46:32.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.455+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f020800abe0 con 0x7f02100c7d40 2024-09-13T18:46:32.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.459+0000 7f0206000700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f01f0066730 0x7f01f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.459+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f0208084250 con 0x7f02100c7d40 2024-09-13T18:46:32.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.459+0000 7f020de00700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f01f0066730 0x7f01f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.459+0000 7f020de00700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f01f0066730 0x7f01f0068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0200009bf0 tx=0x7f0200009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:32.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.471+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0208051270 con 0x7f02100c7d40 2024-09-13T18:46:32.513 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:32.510+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:32.525 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:32.525 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:32.525 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T18:46:32.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T18:46:32.559 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:32.560 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:32.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:32.626 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:32.623+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:32.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f099d400700 1 Processor -- start 2024-09-13T18:46:32.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f099d400700 1 -- start start 2024-09-13T18:46:32.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f099d400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0998157e00 0x7f099815da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f099d400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980c6d80 con 0x7f09980c7cf0 2024-09-13T18:46:32.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f099d400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09981581e0 con 0x7f09980700e0 2024-09-13T18:46:32.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f099d400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980c8770 con 0x7f0998157e00 2024-09-13T18:46:32.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.687+0000 7f0997e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0998157e00 0x7f099815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099ca00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f09980700e0 0x7f0998168330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52110/0 (socket says 172.21.15.32:52110) 2024-09-13T18:46:32.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099ca00700 1 -- 172.21.15.32:0/3148464731 learned_addr learned my addr 172.21.15.32:0/3148464731 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:32.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0996a00700 1 -- 172.21.15.32:0/3148464731 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694591237 0 0) 0x7f09981581e0 con 0x7f09980700e0 2024-09-13T18:46:32.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0996a00700 1 -- 172.21.15.32:0/3148464731 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c0035d0 con 0x7f09980700e0 2024-09-13T18:46:32.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0997e00700 1 -- 172.21.15.32:0/3148464731 >> v1:172.21.15.86:6789/0 conn(0x7f09980700e0 legacy=0x7f0998168330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0997e00700 1 -- 172.21.15.32:0/3148464731 >> v1:172.21.15.32:6789/0 conn(0x7f09980c7cf0 legacy=0x7f09980c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0996a00700 1 -- 172.21.15.32:0/3148464731 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193798690 0 0) 0x7f09980c6d80 con 0x7f09980c7cf0 2024-09-13T18:46:32.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0997e00700 1 -- 172.21.15.32:0/3148464731 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099815df90 con 0x7f0998157e00 2024-09-13T18:46:32.696 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0997e00700 1 --2- 172.21.15.32:0/3148464731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0998157e00 0x7f099815da50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0980009850 tx=0x7f0980009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8005fcb61239d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:32.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0996a00700 1 -- 172.21.15.32:0/3148464731 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980011830 con 0x7f0998157e00 2024-09-13T18:46:32.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0996a00700 1 -- 172.21.15.32:0/3148464731 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0980011990 con 0x7f0998157e00 2024-09-13T18:46:32.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f0996a00700 1 -- 172.21.15.32:0/3148464731 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980011d00 con 0x7f0998157e00 2024-09-13T18:46:32.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 -- 172.21.15.32:0/3148464731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0998157e00 msgr2=0x7f099815da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.697 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 --2- 172.21.15.32:0/3148464731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0998157e00 0x7f099815da50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0980009850 tx=0x7f0980009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:32.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 -- 172.21.15.32:0/3148464731 shutdown_connections 2024-09-13T18:46:32.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 --2- 172.21.15.32:0/3148464731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0998157e00 0x7f099815da50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 -- 172.21.15.32:0/3148464731 >> 172.21.15.32:0/3148464731 conn(0x7f0998072550 msgr2=0x7f09980cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:32.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 -- 172.21.15.32:0/3148464731 shutdown_connections 2024-09-13T18:46:32.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.691+0000 7f099d400700 1 -- 172.21.15.32:0/3148464731 wait complete. 2024-09-13T18:46:32.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 Processor -- start 2024-09-13T18:46:32.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 -- start start 2024-09-13T18:46:32.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09980700e0 0x7f099814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09980c7cf0 0x7f0998150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0998157e00 0x7f099815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980cad70 con 0x7f09980c7cf0 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0998158530 con 0x7f0998157e00 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.695+0000 7f099d400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09981e71a0 con 0x7f09980700e0 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f0997e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09980700e0 0x7f099814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f0997e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09980700e0 0x7f099814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:56634/0 (socket says 172.21.15.32:56634) 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f0997e00700 1 -- 172.21.15.32:0/3144547716 learned_addr learned my addr 172.21.15.32:0/3144547716 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f0997400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09980c7cf0 0x7f0998150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0998157e00 0x7f099815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 -- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09980700e0 msgr2=0x7f099814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09980700e0 0x7f099814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 -- 172.21.15.32:0/3144547716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09980c7cf0 msgr2=0x7f0998150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09980c7cf0 0x7f0998150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 -- 172.21.15.32:0/3144547716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800094b0 con 0x7f0998157e00 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f0997400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09980c7cf0 0x7f0998150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099ca00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0998157e00 0x7f099815ba90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f099000ca70 tx=0x7f099000caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990007480 con 0x7f0998157e00 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09900075e0 con 0x7f0998157e00 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990007970 con 0x7f0998157e00 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09981e7480 con 0x7f0998157e00 2024-09-13T18:46:32.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09980cb2a0 con 0x7f0998157e00 2024-09-13T18:46:32.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.699+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0998161510 con 0x7f0998157e00 2024-09-13T18:46:32.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.703+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f099001c440 con 0x7f0998157e00 2024-09-13T18:46:32.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.703+0000 7f098fe00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0974066760 0x7f0974068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:32.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.703+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f09900842d0 con 0x7f0998157e00 2024-09-13T18:46:32.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.703+0000 7f0997e00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0974066760 0x7f0974068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:32.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.703+0000 7f0997e00700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0974066760 0x7f0974068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0980000c00 tx=0x7f0980008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:32.714 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:32.710+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:32.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.715+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0990051260 con 0x7f0998157e00 2024-09-13T18:46:32.815 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:32.811+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:32.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.819+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7f021015a840 con 0x7f02100c7d40 2024-09-13T18:46:32.838 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:32.839 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:32.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:32.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.907+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f09980c6960 con 0x7f0998157e00 2024-09-13T18:46:32.915 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:32.911+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:32.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.911+0000 7f098fe00700 1 -- 172.21.15.32:0/3144547716 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+37539 (secure 0 0 0) 0x7f0990017090 con 0x7f0998157e00 2024-09-13T18:46:32.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:32.918 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:32.918 INFO:teuthology.orchestra.run.smithi032.stdout: "epoch": 46, 2024-09-13T18:46:32.918 INFO:teuthology.orchestra.run.smithi032.stdout: "fsid": "e3c44028-1b11-4958-a433-ecab24d0f05e", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "created": "2024-09-13T18:44:38.402959+0000", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "modified": "2024-09-13T18:46:30.197829+0000", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "last_up_change": "2024-09-13T18:44:49.741600+0000", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "last_in_change": "2024-09-13T18:46:16.836186+0000", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_num": 5804032, 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_set": [ 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "nodeep-scrub", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "pglog_hardlimit", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "purged_snapdirs", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_deletes", 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: "sortbitwise" 2024-09-13T18:46:32.919 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_version": 6, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_snapshot": "", 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_max": 4, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "max_osd": 8, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "min_compat_client": "luminous", 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "require_osd_release": "reef", 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "allow_crimson": false, 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: "pools": [ 2024-09-13T18:46:32.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 1, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": ".mgr", 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:44:50.146051+0000", 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 1, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool", 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 1, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 2, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 1, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 0, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:32.921 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 1, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 1, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 1, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 1, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 1, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:32.922 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "18", 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:32.923 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:32.924 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "", 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:32.925 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_max": 32, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 1 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": {} 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "read_balance": { 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "score_acting": 8, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "score_stable": 8, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "optimal_score": 0.25, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_acting": 2, 2024-09-13T18:46:32.926 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_stable": 2, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity": 1, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 2, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:44:59.596223+0000", 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 1, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool", 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 1, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 2, 2024-09-13T18:46:32.927 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 1, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 0, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 32, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 32, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 32, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 32, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 32, 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:32.928 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "21", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:32.929 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:32.930 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "", 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:32.931 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 0, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 16, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_priority": 5 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs": { 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": "cephfs" 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "read_balance": { 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "score_acting": 1.9900000095367432, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "score_stable": 1.9900000095367432, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "optimal_score": 0.87999999523162842, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_acting": 1.75, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_stable": 1.75, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity": 1, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 3, 2024-09-13T18:46:32.933 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": "cephfs_data", 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:45:00.330969+0000", 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 1, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool", 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 1, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 2, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 1, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 0, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:32.934 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 64, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 64, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 64, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 64, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 64, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.935 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "22", 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:32.936 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:32.937 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "", 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:32.938 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 0, 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 64, 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "target_size_ratio": 0.05000000074505806 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs": { 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "data": "cephfs" 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.939 INFO:teuthology.orchestra.run.smithi032.stdout: "read_balance": { 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "score_acting": 1.7400000095367432, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "score_stable": 1.7400000095367432, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "optimal_score": 0.87999999523162842, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity": 1, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.940 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 4, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": "cephfs_data_ec", 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:45:03.385324+0000", 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 5, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 3, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 4, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 3, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 1, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:32.941 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 32, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 32, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 32, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 32, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 32, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.942 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "26", 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:32.943 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.944 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 8192, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 64, 2024-09-13T18:46:32.945 INFO:teuthology.orchestra.run.smithi032.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs": { 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "data": "cephfs" 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "osds": [ 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 0, 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "973dc52d-4a57-489e-b680-f484a091a77f", 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.946 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6813", 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6815", 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6816", 2024-09-13T18:46:32.948 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6818", 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6822", 2024-09-13T18:46:32.949 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6823", 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6820", 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6821", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6815/3679908055", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6818/3679908055", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6823/3679908055", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6821/3679908055", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.951 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 1, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "354ae97e-51cf-423c-b257-37bf8960729b", 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:32.952 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6800", 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.953 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6801", 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6802", 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6803", 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6806", 2024-09-13T18:46:32.955 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6807", 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.956 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6804", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6805", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6801/1416437982", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6803/1416437982", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6807/1416437982", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6805/1416437982", 2024-09-13T18:46:32.957 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 2, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "b76494fe-9ae4-4444-8f25-15b7bb18dece", 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6808", 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6809", 2024-09-13T18:46:32.959 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6810", 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.960 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6811", 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6817", 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.961 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6819", 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6812", 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.962 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6814", 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6809/1016396602", 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6811/1016396602", 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6819/1016396602", 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6814/1016396602", 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 3, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "3b89a1fa-2088-4a23-b1e6-31644ebc6000", 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 0, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 0, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 24, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.964 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6824", 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6825", 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6826", 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6827", 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.966 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6830", 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6831", 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.967 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6828", 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6829", 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:32.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6825/2476570305", 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6827/2476570305", 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6831/2476570305", 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6829/2476570305", 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.969 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 4, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "63973273-0c32-404c-9eb2-943b451d3da7", 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:32.970 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6808", 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6811", 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.971 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6815", 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6819", 2024-09-13T18:46:32.972 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6829", 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.973 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6831", 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6822", 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.974 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6825", 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6811/838245911", 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6819/838245911", 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6831/838245911", 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6825/838245911", 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 5, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "2678edb8-ca2a-497a-8439-5f1dc709dbe8", 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.976 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6810", 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6813", 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6817", 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6820", 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6828", 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6830", 2024-09-13T18:46:32.979 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6823", 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.980 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6827", 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6813/2187629356", 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6820/2187629356", 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6830/2187629356", 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6827/2187629356", 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 6, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "8adaa119-857f-4d43-bf54-dcac614aba37", 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.982 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6800", 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6801", 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6802", 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6803", 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.984 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6806", 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6807", 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.985 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6804", 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6805", 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6801/4096931368", 2024-09-13T18:46:32.986 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6803/4096931368", 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6807/4096931368", 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6805/4096931368", 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 7, 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "97880368-e206-4217-aeee-cf13756aa32b", 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:32.987 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 41, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6809", 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.988 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6812", 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6814", 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.989 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6816", 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6824", 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.990 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6826", 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6818", 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6821", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6812/943661157", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6816/943661157", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6826/943661157", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6821/943661157", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_xinfo": [ 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 0, 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.712403+0000", 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 1, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.585781+0000", 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 2, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.994 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.661542+0000", 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 3, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 65536, 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.680620+0000", 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 4, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.198765+0000", 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 5, 2024-09-13T18:46:32.996 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.211743+0000", 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 6, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.997 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.007910+0000", 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 7, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:45.769729+0000", 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:32.998 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_upmap": [], 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_upmap_items": [ 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: "pgid": "3.39", 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: "mappings": [ 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: "from": 0, 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: "to": 7 2024-09-13T18:46:32.999 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: "pgid": "4.18", 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: "mappings": [ 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: "from": 7, 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: "to": 0 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_upmap_primaries": [], 2024-09-13T18:46:33.000 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_temp": [], 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_temp": [], 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklist": {}, 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "range_blocklist": {}, 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profiles": { 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_data_ec": { 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-device-class": "", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-failure-domain": "osd", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-root": "default", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "k": "2", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "m": "2", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin": "jerasure", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "technique": "reed_sol_van", 2024-09-13T18:46:33.001 INFO:teuthology.orchestra.run.smithi032.stdout: "w": "8" 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "default": { 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-failure-domain": "osd", 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "k": "2", 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "m": "1", 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin": "jerasure", 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "technique": "reed_sol_van" 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps_queue": [], 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "new_removed_snaps": [], 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "new_purged_snaps": [], 2024-09-13T18:46:33.002 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_node_flags": {}, 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "device_class_flags": {}, 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_mode": { 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_mode_enabled": false, 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_bucket_count": 0, 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_mode_bucket": 0 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:33.003 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0974066760 msgr2=0x7f0974068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0974066760 0x7f0974068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0980000c00 tx=0x7f0980008030 comp rx=0 tx=0).stop 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0998157e00 msgr2=0x7f099815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0998157e00 0x7f099815ba90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f099000ca70 tx=0x7f099000caa0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 shutdown_connections 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0974066760 0x7f0974068c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0998157e00 0x7f099815ba90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09980c7cf0 0x7f0998150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 --2- 172.21.15.32:0/3144547716 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09980700e0 0x7f099814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 >> 172.21.15.32:0/3144547716 conn(0x7f0998072550 msgr2=0x7f099806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:33.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 shutdown_connections 2024-09-13T18:46:33.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:32.915+0000 7f099d400700 1 -- 172.21.15.32:0/3144547716 wait complete. 2024-09-13T18:46:33.006 INFO:tasks.thrashosds.thrasher:j is {'epoch': 46, 'fsid': 'e3c44028-1b11-4958-a433-ecab24d0f05e', 'created': '2024-09-13T18:44:38.402959+0000', 'modified': '2024-09-13T18:46:30.197829+0000', 'last_up_change': '2024-09-13T18:44:49.741600+0000', 'last_in_change': '2024-09-13T18:46:16.836186+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': '973dc52d-4a57-489e-b680-f484a091a77f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6813', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6815', 'nonce': 3679908055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6816', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6818', 'nonce': 3679908055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6822', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6823', 'nonce': 3679908055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6820', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6821', 'nonce': 3679908055}]}, 'public_addr': '172.21.15.32:6815/3679908055', 'cluster_addr': '172.21.15.32:6818/3679908055', 'heartbeat_back_addr': '172.21.15.32:6823/3679908055', 'heartbeat_front_addr': '172.21.15.32:6821/3679908055', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '354ae97e-51cf-423c-b257-37bf8960729b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6800', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6801', 'nonce': 1416437982}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6802', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6803', 'nonce': 1416437982}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6806', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6807', 'nonce': 1416437982}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6804', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6805', 'nonce': 1416437982}]}, 'public_addr': '172.21.15.32:6801/1416437982', 'cluster_addr': '172.21.15.32:6803/1416437982', 'heartbeat_back_addr': '172.21.15.32:6807/1416437982', 'heartbeat_front_addr': '172.21.15.32:6805/1416437982', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b76494fe-9ae4-4444-8f25-15b7bb18dece', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6808', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6809', 'nonce': 1016396602}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6810', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6811', 'nonce': 1016396602}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6817', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6819', 'nonce': 1016396602}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6812', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6814', 'nonce': 1016396602}]}, 'public_addr': '172.21.15.32:6809/1016396602', 'cluster_addr': '172.21.15.32:6811/1016396602', 'heartbeat_back_addr': '172.21.15.32:6819/1016396602', 'heartbeat_front_addr': '172.21.15.32:6814/1016396602', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3b89a1fa-2088-4a23-b1e6-31644ebc6000', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6824', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6825', 'nonce': 2476570305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6826', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6827', 'nonce': 2476570305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6830', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6831', 'nonce': 2476570305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6828', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6829', 'nonce': 2476570305}]}, 'public_addr': '172.21.15.32:6825/2476570305', 'cluster_addr': '172.21.15.32:6827/2476570305', 'heartbeat_back_addr': '172.21.15.32:6831/2476570305', 'heartbeat_front_addr': '172.21.15.32:6829/2476570305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63973273-0c32-404c-9eb2-943b451d3da7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 838245911}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 838245911}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6829', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 838245911}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 838245911}]}, 'public_addr': '172.21.15.86:6811/838245911', 'cluster_addr': '172.21.15.86:6819/838245911', 'heartbeat_back_addr': '172.21.15.86:6831/838245911', 'heartbeat_front_addr': '172.21.15.86:6825/838245911', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2678edb8-ca2a-497a-8439-5f1dc709dbe8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6813', 'nonce': 2187629356}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 2187629356}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6830', 'nonce': 2187629356}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6823', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 2187629356}]}, 'public_addr': '172.21.15.86:6813/2187629356', 'cluster_addr': '172.21.15.86:6820/2187629356', 'heartbeat_back_addr': '172.21.15.86:6830/2187629356', 'heartbeat_front_addr': '172.21.15.86:6827/2187629356', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8adaa119-857f-4d43-bf54-dcac614aba37', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6801', 'nonce': 4096931368}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6802', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 4096931368}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6806', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 4096931368}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6805', 'nonce': 4096931368}]}, 'public_addr': '172.21.15.86:6801/4096931368', 'cluster_addr': '172.21.15.86:6803/4096931368', 'heartbeat_back_addr': '172.21.15.86:6807/4096931368', 'heartbeat_front_addr': '172.21.15.86:6805/4096931368', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '97880368-e206-4217-aeee-cf13756aa32b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 943661157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6814', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 943661157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6826', 'nonce': 943661157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 943661157}]}, 'public_addr': '172.21.15.86:6812/943661157', 'cluster_addr': '172.21.15.86:6816/943661157', 'heartbeat_back_addr': '172.21.15.86:6826/943661157', 'heartbeat_front_addr': '172.21.15.86:6821/943661157', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.712403+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.585781+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.661542+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.680620+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.198765+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.211743+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.007910+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:45.769729+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.39', 'mappings': [{'from': 0, 'to': 7}]}, {'pgid': '4.18', 'mappings': [{'from': 7, 'to': 0}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T18:46:33.007 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:46:33.016 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:33.014+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:33.066 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.066 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:33.122 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:33.119+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:33.198 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.198 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.195+0000 7fccfb000700 1 Processor -- start 2024-09-13T18:46:33.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccfb000700 1 -- start start 2024-09-13T18:46:33.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccfb000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fccf40c7270 0x7fccf4070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccfb000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf40c8820 con 0x7fccf4070a80 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccfb000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf4153ed0 con 0x7fccf40b1cf0 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccfb000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf40c7930 con 0x7fccf40c7270 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccf9200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fccf40c7270 0x7fccf4070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccf9200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fccf40c7270 0x7fccf4070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35316/0 (socket says 172.21.15.32:35316) 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.199+0000 7fccf9200700 1 -- 172.21.15.32:0/1362861006 learned_addr learned my addr 172.21.15.32:0/1362861006 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf9200700 1 -- 172.21.15.32:0/1362861006 >> v1:172.21.15.86:6789/0 conn(0x7fccf40b1cf0 legacy=0x7fccf406ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf9200700 1 -- 172.21.15.32:0/1362861006 >> v1:172.21.15.32:6789/0 conn(0x7fccf4070a80 legacy=0x7fccf4156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf9200700 1 -- 172.21.15.32:0/1362861006 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40c7c10 con 0x7fccf40c7270 2024-09-13T18:46:33.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf9200700 1 --2- 172.21.15.32:0/1362861006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf40c7270 0x7fccf4070540 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009910 tx=0x7fcce0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ad5b7323ea9dee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf3e00700 1 -- 172.21.15.32:0/1362861006 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000ba60 con 0x7fccf40c7270 2024-09-13T18:46:33.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf3e00700 1 -- 172.21.15.32:0/1362861006 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000bbc0 con 0x7fccf40c7270 2024-09-13T18:46:33.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccf3e00700 1 -- 172.21.15.32:0/1362861006 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0009e60 con 0x7fccf40c7270 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 -- 172.21.15.32:0/1362861006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf40c7270 msgr2=0x7fccf4070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 --2- 172.21.15.32:0/1362861006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf40c7270 0x7fccf4070540 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009910 tx=0x7fcce0009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 -- 172.21.15.32:0/1362861006 shutdown_connections 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 --2- 172.21.15.32:0/1362861006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf40c7270 0x7fccf4070540 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 -- 172.21.15.32:0/1362861006 >> 172.21.15.32:0/1362861006 conn(0x7fccf4071080 msgr2=0x7fccf4071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 -- 172.21.15.32:0/1362861006 shutdown_connections 2024-09-13T18:46:33.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 -- 172.21.15.32:0/1362861006 wait complete. 2024-09-13T18:46:33.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 Processor -- start 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.203+0000 7fccfb000700 1 -- start start 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf4070a80 0x7fccf41f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fccf40b1cf0 0x7fccf40afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccf40c7270 0x7fccf4152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40b0af0 con 0x7fccf4070a80 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41f3410 con 0x7fccf40c7270 2024-09-13T18:46:33.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40af8f0 con 0x7fccf40b1cf0 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf4070a80 0x7fccf41f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfa600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccf40c7270 0x7fccf4152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fccf40b1cf0 0x7fccf40afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfa600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccf40c7270 0x7fccf4152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52868/0 (socket says 172.21.15.32:52868) 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf4070a80 0x7fccf41f2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35330/0 (socket says 172.21.15.32:35330) 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfa600700 1 -- 172.21.15.32:0/3036582937 learned_addr learned my addr 172.21.15.32:0/3036582937 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 -- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccf40c7270 msgr2=0x7fccf4152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccf40c7270 0x7fccf4152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 -- 172.21.15.32:0/3036582937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf4070a80 msgr2=0x7fccf41f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf4070a80 0x7fccf41f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 -- 172.21.15.32:0/3036582937 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009570 con 0x7fccf40b1cf0 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf9200700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fccf40b1cf0 0x7fccf40afda0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcce0016000 tx=0x7fcce0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0004590 con 0x7fccf40b1cf0 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce001f070 con 0x7fccf40b1cf0 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 -- 172.21.15.32:0/3036582937 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf41f3150 con 0x7fccf40b1cf0 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0003900 con 0x7fccf40b1cf0 2024-09-13T18:46:33.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.207+0000 7fccfb000700 1 -- 172.21.15.32:0/3036582937 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf40ae890 con 0x7fccf40b1cf0 2024-09-13T18:46:33.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.211+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf406aca0 con 0x7fccf40b1cf0 2024-09-13T18:46:33.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.211+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcce0003a60 con 0x7fccf40b1cf0 2024-09-13T18:46:33.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.211+0000 7fccf1600700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fccd4066730 0x7fccd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.211+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6550+0+0 (secure 0 0 0) 0x7fcce0021070 con 0x7fccf40b1cf0 2024-09-13T18:46:33.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.211+0000 7fccf9c00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fccd4066730 0x7fccd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.218 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:33.215+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:33.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.215+0000 7fccf9c00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fccd4066730 0x7fccd4068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcce8000f60 tx=0x7fcce8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.223+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcce0052ce0 con 0x7fccf40b1cf0 2024-09-13T18:46:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.231+0000 7f0206000700 1 -- 172.21.15.32:0/4120826685 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v47) v1 ==== 101+0+0 (secure 0 0 0) 0x7f021015a840 con 0x7f02100c7d40 2024-09-13T18:46:33.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f01f0066730 msgr2=0x7f01f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f01f0066730 0x7f01f0068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0200009bf0 tx=0x7f0200009240 comp rx=0 tx=0).stop 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7d40 msgr2=0x7f02101508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7d40 0x7f02101508b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f020800cb90 tx=0x7f020800cea0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 shutdown_connections 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f01f0066730 0x7f01f0068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100c7d40 0x7f02101508b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02100c7960 0x7f02100bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 --2- 172.21.15.32:0/4120826685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100c5870 0x7f02101546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 >> 172.21.15.32:0/4120826685 conn(0x7f02100cac60 msgr2=0x7f02101558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 shutdown_connections 2024-09-13T18:46:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.235+0000 7f020f200700 1 -- 172.21.15.32:0/4120826685 wait complete. 2024-09-13T18:46:33.243 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:46:33.322 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.322 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.322 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:33.319+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:33.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:33.423 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:33.418+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:33.429 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.429 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.439 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:33.526 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:33.522+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:33.548 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.548 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.559+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccf40680e0 con 0x7fccd4066730 2024-09-13T18:46:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.571+0000 7fccf1600700 1 -- 172.21.15.32:0/3036582937 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363159 (secure 0 0 0) 0x7fccf40680e0 con 0x7fccd4066730 2024-09-13T18:46:33.585 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.579+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fccd4066730 msgr2=0x7fccd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.579+0000 7fcce6a00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fccd4066730 0x7fccd4068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcce8000f60 tx=0x7fcce8009040 comp rx=0 tx=0).stop 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.579+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fccf40b1cf0 msgr2=0x7fccf40afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.579+0000 7fcce6a00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fccf40b1cf0 0x7fccf40afda0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcce0016000 tx=0x7fcce0004770 comp rx=0 tx=0).stop 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 shutdown_connections 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fccd4066730 0x7fccd4068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccf40c7270 0x7fccf4152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fccf40b1cf0 0x7fccf40afda0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 --2- 172.21.15.32:0/3036582937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fccf4070a80 0x7fccf41f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 >> 172.21.15.32:0/3036582937 conn(0x7fccf4071080 msgr2=0x7fccf406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:33.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 shutdown_connections 2024-09-13T18:46:33.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.583+0000 7fcce6a00700 1 -- 172.21.15.32:0/3036582937 wait complete. 2024-09-13T18:46:33.589 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:46:33.612 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-13T18:46:33.232289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598905,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":214296,"kb_used_data":4676,"kb_used_omap":10,"kb_used_meta":209525,"kb_avail":660388584,"statfs":{"total":676457349120,"available":676237910016,"internally_reserved":0,"allocated":4788224,"data_stored":2859267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11152,"internal_metadata":214553712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139156"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":52,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355979+0000","last_change":"2024-09-13T18:45:48.732188+0000","last_active":"2024-09-13T18:46:24.355979+0000","last_peered":"2024-09-13T18:46:24.355979+0000","last_clean":"2024-09-13T18:46:24.355979+0000","last_became_active":"2024-09-13T18:45:48.724352+0000","last_became_peered":"2024-09-13T18:45:48.724352+0000","last_unstale":"2024-09-13T18:46:24.355979+0000","last_undegraded":"2024-09-13T18:46:24.355979+0000","last_fullsized":"2024-09-13T18:46:24.355979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:36.623175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.358097+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:46:24.358097+0000","last_peered":"2024-09-13T18:46:24.358097+0000","last_clean":"2024-09-13T18:46:24.358097+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:46:24.358097+0000","last_undegraded":"2024-09-13T18:46:24.358097+0000","last_fullsized":"2024-09-13T18:46:24.358097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354584+0000","last_change":"2024-09-13T18:46:17.888737+0000","last_active":"2024-09-13T18:46:24.354584+0000","last_peered":"2024-09-13T18:46:24.354584+0000","last_clean":"2024-09-13T18:46:24.354584+0000","last_became_active":"2024-09-13T18:46:17.888200+0000","last_became_peered":"2024-09-13T18:46:17.888200+0000","last_unstale":"2024-09-13T18:46:24.354584+0000","last_undegraded":"2024-09-13T18:46:24.354584+0000","last_fullsized":"2024-09-13T18:46:24.354584+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:47.183329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.358450+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:46:24.358450+0000","last_peered":"2024-09-13T18:46:24.358450+0000","last_clean":"2024-09-13T18:46:24.358450+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:46:24.358450+0000","last_undegraded":"2024-09-13T18:46:24.358450+0000","last_fullsized":"2024-09-13T18:46:24.358450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.359072+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:46:24.359072+0000","last_peered":"2024-09-13T18:46:24.359072+0000","last_clean":"2024-09-13T18:46:24.359072+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:46:24.359072+0000","last_undegraded":"2024-09-13T18:46:24.359072+0000","last_fullsized":"2024-09-13T18:46:24.359072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":61,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177040+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:46:24.177040+0000","last_peered":"2024-09-13T18:46:24.177040+0000","last_clean":"2024-09-13T18:46:24.177040+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:46:24.177040+0000","last_undegraded":"2024-09-13T18:46:24.177040+0000","last_fullsized":"2024-09-13T18:46:24.177040+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178320+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:46:24.178320+0000","last_peered":"2024-09-13T18:46:24.178320+0000","last_clean":"2024-09-13T18:46:24.178320+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:46:24.178320+0000","last_undegraded":"2024-09-13T18:46:24.178320+0000","last_fullsized":"2024-09-13T18:46:24.178320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351320+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:46:24.351320+0000","last_peered":"2024-09-13T18:46:24.351320+0000","last_clean":"2024-09-13T18:46:24.351320+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:46:24.351320+0000","last_undegraded":"2024-09-13T18:46:24.351320+0000","last_fullsized":"2024-09-13T18:46:24.351320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":61,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177950+0000","last_change":"2024-09-13T18:46:17.877004+0000","last_active":"2024-09-13T18:46:24.177950+0000","last_peered":"2024-09-13T18:46:24.177950+0000","last_clean":"2024-09-13T18:46:24.177950+0000","last_became_active":"2024-09-13T18:46:17.876650+0000","last_became_peered":"2024-09-13T18:46:17.876650+0000","last_unstale":"2024-09-13T18:46:24.177950+0000","last_undegraded":"2024-09-13T18:46:24.177950+0000","last_fullsized":"2024-09-13T18:46:24.177950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:25.387441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178445+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:46:24.178445+0000","last_peered":"2024-09-13T18:46:24.178445+0000","last_clean":"2024-09-13T18:46:24.178445+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:46:24.178445+0000","last_undegraded":"2024-09-13T18:46:24.178445+0000","last_fullsized":"2024-09-13T18:46:24.178445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178105+0000","last_change":"2024-09-13T18:45:48.709789+0000","last_active":"2024-09-13T18:46:24.178105+0000","last_peered":"2024-09-13T18:46:24.178105+0000","last_clean":"2024-09-13T18:46:24.178105+0000","last_became_active":"2024-09-13T18:45:48.709474+0000","last_became_peered":"2024-09-13T18:45:48.709474+0000","last_unstale":"2024-09-13T18:46:24.178105+0000","last_undegraded":"2024-09-13T18:46:24.178105+0000","last_fullsized":"2024-09-13T18:46:24.178105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:22.361841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177173+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:46:24.177173+0000","last_peered":"2024-09-13T18:46:24.177173+0000","last_clean":"2024-09-13T18:46:24.177173+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:46:24.177173+0000","last_undegraded":"2024-09-13T18:46:24.177173+0000","last_fullsized":"2024-09-13T18:46:24.177173+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.350997+0000","last_change":"2024-09-13T18:45:48.700741+0000","last_active":"2024-09-13T18:46:24.350997+0000","last_peered":"2024-09-13T18:46:24.350997+0000","last_clean":"2024-09-13T18:46:24.350997+0000","last_became_active":"2024-09-13T18:45:48.700396+0000","last_became_peered":"2024-09-13T18:45:48.700396+0000","last_unstale":"2024-09-13T18:46:24.350997+0000","last_undegraded":"2024-09-13T18:46:24.350997+0000","last_fullsized":"2024-09-13T18:46:24.350997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:47.391756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178287+0000","last_change":"2024-09-13T18:45:48.727552+0000","last_active":"2024-09-13T18:46:24.178287+0000","last_peered":"2024-09-13T18:46:24.178287+0000","last_clean":"2024-09-13T18:46:24.178287+0000","last_became_active":"2024-09-13T18:45:48.717660+0000","last_became_peered":"2024-09-13T18:45:48.717660+0000","last_unstale":"2024-09-13T18:46:24.178287+0000","last_undegraded":"2024-09-13T18:46:24.178287+0000","last_fullsized":"2024-09-13T18:46:24.178287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:14.298852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177935+0000","last_change":"2024-09-13T18:45:48.709291+0000","last_active":"2024-09-13T18:46:24.177935+0000","last_peered":"2024-09-13T18:46:24.177935+0000","last_clean":"2024-09-13T18:46:24.177935+0000","last_became_active":"2024-09-13T18:45:48.708380+0000","last_became_peered":"2024-09-13T18:45:48.708380+0000","last_unstale":"2024-09-13T18:46:24.177935+0000","last_undegraded":"2024-09-13T18:46:24.177935+0000","last_fullsized":"2024-09-13T18:46:24.177935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:25.084648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7,5],"acting":[0,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354847+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:46:24.354847+0000","last_peered":"2024-09-13T18:46:24.354847+0000","last_clean":"2024-09-13T18:46:24.354847+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:46:24.354847+0000","last_undegraded":"2024-09-13T18:46:24.354847+0000","last_fullsized":"2024-09-13T18:46:24.354847+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316331+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:46:24.316331+0000","last_peered":"2024-09-13T18:46:24.316331+0000","last_clean":"2024-09-13T18:46:24.316331+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:46:24.316331+0000","last_undegraded":"2024-09-13T18:46:24.316331+0000","last_fullsized":"2024-09-13T18:46:24.316331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177483+0000","last_change":"2024-09-13T18:46:17.888387+0000","last_active":"2024-09-13T18:46:24.177483+0000","last_peered":"2024-09-13T18:46:24.177483+0000","last_clean":"2024-09-13T18:46:24.177483+0000","last_became_active":"2024-09-13T18:46:17.887921+0000","last_became_peered":"2024-09-13T18:46:17.887921+0000","last_unstale":"2024-09-13T18:46:24.177483+0000","last_undegraded":"2024-09-13T18:46:24.177483+0000","last_fullsized":"2024-09-13T18:46:24.177483+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:36.763250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353725+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:46:24.353725+0000","last_peered":"2024-09-13T18:46:24.353725+0000","last_clean":"2024-09-13T18:46:24.353725+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:46:24.353725+0000","last_undegraded":"2024-09-13T18:46:24.353725+0000","last_fullsized":"2024-09-13T18:46:24.353725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354377+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:46:24.354377+0000","last_peered":"2024-09-13T18:46:24.354377+0000","last_clean":"2024-09-13T18:46:24.354377+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:46:24.354377+0000","last_undegraded":"2024-09-13T18:46:24.354377+0000","last_fullsized":"2024-09-13T18:46:24.354377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356159+0000","last_change":"2024-09-13T18:45:48.700850+0000","last_active":"2024-09-13T18:46:24.356159+0000","last_peered":"2024-09-13T18:46:24.356159+0000","last_clean":"2024-09-13T18:46:24.356159+0000","last_became_active":"2024-09-13T18:45:48.700457+0000","last_became_peered":"2024-09-13T18:45:48.700457+0000","last_unstale":"2024-09-13T18:46:24.356159+0000","last_undegraded":"2024-09-13T18:46:24.356159+0000","last_fullsized":"2024-09-13T18:46:24.356159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:15.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353792+0000","last_change":"2024-09-13T18:45:48.693594+0000","last_active":"2024-09-13T18:46:24.353792+0000","last_peered":"2024-09-13T18:46:24.353792+0000","last_clean":"2024-09-13T18:46:24.353792+0000","last_became_active":"2024-09-13T18:45:48.693254+0000","last_became_peered":"2024-09-13T18:45:48.693254+0000","last_unstale":"2024-09-13T18:46:24.353792+0000","last_undegraded":"2024-09-13T18:46:24.353792+0000","last_fullsized":"2024-09-13T18:46:24.353792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:16.258059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.176549+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:46:24.176549+0000","last_peered":"2024-09-13T18:46:24.176549+0000","last_clean":"2024-09-13T18:46:24.176549+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:46:24.176549+0000","last_undegraded":"2024-09-13T18:46:24.176549+0000","last_fullsized":"2024-09-13T18:46:24.176549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178592+0000","last_change":"2024-09-13T18:45:48.714100+0000","last_active":"2024-09-13T18:46:24.178592+0000","last_peered":"2024-09-13T18:46:24.178592+0000","last_clean":"2024-09-13T18:46:24.178592+0000","last_became_active":"2024-09-13T18:45:48.713617+0000","last_became_peered":"2024-09-13T18:45:48.713617+0000","last_unstale":"2024-09-13T18:46:24.178592+0000","last_undegraded":"2024-09-13T18:46:24.178592+0000","last_fullsized":"2024-09-13T18:46:24.178592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:15.374153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357248+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:46:24.357248+0000","last_peered":"2024-09-13T18:46:24.357248+0000","last_clean":"2024-09-13T18:46:24.357248+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:46:24.357248+0000","last_undegraded":"2024-09-13T18:46:24.357248+0000","last_fullsized":"2024-09-13T18:46:24.357248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":67,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178857+0000","last_change":"2024-09-13T18:46:17.900244+0000","last_active":"2024-09-13T18:46:24.178857+0000","last_peered":"2024-09-13T18:46:24.178857+0000","last_clean":"2024-09-13T18:46:24.178857+0000","last_became_active":"2024-09-13T18:46:17.892529+0000","last_became_peered":"2024-09-13T18:46:17.892529+0000","last_unstale":"2024-09-13T18:46:24.178857+0000","last_undegraded":"2024-09-13T18:46:24.178857+0000","last_fullsized":"2024-09-13T18:46:24.178857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:45.481236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177326+0000","last_change":"2024-09-13T18:46:17.878313+0000","last_active":"2024-09-13T18:46:24.177326+0000","last_peered":"2024-09-13T18:46:24.177326+0000","last_clean":"2024-09-13T18:46:24.177326+0000","last_became_active":"2024-09-13T18:46:17.877892+0000","last_became_peered":"2024-09-13T18:46:17.877892+0000","last_unstale":"2024-09-13T18:46:24.177326+0000","last_undegraded":"2024-09-13T18:46:24.177326+0000","last_fullsized":"2024-09-13T18:46:24.177326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:44.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0,1],"acting":[2,6,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355966+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:46:24.355966+0000","last_peered":"2024-09-13T18:46:24.355966+0000","last_clean":"2024-09-13T18:46:24.355966+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:46:24.355966+0000","last_undegraded":"2024-09-13T18:46:24.355966+0000","last_fullsized":"2024-09-13T18:46:24.355966+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"44'4","reported_seq":38,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:26.830287+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:46:26.830287+0000","last_peered":"2024-09-13T18:46:26.830287+0000","last_clean":"2024-09-13T18:46:26.830287+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:46:26.830287+0000","last_undegraded":"2024-09-13T18:46:26.830287+0000","last_fullsized":"2024-09-13T18:46:26.830287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":61,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353612+0000","last_change":"2024-09-13T18:46:17.881885+0000","last_active":"2024-09-13T18:46:24.353612+0000","last_peered":"2024-09-13T18:46:24.353612+0000","last_clean":"2024-09-13T18:46:24.353612+0000","last_became_active":"2024-09-13T18:46:17.881414+0000","last_became_peered":"2024-09-13T18:46:17.881414+0000","last_unstale":"2024-09-13T18:46:24.353612+0000","last_undegraded":"2024-09-13T18:46:24.353612+0000","last_fullsized":"2024-09-13T18:46:24.353612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:39.275770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,0],"acting":[4,1,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.317193+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:46:24.317193+0000","last_peered":"2024-09-13T18:46:24.317193+0000","last_clean":"2024-09-13T18:46:24.317193+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:46:24.317193+0000","last_undegraded":"2024-09-13T18:46:24.317193+0000","last_fullsized":"2024-09-13T18:46:24.317193+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356335+0000","last_change":"2024-09-13T18:46:17.889774+0000","last_active":"2024-09-13T18:46:24.356335+0000","last_peered":"2024-09-13T18:46:24.356335+0000","last_clean":"2024-09-13T18:46:24.356335+0000","last_became_active":"2024-09-13T18:46:17.889427+0000","last_became_peered":"2024-09-13T18:46:17.889427+0000","last_unstale":"2024-09-13T18:46:24.356335+0000","last_undegraded":"2024-09-13T18:46:24.356335+0000","last_fullsized":"2024-09-13T18:46:24.356335+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:57.918514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316353+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:46:24.316353+0000","last_peered":"2024-09-13T18:46:24.316353+0000","last_clean":"2024-09-13T18:46:24.316353+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:46:24.316353+0000","last_undegraded":"2024-09-13T18:46:24.316353+0000","last_fullsized":"2024-09-13T18:46:24.316353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178699+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:46:24.178699+0000","last_peered":"2024-09-13T18:46:24.178699+0000","last_clean":"2024-09-13T18:46:24.178699+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:46:24.178699+0000","last_undegraded":"2024-09-13T18:46:24.178699+0000","last_fullsized":"2024-09-13T18:46:24.178699+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356836+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:46:24.356836+0000","last_peered":"2024-09-13T18:46:24.356836+0000","last_clean":"2024-09-13T18:46:24.356836+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:46:24.356836+0000","last_undegraded":"2024-09-13T18:46:24.356836+0000","last_fullsized":"2024-09-13T18:46:24.356836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316510+0000","last_change":"2024-09-13T18:46:17.886007+0000","last_active":"2024-09-13T18:46:24.316510+0000","last_peered":"2024-09-13T18:46:24.316510+0000","last_clean":"2024-09-13T18:46:24.316510+0000","last_became_active":"2024-09-13T18:46:17.882573+0000","last_became_peered":"2024-09-13T18:46:17.882573+0000","last_unstale":"2024-09-13T18:46:24.316510+0000","last_undegraded":"2024-09-13T18:46:24.316510+0000","last_fullsized":"2024-09-13T18:46:24.316510+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:57.731521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7],"acting":[6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177637+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:46:24.177637+0000","last_peered":"2024-09-13T18:46:24.177637+0000","last_clean":"2024-09-13T18:46:24.177637+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:46:24.177637+0000","last_undegraded":"2024-09-13T18:46:24.177637+0000","last_fullsized":"2024-09-13T18:46:24.177637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316316+0000","last_change":"2024-09-13T18:46:17.884606+0000","last_active":"2024-09-13T18:46:24.316316+0000","last_peered":"2024-09-13T18:46:24.316316+0000","last_clean":"2024-09-13T18:46:24.316316+0000","last_became_active":"2024-09-13T18:46:17.881486+0000","last_became_peered":"2024-09-13T18:46:17.881486+0000","last_unstale":"2024-09-13T18:46:24.316316+0000","last_undegraded":"2024-09-13T18:46:24.316316+0000","last_fullsized":"2024-09-13T18:46:24.316316+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:47.512371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.317059+0000","last_change":"2024-09-13T18:46:17.884448+0000","last_active":"2024-09-13T18:46:24.317059+0000","last_peered":"2024-09-13T18:46:24.317059+0000","last_clean":"2024-09-13T18:46:24.317059+0000","last_became_active":"2024-09-13T18:46:17.878803+0000","last_became_peered":"2024-09-13T18:46:17.878803+0000","last_unstale":"2024-09-13T18:46:24.317059+0000","last_undegraded":"2024-09-13T18:46:24.317059+0000","last_fullsized":"2024-09-13T18:46:24.317059+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:38.985812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,2],"acting":[6,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353087+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:46:24.353087+0000","last_peered":"2024-09-13T18:46:24.353087+0000","last_clean":"2024-09-13T18:46:24.353087+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:46:24.353087+0000","last_undegraded":"2024-09-13T18:46:24.353087+0000","last_fullsized":"2024-09-13T18:46:24.353087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357140+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:46:24.357140+0000","last_peered":"2024-09-13T18:46:24.357140+0000","last_clean":"2024-09-13T18:46:24.357140+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:46:24.357140+0000","last_undegraded":"2024-09-13T18:46:24.357140+0000","last_fullsized":"2024-09-13T18:46:24.357140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.317468+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:46:24.317468+0000","last_peered":"2024-09-13T18:46:24.317468+0000","last_clean":"2024-09-13T18:46:24.317468+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:46:24.317468+0000","last_undegraded":"2024-09-13T18:46:24.317468+0000","last_fullsized":"2024-09-13T18:46:24.317468+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316109+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:46:24.316109+0000","last_peered":"2024-09-13T18:46:24.316109+0000","last_clean":"2024-09-13T18:46:24.316109+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:46:24.316109+0000","last_undegraded":"2024-09-13T18:46:24.316109+0000","last_fullsized":"2024-09-13T18:46:24.316109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.352721+0000","last_change":"2024-09-13T18:46:17.877938+0000","last_active":"2024-09-13T18:46:24.352721+0000","last_peered":"2024-09-13T18:46:24.352721+0000","last_clean":"2024-09-13T18:46:24.352721+0000","last_became_active":"2024-09-13T18:46:17.877614+0000","last_became_peered":"2024-09-13T18:46:17.877614+0000","last_unstale":"2024-09-13T18:46:24.352721+0000","last_undegraded":"2024-09-13T18:46:24.352721+0000","last_fullsized":"2024-09-13T18:46:24.352721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:56.027082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357527+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:46:24.357527+0000","last_peered":"2024-09-13T18:46:24.357527+0000","last_clean":"2024-09-13T18:46:24.357527+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:46:24.357527+0000","last_undegraded":"2024-09-13T18:46:24.357527+0000","last_fullsized":"2024-09-13T18:46:24.357527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355812+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:46:24.355812+0000","last_peered":"2024-09-13T18:46:24.355812+0000","last_clean":"2024-09-13T18:46:24.355812+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:46:24.355812+0000","last_undegraded":"2024-09-13T18:46:24.355812+0000","last_fullsized":"2024-09-13T18:46:24.355812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178513+0000","last_change":"2024-09-13T18:45:48.705448+0000","last_active":"2024-09-13T18:46:24.178513+0000","last_peered":"2024-09-13T18:46:24.178513+0000","last_clean":"2024-09-13T18:46:24.178513+0000","last_became_active":"2024-09-13T18:45:48.697443+0000","last_became_peered":"2024-09-13T18:45:48.697443+0000","last_unstale":"2024-09-13T18:46:24.178513+0000","last_undegraded":"2024-09-13T18:46:24.178513+0000","last_fullsized":"2024-09-13T18:46:24.178513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.436727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.350776+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:46:24.350776+0000","last_peered":"2024-09-13T18:46:24.350776+0000","last_clean":"2024-09-13T18:46:24.350776+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:46:24.350776+0000","last_undegraded":"2024-09-13T18:46:24.350776+0000","last_fullsized":"2024-09-13T18:46:24.350776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.317245+0000","last_change":"2024-09-13T18:46:17.886012+0000","last_active":"2024-09-13T18:46:24.317245+0000","last_peered":"2024-09-13T18:46:24.317245+0000","last_clean":"2024-09-13T18:46:24.317245+0000","last_became_active":"2024-09-13T18:46:17.879270+0000","last_became_peered":"2024-09-13T18:46:17.879270+0000","last_unstale":"2024-09-13T18:46:24.317245+0000","last_undegraded":"2024-09-13T18:46:24.317245+0000","last_fullsized":"2024-09-13T18:46:24.317245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:42.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,2,0],"acting":[6,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351572+0000","last_change":"2024-09-13T18:45:48.702409+0000","last_active":"2024-09-13T18:46:24.351572+0000","last_peered":"2024-09-13T18:46:24.351572+0000","last_clean":"2024-09-13T18:46:24.351572+0000","last_became_active":"2024-09-13T18:45:48.701419+0000","last_became_peered":"2024-09-13T18:45:48.701419+0000","last_unstale":"2024-09-13T18:46:24.351572+0000","last_undegraded":"2024-09-13T18:46:24.351572+0000","last_fullsized":"2024-09-13T18:46:24.351572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:21.717101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316772+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:46:24.316772+0000","last_peered":"2024-09-13T18:46:24.316772+0000","last_clean":"2024-09-13T18:46:24.316772+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:46:24.316772+0000","last_undegraded":"2024-09-13T18:46:24.316772+0000","last_fullsized":"2024-09-13T18:46:24.316772+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177731+0000","last_change":"2024-09-13T18:45:48.717635+0000","last_active":"2024-09-13T18:46:24.177731+0000","last_peered":"2024-09-13T18:46:24.177731+0000","last_clean":"2024-09-13T18:46:24.177731+0000","last_became_active":"2024-09-13T18:45:48.717239+0000","last_became_peered":"2024-09-13T18:45:48.717239+0000","last_unstale":"2024-09-13T18:46:24.177731+0000","last_undegraded":"2024-09-13T18:46:24.177731+0000","last_fullsized":"2024-09-13T18:46:24.177731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:35.309870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178355+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:46:24.178355+0000","last_peered":"2024-09-13T18:46:24.178355+0000","last_clean":"2024-09-13T18:46:24.178355+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:46:24.178355+0000","last_undegraded":"2024-09-13T18:46:24.178355+0000","last_fullsized":"2024-09-13T18:46:24.178355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357238+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:46:24.357238+0000","last_peered":"2024-09-13T18:46:24.357238+0000","last_clean":"2024-09-13T18:46:24.357238+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:46:24.357238+0000","last_undegraded":"2024-09-13T18:46:24.357238+0000","last_fullsized":"2024-09-13T18:46:24.357238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356743+0000","last_change":"2024-09-13T18:45:48.722124+0000","last_active":"2024-09-13T18:46:24.356743+0000","last_peered":"2024-09-13T18:46:24.356743+0000","last_clean":"2024-09-13T18:46:24.356743+0000","last_became_active":"2024-09-13T18:45:48.721727+0000","last_became_peered":"2024-09-13T18:45:48.721727+0000","last_unstale":"2024-09-13T18:46:24.356743+0000","last_undegraded":"2024-09-13T18:46:24.356743+0000","last_fullsized":"2024-09-13T18:46:24.356743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:28.066907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,2],"acting":[5,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178374+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:46:24.178374+0000","last_peered":"2024-09-13T18:46:24.178374+0000","last_clean":"2024-09-13T18:46:24.178374+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:46:24.178374+0000","last_undegraded":"2024-09-13T18:46:24.178374+0000","last_fullsized":"2024-09-13T18:46:24.178374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":36,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356752+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:46:24.356752+0000","last_peered":"2024-09-13T18:46:24.356752+0000","last_clean":"2024-09-13T18:46:24.356752+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:46:24.356752+0000","last_undegraded":"2024-09-13T18:46:24.356752+0000","last_fullsized":"2024-09-13T18:46:24.356752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177219+0000","last_change":"2024-09-13T18:45:48.714847+0000","last_active":"2024-09-13T18:46:24.177219+0000","last_peered":"2024-09-13T18:46:24.177219+0000","last_clean":"2024-09-13T18:46:24.177219+0000","last_became_active":"2024-09-13T18:45:48.714426+0000","last_became_peered":"2024-09-13T18:45:48.714426+0000","last_unstale":"2024-09-13T18:46:24.177219+0000","last_undegraded":"2024-09-13T18:46:24.177219+0000","last_fullsized":"2024-09-13T18:46:24.177219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:11.990795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178757+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:46:24.178757+0000","last_peered":"2024-09-13T18:46:24.178757+0000","last_clean":"2024-09-13T18:46:24.178757+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:46:24.178757+0000","last_undegraded":"2024-09-13T18:46:24.178757+0000","last_fullsized":"2024-09-13T18:46:24.178757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178513+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:46:24.178513+0000","last_peered":"2024-09-13T18:46:24.178513+0000","last_clean":"2024-09-13T18:46:24.178513+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:46:24.178513+0000","last_undegraded":"2024-09-13T18:46:24.178513+0000","last_fullsized":"2024-09-13T18:46:24.178513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":31,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.350850+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:46:24.350850+0000","last_peered":"2024-09-13T18:46:24.350850+0000","last_clean":"2024-09-13T18:46:24.350850+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:46:24.350850+0000","last_undegraded":"2024-09-13T18:46:24.350850+0000","last_fullsized":"2024-09-13T18:46:24.350850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177235+0000","last_change":"2024-09-13T18:45:48.689956+0000","last_active":"2024-09-13T18:46:24.177235+0000","last_peered":"2024-09-13T18:46:24.177235+0000","last_clean":"2024-09-13T18:46:24.177235+0000","last_became_active":"2024-09-13T18:45:48.689409+0000","last_became_peered":"2024-09-13T18:45:48.689409+0000","last_unstale":"2024-09-13T18:46:24.177235+0000","last_undegraded":"2024-09-13T18:46:24.177235+0000","last_fullsized":"2024-09-13T18:46:24.177235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:02.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":42,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353841+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:46:24.353841+0000","last_peered":"2024-09-13T18:46:24.353841+0000","last_clean":"2024-09-13T18:46:24.353841+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:46:24.353841+0000","last_undegraded":"2024-09-13T18:46:24.353841+0000","last_fullsized":"2024-09-13T18:46:24.353841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357915+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:46:24.357915+0000","last_peered":"2024-09-13T18:46:24.357915+0000","last_clean":"2024-09-13T18:46:24.357915+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:46:24.357915+0000","last_undegraded":"2024-09-13T18:46:24.357915+0000","last_fullsized":"2024-09-13T18:46:24.357915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.350707+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:46:24.350707+0000","last_peered":"2024-09-13T18:46:24.350707+0000","last_clean":"2024-09-13T18:46:24.350707+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:46:24.350707+0000","last_undegraded":"2024-09-13T18:46:24.350707+0000","last_fullsized":"2024-09-13T18:46:24.350707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.176687+0000","last_change":"2024-09-13T18:45:48.707772+0000","last_active":"2024-09-13T18:46:24.176687+0000","last_peered":"2024-09-13T18:46:24.176687+0000","last_clean":"2024-09-13T18:46:24.176687+0000","last_became_active":"2024-09-13T18:45:48.707514+0000","last_became_peered":"2024-09-13T18:45:48.707514+0000","last_unstale":"2024-09-13T18:46:24.176687+0000","last_undegraded":"2024-09-13T18:46:24.176687+0000","last_fullsized":"2024-09-13T18:46:24.176687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:29.071230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.358978+0000","last_change":"2024-09-13T18:46:17.878917+0000","last_active":"2024-09-13T18:46:24.358978+0000","last_peered":"2024-09-13T18:46:24.358978+0000","last_clean":"2024-09-13T18:46:24.358978+0000","last_became_active":"2024-09-13T18:46:17.878462+0000","last_became_peered":"2024-09-13T18:46:17.878462+0000","last_unstale":"2024-09-13T18:46:24.358978+0000","last_undegraded":"2024-09-13T18:46:24.358978+0000","last_fullsized":"2024-09-13T18:46:24.358978+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.130945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177463+0000","last_change":"2024-09-13T18:45:48.725411+0000","last_active":"2024-09-13T18:46:24.177463+0000","last_peered":"2024-09-13T18:46:24.177463+0000","last_clean":"2024-09-13T18:46:24.177463+0000","last_became_active":"2024-09-13T18:45:48.724382+0000","last_became_peered":"2024-09-13T18:45:48.724382+0000","last_unstale":"2024-09-13T18:46:24.177463+0000","last_undegraded":"2024-09-13T18:46:24.177463+0000","last_fullsized":"2024-09-13T18:46:24.177463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:42.389416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355086+0000","last_change":"2024-09-13T18:45:48.728662+0000","last_active":"2024-09-13T18:46:24.355086+0000","last_peered":"2024-09-13T18:46:24.355086+0000","last_clean":"2024-09-13T18:46:24.355086+0000","last_became_active":"2024-09-13T18:45:48.728376+0000","last_became_peered":"2024-09-13T18:45:48.728376+0000","last_unstale":"2024-09-13T18:46:24.355086+0000","last_undegraded":"2024-09-13T18:46:24.355086+0000","last_fullsized":"2024-09-13T18:46:24.355086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:27.005563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316791+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:46:24.316791+0000","last_peered":"2024-09-13T18:46:24.316791+0000","last_clean":"2024-09-13T18:46:24.316791+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:46:24.316791+0000","last_undegraded":"2024-09-13T18:46:24.316791+0000","last_fullsized":"2024-09-13T18:46:24.316791+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316017+0000","last_change":"2024-09-13T18:46:17.873929+0000","last_active":"2024-09-13T18:46:24.316017+0000","last_peered":"2024-09-13T18:46:24.316017+0000","last_clean":"2024-09-13T18:46:24.316017+0000","last_became_active":"2024-09-13T18:46:17.873625+0000","last_became_peered":"2024-09-13T18:46:17.873625+0000","last_unstale":"2024-09-13T18:46:24.316017+0000","last_undegraded":"2024-09-13T18:46:24.316017+0000","last_fullsized":"2024-09-13T18:46:24.316017+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:59.562319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355102+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:46:24.355102+0000","last_peered":"2024-09-13T18:46:24.355102+0000","last_clean":"2024-09-13T18:46:24.355102+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:46:24.355102+0000","last_undegraded":"2024-09-13T18:46:24.355102+0000","last_fullsized":"2024-09-13T18:46:24.355102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351395+0000","last_change":"2024-09-13T18:46:17.886302+0000","last_active":"2024-09-13T18:46:24.351395+0000","last_peered":"2024-09-13T18:46:24.351395+0000","last_clean":"2024-09-13T18:46:24.351395+0000","last_became_active":"2024-09-13T18:46:17.885969+0000","last_became_peered":"2024-09-13T18:46:17.885969+0000","last_unstale":"2024-09-13T18:46:24.351395+0000","last_undegraded":"2024-09-13T18:46:24.351395+0000","last_fullsized":"2024-09-13T18:46:24.351395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:10.207129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178647+0000","last_change":"2024-09-13T18:46:17.892850+0000","last_active":"2024-09-13T18:46:24.178647+0000","last_peered":"2024-09-13T18:46:24.178647+0000","last_clean":"2024-09-13T18:46:24.178647+0000","last_became_active":"2024-09-13T18:46:17.892525+0000","last_became_peered":"2024-09-13T18:46:17.892525+0000","last_unstale":"2024-09-13T18:46:24.178647+0000","last_undegraded":"2024-09-13T18:46:24.178647+0000","last_fullsized":"2024-09-13T18:46:24.178647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:57.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"42'14","reported_seq":47,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178260+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:46:24.178260+0000","last_peered":"2024-09-13T18:46:24.178260+0000","last_clean":"2024-09-13T18:46:24.178260+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:46:24.178260+0000","last_undegraded":"2024-09-13T18:46:24.178260+0000","last_fullsized":"2024-09-13T18:46:24.178260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353830+0000","last_change":"2024-09-13T18:45:48.702097+0000","last_active":"2024-09-13T18:46:24.353830+0000","last_peered":"2024-09-13T18:46:24.353830+0000","last_clean":"2024-09-13T18:46:24.353830+0000","last_became_active":"2024-09-13T18:45:48.701675+0000","last_became_peered":"2024-09-13T18:45:48.701675+0000","last_unstale":"2024-09-13T18:46:24.353830+0000","last_undegraded":"2024-09-13T18:46:24.353830+0000","last_fullsized":"2024-09-13T18:46:24.353830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:39.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,5,0],"acting":[4,7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178111+0000","last_change":"2024-09-13T18:45:48.712004+0000","last_active":"2024-09-13T18:46:24.178111+0000","last_peered":"2024-09-13T18:46:24.178111+0000","last_clean":"2024-09-13T18:46:24.178111+0000","last_became_active":"2024-09-13T18:45:48.711706+0000","last_became_peered":"2024-09-13T18:45:48.711706+0000","last_unstale":"2024-09-13T18:46:24.178111+0000","last_undegraded":"2024-09-13T18:46:24.178111+0000","last_fullsized":"2024-09-13T18:46:24.178111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:54.843576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":36,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356277+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:46:24.356277+0000","last_peered":"2024-09-13T18:46:24.356277+0000","last_clean":"2024-09-13T18:46:24.356277+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:46:24.356277+0000","last_undegraded":"2024-09-13T18:46:24.356277+0000","last_fullsized":"2024-09-13T18:46:24.356277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178779+0000","last_change":"2024-09-13T18:45:48.718535+0000","last_active":"2024-09-13T18:46:24.178779+0000","last_peered":"2024-09-13T18:46:24.178779+0000","last_clean":"2024-09-13T18:46:24.178779+0000","last_became_active":"2024-09-13T18:45:48.718213+0000","last_became_peered":"2024-09-13T18:45:48.718213+0000","last_unstale":"2024-09-13T18:46:24.178779+0000","last_undegraded":"2024-09-13T18:46:24.178779+0000","last_fullsized":"2024-09-13T18:46:24.178779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:22.172956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,7],"acting":[2,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.359162+0000","last_change":"2024-09-13T18:45:48.699228+0000","last_active":"2024-09-13T18:46:24.359162+0000","last_peered":"2024-09-13T18:46:24.359162+0000","last_clean":"2024-09-13T18:46:24.359162+0000","last_became_active":"2024-09-13T18:45:48.698943+0000","last_became_peered":"2024-09-13T18:45:48.698943+0000","last_unstale":"2024-09-13T18:46:24.359162+0000","last_undegraded":"2024-09-13T18:46:24.359162+0000","last_fullsized":"2024-09-13T18:46:24.359162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:44.992708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177794+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:46:24.177794+0000","last_peered":"2024-09-13T18:46:24.177794+0000","last_clean":"2024-09-13T18:46:24.177794+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:46:24.177794+0000","last_undegraded":"2024-09-13T18:46:24.177794+0000","last_fullsized":"2024-09-13T18:46:24.177794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354301+0000","last_change":"2024-09-13T18:45:48.718613+0000","last_active":"2024-09-13T18:46:24.354301+0000","last_peered":"2024-09-13T18:46:24.354301+0000","last_clean":"2024-09-13T18:46:24.354301+0000","last_became_active":"2024-09-13T18:45:48.718087+0000","last_became_peered":"2024-09-13T18:45:48.718087+0000","last_unstale":"2024-09-13T18:46:24.354301+0000","last_undegraded":"2024-09-13T18:46:24.354301+0000","last_fullsized":"2024-09-13T18:46:24.354301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:44.664471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4,2],"acting":[7,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178672+0000","last_change":"2024-09-13T18:45:48.698690+0000","last_active":"2024-09-13T18:46:24.178672+0000","last_peered":"2024-09-13T18:46:24.178672+0000","last_clean":"2024-09-13T18:46:24.178672+0000","last_became_active":"2024-09-13T18:45:48.697966+0000","last_became_peered":"2024-09-13T18:45:48.697966+0000","last_unstale":"2024-09-13T18:46:24.178672+0000","last_undegraded":"2024-09-13T18:46:24.178672+0000","last_fullsized":"2024-09-13T18:46:24.178672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:13.604007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351908+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:46:24.351908+0000","last_peered":"2024-09-13T18:46:24.351908+0000","last_clean":"2024-09-13T18:46:24.351908+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:46:24.351908+0000","last_undegraded":"2024-09-13T18:46:24.351908+0000","last_fullsized":"2024-09-13T18:46:24.351908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354164+0000","last_change":"2024-09-13T18:45:48.702521+0000","last_active":"2024-09-13T18:46:24.354164+0000","last_peered":"2024-09-13T18:46:24.354164+0000","last_clean":"2024-09-13T18:46:24.354164+0000","last_became_active":"2024-09-13T18:45:48.701942+0000","last_became_peered":"2024-09-13T18:45:48.701942+0000","last_unstale":"2024-09-13T18:46:24.354164+0000","last_undegraded":"2024-09-13T18:46:24.354164+0000","last_fullsized":"2024-09-13T18:46:24.354164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:37.726860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7,1],"acting":[4,0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355485+0000","last_change":"2024-09-13T18:45:48.715907+0000","last_active":"2024-09-13T18:46:24.355485+0000","last_peered":"2024-09-13T18:46:24.355485+0000","last_clean":"2024-09-13T18:46:24.355485+0000","last_became_active":"2024-09-13T18:45:48.715518+0000","last_became_peered":"2024-09-13T18:45:48.715518+0000","last_unstale":"2024-09-13T18:46:24.355485+0000","last_undegraded":"2024-09-13T18:46:24.355485+0000","last_fullsized":"2024-09-13T18:46:24.355485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:40.192039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,2],"acting":[4,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354222+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:46:24.354222+0000","last_peered":"2024-09-13T18:46:24.354222+0000","last_clean":"2024-09-13T18:46:24.354222+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:46:24.354222+0000","last_undegraded":"2024-09-13T18:46:24.354222+0000","last_fullsized":"2024-09-13T18:46:24.354222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.350680+0000","last_change":"2024-09-13T18:45:48.692116+0000","last_active":"2024-09-13T18:46:24.350680+0000","last_peered":"2024-09-13T18:46:24.350680+0000","last_clean":"2024-09-13T18:46:24.350680+0000","last_became_active":"2024-09-13T18:45:48.691790+0000","last_became_peered":"2024-09-13T18:45:48.691790+0000","last_unstale":"2024-09-13T18:46:24.350680+0000","last_undegraded":"2024-09-13T18:46:24.350680+0000","last_fullsized":"2024-09-13T18:46:24.350680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:43.012450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177762+0000","last_change":"2024-09-13T18:45:48.711809+0000","last_active":"2024-09-13T18:46:24.177762+0000","last_peered":"2024-09-13T18:46:24.177762+0000","last_clean":"2024-09-13T18:46:24.177762+0000","last_became_active":"2024-09-13T18:45:48.710783+0000","last_became_peered":"2024-09-13T18:45:48.710783+0000","last_unstale":"2024-09-13T18:46:24.177762+0000","last_undegraded":"2024-09-13T18:46:24.177762+0000","last_fullsized":"2024-09-13T18:46:24.177762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:39.637386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5,1],"acting":[2,4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353146+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:46:24.353146+0000","last_peered":"2024-09-13T18:46:24.353146+0000","last_clean":"2024-09-13T18:46:24.353146+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:46:24.353146+0000","last_undegraded":"2024-09-13T18:46:24.353146+0000","last_fullsized":"2024-09-13T18:46:24.353146+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.315863+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:46:24.315863+0000","last_peered":"2024-09-13T18:46:24.315863+0000","last_clean":"2024-09-13T18:46:24.315863+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:46:24.315863+0000","last_undegraded":"2024-09-13T18:46:24.315863+0000","last_fullsized":"2024-09-13T18:46:24.315863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.176758+0000","last_change":"2024-09-13T18:45:48.712120+0000","last_active":"2024-09-13T18:46:24.176758+0000","last_peered":"2024-09-13T18:46:24.176758+0000","last_clean":"2024-09-13T18:46:24.176758+0000","last_became_active":"2024-09-13T18:45:48.711759+0000","last_became_peered":"2024-09-13T18:45:48.711759+0000","last_unstale":"2024-09-13T18:46:24.176758+0000","last_undegraded":"2024-09-13T18:46:24.176758+0000","last_fullsized":"2024-09-13T18:46:24.176758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:32.142963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355854+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:46:24.355854+0000","last_peered":"2024-09-13T18:46:24.355854+0000","last_clean":"2024-09-13T18:46:24.355854+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:46:24.355854+0000","last_undegraded":"2024-09-13T18:46:24.355854+0000","last_fullsized":"2024-09-13T18:46:24.355854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355320+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:46:24.355320+0000","last_peered":"2024-09-13T18:46:24.355320+0000","last_clean":"2024-09-13T18:46:24.355320+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:46:24.355320+0000","last_undegraded":"2024-09-13T18:46:24.355320+0000","last_fullsized":"2024-09-13T18:46:24.355320+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357132+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:46:24.357132+0000","last_peered":"2024-09-13T18:46:24.357132+0000","last_clean":"2024-09-13T18:46:24.357132+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:46:24.357132+0000","last_undegraded":"2024-09-13T18:46:24.357132+0000","last_fullsized":"2024-09-13T18:46:24.357132+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351068+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:46:24.351068+0000","last_peered":"2024-09-13T18:46:24.351068+0000","last_clean":"2024-09-13T18:46:24.351068+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:46:24.351068+0000","last_undegraded":"2024-09-13T18:46:24.351068+0000","last_fullsized":"2024-09-13T18:46:24.351068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355835+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:46:24.355835+0000","last_peered":"2024-09-13T18:46:24.355835+0000","last_clean":"2024-09-13T18:46:24.355835+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:46:24.355835+0000","last_undegraded":"2024-09-13T18:46:24.355835+0000","last_fullsized":"2024-09-13T18:46:24.355835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177284+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:46:24.177284+0000","last_peered":"2024-09-13T18:46:24.177284+0000","last_clean":"2024-09-13T18:46:24.177284+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:46:24.177284+0000","last_undegraded":"2024-09-13T18:46:24.177284+0000","last_fullsized":"2024-09-13T18:46:24.177284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354811+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:46:24.354811+0000","last_peered":"2024-09-13T18:46:24.354811+0000","last_clean":"2024-09-13T18:46:24.354811+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:46:24.354811+0000","last_undegraded":"2024-09-13T18:46:24.354811+0000","last_fullsized":"2024-09-13T18:46:24.354811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353816+0000","last_change":"2024-09-13T18:45:48.701844+0000","last_active":"2024-09-13T18:46:24.353816+0000","last_peered":"2024-09-13T18:46:24.353816+0000","last_clean":"2024-09-13T18:46:24.353816+0000","last_became_active":"2024-09-13T18:45:48.701424+0000","last_became_peered":"2024-09-13T18:45:48.701424+0000","last_unstale":"2024-09-13T18:46:24.353816+0000","last_undegraded":"2024-09-13T18:46:24.353816+0000","last_fullsized":"2024-09-13T18:46:24.353816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:06.472145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356920+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:46:24.356920+0000","last_peered":"2024-09-13T18:46:24.356920+0000","last_clean":"2024-09-13T18:46:24.356920+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:46:24.356920+0000","last_undegraded":"2024-09-13T18:46:24.356920+0000","last_fullsized":"2024-09-13T18:46:24.356920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316661+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:46:24.316661+0000","last_peered":"2024-09-13T18:46:24.316661+0000","last_clean":"2024-09-13T18:46:24.316661+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:46:24.316661+0000","last_undegraded":"2024-09-13T18:46:24.316661+0000","last_fullsized":"2024-09-13T18:46:24.316661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.317042+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:46:24.317042+0000","last_peered":"2024-09-13T18:46:24.317042+0000","last_clean":"2024-09-13T18:46:24.317042+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:46:24.317042+0000","last_undegraded":"2024-09-13T18:46:24.317042+0000","last_fullsized":"2024-09-13T18:46:24.317042+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178660+0000","last_change":"2024-09-13T18:45:48.698886+0000","last_active":"2024-09-13T18:46:24.178660+0000","last_peered":"2024-09-13T18:46:24.178660+0000","last_clean":"2024-09-13T18:46:24.178660+0000","last_became_active":"2024-09-13T18:45:48.698416+0000","last_became_peered":"2024-09-13T18:45:48.698416+0000","last_unstale":"2024-09-13T18:46:24.178660+0000","last_undegraded":"2024-09-13T18:46:24.178660+0000","last_fullsized":"2024-09-13T18:46:24.178660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:54.636986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.358873+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:46:24.358873+0000","last_peered":"2024-09-13T18:46:24.358873+0000","last_clean":"2024-09-13T18:46:24.358873+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:46:24.358873+0000","last_undegraded":"2024-09-13T18:46:24.358873+0000","last_fullsized":"2024-09-13T18:46:24.358873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.352676+0000","last_change":"2024-09-13T18:45:48.696609+0000","last_active":"2024-09-13T18:46:24.352676+0000","last_peered":"2024-09-13T18:46:24.352676+0000","last_clean":"2024-09-13T18:46:24.352676+0000","last_became_active":"2024-09-13T18:45:48.696261+0000","last_became_peered":"2024-09-13T18:45:48.696261+0000","last_unstale":"2024-09-13T18:46:24.352676+0000","last_undegraded":"2024-09-13T18:46:24.352676+0000","last_fullsized":"2024-09-13T18:46:24.352676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:26.988762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.353194+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:46:24.353194+0000","last_peered":"2024-09-13T18:46:24.353194+0000","last_clean":"2024-09-13T18:46:24.353194+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:46:24.353194+0000","last_undegraded":"2024-09-13T18:46:24.353194+0000","last_fullsized":"2024-09-13T18:46:24.353194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351033+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:46:24.351033+0000","last_peered":"2024-09-13T18:46:24.351033+0000","last_clean":"2024-09-13T18:46:24.351033+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:46:24.351033+0000","last_undegraded":"2024-09-13T18:46:24.351033+0000","last_fullsized":"2024-09-13T18:46:24.351033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355640+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:46:24.355640+0000","last_peered":"2024-09-13T18:46:24.355640+0000","last_clean":"2024-09-13T18:46:24.355640+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:46:24.355640+0000","last_undegraded":"2024-09-13T18:46:24.355640+0000","last_fullsized":"2024-09-13T18:46:24.355640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178276+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:46:24.178276+0000","last_peered":"2024-09-13T18:46:24.178276+0000","last_clean":"2024-09-13T18:46:24.178276+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:46:24.178276+0000","last_undegraded":"2024-09-13T18:46:24.178276+0000","last_fullsized":"2024-09-13T18:46:24.178276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.355462+0000","last_change":"2024-09-13T18:45:48.717665+0000","last_active":"2024-09-13T18:46:24.355462+0000","last_peered":"2024-09-13T18:46:24.355462+0000","last_clean":"2024-09-13T18:46:24.355462+0000","last_became_active":"2024-09-13T18:45:48.717331+0000","last_became_peered":"2024-09-13T18:45:48.717331+0000","last_unstale":"2024-09-13T18:46:24.355462+0000","last_undegraded":"2024-09-13T18:46:24.355462+0000","last_fullsized":"2024-09-13T18:46:24.355462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:50.696835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.356515+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:46:24.356515+0000","last_peered":"2024-09-13T18:46:24.356515+0000","last_clean":"2024-09-13T18:46:24.356515+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:46:24.356515+0000","last_undegraded":"2024-09-13T18:46:24.356515+0000","last_fullsized":"2024-09-13T18:46:24.356515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177967+0000","last_change":"2024-09-13T18:45:48.724958+0000","last_active":"2024-09-13T18:46:24.177967+0000","last_peered":"2024-09-13T18:46:24.177967+0000","last_clean":"2024-09-13T18:46:24.177967+0000","last_became_active":"2024-09-13T18:45:48.724614+0000","last_became_peered":"2024-09-13T18:45:48.724614+0000","last_unstale":"2024-09-13T18:46:24.177967+0000","last_undegraded":"2024-09-13T18:46:24.177967+0000","last_fullsized":"2024-09-13T18:46:24.177967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:44.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177117+0000","last_change":"2024-09-13T18:46:17.874895+0000","last_active":"2024-09-13T18:46:24.177117+0000","last_peered":"2024-09-13T18:46:24.177117+0000","last_clean":"2024-09-13T18:46:24.177117+0000","last_became_active":"2024-09-13T18:46:17.874620+0000","last_became_peered":"2024-09-13T18:46:17.874620+0000","last_unstale":"2024-09-13T18:46:24.177117+0000","last_undegraded":"2024-09-13T18:46:24.177117+0000","last_fullsized":"2024-09-13T18:46:24.177117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:58.761015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.352963+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:46:24.352963+0000","last_peered":"2024-09-13T18:46:24.352963+0000","last_clean":"2024-09-13T18:46:24.352963+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:46:24.352963+0000","last_undegraded":"2024-09-13T18:46:24.352963+0000","last_fullsized":"2024-09-13T18:46:24.352963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316559+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:46:24.316559+0000","last_peered":"2024-09-13T18:46:24.316559+0000","last_clean":"2024-09-13T18:46:24.316559+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:46:24.316559+0000","last_undegraded":"2024-09-13T18:46:24.316559+0000","last_fullsized":"2024-09-13T18:46:24.316559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.316469+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:46:24.316469+0000","last_peered":"2024-09-13T18:46:24.316469+0000","last_clean":"2024-09-13T18:46:24.316469+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:46:24.316469+0000","last_undegraded":"2024-09-13T18:46:24.316469+0000","last_fullsized":"2024-09-13T18:46:24.316469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178193+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:46:24.178193+0000","last_peered":"2024-09-13T18:46:24.178193+0000","last_clean":"2024-09-13T18:46:24.178193+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:46:24.178193+0000","last_undegraded":"2024-09-13T18:46:24.178193+0000","last_fullsized":"2024-09-13T18:46:24.178193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178186+0000","last_change":"2024-09-13T18:45:48.721113+0000","last_active":"2024-09-13T18:46:24.178186+0000","last_peered":"2024-09-13T18:46:24.178186+0000","last_clean":"2024-09-13T18:46:24.178186+0000","last_became_active":"2024-09-13T18:45:48.720617+0000","last_became_peered":"2024-09-13T18:45:48.720617+0000","last_unstale":"2024-09-13T18:46:24.178186+0000","last_undegraded":"2024-09-13T18:46:24.178186+0000","last_fullsized":"2024-09-13T18:46:24.178186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:42.694597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177652+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:46:24.177652+0000","last_peered":"2024-09-13T18:46:24.177652+0000","last_clean":"2024-09-13T18:46:24.177652+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:46:24.177652+0000","last_undegraded":"2024-09-13T18:46:24.177652+0000","last_fullsized":"2024-09-13T18:46:24.177652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.351881+0000","last_change":"2024-09-13T18:45:48.694951+0000","last_active":"2024-09-13T18:46:24.351881+0000","last_peered":"2024-09-13T18:46:24.351881+0000","last_clean":"2024-09-13T18:46:24.351881+0000","last_became_active":"2024-09-13T18:45:48.694647+0000","last_became_peered":"2024-09-13T18:45:48.694647+0000","last_unstale":"2024-09-13T18:46:24.351881+0000","last_undegraded":"2024-09-13T18:46:24.351881+0000","last_fullsized":"2024-09-13T18:46:24.351881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:04.005346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.352955+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:46:24.352955+0000","last_peered":"2024-09-13T18:46:24.352955+0000","last_clean":"2024-09-13T18:46:24.352955+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:46:24.352955+0000","last_undegraded":"2024-09-13T18:46:24.352955+0000","last_fullsized":"2024-09-13T18:46:24.352955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.354374+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:46:24.354374+0000","last_peered":"2024-09-13T18:46:24.354374+0000","last_clean":"2024-09-13T18:46:24.354374+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:46:24.354374+0000","last_undegraded":"2024-09-13T18:46:24.354374+0000","last_fullsized":"2024-09-13T18:46:24.354374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177859+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:46:24.177859+0000","last_peered":"2024-09-13T18:46:24.177859+0000","last_clean":"2024-09-13T18:46:24.177859+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:46:24.177859+0000","last_undegraded":"2024-09-13T18:46:24.177859+0000","last_fullsized":"2024-09-13T18:46:24.177859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.177770+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:46:24.177770+0000","last_peered":"2024-09-13T18:46:24.177770+0000","last_clean":"2024-09-13T18:46:24.177770+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:46:24.177770+0000","last_undegraded":"2024-09-13T18:46:24.177770+0000","last_fullsized":"2024-09-13T18:46:24.177770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178178+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:46:24.178178+0000","last_peered":"2024-09-13T18:46:24.178178+0000","last_clean":"2024-09-13T18:46:24.178178+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:46:24.178178+0000","last_undegraded":"2024-09-13T18:46:24.178178+0000","last_fullsized":"2024-09-13T18:46:24.178178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357097+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:46:24.357097+0000","last_peered":"2024-09-13T18:46:24.357097+0000","last_clean":"2024-09-13T18:46:24.357097+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:46:24.357097+0000","last_undegraded":"2024-09-13T18:46:24.357097+0000","last_fullsized":"2024-09-13T18:46:24.357097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.357716+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:46:24.357716+0000","last_peered":"2024-09-13T18:46:24.357716+0000","last_clean":"2024-09-13T18:46:24.357716+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:46:24.357716+0000","last_undegraded":"2024-09-13T18:46:24.357716+0000","last_fullsized":"2024-09-13T18:46:24.357716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:46:24.178248+0000","last_change":"2024-09-13T18:45:48.713439+0000","last_active":"2024-09-13T18:46:24.178248+0000","last_peered":"2024-09-13T18:46:24.178248+0000","last_clean":"2024-09-13T18:46:24.178248+0000","last_became_active":"2024-09-13T18:45:48.713131+0000","last_became_peered":"2024-09-13T18:45:48.713131+0000","last_unstale":"2024-09-13T18:46:24.178248+0000","last_undegraded":"2024-09-13T18:46:24.178248+0000","last_fullsized":"2024-09-13T18:46:24.178248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:38.704083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8537,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":17656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":0,"seq":64424509462,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31628,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340212,"statfs":{"total":96636764160,"available":96604377088,"internally_reserved":0,"allocated":524288,"data_stored":245672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.0469999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.876}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.92900000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1101824,"data_stored":827789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.008},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.5979999999999999,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":0.91800000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.264,"5min":1.264,"15min":1.264},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.03}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":512000,"data_stored":237407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.91300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.78800000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":237475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.0649999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.113}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.141},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.044}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.93200000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":237351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0589999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.96099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.748},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0169999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1890000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1105920,"data_stored":827811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.92700000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.746},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0409999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":528384,"data_stored":245762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.4399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.538},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.81899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":1.611}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":10.058999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.732,"5min":1.732,"15min":1.732},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":10.223000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":0.63}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.117},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.3069999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.159},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.5680000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":8411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:46:33.618 INFO:tasks.thrashosds.thrasher:Setting 4.17 to [6, 4, 7, 5] 2024-09-13T18:46:33.619 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.17', '6', '4', '7', '5'] 2024-09-13T18:46:33.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.17 6 4 7 5 2024-09-13T18:46:33.659 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:33.655+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:33.706 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.706 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:33.717 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:33.727 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:33.722+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:33.819 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.819 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.830 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:33.830 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:33.823+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:33.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.839+0000 7f1732a00700 1 Processor -- start 2024-09-13T18:46:33.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1732a00700 1 -- start start 2024-09-13T18:46:33.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1732a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f172c0c70d0 0x7f172c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1732a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0c4610 con 0x7f172c0c7870 2024-09-13T18:46:33.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1732a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c157fe0 con 0x7f172c0c6cf0 2024-09-13T18:46:33.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1732a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c1585a0 con 0x7f172c0c70d0 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1731600700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f172c0c6cf0 0x7f172c1575c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52132/0 (socket says 172.21.15.32:52132) 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1731600700 1 -- 172.21.15.32:0/146791142 learned_addr learned my addr 172.21.15.32:0/146791142 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1730c00700 1 --2- 172.21.15.32:0/146791142 >> v2:172.21.15.32:3300/0 conn(0x7f172c0c70d0 0x7f172c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f172be00700 1 -- 172.21.15.32:0/146791142 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294993926 0 0) 0x7f172c157fe0 con 0x7f172c0c6cf0 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1730c00700 1 -- 172.21.15.32:0/146791142 >> v1:172.21.15.86:6789/0 conn(0x7f172c0c6cf0 legacy=0x7f172c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1730c00700 1 -- 172.21.15.32:0/146791142 >> v1:172.21.15.32:6789/0 conn(0x7f172c0c7870 legacy=0x7f172c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.843+0000 7f1730c00700 1 -- 172.21.15.32:0/146791142 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c1582c0 con 0x7f172c0c70d0 2024-09-13T18:46:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1730c00700 1 --2- 172.21.15.32:0/146791142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c06a390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1718009850 tx=0x7f1718009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6aa94ae179b1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f172be00700 1 -- 172.21.15.32:0/146791142 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011830 con 0x7f172c0c70d0 2024-09-13T18:46:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f172be00700 1 -- 172.21.15.32:0/146791142 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718011990 con 0x7f172c0c70d0 2024-09-13T18:46:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f172be00700 1 -- 172.21.15.32:0/146791142 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011d20 con 0x7f172c0c70d0 2024-09-13T18:46:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 -- 172.21.15.32:0/146791142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 msgr2=0x7f172c06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 --2- 172.21.15.32:0/146791142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c06a390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1718009850 tx=0x7f1718009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 -- 172.21.15.32:0/146791142 shutdown_connections 2024-09-13T18:46:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 --2- 172.21.15.32:0/146791142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c06a390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 -- 172.21.15.32:0/146791142 >> 172.21.15.32:0/146791142 conn(0x7f172c0ccf70 msgr2=0x7f172c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 -- 172.21.15.32:0/146791142 shutdown_connections 2024-09-13T18:46:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.847+0000 7f1732a00700 1 -- 172.21.15.32:0/146791142 wait complete. 2024-09-13T18:46:33.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 Processor -- start 2024-09-13T18:46:33.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 -- start start 2024-09-13T18:46:33.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 0x7f172c0be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c0bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c0c7870 0x7f172c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c157510 con 0x7f172c0c70d0 2024-09-13T18:46:33.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c06ff40 con 0x7f172c0c6cf0 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172c157700 con 0x7f172c0c7870 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1731600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 0x7f172c0be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1731600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 0x7f172c0be6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52876/0 (socket says 172.21.15.32:52876) 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1731600700 1 -- 172.21.15.32:0/1315666477 learned_addr learned my addr 172.21.15.32:0/1315666477 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732000700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c0c7870 0x7f172c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1730c00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c0bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732000700 1 -- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 msgr2=0x7f172c0be6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732000700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 0x7f172c0be6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732000700 1 -- 172.21.15.32:0/1315666477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 msgr2=0x7f172c0bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732000700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c0bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1732000700 1 -- 172.21.15.32:0/1315666477 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17180094b0 con 0x7f172c0c7870 2024-09-13T18:46:33.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.851+0000 7f1731600700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 0x7f172c0be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:33.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1732000700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c0c7870 0x7f172c151f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f172400cae0 tx=0x7f172400cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724003c20 con 0x7f172c0c7870 2024-09-13T18:46:33.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724003d80 con 0x7f172c0c7870 2024-09-13T18:46:33.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172400aa20 con 0x7f172c0c7870 2024-09-13T18:46:33.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c0bec70 con 0x7f172c0c7870 2024-09-13T18:46:33.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c070470 con 0x7f172c0c7870 2024-09-13T18:46:33.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.855+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c06a390 con 0x7f172c0c7870 2024-09-13T18:46:33.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.859+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f172400ab80 con 0x7f172c0c7870 2024-09-13T18:46:33.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.859+0000 7f1729600700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.859+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f1724084500 con 0x7f172c0c7870 2024-09-13T18:46:33.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.859+0000 7f1731600700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.859+0000 7f1731600700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f170c066730 0x7f170c068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1720000f60 tx=0x7f1720001960 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.871+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1724051370 con 0x7f172c0c7870 2024-09-13T18:46:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bbe00700 1 Processor -- start 2024-09-13T18:46:33.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bbe00700 1 -- start start 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bbe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f99bc0c7070 0x7f99bc157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bbe00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0c2230 con 0x7f99bc0719b0 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bbe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0c24f0 con 0x7f99bc071d90 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bbe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0c3ed0 con 0x7f99bc0c7070 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99ba000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f99bc071d90 0x7f99bc1511d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52144/0 (socket says 172.21.15.32:52144) 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99ba000700 1 -- 172.21.15.32:0/2968106536 learned_addr learned my addr 172.21.15.32:0/2968106536 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99bb400700 1 --2- 172.21.15.32:0/2968106536 >> v2:172.21.15.32:3300/0 conn(0x7f99bc0c7070 0x7f99bc157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99b9600700 1 -- 172.21.15.32:0/2968106536 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059915752 0 0) 0x7f99bc0c24f0 con 0x7f99bc071d90 2024-09-13T18:46:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.883+0000 7f99b9600700 1 -- 172.21.15.32:0/2968106536 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a00035d0 con 0x7f99bc071d90 2024-09-13T18:46:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bb400700 1 -- 172.21.15.32:0/2968106536 >> v1:172.21.15.86:6789/0 conn(0x7f99bc071d90 legacy=0x7f99bc1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bb400700 1 -- 172.21.15.32:0/2968106536 >> v1:172.21.15.32:6789/0 conn(0x7f99bc0719b0 legacy=0x7f99bc15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bb400700 1 -- 172.21.15.32:0/2968106536 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0c41b0 con 0x7f99bc0c7070 2024-09-13T18:46:33.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bb400700 1 --2- 172.21.15.32:0/2968106536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc0c7070 0x7f99bc157990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1806c2e667d8225 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99b9600700 1 -- 172.21.15.32:0/2968106536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400e070 con 0x7f99bc0c7070 2024-09-13T18:46:33.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99b9600700 1 -- 172.21.15.32:0/2968106536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4003a40 con 0x7f99bc0c7070 2024-09-13T18:46:33.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99b9600700 1 -- 172.21.15.32:0/2968106536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8001670 con 0x7f99bc0c7070 2024-09-13T18:46:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 -- 172.21.15.32:0/2968106536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc0c7070 msgr2=0x7f99bc157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 --2- 172.21.15.32:0/2968106536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc0c7070 0x7f99bc157990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b400b330 comp rx=0 tx=0).stop 2024-09-13T18:46:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 -- 172.21.15.32:0/2968106536 shutdown_connections 2024-09-13T18:46:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 --2- 172.21.15.32:0/2968106536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc0c7070 0x7f99bc157990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 -- 172.21.15.32:0/2968106536 >> 172.21.15.32:0/2968106536 conn(0x7f99bc06a7d0 msgr2=0x7f99bc06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:33.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 -- 172.21.15.32:0/2968106536 shutdown_connections 2024-09-13T18:46:33.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.887+0000 7f99bbe00700 1 -- 172.21.15.32:0/2968106536 wait complete. 2024-09-13T18:46:33.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 Processor -- start 2024-09-13T18:46:33.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 -- start start 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99bc0719b0 0x7f99bc071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc071d90 0x7f99bc1e2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99bc0c7070 0x7f99bc155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0715a0 con 0x7f99bc071d90 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0cccd0 con 0x7f99bc0c7070 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc06f5d0 con 0x7f99bc0719b0 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc071d90 0x7f99bc1e2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bb400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99bc0c7070 0x7f99bc155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bb400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99bc0c7070 0x7f99bc155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52890/0 (socket says 172.21.15.32:52890) 2024-09-13T18:46:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bb400700 1 -- 172.21.15.32:0/3866227619 learned_addr learned my addr 172.21.15.32:0/3866227619 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:33.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99bc0719b0 0x7f99bc071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99bc0719b0 msgr2=0x7f99bc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99bc0719b0 0x7f99bc071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99bc0c7070 msgr2=0x7f99bc155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99bc0c7070 0x7f99bc155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009a70 con 0x7f99bc071d90 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99bc0719b0 0x7f99bc071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99bc0c7070 0x7f99bc155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc071d90 0x7f99bc1e2870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f99a800c780 tx=0x7f99a800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8004ca0 con 0x7f99bc071d90 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a8004e00 con 0x7f99bc071d90 2024-09-13T18:46:33.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8007310 con 0x7f99bc071d90 2024-09-13T18:46:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc06f8b0 con 0x7f99bc071d90 2024-09-13T18:46:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.891+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc06fe70 con 0x7f99bc071d90 2024-09-13T18:46:33.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.895+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f99bc15b360 con 0x7f99bc071d90 2024-09-13T18:46:33.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.895+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99a8007470 con 0x7f99bc071d90 2024-09-13T18:46:33.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.895+0000 7f99b2a00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f999c066760 0x7f999c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.895+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f99a80842f0 con 0x7f99bc071d90 2024-09-13T18:46:33.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.895+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v47) v1 ==== 54+0+16 (secure 0 0 0) 0x7f99a808b070 con 0x7f99bc071d90 2024-09-13T18:46:33.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f999c066760 0x7f999c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f99bc0700b0 0x7f99bc0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc0c3bd0 con 0x7f99bc0700b0 2024-09-13T18:46:33.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f99bc0700b0 0x7f99bc0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f999c066760 0x7f999c068c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001c90 tx=0x7f99ac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f99bc0700b0 0x7f99bc0c9070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.899+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99b400bd80 con 0x7f99bc0700b0 2024-09-13T18:46:33.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.919+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc1518e0 con 0x7f99bc0700b0 2024-09-13T18:46:33.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.923+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99b4004030 con 0x7f99bc0700b0 2024-09-13T18:46:33.927 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:33.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.923+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f99bc156360 0x7f99bc0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.923+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc0741b0 con 0x7f99bc156360 2024-09-13T18:46:33.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.923+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f99bc156360 0x7f99bc0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.923+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f99bc156360 0x7f99bc0c9ac0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.923+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc0741b0 con 0x7f99bc156360 2024-09-13T18:46:33.934 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:33.927+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:33.943 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:33.943 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.943+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc14f880 con 0x7f99bc156360 2024-09-13T18:46:33.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.947+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc14f880 con 0x7f99bc156360 2024-09-13T18:46:33.951 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:33.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.947+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f99bc0612c0 0x7f99bc0616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.947+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc0b2570 con 0x7f99bc0612c0 2024-09-13T18:46:33.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.947+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f99bc0612c0 0x7f99bc0616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.947+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f99bc0612c0 0x7f99bc0616a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.947+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc0b2570 con 0x7f99bc0612c0 2024-09-13T18:46:33.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.963+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc061be0 con 0x7f99bc0612c0 2024-09-13T18:46:33.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.967+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc061be0 con 0x7f99bc0612c0 2024-09-13T18:46:33.973 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:33.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.967+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f99bc0cb360 0x7f99bc0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.967+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc0cbc80 con 0x7f99bc0cb360 2024-09-13T18:46:33.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.967+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f99bc0cb360 0x7f99bc0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.967+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f99bc0cb360 0x7f99bc0cb740 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.971+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc0cbc80 con 0x7f99bc0cb360 2024-09-13T18:46:33.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.987+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc02b960 con 0x7f99bc0cb360 2024-09-13T18:46:33.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.987+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc02b960 con 0x7f99bc0cb360 2024-09-13T18:46:33.993 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:33.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.987+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f99bc02bfe0 0x7f99bc02c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:33.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.987+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc02c980 con 0x7f99bc02bfe0 2024-09-13T18:46:33.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.987+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f99bc02bfe0 0x7f99bc02c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:33.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.991+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f99bc02bfe0 0x7f99bc02c440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:33.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:33.991+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc02c980 con 0x7f99bc02bfe0 2024-09-13T18:46:34.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.007+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc02c980 con 0x7f99bc02bfe0 2024-09-13T18:46:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.011+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc02c980 con 0x7f99bc02bfe0 2024-09-13T18:46:34.015 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.011+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f99bc202d90 0x7f99bc205180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:34.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.011+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc02cb80 con 0x7f99bc202d90 2024-09-13T18:46:34.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.011+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f99bc202d90 0x7f99bc205180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:34.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.011+0000 7f99ba000700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f99bc202d90 0x7f99bc205180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:34.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.011+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc02cb80 con 0x7f99bc202d90 2024-09-13T18:46:34.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.031+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc02cb80 con 0x7f99bc202d90 2024-09-13T18:46:34.035 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:34.031+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:34.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.035+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc02cb80 con 0x7f99bc202d90 2024-09-13T18:46:34.038 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.035+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f99bc205bd0 0x7f99bc207fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.035+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc20ae40 con 0x7f99bc205bd0 2024-09-13T18:46:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.035+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f99bc205bd0 0x7f99bc207fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:34.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.035+0000 7f99bb400700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f99bc205bd0 0x7f99bc207fc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:34.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.035+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc20ae40 con 0x7f99bc205bd0 2024-09-13T18:46:34.060 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:34.060 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:34.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.059+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc208500 con 0x7f99bc205bd0 2024-09-13T18:46:34.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.059+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc208500 con 0x7f99bc205bd0 2024-09-13T18:46:34.065 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:34.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.059+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f99bc208b80 0x7f99bc20af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.059+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99bc20def0 con 0x7f99bc208b80 2024-09-13T18:46:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.059+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f99bc208b80 0x7f99bc20af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.063+0000 7f99baa00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f99bc208b80 0x7f99bc20af70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.063+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99bc20def0 con 0x7f99bc208b80 2024-09-13T18:46:34.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:34.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.087+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f99bc20dec0 con 0x7f99bc208b80 2024-09-13T18:46:34.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99b2a00700 1 -- 172.21.15.32:0/3866227619 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f99bc20dec0 con 0x7f99bc208b80 2024-09-13T18:46:34.096 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f99bc0700b0 msgr2=0x7f99bc0c9070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f99bc0700b0 0x7f99bc0c9070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f99bc156360 msgr2=0x7f99bc0c9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f99bc156360 0x7f99bc0c9ac0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f99bc0612c0 msgr2=0x7f99bc0616a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f99bc0612c0 0x7f99bc0616a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f99bc0cb360 msgr2=0x7f99bc0cb740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f99bc0cb360 0x7f99bc0cb740 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f99bc02bfe0 msgr2=0x7f99bc02c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f99bc02bfe0 0x7f99bc02c440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f99bc202d90 msgr2=0x7f99bc205180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f99bc202d90 0x7f99bc205180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f99bc205bd0 msgr2=0x7f99bc207fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f99bc205bd0 0x7f99bc207fc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f99bc208b80 msgr2=0x7f99bc20af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f99bc208b80 0x7f99bc20af70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bb400700 1 -- 172.21.15.32:0/3866227619 reap_dead start 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bb400700 1 -- 172.21.15.32:0/3866227619 reap_dead start 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bb400700 1 -- 172.21.15.32:0/3866227619 reap_dead start 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bb400700 1 -- 172.21.15.32:0/3866227619 reap_dead start 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bb400700 1 -- 172.21.15.32:0/3866227619 reap_dead start 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f999c066760 msgr2=0x7f999c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f999c066760 0x7f999c068c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99ac001c90 tx=0x7f99ac009040 comp rx=0 tx=0).stop 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc071d90 msgr2=0x7f99bc1e2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc071d90 0x7f99bc1e2870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f99a800c780 tx=0x7f99a800ca90 comp rx=0 tx=0).stop 2024-09-13T18:46:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.091+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 shutdown_connections 2024-09-13T18:46:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.095+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f999c066760 0x7f999c068c20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.095+0000 7f99bbe00700 1 --2- 172.21.15.32:0/3866227619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99bc071d90 0x7f99bc1e2870 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.095+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 >> 172.21.15.32:0/3866227619 conn(0x7f99bc06a7d0 msgr2=0x7f99bc14ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.095+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 shutdown_connections 2024-09-13T18:46:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.095+0000 7f99bbe00700 1 -- 172.21.15.32:0/3866227619 wait complete. 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:34.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:34.138 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:34.134+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:34.170 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:34.170 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 87.841533943000002, 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.175 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:34.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:34.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.203+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pg-upmap", "pgid": "4.17", "id": [6, 4, 7, 5]} v 0) v1 -- 0x7f172c0ad690 con 0x7f172c0c7870 2024-09-13T18:46:34.238 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:34.234+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:34.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.235+0000 7f1729600700 1 -- 172.21.15.32:0/1315666477 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pg-upmap", "pgid": "4.17", "id": [6, 4, 7, 5]}]=0 set 4.17 pg_upmap mapping to [6,4,7,5] v48) v1 ==== 134+0+0 (secure 0 0 0) 0x7f1724054990 con 0x7f172c0c7870 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f170c066730 msgr2=0x7f170c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f170c066730 0x7f170c068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1720000f60 tx=0x7f1720001960 comp rx=0 tx=0).stop 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c0c7870 msgr2=0x7f172c151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c0c7870 0x7f172c151f30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f172400cae0 tx=0x7f172400cdf0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 shutdown_connections 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f172c0c7870 0x7f172c151f30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f172c0c70d0 0x7f172c0bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 --2- 172.21.15.32:0/1315666477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f172c0c6cf0 0x7f172c0be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 >> 172.21.15.32:0/1315666477 conn(0x7f172c0ccf70 msgr2=0x7f172c0cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 shutdown_connections 2024-09-13T18:46:34.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:34.239+0000 7f1732a00700 1 -- 172.21.15.32:0/1315666477 wait complete. 2024-09-13T18:46:34.248 INFO:teuthology.orchestra.run.smithi032.stderr:set 4.17 pg_upmap mapping to [6,4,7,5] 2024-09-13T18:46:34.291 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:34.291 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:34.291 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:34.291 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:34.301 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:34.348 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:34.342+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:34.441 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:34.438+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:34.458 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:34.459 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:34.459 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:34.459 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:34.459 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:34.468 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:34.546 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:34.542+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:34.624 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.299465326999993, 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.625 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:46:34.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.299441459999997, 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:46:34.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:34.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.299430950000001, 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:46:34.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:46:34.643 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.299414949999999, 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:46:34.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:46:34.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.649 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.299408112999998, 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:46:34.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.295849986999997, 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:46:34.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.294039161000001, 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:46:34.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:46:34.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.293985469000006, 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:34.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:46:34.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:46:34.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.292941522000007, 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:46:34.667 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:46:34.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:46:34.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:46:34.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.291385833999996, 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:34.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.676 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.291332087000001, 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.680 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.290092907000002, 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.684 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.290047672, 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:34.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.688 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.290012637999993, 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:34.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.289972407999997, 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.693 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:46:34.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.289279985999997, 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:46:34.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.289229297999995, 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:46:34.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:46:34.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:46:34.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.288835657999996, 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:46:34.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 88.288439093999997, 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:34.710 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:34.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:46:34.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:34.715 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:34.715 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:34.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:34.717 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:34.711+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:34.817 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:34.814+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:34.863 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:34.863 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:34.863 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:34.863 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:34.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:34.930 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:34.927+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:35.019 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:35.014+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:35.024 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:35.024 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:35.024 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:35.024 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:35.037 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:35.127 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:35.123+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:35.221 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:35.218+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:35.230 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:35.230 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.907169044, 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:35.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:35.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:46:35.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.907145057999998, 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:46:35.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:46:35.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:46:35.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.907136152000007, 2024-09-13T18:46:35.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:35.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:46:35.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:35.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:46:35.251 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.907133279999996, 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:46:35.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.907130572, 2024-09-13T18:46:35.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:46:35.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:35.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:46:35.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.904003505000006, 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:46:35.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.902952818000003, 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:46:35.270 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:46:35.274 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.902598230999999, 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:46:35.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:46:35.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:46:35.280 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.902453073000004, 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:46:35.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.902355658999994, 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:35.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:46:35.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.902274546000001, 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.290 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:46:35.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.902024044000001, 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:46:35.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.299 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.900929769000001, 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:46:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.900848819999993, 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 88.898746166999999, 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:46:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 83.400754479, 2024-09-13T18:46:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:46:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:46:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(2.7 35/34 [PushReplyOp(2:e0b41d06:::609.00000000:head)])", 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.436064180000002, 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229566, 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791243+0000", 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791249+0000", 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6380000000000001e-06 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791257+0000", 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8639999999999996e-06 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791264+0000", 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-13T18:46:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791309+0000", 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4860000000000001e-05 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791473+0000", 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164644 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:35.324 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:35.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:46:35.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:35.326 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:35.319+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:35.426 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:35.423+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:35.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.519+0000 7f24b7200700 1 Processor -- start 2024-09-13T18:46:35.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.519+0000 7f24b7200700 1 -- start start 2024-09-13T18:46:35.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b7200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f24b00c8f10 0x7f24b00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b7200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f24b00c8950 0x7f24b00cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b7200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b006b810 con 0x7f24b00c8950 2024-09-13T18:46:35.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b7200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b00c8370 con 0x7f24b00c8f10 2024-09-13T18:46:35.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00c8650 con 0x7f24b0153840 2024-09-13T18:46:35.528 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:35.526+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f24b00c8f10 0x7f24b00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b00c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:56664/0 (socket says 172.21.15.32:56664) 2024-09-13T18:46:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 -- 172.21.15.32:0/4156172500 learned_addr learned my addr 172.21.15.32:0/4156172500 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:35.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b6800700 1 --2- 172.21.15.32:0/4156172500 >> v2:172.21.15.32:3300/0 conn(0x7f24b00c8950 0x7f24b00cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 -- 172.21.15.32:0/4156172500 >> v2:172.21.15.86:3300/0 conn(0x7f24b00c8f10 msgr2=0x7f24b00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 --2- 172.21.15.32:0/4156172500 >> v2:172.21.15.86:3300/0 conn(0x7f24b00c8f10 0x7f24b00ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 -- 172.21.15.32:0/4156172500 >> v2:172.21.15.32:3300/0 conn(0x7f24b00c8950 msgr2=0x7f24b00cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 --2- 172.21.15.32:0/4156172500 >> v2:172.21.15.32:3300/0 conn(0x7f24b00c8950 0x7f24b00cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 -- 172.21.15.32:0/4156172500 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b006ae70 con 0x7f24b0153840 2024-09-13T18:46:35.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b5e00700 1 --2- 172.21.15.32:0/4156172500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b00c93e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24b00cddf0 tx=0x7f24a4009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f3a728cf259b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b4a00700 1 -- 172.21.15.32:0/4156172500 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4011830 con 0x7f24b0153840 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b4a00700 1 -- 172.21.15.32:0/4156172500 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a4011990 con 0x7f24b0153840 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.523+0000 7f24b4a00700 1 -- 172.21.15.32:0/4156172500 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4011d20 con 0x7f24b0153840 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 -- 172.21.15.32:0/4156172500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 msgr2=0x7f24b00c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 --2- 172.21.15.32:0/4156172500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b00c93e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24b00cddf0 tx=0x7f24a4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 -- 172.21.15.32:0/4156172500 shutdown_connections 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 --2- 172.21.15.32:0/4156172500 >> v2:172.21.15.32:3300/0 conn(0x7f24b00c8950 0x7f24b00cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 --2- 172.21.15.32:0/4156172500 >> v2:172.21.15.86:3300/0 conn(0x7f24b00c8f10 0x7f24b00ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 --2- 172.21.15.32:0/4156172500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b00c93e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 -- 172.21.15.32:0/4156172500 >> 172.21.15.32:0/4156172500 conn(0x7f24b0071740 msgr2=0x7f24b0071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:35.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 -- 172.21.15.32:0/4156172500 shutdown_connections 2024-09-13T18:46:35.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 -- 172.21.15.32:0/4156172500 wait complete. 2024-09-13T18:46:35.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 Processor -- start 2024-09-13T18:46:35.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.527+0000 7f24b7200700 1 -- start start 2024-09-13T18:46:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b00c8950 0x7f24b014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 0x7f24b014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b01eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0150920 con 0x7f24b00c8950 2024-09-13T18:46:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0150e50 con 0x7f24b00c8f10 2024-09-13T18:46:35.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00c6d40 con 0x7f24b0153840 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 0x7f24b014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 0x7f24b014a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52912/0 (socket says 172.21.15.32:52912) 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 -- 172.21.15.32:0/1393670060 learned_addr learned my addr 172.21.15.32:0/1393670060 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b6800700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b01eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 -- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 msgr2=0x7f24b01eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b01eefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 -- 172.21.15.32:0/1393670060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b00c8950 msgr2=0x7f24b014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b00c8950 0x7f24b014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 -- 172.21.15.32:0/1393670060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4009570 con 0x7f24b00c8f10 2024-09-13T18:46:35.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b5400700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 0x7f24b014a5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a000e980 tx=0x7f24a000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:35.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0009700 con 0x7f24b00c8f10 2024-09-13T18:46:35.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b0150b70 con 0x7f24b00c8f10 2024-09-13T18:46:35.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000eed0 con 0x7f24b00c8f10 2024-09-13T18:46:35.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0004240 con 0x7f24b00c8f10 2024-09-13T18:46:35.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.531+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b014cdd0 con 0x7f24b00c8f10 2024-09-13T18:46:35.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.535+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b00c7220 con 0x7f24b00c8f10 2024-09-13T18:46:35.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.535+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24a0004420 con 0x7f24b00c8f10 2024-09-13T18:46:35.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.539+0000 7f24aa000700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2494066730 0x7f2494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:35.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.539+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6587+0+0 (secure 0 0 0) 0x7f24a00845d0 con 0x7f24b00c8f10 2024-09-13T18:46:35.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.539+0000 7f24b5e00700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2494066730 0x7f2494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:35.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.539+0000 7f24b5e00700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2494066730 0x7f2494068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009c30 tx=0x7f24a4010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:35.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.547+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24b00c7220 con 0x7f24b00c8f10 2024-09-13T18:46:35.590 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:35.590 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:35.590 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:35.590 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:35.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:35.651 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:35.647+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:35.730 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:35.723+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:35.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:35.795+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7f24b00c7220 con 0x7f24b00c8f10 2024-09-13T18:46:35.831 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:35.827+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:35.845 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:35.845 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:35.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:35.931 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:35.930+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:36.032 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:36.030+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.28647082400001, 2024-09-13T18:46:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:36.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:36.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.59407974, 2024-09-13T18:46:36.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:36.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:36.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.593965948, 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.073 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.250415819, 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:36.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:36.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:36.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.25041192899999, 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.087 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:36.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:36.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.093 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.250200049, 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:36.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:36.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.250190565, 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:36.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:36.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:36.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.109 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.24992569299999, 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.110 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:36.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:36.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:36.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.249728543, 2024-09-13T18:46:36.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.24972429899999, 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.122 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:36.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.233668997, 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.34928160600001, 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.348706025, 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.34869463699999, 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.348687039, 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.348475622, 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.34846984799999, 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.34845080700001, 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 102.34821864200001, 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 101.475102107, 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:36.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:36.199 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:36.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:36.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:36.202 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:36.195+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:36.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.259+0000 7f24aa000700 1 -- 172.21.15.32:0/1393670060 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v50) v1 ==== 87+0+0 (secure 0 0 0) 0x7f24b00c7220 con 0x7f24b00c8f10 2024-09-13T18:46:36.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2494066730 msgr2=0x7f2494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2494066730 0x7f2494068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009c30 tx=0x7f24a4010000 comp rx=0 tx=0).stop 2024-09-13T18:46:36.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 msgr2=0x7f24b014a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 0x7f24b014a5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a000e980 tx=0x7f24a000ec90 comp rx=0 tx=0).stop 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 shutdown_connections 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2494066730 0x7f2494068bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24b0153840 0x7f24b01eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24b00c8f10 0x7f24b014a5d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 --2- 172.21.15.32:0/1393670060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f24b00c8950 0x7f24b014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 >> 172.21.15.32:0/1393670060 conn(0x7f24b0071740 msgr2=0x7f24b0151340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 shutdown_connections 2024-09-13T18:46:36.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.263+0000 7f24b7200700 1 -- 172.21.15.32:0/1393670060 wait complete. 2024-09-13T18:46:36.274 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:46:36.302 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:36.298+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:36.403 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:36.398+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:36.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd4e000700 1 Processor -- start 2024-09-13T18:46:36.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd4e000700 1 -- start start 2024-09-13T18:46:36.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd4e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd48159800 0x7fbd48161430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.458 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:36.458 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:36.458 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:36.458 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd4e000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd480c67b0 con 0x7fbd480c9c80 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd4e000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd48150340 con 0x7fbd480c0e50 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd4e000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480c6390 con 0x7fbd48159800 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd46a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbd480c9c80 0x7fbd481590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44890/0 (socket says 172.21.15.32:44890) 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd46a00700 1 -- 172.21.15.32:0/2438544560 learned_addr learned my addr 172.21.15.32:0/2438544560 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd47e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd48159800 0x7fbd48161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.451+0000 7fbd47400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fbd480c0e50 0x7fbd480bfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52156/0 (socket says 172.21.15.32:52156) 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd47e00700 1 -- 172.21.15.32:0/2438544560 >> v1:172.21.15.86:6789/0 conn(0x7fbd480c0e50 legacy=0x7fbd480bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd47e00700 1 -- 172.21.15.32:0/2438544560 >> v1:172.21.15.32:6789/0 conn(0x7fbd480c9c80 legacy=0x7fbd481590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd47e00700 1 -- 172.21.15.32:0/2438544560 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480c54c0 con 0x7fbd48159800 2024-09-13T18:46:36.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd47e00700 1 --2- 172.21.15.32:0/2438544560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd48159800 0x7fbd48161430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009dc0 tx=0x7fbd4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e47db10c5e0cfb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd46000700 1 -- 172.21.15.32:0/2438544560 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000e070 con 0x7fbd48159800 2024-09-13T18:46:36.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd46000700 1 -- 172.21.15.32:0/2438544560 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000bbd0 con 0x7fbd48159800 2024-09-13T18:46:36.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd46000700 1 -- 172.21.15.32:0/2438544560 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40012430 con 0x7fbd48159800 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 -- 172.21.15.32:0/2438544560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd48159800 msgr2=0x7fbd48161430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 --2- 172.21.15.32:0/2438544560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd48159800 0x7fbd48161430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009dc0 tx=0x7fbd4000b330 comp rx=0 tx=0).stop 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 -- 172.21.15.32:0/2438544560 shutdown_connections 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 --2- 172.21.15.32:0/2438544560 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd48159800 0x7fbd48161430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 -- 172.21.15.32:0/2438544560 >> 172.21.15.32:0/2438544560 conn(0x7fbd480caae0 msgr2=0x7fbd480caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 -- 172.21.15.32:0/2438544560 shutdown_connections 2024-09-13T18:46:36.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.455+0000 7fbd4e000700 1 -- 172.21.15.32:0/2438544560 wait complete. 2024-09-13T18:46:36.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 Processor -- start 2024-09-13T18:46:36.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 -- start start 2024-09-13T18:46:36.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd480c9c80 0x7fbd481ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd48159800 0x7fbd481495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd480b0bf0 0x7fbd48149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480ae050 con 0x7fbd48159800 2024-09-13T18:46:36.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481eeaf0 con 0x7fbd480b0bf0 2024-09-13T18:46:36.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd4e000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48159f70 con 0x7fbd480c9c80 2024-09-13T18:46:36.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd46a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd48159800 0x7fbd481495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd46a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd48159800 0x7fbd481495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35396/0 (socket says 172.21.15.32:35396) 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd47400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd480c9c80 0x7fbd481ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd46a00700 1 -- 172.21.15.32:0/3032490875 learned_addr learned my addr 172.21.15.32:0/3032490875 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.459+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd480b0bf0 0x7fbd48149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd46a00700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd480c9c80 msgr2=0x7fbd481ebc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd480c9c80 0x7fbd481ebc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd46a00700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd480b0bf0 msgr2=0x7fbd48149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd480b0bf0 0x7fbd48149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd46a00700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009a70 con 0x7fbd48159800 2024-09-13T18:46:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd480c9c80 0x7fbd481ebc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd48159800 0x7fbd481495e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c700 tx=0x7fbd3400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34005d90 con 0x7fbd48159800 2024-09-13T18:46:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd340070d0 con 0x7fbd48159800 2024-09-13T18:46:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34007440 con 0x7fbd48159800 2024-09-13T18:46:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd481ec7d0 con 0x7fbd48159800 2024-09-13T18:46:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.463+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd481ec4f0 con 0x7fbd48159800 2024-09-13T18:46:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.467+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fbd480c5fb0 con 0x7fbd48159800 2024-09-13T18:46:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.467+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd340075a0 con 0x7fbd48159800 2024-09-13T18:46:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.467+0000 7fbd3f400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd28066760 0x7fbd28068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.467+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fbd340837a0 con 0x7fbd48159800 2024-09-13T18:46:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.467+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v50) v1 ==== 54+0+16 (secure 0 0 0) 0x7fbd3408a070 con 0x7fbd48159800 2024-09-13T18:46:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.467+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd28066760 0x7fbd28068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.471+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbd480c0e50 0x7fbd480c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.471+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd480c5710 con 0x7fbd480c0e50 2024-09-13T18:46:36.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.471+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbd480c0e50 0x7fbd480c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.471+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd28066760 0x7fbd28068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000f60 tx=0x7fbd38007f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:36.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.471+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbd480c0e50 0x7fbd480c88e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.475+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd40003d20 con 0x7fbd480c0e50 2024-09-13T18:46:36.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.491+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd480c5cd0 con 0x7fbd480c0e50 2024-09-13T18:46:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.495+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd40003e90 con 0x7fbd480c0e50 2024-09-13T18:46:36.499 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.495+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbd481ef450 0x7fbd481f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.495+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd481eec60 con 0x7fbd481ef450 2024-09-13T18:46:36.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.495+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbd481ef450 0x7fbd481f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.495+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbd481ef450 0x7fbd481f2060 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.495+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd481eec60 con 0x7fbd481ef450 2024-09-13T18:46:36.504 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:36.499+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.511+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd480ca4b0 con 0x7fbd481ef450 2024-09-13T18:46:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.515+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd480ca4b0 con 0x7fbd481ef450 2024-09-13T18:46:36.520 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:36.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.515+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbd481f2ab0 0x7fbd48060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.515+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd481f2e90 con 0x7fbd481f2ab0 2024-09-13T18:46:36.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.515+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbd481f2ab0 0x7fbd48060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.515+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbd481f2ab0 0x7fbd48060db0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.515+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd481f2e90 con 0x7fbd481f2ab0 2024-09-13T18:46:36.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.531+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd481ec170 con 0x7fbd481f2ab0 2024-09-13T18:46:36.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.535+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd481ec170 con 0x7fbd481f2ab0 2024-09-13T18:46:36.539 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:36.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.535+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd48061970 0x7fbd480c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.535+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd48061d90 con 0x7fbd48061970 2024-09-13T18:46:36.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.535+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd48061970 0x7fbd480c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.535+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd48061970 0x7fbd480c2eb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.535+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd48061d90 con 0x7fbd48061970 2024-09-13T18:46:36.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.555+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd480c36b0 con 0x7fbd48061970 2024-09-13T18:46:36.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.555+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd480c36b0 con 0x7fbd48061970 2024-09-13T18:46:36.561 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:36.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.555+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbd4802b6a0 0x7fbd4802bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.555+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd480c3d30 con 0x7fbd4802b6a0 2024-09-13T18:46:36.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.555+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbd4802b6a0 0x7fbd4802bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.559+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbd4802b6a0 0x7fbd4802bb00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.559+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd480c3d30 con 0x7fbd4802b6a0 2024-09-13T18:46:36.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.579+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd480c3d30 con 0x7fbd4802b6a0 2024-09-13T18:46:36.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.583+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd480c3d30 con 0x7fbd4802b6a0 2024-09-13T18:46:36.590 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:36.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.583+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbd4802c550 0x7fbd482053f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.583+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd4802c990 con 0x7fbd4802c550 2024-09-13T18:46:36.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.583+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbd4802c550 0x7fbd482053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.583+0000 7fbd46a00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbd4802c550 0x7fbd482053f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.583+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd4802c990 con 0x7fbd4802c550 2024-09-13T18:46:36.605 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:36.602+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:36.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.603+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd4802c990 con 0x7fbd4802c550 2024-09-13T18:46:36.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.607+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd4802c990 con 0x7fbd4802c550 2024-09-13T18:46:36.613 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:36.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.607+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbd48205e40 0x7fbd48208230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.607+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd4802cb60 con 0x7fbd48205e40 2024-09-13T18:46:36.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.607+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbd48205e40 0x7fbd48208230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.611+0000 7fbd47e00700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbd48205e40 0x7fbd48208230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.611+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd4802cb60 con 0x7fbd48205e40 2024-09-13T18:46:36.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.631+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd4802cb60 con 0x7fbd48205e40 2024-09-13T18:46:36.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.635+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd4802cb60 con 0x7fbd48205e40 2024-09-13T18:46:36.640 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:36.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.635+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbd48208c80 0x7fbd4820b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:36.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.635+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd4820df70 con 0x7fbd48208c80 2024-09-13T18:46:36.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.635+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbd48208c80 0x7fbd4820b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:36.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.635+0000 7fbd47400700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbd48208c80 0x7fbd4820b070 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:36.643 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.639+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd4820df70 con 0x7fbd48208c80 2024-09-13T18:46:36.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:36.655+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fbd4820b630 con 0x7fbd48208c80 2024-09-13T18:46:36.678 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:36.678 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:36.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:36.739 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:36.735+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:36.806 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:36.802+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:36.888 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:36.889 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:36.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:36.906 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:36.902+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:37.008 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:37.006+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:37.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd3f400700 1 -- 172.21.15.32:0/3032490875 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fbd4820b630 con 0x7fbd48208c80 2024-09-13T18:46:37.014 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbd480c0e50 msgr2=0x7fbd480c88e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fbd480c0e50 0x7fbd480c88e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbd481ef450 msgr2=0x7fbd481f2060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fbd481ef450 0x7fbd481f2060 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbd481f2ab0 msgr2=0x7fbd48060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fbd481f2ab0 0x7fbd48060db0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd48061970 msgr2=0x7fbd480c2eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fbd48061970 0x7fbd480c2eb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbd4802b6a0 msgr2=0x7fbd4802bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fbd4802b6a0 0x7fbd4802bb00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbd4802c550 msgr2=0x7fbd482053f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fbd4802c550 0x7fbd482053f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbd48205e40 msgr2=0x7fbd48208230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fbd48205e40 0x7fbd48208230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbd48208c80 msgr2=0x7fbd4820b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.007+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fbd48208c80 0x7fbd4820b070 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd28066760 msgr2=0x7fbd28068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd28066760 0x7fbd28068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000f60 tx=0x7fbd38007f30 comp rx=0 tx=0).stop 2024-09-13T18:46:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd48159800 msgr2=0x7fbd481495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 --2- 172.21.15.32:0/3032490875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd48159800 0x7fbd481495e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c700 tx=0x7fbd3400ca10 comp rx=0 tx=0).stop 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd47e00700 1 -- 172.21.15.32:0/3032490875 reap_dead start 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd47e00700 1 -- 172.21.15.32:0/3032490875 reap_dead start 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd47e00700 1 -- 172.21.15.32:0/3032490875 reap_dead start 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd47e00700 1 -- 172.21.15.32:0/3032490875 reap_dead start 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd47e00700 1 -- 172.21.15.32:0/3032490875 reap_dead start 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd47e00700 1 -- 172.21.15.32:0/3032490875 reap_dead start 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 shutdown_connections 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 >> 172.21.15.32:0/3032490875 conn(0x7fbd480caae0 msgr2=0x7fbd4806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 shutdown_connections 2024-09-13T18:46:37.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:37.011+0000 7fbd4e000700 1 -- 172.21.15.32:0/3032490875 wait complete. 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:37.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:37.052 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.052 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:37.109 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:37.106+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:37.210 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:37.206+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:37.251 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.251 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:37.312 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:37.307+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:37.410 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.410 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.412 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:37.407+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:37.423 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:37.514 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:37.507+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:37.541 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.541 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.551 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:37.615 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:37.611+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:37.661 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.661 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:37.715 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:37.711+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:37.774 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.775 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:37.816 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:37.814+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:37.893 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:37.893 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:37.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:37.944 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:37.942+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:38.018 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:38.014+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:38.053 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.053 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:38.118 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:38.114+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:38.171 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.171 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:38.219 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:38.214+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:38.291 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.291 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:46:38.300 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:38.347 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:38.343+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:38.405 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.405 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.415 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.443+0000 7fb8df200700 1 Processor -- start 2024-09-13T18:46:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.443+0000 7fb8df200700 1 -- start start 2024-09-13T18:46:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8df200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 0x7fb8e00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8df200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb8e00c8f10 0x7fb8e00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8df200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e00c8370 con 0x7fb8e00c8950 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8df200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e006b810 con 0x7fb8e00c8f10 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8df200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00c8650 con 0x7fb8e0153840 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dde00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 0x7fb8e00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dd400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb8e00c8f10 0x7fb8e00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dde00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 0x7fb8e00c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52932/0 (socket says 172.21.15.32:52932) 2024-09-13T18:46:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dde00700 1 -- 172.21.15.32:0/2657545577 learned_addr learned my addr 172.21.15.32:0/2657545577 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dd400700 1 -- 172.21.15.32:0/2657545577 >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 msgr2=0x7fb8e00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dd400700 1 --2- 172.21.15.32:0/2657545577 >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 0x7fb8e00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dd400700 1 -- 172.21.15.32:0/2657545577 >> v1:172.21.15.32:6789/0 conn(0x7fb8e00c8950 legacy=0x7fb8e015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dd400700 1 -- 172.21.15.32:0/2657545577 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e006ae70 con 0x7fb8e00c8f10 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dde00700 1 --2- 172.21.15.32:0/2657545577 >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 0x7fb8e00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dd400700 1 --2- 172.21.15.32:0/2657545577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e00c8f10 0x7fb8e00ccf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8e006d7b0 tx=0x7fb8cc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9a1beda0d73bca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dca00700 1 -- 172.21.15.32:0/2657545577 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc011830 con 0x7fb8e00c8f10 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dca00700 1 -- 172.21.15.32:0/2657545577 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc011990 con 0x7fb8e00c8f10 2024-09-13T18:46:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.447+0000 7fb8dca00700 1 -- 172.21.15.32:0/2657545577 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc011d20 con 0x7fb8e00c8f10 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- 172.21.15.32:0/2657545577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e00c8f10 msgr2=0x7fb8e00ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 --2- 172.21.15.32:0/2657545577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e00c8f10 0x7fb8e00ccf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8e006d7b0 tx=0x7fb8cc009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- 172.21.15.32:0/2657545577 shutdown_connections 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 --2- 172.21.15.32:0/2657545577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e00c8f10 0x7fb8e00ccf30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 --2- 172.21.15.32:0/2657545577 >> v2:172.21.15.86:3300/0 conn(0x7fb8e0153840 0x7fb8e00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- 172.21.15.32:0/2657545577 >> 172.21.15.32:0/2657545577 conn(0x7fb8e0071740 msgr2=0x7fb8e0071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- 172.21.15.32:0/2657545577 shutdown_connections 2024-09-13T18:46:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- 172.21.15.32:0/2657545577 wait complete. 2024-09-13T18:46:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 Processor -- start 2024-09-13T18:46:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- start start 2024-09-13T18:46:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 0x7fb8e0145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8e00c8f10 0x7fb8e0146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e0153840 0x7fb8e014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.451+0000 7fb8df200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e014d980 con 0x7fb8e0153840 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8df200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e01502d0 con 0x7fb8e00c8950 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8df200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e01efc70 con 0x7fb8e00c8f10 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 0x7fb8e0145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 0x7fb8e0145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:52934/0 (socket says 172.21.15.32:52934) 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 -- 172.21.15.32:0/1386011593 learned_addr learned my addr 172.21.15.32:0/1386011593 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8de800700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e0153840 0x7fb8e014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dd400700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8e00c8f10 0x7fb8e0146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:38.460 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:38.458+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 -- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8e00c8f10 msgr2=0x7fb8e0146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8e00c8f10 0x7fb8e0146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 -- 172.21.15.32:0/1386011593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e0153840 msgr2=0x7fb8e014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e0153840 0x7fb8e014af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 -- 172.21.15.32:0/1386011593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d0009570 con 0x7fb8e00c8950 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8dde00700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 0x7fb8e0145ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000e9d0 tx=0x7fb8d000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000ee70 con 0x7fb8e00c8950 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d000c850 con 0x7fb8e00c8950 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc0094b0 con 0x7fb8e00c8950 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000cbc0 con 0x7fb8e00c8950 2024-09-13T18:46:38.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e014a750 con 0x7fb8e00c8950 2024-09-13T18:46:38.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.455+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e014a5b0 con 0x7fb8e00c8950 2024-09-13T18:46:38.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.459+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8d000cd20 con 0x7fb8e00c8950 2024-09-13T18:46:38.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.459+0000 7fb8d6000700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb8c0066760 0x7fb8c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:38.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.459+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fb8d0084500 con 0x7fb8e00c8950 2024-09-13T18:46:38.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.459+0000 7fb8dd400700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb8c0066760 0x7fb8c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:38.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.459+0000 7fb8dd400700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb8c0066760 0x7fb8c0068c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc000c00 tx=0x7fb8cc008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:38.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.467+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8d00513d0 con 0x7fb8e00c8950 2024-09-13T18:46:38.521 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:38.515+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:38.524 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.524 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.534 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:38.621 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:38.615+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:38.643 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.643 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.653 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:38.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:38.663+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7fb8e014a5b0 con 0x7fb8e00c8950 2024-09-13T18:46:38.722 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:38.718+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:38.761 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.762 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:38.823 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:38.822+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:38.921 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:38.921 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:38.924 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:38.922+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:38.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:39.026 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:39.019+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:39.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:39.079 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:39.079 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:39.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:39.127 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:39.122+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:39.228 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:39.226+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:39.542 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:39.542 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:39.543 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-13T18:46:39.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-13T18:46:39.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.231+0000 7fc0faa00700 1 Processor -- start 2024-09-13T18:46:39.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.231+0000 7fc0faa00700 1 -- start start 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0f40c3400 0x7fc0f40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f40c7f70 con 0x7fc0f4156e30 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f415cd80 con 0x7fc0f40c7a50 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f415cb70 con 0x7fc0f40c3400 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f9600700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc0f4156e30 0x7fc0f41575e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47176/0 (socket says 172.21.15.32:47176) 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f9600700 1 -- 172.21.15.32:0/589433359 learned_addr learned my addr 172.21.15.32:0/589433359 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/589433359 >> v2:172.21.15.32:3300/0 conn(0x7fc0f40c3400 0x7fc0f40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f3e00700 1 -- 172.21.15.32:0/589433359 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077325609 0 0) 0x7fc0f40c7f70 con 0x7fc0f4156e30 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f8c00700 1 -- 172.21.15.32:0/589433359 >> v1:172.21.15.86:6789/0 conn(0x7fc0f40c7a50 legacy=0x7fc0f4163ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f8c00700 1 -- 172.21.15.32:0/589433359 >> v1:172.21.15.32:6789/0 conn(0x7fc0f4156e30 legacy=0x7fc0f41575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f8c00700 1 -- 172.21.15.32:0/589433359 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f415d060 con 0x7fc0f40c3400 2024-09-13T18:46:39.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/589433359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f40c3400 0x7fc0f40ccfe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009850 tx=0x7fc0e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e8f14a68d1f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f3e00700 1 -- 172.21.15.32:0/589433359 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011830 con 0x7fc0f40c3400 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f3e00700 1 -- 172.21.15.32:0/589433359 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0011990 con 0x7fc0f40c3400 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0f3e00700 1 -- 172.21.15.32:0/589433359 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011d20 con 0x7fc0f40c3400 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- 172.21.15.32:0/589433359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f40c3400 msgr2=0x7fc0f40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 --2- 172.21.15.32:0/589433359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f40c3400 0x7fc0f40ccfe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009850 tx=0x7fc0e0009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- 172.21.15.32:0/589433359 shutdown_connections 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 --2- 172.21.15.32:0/589433359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f40c3400 0x7fc0f40ccfe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- 172.21.15.32:0/589433359 >> 172.21.15.32:0/589433359 conn(0x7fc0f406a7d0 msgr2=0x7fc0f406e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- 172.21.15.32:0/589433359 shutdown_connections 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.235+0000 7fc0faa00700 1 -- 172.21.15.32:0/589433359 wait complete. 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 Processor -- start 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 -- start start 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0f40c3400 0x7fc0f41e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0f40c7a50 0x7fc0f41ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 0x7fc0f4153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f40c8f60 con 0x7fc0f4156e30 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f41ef250 con 0x7fc0f40c3400 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.239+0000 7fc0faa00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4158ba0 con 0x7fc0f40c7a50 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 0x7fc0f4153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0f9600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0f40c3400 0x7fc0f41e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 0x7fc0f4153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46866/0 (socket says 172.21.15.32:46866) 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 learned_addr learned my addr 172.21.15.32:0/1112611784 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0f40c7a50 0x7fc0f41ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0f40c7a50 msgr2=0x7fc0f41ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0f40c7a50 0x7fc0f41ef980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0f40c3400 msgr2=0x7fc0f41e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0f40c3400 0x7fc0f41e61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00094b0 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 0x7fc0f4153b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00cc50 tx=0x7fc0ec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec003c20 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec003d80 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00aab0 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f40c2f60 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f4159120 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.243+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fc0f415d5e0 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.247+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0ec00ac10 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.247+0000 7fc0f1600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc0d4066780 0x7fc0d4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.247+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fc0ec084eb0 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.247+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v50) v1 ==== 54+0+16 (secure 0 0 0) 0x7fc0ec085220 con 0x7fc0f4156e30 2024-09-13T18:46:39.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.247+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc0d4066780 0x7fc0d4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.251+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc0f40c5120 0x7fc0f40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.251+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f4154550 con 0x7fc0f40c5120 2024-09-13T18:46:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.251+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc0f40c5120 0x7fc0f40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.251+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc0d4066780 0x7fc0d4068c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8000f60 tx=0x7fc0e8004a70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.251+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc0f40c5120 0x7fc0f40c8300 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.251+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0f4154550 con 0x7fc0f40c5120 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.271+0000 7fb8d6000700 1 -- 172.21.15.32:0/1386011593 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb8e014a5b0 con 0x7fb8e00c8950 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb8c0066760 msgr2=0x7fb8c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb8c0066760 0x7fb8c0068c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc000c00 tx=0x7fb8cc008030 comp rx=0 tx=0).stop 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 msgr2=0x7fb8e0145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 0x7fb8e0145ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000e9d0 tx=0x7fb8d000ece0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 shutdown_connections 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb8c0066760 0x7fb8c0068c20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb8e0153840 0x7fb8e014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb8e00c8f10 0x7fb8e0146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 --2- 172.21.15.32:0/1386011593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8e00c8950 0x7fb8e0145ae0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 >> 172.21.15.32:0/1386011593 conn(0x7fb8e0071740 msgr2=0x7fb8e00cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 shutdown_connections 2024-09-13T18:46:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.275+0000 7fb8df200700 1 -- 172.21.15.32:0/1386011593 wait complete. 2024-09-13T18:46:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:46:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.283+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f4157210 con 0x7fc0f40c5120 2024-09-13T18:46:39.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.283+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0e0022040 con 0x7fc0f40c5120 2024-09-13T18:46:39.555 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:39.555 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:39.542+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.287+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc0f41ef3c0 0x7fc0f41f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.287+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f40c2070 con 0x7fc0f41ef3c0 2024-09-13T18:46:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.287+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc0f41ef3c0 0x7fc0f41f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.287+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc0f41ef3c0 0x7fc0f41f2770 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.287+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0f40c2070 con 0x7fc0f41ef3c0 2024-09-13T18:46:39.557 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:39.557 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.319+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f4061fa0 con 0x7fc0f41ef3c0 2024-09-13T18:46:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.319+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f4061fa0 con 0x7fc0f41ef3c0 2024-09-13T18:46:39.558 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.319+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc0f40ad4b0 0x7fc0f41f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.319+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f406f750 con 0x7fc0f40ad4b0 2024-09-13T18:46:39.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.323+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc0f40ad4b0 0x7fc0f41f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:39.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.323+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc0f40ad4b0 0x7fc0f41f31c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.323+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0f406f750 con 0x7fc0f40ad4b0 2024-09-13T18:46:39.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.347+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f41f0100 con 0x7fc0f40ad4b0 2024-09-13T18:46:39.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.351+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f41f0100 con 0x7fc0f40ad4b0 2024-09-13T18:46:39.561 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.351+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc0f40612c0 0x7fc0f40616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.351+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f406f950 con 0x7fc0f40612c0 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.355+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc0f40612c0 0x7fc0f40616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.355+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc0f40612c0 0x7fc0f40616c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.355+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0ec0851e0 con 0x7fc0f40612c0 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.383+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f41546e0 con 0x7fc0f40612c0 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.383+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f41546e0 con 0x7fc0f40612c0 2024-09-13T18:46:39.562 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.383+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc0f4154dc0 0x7fc0f41551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.383+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f41556e0 con 0x7fc0f4154dc0 2024-09-13T18:46:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.387+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc0f4154dc0 0x7fc0f41551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.387+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc0f4154dc0 0x7fc0f41551a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.387+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0e8024aa0 con 0x7fc0f4154dc0 2024-09-13T18:46:39.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.415+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f402b6a0 con 0x7fc0f4154dc0 2024-09-13T18:46:39.564 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.419+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f402b6a0 con 0x7fc0f4154dc0 2024-09-13T18:46:39.564 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.419+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc0f402bd20 0x7fc0f402c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.419+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f402c6c0 con 0x7fc0f402bd20 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.419+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc0f402bd20 0x7fc0f402c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.419+0000 7fc0f8c00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc0f402bd20 0x7fc0f402c180 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.423+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0f402c6c0 con 0x7fc0f402bd20 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.447+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f402c6c0 con 0x7fc0f402bd20 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.451+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f402c6c0 con 0x7fc0f402bd20 2024-09-13T18:46:39.565 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:39.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.451+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc0f420a340 0x7fc0f420c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.451+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f420f5b0 con 0x7fc0f420a340 2024-09-13T18:46:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.451+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc0f420a340 0x7fc0f420c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.455+0000 7fc0fa000700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc0f420a340 0x7fc0f420c730 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.455+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0f420f5b0 con 0x7fc0f420a340 2024-09-13T18:46:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.483+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f420cc70 con 0x7fc0f420a340 2024-09-13T18:46:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.487+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f420cc70 con 0x7fc0f420a340 2024-09-13T18:46:39.567 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.487+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc0f420d2f0 0x7fc0f420f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.487+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f4212560 con 0x7fc0f420d2f0 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.487+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc0f420d2f0 0x7fc0f420f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.487+0000 7fc0f9600700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc0f420d2f0 0x7fc0f420f6e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.491+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc0f4212560 con 0x7fc0f420d2f0 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.515+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fc0f420fc20 con 0x7fc0f420d2f0 2024-09-13T18:46:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0f1600700 1 -- 172.21.15.32:0/1112611784 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fc0f420fc20 con 0x7fc0f420d2f0 2024-09-13T18:46:39.569 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc0f40c5120 msgr2=0x7fc0f40c8300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fc0f40c5120 0x7fc0f40c8300 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc0f41ef3c0 msgr2=0x7fc0f41f2770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fc0f41ef3c0 0x7fc0f41f2770 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc0f40ad4b0 msgr2=0x7fc0f41f31c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fc0f40ad4b0 0x7fc0f41f31c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc0f40612c0 msgr2=0x7fc0f40616c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fc0f40612c0 0x7fc0f40616c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc0f4154dc0 msgr2=0x7fc0f41551a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fc0f4154dc0 0x7fc0f41551a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc0f402bd20 msgr2=0x7fc0f402c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 reap_dead start 2024-09-13T18:46:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fc0f402bd20 0x7fc0f402c180 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 reap_dead start 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc0f420a340 msgr2=0x7fc0f420c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fc0f420a340 0x7fc0f420c730 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc0f420d2f0 msgr2=0x7fc0f420f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fc0f420d2f0 0x7fc0f420f6e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.519+0000 7fc0fa000700 1 -- 172.21.15.32:0/1112611784 reap_dead start 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc0d4066780 msgr2=0x7fc0d4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc0d4066780 0x7fc0d4068c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8000f60 tx=0x7fc0e8004a70 comp rx=0 tx=0).stop 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 msgr2=0x7fc0f4153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 0x7fc0f4153b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00cc50 tx=0x7fc0ec00cf60 comp rx=0 tx=0).stop 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 shutdown_connections 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc0d4066780 0x7fc0d4068c40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 --2- 172.21.15.32:0/1112611784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0f4156e30 0x7fc0f4153b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 >> 172.21.15.32:0/1112611784 conn(0x7fc0f406a7d0 msgr2=0x7fc0f40c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 shutdown_connections 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.523+0000 7fc0faa00700 1 -- 172.21.15.32:0/1112611784 wait complete. 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:39.647 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:39.643+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:39.746 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:39.742+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:39.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.791+0000 7f4089e00700 1 Processor -- start 2024-09-13T18:46:39.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.791+0000 7f4089e00700 1 -- start start 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f408406f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40840c6860 0x7f40840c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408415a780 con 0x7f4084159c90 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40840c71f0 con 0x7f40840c6860 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40840c88f0 con 0x7f408406f530 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4088a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4084159c90 0x7f408415a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47192/0 (socket says 172.21.15.32:47192) 2024-09-13T18:46:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4088a00700 1 -- 172.21.15.32:0/253228298 learned_addr learned my addr 172.21.15.32:0/253228298 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:39.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4083e00700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f408406f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089400700 1 --2- 172.21.15.32:0/253228298 >> v2:172.21.15.32:3300/0 conn(0x7f40840c6860 0x7f40840c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4083400700 1 -- 172.21.15.32:0/253228298 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124638654 0 0) 0x7f408415a780 con 0x7f4084159c90 2024-09-13T18:46:39.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089400700 1 -- 172.21.15.32:0/253228298 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 msgr2=0x7f408406f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:39.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089400700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f408406f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089400700 1 -- 172.21.15.32:0/253228298 >> v1:172.21.15.32:6789/0 conn(0x7f4084159c90 legacy=0x7f408415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089400700 1 -- 172.21.15.32:0/253228298 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40840c7850 con 0x7f40840c6860 2024-09-13T18:46:39.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4083e00700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f408406f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:39.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089400700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40840c6860 0x7f40840c6cb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f407c009d90 tx=0x7f407c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9ca8505b6d4980 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4083400700 1 -- 172.21.15.32:0/253228298 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00e070 con 0x7f40840c6860 2024-09-13T18:46:39.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4083400700 1 -- 172.21.15.32:0/253228298 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00bb20 con 0x7f40840c6860 2024-09-13T18:46:39.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4083400700 1 -- 172.21.15.32:0/253228298 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c012430 con 0x7f40840c6860 2024-09-13T18:46:39.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 -- 172.21.15.32:0/253228298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40840c6860 msgr2=0x7f40840c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.795+0000 7f4089e00700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40840c6860 0x7f40840c6cb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f407c009d90 tx=0x7f407c00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 -- 172.21.15.32:0/253228298 shutdown_connections 2024-09-13T18:46:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40840c6860 0x7f40840c6cb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 --2- 172.21.15.32:0/253228298 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f408406f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 -- 172.21.15.32:0/253228298 >> 172.21.15.32:0/253228298 conn(0x7f40840c8a60 msgr2=0x7f40840c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 -- 172.21.15.32:0/253228298 shutdown_connections 2024-09-13T18:46:39.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 -- 172.21.15.32:0/253228298 wait complete. 2024-09-13T18:46:39.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 Processor -- start 2024-09-13T18:46:39.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.799+0000 7f4089e00700 1 -- start start 2024-09-13T18:46:39.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f40840c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40840c6860 0x7f40841eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 0x7f40841ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40840ca810 con 0x7f4084159c90 2024-09-13T18:46:39.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40840c5400 con 0x7f40840c6860 2024-09-13T18:46:39.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40840caa40 con 0x7f408406f530 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 0x7f40841ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 0x7f40841ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46884/0 (socket says 172.21.15.32:46884) 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4083e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40840c6860 0x7f40841eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 -- 172.21.15.32:0/4029368031 learned_addr learned my addr 172.21.15.32:0/4029368031 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4088a00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f40840c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 -- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 msgr2=0x7f40840c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f40840c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 -- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40840c6860 msgr2=0x7f40841eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40840c6860 0x7f40841eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:39.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 -- 172.21.15.32:0/4029368031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700094b0 con 0x7f4084159c90 2024-09-13T18:46:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089400700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 0x7f40841ef490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4084071020 tx=0x7f407c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c012430 con 0x7f4084159c90 2024-09-13T18:46:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c020070 con 0x7f4084159c90 2024-09-13T18:46:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c009a70 con 0x7f4084159c90 2024-09-13T18:46:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c004280 con 0x7f4084159c90 2024-09-13T18:46:39.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.803+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4084149a30 con 0x7f4084159c90 2024-09-13T18:46:39.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.807+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40840c39d0 con 0x7f4084159c90 2024-09-13T18:46:39.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.807+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f407c0043e0 con 0x7f4084159c90 2024-09-13T18:46:39.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.807+0000 7f4080c00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4064066760 0x7f4064068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:39.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.807+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6587+0+0 (secure 0 0 0) 0x7f407c022070 con 0x7f4084159c90 2024-09-13T18:46:39.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.811+0000 7f4088a00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4064066760 0x7f4064068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:39.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.811+0000 7f4088a00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4064066760 0x7f4064068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4078000f60 tx=0x7f4078007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:39.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:39.815+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f407c0525a0 con 0x7f4084159c90 2024-09-13T18:46:39.823 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:39.823 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:39.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:39.823 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:39.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.499780408000007, 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:46:39.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:46:39.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:39.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.499756422000004, 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:46:39.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.499747515999999, 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:46:39.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:39.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:39.840 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.499744644000003, 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:46:39.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.499741936000007, 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.846 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:46:39.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.496614868999998, 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:46:39.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:46:39.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.495564181999995, 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212265, 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324355+0000", 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324354+0000", 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324362+0000", 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0139999999999998e-06 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324376+0000", 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4175000000000001e-05 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324385+0000", 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1500000000000005e-06 2024-09-13T18:46:39.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324543+0000", 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015790699999999999 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324554+0000", 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1155000000000001e-05 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324567+0000", 2024-09-13T18:46:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.495209595000006, 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:46:39.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:46:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.495064436999996, 2024-09-13T18:46:39.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:46:39.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.494967023000001, 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:46:39.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:46:39.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:39.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.494885909999994, 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:46:39.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.494635407999994, 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:46:39.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.493541132999994, 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:39.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:46:39.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.493460184, 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:39.885 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.491357531000006, 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:46:39.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 87.993365843000007, 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:46:39.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(2.7 35/34 [PushReplyOp(2:e0b41d06:::609.00000000:head)])", 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.028675544000002, 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229566, 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791243+0000", 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791249+0000", 2024-09-13T18:46:39.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6380000000000001e-06 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791257+0000", 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8639999999999996e-06 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791264+0000", 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:39.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791309+0000", 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4860000000000001e-05 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791473+0000", 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164644 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:39.901 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:39.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:39.903 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:39.898+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:40.004 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:39.999+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.075+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd in", "ids": ["3"]} v 0) v1 -- 0x7f40840c73d0 con 0x7f4084159c90 2024-09-13T18:46:40.082 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-09-13T18:46:40.075+0000 7f8fc4800700 -1 mon.a@0(leader).osd e51 definitely_dead 0 2024-09-13T18:46:40.104 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:40.099+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:40.138 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:40.138 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:40.138 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:40.138 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:40.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:40.243 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:40.239+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:40.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.275+0000 7f4080c00700 1 -- 172.21.15.32:0/4029368031 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd in", "ids": ["3"]}]=0 marked in osd.3. v52) v1 ==== 85+0+0 (secure 0 0 0) 0x7f407c055bc0 con 0x7f4084159c90 2024-09-13T18:46:40.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4064066760 msgr2=0x7f4064068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:40.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4064066760 0x7f4064068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4078000f60 tx=0x7f4078007e00 comp rx=0 tx=0).stop 2024-09-13T18:46:40.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 msgr2=0x7f40841ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:40.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 0x7f40841ef490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4084071020 tx=0x7f407c004af0 comp rx=0 tx=0).stop 2024-09-13T18:46:40.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 shutdown_connections 2024-09-13T18:46:40.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4064066760 0x7f4064068c20 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4078000f60 tx=0x7f4078007e00 comp rx=0 tx=0).stop 2024-09-13T18:46:40.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4084159c90 0x7f40841ef490 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:40.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40840c6860 0x7f40841eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:40.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 --2- 172.21.15.32:0/4029368031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f408406f530 0x7f40840c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:40.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.283+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 >> 172.21.15.32:0/4029368031 conn(0x7f40840c8a60 msgr2=0x7f4084070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:40.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.291+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 shutdown_connections 2024-09-13T18:46:40.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:40.291+0000 7f4089e00700 1 -- 172.21.15.32:0/4029368031 wait complete. 2024-09-13T18:46:40.310 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:40.303+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:40.316 INFO:teuthology.orchestra.run.smithi032.stderr:marked in osd.3. 2024-09-13T18:46:40.334 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-13T18:46:40.365 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:40.365 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:40.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:40.431 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:40.427+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:40.507 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:40.506+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:40.591 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:40.592 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:40.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:40.592 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:40.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.592 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:40.592 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:40.593 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.81955556299999, 2024-09-13T18:46:40.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:40.593 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.593 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:40.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:40.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:40.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:40.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:40.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:40.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:40.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:40.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:40.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:40.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:40.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:40.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:40.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:40.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:40.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:40.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:40.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:40.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:40.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:40.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:40.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:40.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:40.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:40.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:40.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:40.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:40.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.608 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:40.609 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:40.609 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.127164479, 2024-09-13T18:46:40.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:40.609 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.609 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:40.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:40.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:40.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:40.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:40.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:40.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:40.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:40.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:40.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:40.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:40.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:40.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.620 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.621 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:40.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:40.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.12705068699999, 2024-09-13T18:46:40.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:40.622 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.622 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:40.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:40.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:40.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:40.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:40.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:40.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:40.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:40.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:40.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:40.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:40.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:40.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:40.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:40.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:40.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:40.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:40.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:40.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:40.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:40.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:40.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.634 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.783500558, 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.635 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:40.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.783496668, 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:40.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:40.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.783284788, 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.648 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:40.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:40.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:40.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.783275304, 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:40.654 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:40.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.783010432, 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:40.660 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:40.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:40.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.78281328200001, 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:40.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.782809038, 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:40.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:40.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:40.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 107.766753736, 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:40.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:40.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:40.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.88236634499999, 2024-09-13T18:46:40.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:40.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:40.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:40.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.881790764, 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:40.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:40.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.881779376, 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:40.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:40.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.881771778, 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.703 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:40.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:40.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.881560361, 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:40.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.881554587, 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.715 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:40.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.88153554599999, 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:40.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:40.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.881303381, 2024-09-13T18:46:40.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:40.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:40.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 106.008186846, 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:40.733 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:40.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:40.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:40.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:40.739 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:40.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:40.741 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:40.738+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:40.842 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:40.835+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:40.900 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:40.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:40.901 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:40.901 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:40.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:40.963 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:40.959+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:41.044 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:41.042+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:41.114 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:41.114 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:41.114 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:41.114 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:41.114 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:41.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:41.175 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:41.171+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:41.246 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:41.242+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:41.289 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.963130366000001, 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.290 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:41.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.961824582000006, 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:41.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.298 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.961148532999999, 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:41.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:41.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:41.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.961136213000003, 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.961121457999994, 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.961116406000002, 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.961111106000004, 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.955384699999996, 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.954062792000002, 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.954024493999995, 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.949671745000003, 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 87.344688316000003, 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 85.508250329000006, 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 80.265035487999995, 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.953833287999998, 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.953804091999999, 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.950630769, 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.879473548999997, 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5398~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.427792487000001, 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031271250000000001, 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858261+0000", 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858278+0000", 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858331+0000", 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2884999999999999e-05 2024-09-13T18:46:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858345+0000", 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4154e-05 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858429+0000", 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3588e-05 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858547+0000", 2024-09-13T18:46:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011875 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858693+0000", 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001461 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860297+0000", 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603033 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861283+0000", 2024-09-13T18:46:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098661600000000006 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861346+0000", 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2866000000000004e-05 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861391+0000", 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4713999999999999e-05 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.427765032, 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038877360000000001, 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858295+0000", 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.656e-06 2024-09-13T18:46:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858375+0000", 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9847999999999999e-05 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858386+0000", 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0665999999999999e-05 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859128+0000", 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074182399999999998 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859200+0000", 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2170999999999997e-05 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859298+0000", 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8455000000000005e-05 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860602+0000", 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013036510000000001 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862094+0000", 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492581 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862141+0000", 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6585999999999997e-05 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862179+0000", 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7796000000000002e-05 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:41.392 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:41.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:41.394 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:41.387+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:41.494 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:41.491+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:41.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:46:41.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:41.586 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:41.586 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:41.586 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:41.586 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:41.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:41.600 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:41.595+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:41.696 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:41.691+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.727+0000 7fa562800700 1 Processor -- start 2024-09-13T18:46:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.727+0000 7fa562800700 1 -- start start 2024-09-13T18:46:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa562800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa55c156e30 0x7fa55c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa562800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa55c0c3400 0x7fa55c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa562800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0c7f70 con 0x7fa55c0c7a50 2024-09-13T18:46:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa562800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c15cb70 con 0x7fa55c156e30 2024-09-13T18:46:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa562800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c15cd80 con 0x7fa55c0c3400 2024-09-13T18:46:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa55c156e30 0x7fa55c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa55c156e30 0x7fa55c1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46898/0 (socket says 172.21.15.32:46898) 2024-09-13T18:46:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 -- 172.21.15.32:0/3906880320 learned_addr learned my addr 172.21.15.32:0/3906880320 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa560a00700 1 --2- 172.21.15.32:0/3906880320 >> v2:172.21.15.86:3300/0 conn(0x7fa55c0c3400 0x7fa55c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 -- 172.21.15.32:0/3906880320 >> v2:172.21.15.86:3300/0 conn(0x7fa55c0c3400 msgr2=0x7fa55c157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 --2- 172.21.15.32:0/3906880320 >> v2:172.21.15.86:3300/0 conn(0x7fa55c0c3400 0x7fa55c157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 -- 172.21.15.32:0/3906880320 >> v1:172.21.15.86:6789/0 conn(0x7fa55c0c7a50 legacy=0x7fa55c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa55be00700 1 -- 172.21.15.32:0/3906880320 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511284247 0 0) 0x7fa55c0c7f70 con 0x7fa55c0c7a50 2024-09-13T18:46:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 -- 172.21.15.32:0/3906880320 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c15d060 con 0x7fa55c156e30 2024-09-13T18:46:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa560a00700 1 --2- 172.21.15.32:0/3906880320 >> v2:172.21.15.86:3300/0 conn(0x7fa55c0c3400 0x7fa55c157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa561400700 1 --2- 172.21.15.32:0/3906880320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1575e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0ce020 tx=0x7fa550009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1305acaf69a608 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa55be00700 1 -- 172.21.15.32:0/3906880320 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550011830 con 0x7fa55c156e30 2024-09-13T18:46:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa55be00700 1 -- 172.21.15.32:0/3906880320 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550011990 con 0x7fa55c156e30 2024-09-13T18:46:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.731+0000 7fa55be00700 1 -- 172.21.15.32:0/3906880320 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550011d20 con 0x7fa55c156e30 2024-09-13T18:46:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 -- 172.21.15.32:0/3906880320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 msgr2=0x7fa55c1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 --2- 172.21.15.32:0/3906880320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1575e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0ce020 tx=0x7fa550009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 -- 172.21.15.32:0/3906880320 shutdown_connections 2024-09-13T18:46:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 --2- 172.21.15.32:0/3906880320 >> v2:172.21.15.86:3300/0 conn(0x7fa55c0c3400 0x7fa55c157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 --2- 172.21.15.32:0/3906880320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1575e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 -- 172.21.15.32:0/3906880320 >> 172.21.15.32:0/3906880320 conn(0x7fa55c06a7d0 msgr2=0x7fa55c06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 -- 172.21.15.32:0/3906880320 shutdown_connections 2024-09-13T18:46:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 -- 172.21.15.32:0/3906880320 wait complete. 2024-09-13T18:46:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 Processor -- start 2024-09-13T18:46:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.735+0000 7fa562800700 1 -- start start 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa55c0c3400 0x7fa55c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa55c0c7a50 0x7fa55c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c071f50 con 0x7fa55c156e30 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c6550 con 0x7fa55c0c7a50 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0c6270 con 0x7fa55c0c3400 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa560a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa55c0c7a50 0x7fa55c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa55c0c3400 0x7fa55c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46912/0 (socket says 172.21.15.32:46912) 2024-09-13T18:46:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 learned_addr learned my addr 172.21.15.32:0/987464257 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa55c0c3400 msgr2=0x7fa55c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa55c0c3400 0x7fa55c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa55c0c7a50 msgr2=0x7fa55c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa55c0c7a50 0x7fa55c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480094b0 con 0x7fa55c156e30 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa55c0c3400 0x7fa55c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa55c0c7a50 0x7fa55c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1f6940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa55400cca0 tx=0x7fa55400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554003e50 con 0x7fa55c156e30 2024-09-13T18:46:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400a720 con 0x7fa55c156e30 2024-09-13T18:46:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400aad0 con 0x7fa55c156e30 2024-09-13T18:46:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa550009570 con 0x7fa55c156e30 2024-09-13T18:46:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.739+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c1f4220 con 0x7fa55c156e30 2024-09-13T18:46:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.743+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fa55c0c6700 con 0x7fa55c156e30 2024-09-13T18:46:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.743+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa55400ac30 con 0x7fa55c156e30 2024-09-13T18:46:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.743+0000 7fa559600700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa53c066780 0x7fa53c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fa554083ff0 con 0x7fa55c156e30 2024-09-13T18:46:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v53) v1 ==== 54+0+16 (secure 0 0 0) 0x7fa55c0c6700 con 0x7fa55c156e30 2024-09-13T18:46:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa53c066780 0x7fa53c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa55c06f530 0x7fa55c0c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c15bdd0 con 0x7fa55c06f530 2024-09-13T18:46:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa55c06f530 0x7fa55c0c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa53c066780 0x7fa53c068c40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c00 tx=0x7fa550008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.747+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa55c06f530 0x7fa55c0c2770 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.751+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c15bdd0 con 0x7fa55c06f530 2024-09-13T18:46:41.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.755+0000 7ff1a3400700 1 Processor -- start 2024-09-13T18:46:41.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.755+0000 7ff1a3400700 1 -- start start 2024-09-13T18:46:41.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a3400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff19c072120 0x7ff19c1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a3400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c06d5e0 0x7ff19c151400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a3400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06de20 con 0x7ff19c072500 2024-09-13T18:46:41.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a3400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c0c5890 con 0x7ff19c072120 2024-09-13T18:46:41.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a3400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c06daf0 con 0x7ff19c06d5e0 2024-09-13T18:46:41.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff19be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c06d5e0 0x7ff19c151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a1400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff19c072500 0x7ff19c0cb270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47202/0 (socket says 172.21.15.32:47202) 2024-09-13T18:46:41.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a1400700 1 -- 172.21.15.32:0/1978333883 learned_addr learned my addr 172.21.15.32:0/1978333883 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:41.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a0a00700 1 --2- 172.21.15.32:0/1978333883 >> v2:172.21.15.32:3300/0 conn(0x7ff19c072120 0x7ff19c1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1978333883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c06d5e0 msgr2=0x7ff19c151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:41.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a0a00700 1 --2- 172.21.15.32:0/1978333883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c06d5e0 0x7ff19c151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff19b400700 1 -- 172.21.15.32:0/1978333883 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608235268 0 0) 0x7ff19c06de20 con 0x7ff19c072500 2024-09-13T18:46:41.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1978333883 >> v1:172.21.15.32:6789/0 conn(0x7ff19c072500 legacy=0x7ff19c0cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1978333883 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c06cc60 con 0x7ff19c072120 2024-09-13T18:46:41.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.759+0000 7ff19be00700 1 --2- 172.21.15.32:0/1978333883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c06d5e0 0x7ff19c151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:41.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a0a00700 1 --2- 172.21.15.32:0/1978333883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072120 0x7ff19c1575b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff190009850 tx=0x7ff190009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad88ba9f21080e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff19b400700 1 -- 172.21.15.32:0/1978333883 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011830 con 0x7ff19c072120 2024-09-13T18:46:41.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff19b400700 1 -- 172.21.15.32:0/1978333883 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190011990 con 0x7ff19c072120 2024-09-13T18:46:41.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 -- 172.21.15.32:0/1978333883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072120 msgr2=0x7ff19c1575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1978333883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072120 0x7ff19c1575b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff190009850 tx=0x7ff190009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:41.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 -- 172.21.15.32:0/1978333883 shutdown_connections 2024-09-13T18:46:41.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1978333883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c06d5e0 0x7ff19c151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1978333883 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072120 0x7ff19c1575b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 -- 172.21.15.32:0/1978333883 >> 172.21.15.32:0/1978333883 conn(0x7ff19c06a570 msgr2=0x7ff19c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:41.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 -- 172.21.15.32:0/1978333883 shutdown_connections 2024-09-13T18:46:41.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.763+0000 7ff1a3400700 1 -- 172.21.15.32:0/1978333883 wait complete. 2024-09-13T18:46:41.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 Processor -- start 2024-09-13T18:46:41.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 -- start start 2024-09-13T18:46:41.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 0x7ff19c158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072500 0x7ff19c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c0c3ab0 0x7ff19c142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0c9bc0 con 0x7ff19c072500 2024-09-13T18:46:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c157740 con 0x7ff19c06d5e0 2024-09-13T18:46:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a3400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0c34e0 con 0x7ff19c0c3ab0 2024-09-13T18:46:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.767+0000 7ff1a0a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 0x7ff19c158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 0x7ff19c158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39560/0 (socket says 172.21.15.32:39560) 2024-09-13T18:46:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1588034818 learned_addr learned my addr 172.21.15.32:0/1588034818 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a1400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c0c3ab0 0x7ff19c142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff19be00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072500 0x7ff19c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c0c3ab0 msgr2=0x7ff19c142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c0c3ab0 0x7ff19c142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1588034818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072500 msgr2=0x7ff19c141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072500 0x7ff19c141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 -- 172.21.15.32:0/1588034818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880094b0 con 0x7ff19c06d5e0 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a0a00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 0x7ff19c158310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff190000c00 tx=0x7ff190004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19001ab00 con 0x7ff19c06d5e0 2024-09-13T18:46:41.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19001ac60 con 0x7ff19c06d5e0 2024-09-13T18:46:41.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1900094b0 con 0x7ff19c06d5e0 2024-09-13T18:46:41.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190024420 con 0x7ff19c06d5e0 2024-09-13T18:46:41.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c147240 con 0x7ff19c06d5e0 2024-09-13T18:46:41.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.771+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c1f2760 con 0x7ff19c06d5e0 2024-09-13T18:46:41.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.775+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c06afb0 con 0x7fa55c06f530 2024-09-13T18:46:41.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.775+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff190022070 con 0x7ff19c06d5e0 2024-09-13T18:46:41.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.775+0000 7ff198c00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff17c066730 0x7ff17c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.775+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6587+0+0 (secure 0 0 0) 0x7ff190085c20 con 0x7ff19c06d5e0 2024-09-13T18:46:41.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.775+0000 7ff19be00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff17c066730 0x7ff17c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.782 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7ff19be00700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff17c066730 0x7ff17c068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff19c1f0320 tx=0x7ff188009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa548004100 con 0x7fa55c06f530 2024-09-13T18:46:41.783 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:41.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa55c0cc3e0 0x7fa55c1f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c157210 con 0x7fa55c0cc3e0 2024-09-13T18:46:41.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa55c0cc3e0 0x7fa55c1f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa55c0cc3e0 0x7fa55c1f7390 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.779+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa550006d60 con 0x7fa55c0cc3e0 2024-09-13T18:46:41.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.783+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff190085e60 con 0x7ff19c06d5e0 2024-09-13T18:46:41.796 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:41.791+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:41.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.807+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c0c6700 con 0x7fa55c0cc3e0 2024-09-13T18:46:41.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.807+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c0c6700 con 0x7fa55c0cc3e0 2024-09-13T18:46:41.814 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:41.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.811+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa55c1532c0 0x7fa55c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.811+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c153be0 con 0x7fa55c1532c0 2024-09-13T18:46:41.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.811+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa55c1532c0 0x7fa55c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.811+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa55c1532c0 0x7fa55c1536a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.811+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c153be0 con 0x7fa55c1532c0 2024-09-13T18:46:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.839+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c06ef60 con 0x7fa55c1532c0 2024-09-13T18:46:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.843+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c06ef60 con 0x7fa55c1532c0 2024-09-13T18:46:41.847 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.843+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa55c0612c0 0x7fa55c0616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.843+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c0ca590 con 0x7fa55c0612c0 2024-09-13T18:46:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.843+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa55c0612c0 0x7fa55c0616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.843+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa55c0612c0 0x7fa55c0616e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.843+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c0ca590 con 0x7fa55c0612c0 2024-09-13T18:46:41.865 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:41.865 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:41.865 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:41.865 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:41.865 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.871+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c0ca730 con 0x7fa55c0612c0 2024-09-13T18:46:41.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.875+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c0ca730 con 0x7fa55c0612c0 2024-09-13T18:46:41.880 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:41.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.875+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa55c0c51d0 0x7fa55c0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.875+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c0c5b50 con 0x7fa55c0c51d0 2024-09-13T18:46:41.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.875+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa55c0c51d0 0x7fa55c0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.875+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa55c0c51d0 0x7fa55c0c5610 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.879+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c0c5b50 con 0x7fa55c0c51d0 2024-09-13T18:46:41.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:41.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.903+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c0c5d20 con 0x7fa55c0c51d0 2024-09-13T18:46:41.910 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:41.903+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:41.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.907+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c0c5d20 con 0x7fa55c0c51d0 2024-09-13T18:46:41.917 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:41.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.907+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa55c02bbb0 0x7fa55c02c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.907+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c0c5f10 con 0x7fa55c02bbb0 2024-09-13T18:46:41.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.911+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa55c02bbb0 0x7fa55c02c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.911+0000 7fa560a00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa55c02bbb0 0x7fa55c02c030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.911+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c0c5f10 con 0x7fa55c02bbb0 2024-09-13T18:46:41.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.939+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c0c5e90 con 0x7fa55c02bbb0 2024-09-13T18:46:41.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.943+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c0c5e90 con 0x7fa55c02bbb0 2024-09-13T18:46:41.948 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:41.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.943+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa55c02ca80 0x7fa55c20bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.943+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c20ee90 con 0x7fa55c02ca80 2024-09-13T18:46:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.943+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa55c02ca80 0x7fa55c20bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.943+0000 7fa561e00700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa55c02ca80 0x7fa55c20bf60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.947+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c20ee90 con 0x7fa55c02ca80 2024-09-13T18:46:41.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.971+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c20c520 con 0x7fa55c02ca80 2024-09-13T18:46:41.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.975+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c20c520 con 0x7fa55c02ca80 2024-09-13T18:46:41.982 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:41.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.975+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa55c20cba0 0x7fa55c20cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:41.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.975+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c212220 con 0x7fa55c20cba0 2024-09-13T18:46:41.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.979+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa55c20cba0 0x7fa55c20cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:41.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.979+0000 7fa561400700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa55c20cba0 0x7fa55c20cfe0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:41.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:41.979+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa55c212220 con 0x7fa55c20cba0 2024-09-13T18:46:41.998 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:41.995+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:42.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.007+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa55c20d630 con 0x7fa55c20cba0 2024-09-13T18:46:42.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa559600700 1 -- 172.21.15.32:0/987464257 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa55c20d630 con 0x7fa55c20cba0 2024-09-13T18:46:42.016 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:42.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa55c06f530 msgr2=0x7fa55c0c2770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa55c06f530 0x7fa55c0c2770 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa55c0cc3e0 msgr2=0x7fa55c1f7390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa55c0cc3e0 0x7fa55c1f7390 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa55c1532c0 msgr2=0x7fa55c1536a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa55c1532c0 0x7fa55c1536a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa55c0612c0 msgr2=0x7fa55c0616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa55c0612c0 0x7fa55c0616e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa55c0c51d0 msgr2=0x7fa55c0c5610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa55c0c51d0 0x7fa55c0c5610 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa55c02bbb0 msgr2=0x7fa55c02c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa55c02bbb0 0x7fa55c02c030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa55c02ca80 msgr2=0x7fa55c20bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa55c02ca80 0x7fa55c20bf60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa55c20cba0 msgr2=0x7fa55c20cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa55c20cba0 0x7fa55c20cfe0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 reap_dead start 2024-09-13T18:46:42.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 reap_dead start 2024-09-13T18:46:42.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 reap_dead start 2024-09-13T18:46:42.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 reap_dead start 2024-09-13T18:46:42.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa561e00700 1 -- 172.21.15.32:0/987464257 reap_dead start 2024-09-13T18:46:42.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa53c066780 msgr2=0x7fa53c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa53c066780 0x7fa53c068c40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c00 tx=0x7fa550008030 comp rx=0 tx=0).stop 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 msgr2=0x7fa55c1f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.011+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1f6940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa55400cca0 tx=0x7fa55400a060 comp rx=0 tx=0).stop 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 shutdown_connections 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa53c066780 0x7fa53c068c40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7fa562800700 1 --2- 172.21.15.32:0/987464257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa55c156e30 0x7fa55c1f6940 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 >> 172.21.15.32:0/987464257 conn(0x7fa55c06a7d0 msgr2=0x7fa55c15c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:42.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7ff19c06e2b0 con 0x7ff19c06d5e0 2024-09-13T18:46:42.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 shutdown_connections 2024-09-13T18:46:42.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.015+0000 7fa562800700 1 -- 172.21.15.32:0/987464257 wait complete. 2024-09-13T18:46:42.022 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:42.022 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:42.022 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:42.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:42.099 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:42.094+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:42.105 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.105 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:42.200 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:42.198+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:42.237 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.238 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.247 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:42.303 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:42.298+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:42.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.299+0000 7ff198c00700 1 -- 172.21.15.32:0/1588034818 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v54) v1 ==== 91+0+0 (secure 0 0 0) 0x7ff190029020 con 0x7ff19c06d5e0 2024-09-13T18:46:42.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff17c066730 msgr2=0x7ff17c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff17c066730 0x7ff17c068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff19c1f0320 tx=0x7ff188009240 comp rx=0 tx=0).stop 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 msgr2=0x7ff19c158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 0x7ff19c158310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff190000c00 tx=0x7ff190004770 comp rx=0 tx=0).stop 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 shutdown_connections 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff17c066730 0x7ff17c068bf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19c0c3ab0 0x7ff19c142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff19c072500 0x7ff19c141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 --2- 172.21.15.32:0/1588034818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19c06d5e0 0x7ff19c158310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 >> 172.21.15.32:0/1588034818 conn(0x7ff19c06a570 msgr2=0x7ff19c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 shutdown_connections 2024-09-13T18:46:42.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:42.303+0000 7ff1a3400700 1 -- 172.21.15.32:0/1588034818 wait complete. 2024-09-13T18:46:42.310 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:46:42.360 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.361 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:42.403 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:42.399+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:42.503 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:42.502+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:42.517 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.517 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.527 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:42.604 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:42.602+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:42.636 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.637 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:42.706 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:42.702+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:42.756 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.756 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.766 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:42.806 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:42.803+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:42.907 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:42.903+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:42.917 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:42.917 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:42.927 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:43.008 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:43.003+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:43.036 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.036 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.046 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:43.109 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:43.106+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:43.154 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.155 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.164 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:43.212 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:43.210+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:43.310 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:43.306+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:43.322 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.322 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:43.411 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:43.406+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:43.437 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.437 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:43.512 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:43.510+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:43.597 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.597 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.607 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:43.656 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:43.654+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:43.714 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.714 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.715 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:43.711+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:43.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:43.815 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:43.810+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:43.873 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:43.873 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:43.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:43.935 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:43.931+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:44.017 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:44.011+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:44.028 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:44.028 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:44.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:44.044 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:44.135 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:44.131+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:44.219 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:44.214+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:44.245 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:44.245 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:44.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:44.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.283+0000 7fa5e2200700 1 Processor -- start 2024-09-13T18:46:44.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.283+0000 7fa5e2200700 1 -- start start 2024-09-13T18:46:44.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.283+0000 7fa5e2200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d40d89f0 0x7fa5d404cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.283+0000 7fa5e2200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d404d240 0x7fa5d4047840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d4048230 con 0x7fa5d4047d80 2024-09-13T18:46:44.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d4047240 con 0x7fa5d40d89f0 2024-09-13T18:46:44.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40d8dd0 con 0x7fa5d404d240 2024-09-13T18:46:44.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d40d89f0 0x7fa5d404cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d40d89f0 0x7fa5d404cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46932/0 (socket says 172.21.15.32:46932) 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 -- 172.21.15.32:0/2787869248 learned_addr learned my addr 172.21.15.32:0/2787869248 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/2787869248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d404d240 0x7fa5d4047840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 -- 172.21.15.32:0/2787869248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d404d240 msgr2=0x7fa5d4047840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/2787869248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d404d240 0x7fa5d4047840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 -- 172.21.15.32:0/2787869248 >> v1:172.21.15.86:6789/0 conn(0x7fa5d4047d80 legacy=0x7fa5d40088f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 -- 172.21.15.32:0/2787869248 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40e1d50 con 0x7fa5d40d89f0 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/2787869248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40d89f0 0x7fa5d404cd00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009910 tx=0x7fa5d0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef41cd77d535041 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5db400700 1 -- 172.21.15.32:0/2787869248 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0011830 con 0x7fa5d40d89f0 2024-09-13T18:46:44.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5db400700 1 -- 172.21.15.32:0/2787869248 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0011990 con 0x7fa5d40d89f0 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5db400700 1 -- 172.21.15.32:0/2787869248 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0011d40 con 0x7fa5d40d89f0 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- 172.21.15.32:0/2787869248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40d89f0 msgr2=0x7fa5d404cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 --2- 172.21.15.32:0/2787869248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40d89f0 0x7fa5d404cd00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009910 tx=0x7fa5d0009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- 172.21.15.32:0/2787869248 shutdown_connections 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 --2- 172.21.15.32:0/2787869248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d404d240 0x7fa5d4047840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 --2- 172.21.15.32:0/2787869248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d40d89f0 0x7fa5d404cd00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- 172.21.15.32:0/2787869248 >> 172.21.15.32:0/2787869248 conn(0x7fa5d400dc40 msgr2=0x7fa5d400e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- 172.21.15.32:0/2787869248 shutdown_connections 2024-09-13T18:46:44.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.287+0000 7fa5e2200700 1 -- 172.21.15.32:0/2787869248 wait complete. 2024-09-13T18:46:44.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 Processor -- start 2024-09-13T18:46:44.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 -- start start 2024-09-13T18:46:44.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 0x7fa5d40c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5d404d240 0x7fa5d40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d40d89f0 0x7fa5d40dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d4168940 con 0x7fa5d4047d80 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d4169510 con 0x7fa5d404d240 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.291+0000 7fa5e2200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d41683f0 con 0x7fa5d40d89f0 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 0x7fa5d40c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 0x7fa5d40c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46934/0 (socket says 172.21.15.32:46934) 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 -- 172.21.15.32:0/1704953873 learned_addr learned my addr 172.21.15.32:0/1704953873 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:44.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5d404d240 0x7fa5d40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d40d89f0 0x7fa5d40dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d40d89f0 msgr2=0x7fa5d40dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d40d89f0 0x7fa5d40dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5d404d240 msgr2=0x7fa5d40ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5d404d240 0x7fa5d40ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0009570 con 0x7fa5d4047d80 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5d404d240 0x7fa5d40ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa5d40d89f0 0x7fa5d40dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 0x7fa5d40c2ae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009f70 tx=0x7fa5d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0004590 con 0x7fa5d4047d80 2024-09-13T18:46:44.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d4168660 con 0x7fa5d4047d80 2024-09-13T18:46:44.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d40dfc70 con 0x7fa5d4047d80 2024-09-13T18:46:44.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d001e070 con 0x7fa5d4047d80 2024-09-13T18:46:44.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003900 con 0x7fa5d4047d80 2024-09-13T18:46:44.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.295+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fa5d40df7f0 con 0x7fa5d4047d80 2024-09-13T18:46:44.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.299+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5d0003a60 con 0x7fa5d4047d80 2024-09-13T18:46:44.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5d8c00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa5bc066730 0x7fa5bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fa5d0085ba0 con 0x7fa5d4047d80 2024-09-13T18:46:44.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v54) v1 ==== 54+0+16 (secure 0 0 0) 0x7fa5d00860c0 con 0x7fa5d4047d80 2024-09-13T18:46:44.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa5bc066730 0x7fa5bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa5d40ce680 0x7fa5d40d6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d40e2310 con 0x7fa5d40ce680 2024-09-13T18:46:44.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa5d40ce680 0x7fa5d40d6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa5bc066730 0x7fa5bc068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40dc1d0 tx=0x7fa5c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa5d40ce680 0x7fa5d40d6210 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.303+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5dc0671c0 con 0x7fa5d40ce680 2024-09-13T18:46:44.321 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:44.315+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:44.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.323+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d40e28d0 con 0x7fa5d40ce680 2024-09-13T18:46:44.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.323+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5dc04ec20 con 0x7fa5d40ce680 2024-09-13T18:46:44.330 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:44.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.323+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa5d40e09a0 0x7fa5d4178010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.323+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d4047840 con 0x7fa5d40e09a0 2024-09-13T18:46:44.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.327+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa5d40e09a0 0x7fa5d4178010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.327+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa5d40e09a0 0x7fa5d4178010 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.327+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d4047840 con 0x7fa5d40e09a0 2024-09-13T18:46:44.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:46:44.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.355+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d4169650 con 0x7fa5d40e09a0 2024-09-13T18:46:44.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.355+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d4169650 con 0x7fa5d40e09a0 2024-09-13T18:46:44.362 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:44.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.359+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa5d4178a60 0x7fa5d40d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.363 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.359+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d4048d70 con 0x7fa5d4178a60 2024-09-13T18:46:44.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.363+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa5d4178a60 0x7fa5d40d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.363+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa5d4178a60 0x7fa5d40d2e20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.369 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.363+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d4048d70 con 0x7fa5d4178a60 2024-09-13T18:46:44.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.391+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d404d840 con 0x7fa5d4178a60 2024-09-13T18:46:44.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.395+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d404d840 con 0x7fa5d4178a60 2024-09-13T18:46:44.398 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.395+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa5d40d3870 0x7fa5d4002970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.395+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d40d6750 con 0x7fa5d40d3870 2024-09-13T18:46:44.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.395+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa5d40d3870 0x7fa5d4002970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.395+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa5d40d3870 0x7fa5d4002970 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.395+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d40d6750 con 0x7fa5d40d3870 2024-09-13T18:46:44.421 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:44.415+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:44.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.423+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d40cd170 con 0x7fa5d40d3870 2024-09-13T18:46:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.423+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d40cd170 con 0x7fa5d40d3870 2024-09-13T18:46:44.430 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.427+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa5d40033c0 0x7fa5d4001180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.427+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d40d3e00 con 0x7fa5d40033c0 2024-09-13T18:46:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.427+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa5d40033c0 0x7fa5d4001180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.427+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa5d40033c0 0x7fa5d4001180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.427+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d40d3e00 con 0x7fa5d40033c0 2024-09-13T18:46:44.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.455+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d40d3e00 con 0x7fa5d40033c0 2024-09-13T18:46:44.466 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.459+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d40d3e00 con 0x7fa5d40033c0 2024-09-13T18:46:44.466 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:44.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.463+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa5d4001bd0 0x7fa5d4001ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.463+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d4003800 con 0x7fa5d4001bd0 2024-09-13T18:46:44.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.463+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa5d4001bd0 0x7fa5d4001ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.463+0000 7fa5dbe00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa5d4001bd0 0x7fa5d4001ff0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.463+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d4003800 con 0x7fa5d4001bd0 2024-09-13T18:46:44.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.487+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d40039a0 con 0x7fa5d4001bd0 2024-09-13T18:46:44.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.491+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d40039a0 con 0x7fa5d4001bd0 2024-09-13T18:46:44.498 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:44.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.495+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa5d4002530 0x7fa5d418d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.495+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d4003800 con 0x7fa5d4002530 2024-09-13T18:46:44.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.495+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa5d4002530 0x7fa5d418d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.495+0000 7fa5e1800700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa5d4002530 0x7fa5d418d8c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.501 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:44.502 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:44.502 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:44.502 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:44.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.495+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d4003800 con 0x7fa5d4002530 2024-09-13T18:46:44.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff376400700 1 Processor -- start 2024-09-13T18:46:44.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff376400700 1 -- start start 2024-09-13T18:46:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff376400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff370151680 0x7ff37006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff376400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37015aa50 con 0x7ff3700cd640 2024-09-13T18:46:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff376400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37015aca0 con 0x7ff370151a60 2024-09-13T18:46:44.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff376400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37015af80 con 0x7ff370151680 2024-09-13T18:46:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff375a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff3700cd640 0x7ff370157a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47214/0 (socket says 172.21.15.32:47214) 2024-09-13T18:46:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff375a00700 1 -- 172.21.15.32:0/991112112 learned_addr learned my addr 172.21.15.32:0/991112112 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff36fe00700 1 --1- 172.21.15.32:0/991112112 >> v1:172.21.15.86:6789/0 conn(0x7ff370151a60 0x7ff3700ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:39924/0 (socket says 172.21.15.32:39924) 2024-09-13T18:46:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.503+0000 7ff375000700 1 --2- 172.21.15.32:0/991112112 >> v2:172.21.15.32:3300/0 conn(0x7ff370151680 0x7ff37006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948858565 0 0) 0x7ff37015aca0 con 0x7ff370151a60 2024-09-13T18:46:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3580035d0 con 0x7ff370151a60 2024-09-13T18:46:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588838967 0 0) 0x7ff37015aa50 con 0x7ff3700cd640 2024-09-13T18:46:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff37015aca0 con 0x7ff3700cd640 2024-09-13T18:46:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff375000700 1 -- 172.21.15.32:0/991112112 >> v1:172.21.15.86:6789/0 conn(0x7ff370151a60 legacy=0x7ff3700ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff375000700 1 -- 172.21.15.32:0/991112112 >> v1:172.21.15.32:6789/0 conn(0x7ff3700cd640 legacy=0x7ff370157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff375000700 1 -- 172.21.15.32:0/991112112 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37015b260 con 0x7ff370151680 2024-09-13T18:46:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff375000700 1 --2- 172.21.15.32:0/991112112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff370151680 0x7ff37006b260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff364009850 tx=0x7ff364009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36243d1031b9d31b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364011830 con 0x7ff370151680 2024-09-13T18:46:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff364011990 con 0x7ff370151680 2024-09-13T18:46:44.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff36f400700 1 -- 172.21.15.32:0/991112112 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364011d40 con 0x7ff370151680 2024-09-13T18:46:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 -- 172.21.15.32:0/991112112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff370151680 msgr2=0x7ff37006b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 --2- 172.21.15.32:0/991112112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff370151680 0x7ff37006b260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff364009850 tx=0x7ff364009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 -- 172.21.15.32:0/991112112 shutdown_connections 2024-09-13T18:46:44.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 --2- 172.21.15.32:0/991112112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff370151680 0x7ff37006b260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 -- 172.21.15.32:0/991112112 >> 172.21.15.32:0/991112112 conn(0x7ff370071740 msgr2=0x7ff370071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 -- 172.21.15.32:0/991112112 shutdown_connections 2024-09-13T18:46:44.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.507+0000 7ff376400700 1 -- 172.21.15.32:0/991112112 wait complete. 2024-09-13T18:46:44.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.511+0000 7ff376400700 1 Processor -- start 2024-09-13T18:46:44.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.511+0000 7ff376400700 1 -- start start 2024-09-13T18:46:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3700cd640 0x7ff3700ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 0x7ff3701556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3700a9f90 0x7ff3700aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700abf30 con 0x7ff3700cd640 2024-09-13T18:46:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3701ed240 con 0x7ff370151680 2024-09-13T18:46:44.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700b2230 con 0x7ff3700a9f90 2024-09-13T18:46:44.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 0x7ff3701556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 0x7ff3701556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39578/0 (socket says 172.21.15.32:39578) 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 -- 172.21.15.32:0/2594051196 learned_addr learned my addr 172.21.15.32:0/2594051196 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff375000700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3700cd640 0x7ff3700ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff375a00700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3700a9f90 0x7ff3700aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 -- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3700a9f90 msgr2=0x7ff3700aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3700a9f90 0x7ff3700aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 -- 172.21.15.32:0/2594051196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3700cd640 msgr2=0x7ff3700ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3700cd640 0x7ff3700ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 -- 172.21.15.32:0/2594051196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640094b0 con 0x7ff370151680 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36fe00700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 0x7ff3701556e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00c500 tx=0x7ff35c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c005cd0 con 0x7ff370151680 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c005e30 con 0x7ff370151680 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3700aa960 con 0x7ff370151680 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c007310 con 0x7ff370151680 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.515+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3700a97d0 con 0x7ff370151680 2024-09-13T18:46:44.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.519+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3700ccf30 con 0x7ff370151680 2024-09-13T18:46:44.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.519+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff35c007470 con 0x7ff370151680 2024-09-13T18:46:44.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.523+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d4003800 con 0x7fa5d4002530 2024-09-13T18:46:44.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.523+0000 7ff36cc00700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff350066730 0x7ff350068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.523+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6587+0+0 (secure 0 0 0) 0x7ff35c083c30 con 0x7ff370151680 2024-09-13T18:46:44.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.523+0000 7ff375000700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff350066730 0x7ff350068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.523+0000 7ff375000700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff350066730 0x7ff350068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3640090b0 tx=0x7ff364008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.530 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:44.523+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:44.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.527+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d4003800 con 0x7fa5d4002530 2024-09-13T18:46:44.531 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:44.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.527+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa5d418e310 0x7fa5d4190700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:44.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.527+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d4193580 con 0x7fa5d418e310 2024-09-13T18:46:44.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.527+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa5d418e310 0x7fa5d4190700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:44.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.527+0000 7fa5e0e00700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa5d418e310 0x7fa5d4190700 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:44.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.531+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa5d4193580 con 0x7fa5d418e310 2024-09-13T18:46:44.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.531+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff35c050ca0 con 0x7ff370151680 2024-09-13T18:46:44.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.555+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7fa5d4190c40 con 0x7fa5d418e310 2024-09-13T18:46:44.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5d8c00700 1 -- 172.21.15.32:0/1704953873 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa5d4190c40 con 0x7fa5d418e310 2024-09-13T18:46:44.565 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:44.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa5d40ce680 msgr2=0x7fa5d40d6210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa5d40ce680 0x7fa5d40d6210 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa5d40e09a0 msgr2=0x7fa5d4178010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa5d40e09a0 0x7fa5d4178010 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa5d4178a60 msgr2=0x7fa5d40d2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa5d4178a60 0x7fa5d40d2e20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa5d40d3870 msgr2=0x7fa5d4002970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa5d40d3870 0x7fa5d4002970 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa5d40033c0 msgr2=0x7fa5d4001180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa5d40033c0 0x7fa5d4001180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa5d4001bd0 msgr2=0x7fa5d4001ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa5d4001bd0 0x7fa5d4001ff0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa5d4002530 msgr2=0x7fa5d418d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa5d4002530 0x7fa5d418d8c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa5d418e310 msgr2=0x7fa5d4190700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa5d418e310 0x7fa5d4190700 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e1800700 1 -- 172.21.15.32:0/1704953873 reap_dead start 2024-09-13T18:46:44.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e1800700 1 -- 172.21.15.32:0/1704953873 reap_dead start 2024-09-13T18:46:44.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e1800700 1 -- 172.21.15.32:0/1704953873 reap_dead start 2024-09-13T18:46:44.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e1800700 1 -- 172.21.15.32:0/1704953873 reap_dead start 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e1800700 1 -- 172.21.15.32:0/1704953873 reap_dead start 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa5bc066730 msgr2=0x7fa5bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa5bc066730 0x7fa5bc068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40dc1d0 tx=0x7fa5c8008040 comp rx=0 tx=0).stop 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 msgr2=0x7fa5d40c2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.559+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 0x7fa5d40c2ae0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009f70 tx=0x7fa5d0004770 comp rx=0 tx=0).stop 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.563+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 shutdown_connections 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.563+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa5bc066730 0x7fa5bc068bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.563+0000 7fa5e2200700 1 --2- 172.21.15.32:0/1704953873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d4047d80 0x7fa5d40c2ae0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.563+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 >> 172.21.15.32:0/1704953873 conn(0x7fa5d400dc40 msgr2=0x7fa5d40d6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.563+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 shutdown_connections 2024-09-13T18:46:44.568 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.563+0000 7fa5e2200700 1 -- 172.21.15.32:0/1704953873 wait complete. 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:44.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:44.627 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:44.622+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:44.671 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:44.671 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:44.671 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:44.671 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:44.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:44.734 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:44.731+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:44.829 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:44.823+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.075763717, 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.38337263299999, 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.383258841, 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.03970871200001, 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.039704822, 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.039492942, 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.03948345800001, 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.039218586, 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.039021436, 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.039017192, 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 112.02296189, 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.138574499, 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.13799891799999, 2024-09-13T18:46:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.13798753, 2024-09-13T18:46:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.13797993199999, 2024-09-13T18:46:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.137768515, 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.137762741, 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.1377437, 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 111.137511535, 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 110.26439499999999, 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.004 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:45.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:45.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:44.887+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7ff3700c2110 con 0x7ff370151680 2024-09-13T18:46:45.006 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:45.002+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:45.107 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:45.103+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:45.197 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:45.198 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:45.198 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:45.208 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:45.203+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:45.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:45.311 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:45.307+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.315+0000 7ff36cc00700 1 -- 172.21.15.32:0/2594051196 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v55) v1 ==== 101+0+0 (secure 0 0 0) 0x7ff35c017020 con 0x7ff370151680 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff350066730 msgr2=0x7ff350068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff350066730 0x7ff350068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3640090b0 tx=0x7ff364008030 comp rx=0 tx=0).stop 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 msgr2=0x7ff3701556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 0x7ff3701556e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00c500 tx=0x7ff35c00c810 comp rx=0 tx=0).stop 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 shutdown_connections 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff350066730 0x7ff350068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3700a9f90 0x7ff3700aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff370151680 0x7ff3701556e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.325 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 --2- 172.21.15.32:0/2594051196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3700cd640 0x7ff3700ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 >> 172.21.15.32:0/2594051196 conn(0x7ff370071740 msgr2=0x7ff3700c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:45.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 shutdown_connections 2024-09-13T18:46:45.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.319+0000 7ff376400700 1 -- 172.21.15.32:0/2594051196 wait complete. 2024-09-13T18:46:45.326 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:46:45.335 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:45.335 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:45.335 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T18:46:45.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T18:46:45.409 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:45.406+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:45.416 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:45.417 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:45.417 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:45.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:45.510 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:45.506+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:45.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.531+0000 7f855a800700 1 Processor -- start 2024-09-13T18:46:45.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.531+0000 7f855a800700 1 -- start start 2024-09-13T18:46:45.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f85540c6150 0x7f8554070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:45.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85540c6f70 0x7f855415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:45.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855415a3b0 con 0x7f8554070a80 2024-09-13T18:46:45.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855406da90 con 0x7f85540c6f70 2024-09-13T18:46:45.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855415db10 con 0x7f85540c6150 2024-09-13T18:46:45.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f85540c6150 0x7f8554070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8558a00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8554070a80 0x7f85540c6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:39934/0 (socket says 172.21.15.32:39934) 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8558a00700 1 -- 172.21.15.32:0/3648628517 learned_addr learned my addr 172.21.15.32:0/3648628517 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559e00700 1 --2- 172.21.15.32:0/3648628517 >> v2:172.21.15.32:3300/0 conn(0x7f85540c6f70 0x7f855415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559e00700 1 -- 172.21.15.32:0/3648628517 >> v2:172.21.15.86:3300/0 conn(0x7f85540c6150 msgr2=0x7f8554070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559e00700 1 --2- 172.21.15.32:0/3648628517 >> v2:172.21.15.86:3300/0 conn(0x7f85540c6150 0x7f8554070540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559e00700 1 -- 172.21.15.32:0/3648628517 >> v1:172.21.15.86:6789/0 conn(0x7f8554070a80 legacy=0x7f85540c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559e00700 1 -- 172.21.15.32:0/3648628517 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85541597a0 con 0x7f85540c6f70 2024-09-13T18:46:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8553e00700 1 -- 172.21.15.32:0/3648628517 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479866905 0 0) 0x7f855415a3b0 con 0x7f8554070a80 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8559e00700 1 --2- 172.21.15.32:0/3648628517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c6f70 0x7f855415cc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8554070fd0 tx=0x7f854c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545ffca382080ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8553e00700 1 -- 172.21.15.32:0/3648628517 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00e070 con 0x7f85540c6f70 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8553e00700 1 -- 172.21.15.32:0/3648628517 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00bb20 con 0x7f85540c6f70 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f8553e00700 1 -- 172.21.15.32:0/3648628517 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c012430 con 0x7f85540c6f70 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 -- 172.21.15.32:0/3648628517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c6f70 msgr2=0x7f855415cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.535+0000 7f855a800700 1 --2- 172.21.15.32:0/3648628517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c6f70 0x7f855415cc80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8554070fd0 tx=0x7f854c00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 -- 172.21.15.32:0/3648628517 shutdown_connections 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 --2- 172.21.15.32:0/3648628517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85540c6f70 0x7f855415cc80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 --2- 172.21.15.32:0/3648628517 >> v2:172.21.15.86:3300/0 conn(0x7f85540c6150 0x7f8554070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 -- 172.21.15.32:0/3648628517 >> 172.21.15.32:0/3648628517 conn(0x7f8554071080 msgr2=0x7f8554071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 -- 172.21.15.32:0/3648628517 shutdown_connections 2024-09-13T18:46:45.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 -- 172.21.15.32:0/3648628517 wait complete. 2024-09-13T18:46:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 Processor -- start 2024-09-13T18:46:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.539+0000 7f855a800700 1 -- start start 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 0x7f8554154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85540c6150 0x7f85541f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85540c6f70 0x7f855415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541547b0 con 0x7f8554070a80 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85541f2750 con 0x7f85540c6150 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540af6b0 con 0x7f85540c6f70 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 0x7f8554154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8558a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85540c6150 0x7f85541f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85540c6f70 0x7f855415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 0x7f8554154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46946/0 (socket says 172.21.15.32:46946) 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559400700 1 -- 172.21.15.32:0/2438145522 learned_addr learned my addr 172.21.15.32:0/2438145522 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 -- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85540c6150 msgr2=0x7f85541f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85540c6150 0x7f85541f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 -- 172.21.15.32:0/2438145522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 msgr2=0x7f8554154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:45.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 0x7f8554154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:45.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 -- 172.21.15.32:0/2438145522 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009a70 con 0x7f85540c6f70 2024-09-13T18:46:45.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559400700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 0x7f8554154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:45.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8559e00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85540c6f70 0x7f855415c5c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f854c016000 tx=0x7f854c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:45.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c012430 con 0x7f85540c6f70 2024-09-13T18:46:45.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c020070 con 0x7f85540c6f70 2024-09-13T18:46:45.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c004280 con 0x7f85540c6f70 2024-09-13T18:46:45.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 -- 172.21.15.32:0/2438145522 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85540adf40 con 0x7f85540c6f70 2024-09-13T18:46:45.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.543+0000 7f855a800700 1 -- 172.21.15.32:0/2438145522 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8554156750 con 0x7f85540c6f70 2024-09-13T18:46:45.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.547+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528005310 con 0x7f85540c6f70 2024-09-13T18:46:45.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.547+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f854c0043e0 con 0x7f85540c6f70 2024-09-13T18:46:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.551+0000 7f8551600700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8534066730 0x7f8534068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.551+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6587+0+0 (secure 0 0 0) 0x7f854c022070 con 0x7f85540c6f70 2024-09-13T18:46:45.556 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.551+0000 7f8559400700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8534066730 0x7f8534068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:45.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.551+0000 7f8559400700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8534066730 0x7f8534068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f85480113d0 tx=0x7f8548009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.559+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f854c0535f0 con 0x7f85540c6f70 2024-09-13T18:46:45.581 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:45.581 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:45.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:45.581 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.253975156999999, 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:45.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:45.586 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.252669373000003, 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:45.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.251993323999997, 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.590 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:45.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.251981004000001, 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:45.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:45.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:45.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.251966249000006, 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.251961197, 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.608 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:45.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:45.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:45.614 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.251955897000002, 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:45.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.246229490999994, 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.244907583, 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.244869284999993, 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.240516536000001, 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 91.635533107000001, 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 89.799095120000004, 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 84.555880278999993, 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.244678079000003, 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.244648883000004, 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.241475559999998, 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.170318340000001, 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5398~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.718637277999999, 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031271250000000001, 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858261+0000", 2024-09-13T18:46:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858278+0000", 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858331+0000", 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2884999999999999e-05 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858345+0000", 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4154e-05 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858429+0000", 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3588e-05 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858547+0000", 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011875 2024-09-13T18:46:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858693+0000", 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001461 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860297+0000", 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603033 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861283+0000", 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098661600000000006 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861346+0000", 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2866000000000004e-05 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861391+0000", 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4713999999999999e-05 2024-09-13T18:46:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.718609823000001, 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038877360000000001, 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858295+0000", 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.656e-06 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858375+0000", 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9847999999999999e-05 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858386+0000", 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0665999999999999e-05 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859128+0000", 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074182399999999998 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859200+0000", 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2170999999999997e-05 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859298+0000", 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8455000000000005e-05 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860602+0000", 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013036510000000001 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862094+0000", 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492581 2024-09-13T18:46:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862141+0000", 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6585999999999997e-05 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862179+0000", 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7796000000000002e-05 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.692 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:45.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:45.694 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:45.687+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:45.794 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:45.787+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:45.879 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:45.879 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:45.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:45.895 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:45.890+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:45.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.907+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8528005890 con 0x7f85540c6f70 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "epoch": 55, 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "fsid": "e3c44028-1b11-4958-a433-ecab24d0f05e", 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "created": "2024-09-13T18:44:38.402959+0000", 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "modified": "2024-09-13T18:46:45.299926+0000", 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "last_up_change": "2024-09-13T18:44:49.741600+0000", 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "last_in_change": "2024-09-13T18:46:40.269675+0000", 2024-09-13T18:46:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_num": 5799936, 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_set": [ 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pglog_hardlimit", 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "purged_snapdirs", 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_deletes", 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "sortbitwise" 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_version": 6, 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_snapshot": "", 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_max": 4, 2024-09-13T18:46:45.922 INFO:teuthology.orchestra.run.smithi032.stdout: "max_osd": 8, 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "min_compat_client": "luminous", 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "require_osd_release": "reef", 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "allow_crimson": false, 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "pools": [ 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 1, 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": ".mgr", 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:44:50.146051+0000", 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 1, 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool", 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 1, 2024-09-13T18:46:45.923 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 2, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 1, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 0, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 1, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 1, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 1, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 1, 2024-09-13T18:46:45.924 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 1, 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "18", 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:45.925 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:45.926 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "", 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:45.927 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 0, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_max": 32, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 1 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": {} 2024-09-13T18:46:45.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "read_balance": { 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "score_acting": 8, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "score_stable": 8, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "optimal_score": 0.25, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_acting": 2, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_stable": 2, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity": 1, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 2, 2024-09-13T18:46:45.929 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:44:59.596223+0000", 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 1, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool", 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 1, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 2, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 1, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 0, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:45.930 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 32, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 32, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 32, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 32, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 32, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "21", 2024-09-13T18:46:45.931 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:45.932 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "", 2024-09-13T18:46:45.933 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 0, 2024-09-13T18:46:45.934 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 16, 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "recovery_priority": 5 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs": { 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": "cephfs" 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.935 INFO:teuthology.orchestra.run.smithi032.stdout: "read_balance": { 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "score_acting": 2.25, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "score_stable": 2.25, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "optimal_score": 1, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_acting": 2.25, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_stable": 2.25, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity": 1, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 3, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": "cephfs_data", 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:45:00.330969+0000", 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 1, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool", 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 1, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 2, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 1, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 0, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:45.937 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 64, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 64, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 64, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 64, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 64, 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:45.938 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "22", 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:45.939 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:45.940 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "", 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:45.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 0, 2024-09-13T18:46:45.942 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 64, 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "target_size_ratio": 0.05000000074505806 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs": { 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "data": "cephfs" 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "read_balance": { 2024-09-13T18:46:45.943 INFO:teuthology.orchestra.run.smithi032.stdout: "score_acting": 1.5, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "score_stable": 1.5, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "optimal_score": 1, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_acting": 1.5, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "raw_score_stable": 1.5, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity": 1, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.944 INFO:teuthology.orchestra.run.smithi032.stdout: "pool": 4, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_name": "cephfs_data_ec", 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "create_time": "2024-09-13T18:45:03.385324+0000", 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "flags": 5, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type": 3, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 4, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "min_size": 3, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_rule": 1, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:46:45.945 INFO:teuthology.orchestra.run.smithi032.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "object_hash": 2, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num": 32, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num": 32, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_placement_num_target": 32, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_target": 32, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_pending": 32, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "last_pg_merge_meta": { 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "source_pgid": "0.0", 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "ready_epoch": 0, 2024-09-13T18:46:45.946 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_started": 0, 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_epoch_clean": 0, 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "source_version": "0'0", 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "target_version": "0'0" 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_change": "26", 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend": "0", 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "auid": 0, 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_seq": 0, 2024-09-13T18:46:45.947 INFO:teuthology.orchestra.run.smithi032.stdout: "snap_epoch": 0, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "pool_snaps": [], 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps": "[]", 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_bytes": 0, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "quota_max_objects": 0, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "tiers": [], 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "tier_of": -1, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "read_tier": -1, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "write_tier": -1, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_mode": "none", 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_bytes": 0, 2024-09-13T18:46:45.948 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_objects": 0, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_flush_age": 0, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "cache_min_evict_age": 0, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_params": { 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "none" 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_period": 0, 2024-09-13T18:46:45.949 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_count": 0, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "use_gmt_hitset": true, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "grade_table": [], 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "stripe_width": 8192, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "expected_num_objects": 0, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "fast_read": false, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "options": { 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_num_min": 64, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.950 INFO:teuthology.orchestra.run.smithi032.stdout: "application_metadata": { 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs": { 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "data": "cephfs" 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "osds": [ 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 0, 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "973dc52d-4a57-489e-b680-f484a091a77f", 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.951 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6813", 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6815", 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6816", 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6818", 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6822", 2024-09-13T18:46:45.954 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6823", 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6820", 2024-09-13T18:46:45.955 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6821", 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3679908055 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6815/3679908055", 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6818/3679908055", 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6823/3679908055", 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6821/3679908055", 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.956 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 1, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "354ae97e-51cf-423c-b257-37bf8960729b", 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.957 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6800", 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6801", 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.959 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.911+0000 7f8551600700 1 -- 172.21.15.32:0/2438145522 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+37538 (secure 0 0 0) 0x7f854c056c10 con 0x7f85540c6f70 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6802", 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6803", 2024-09-13T18:46:45.960 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6806", 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6807", 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6804", 2024-09-13T18:46:45.962 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6805", 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1416437982 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6801/1416437982", 2024-09-13T18:46:45.963 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6803/1416437982", 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6807/1416437982", 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6805/1416437982", 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 2, 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "b76494fe-9ae4-4444-8f25-15b7bb18dece", 2024-09-13T18:46:45.964 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.965 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6808", 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6809", 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6810", 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.967 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6811", 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6817", 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6819", 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.969 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6812", 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6814", 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1016396602 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6809/1016396602", 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6811/1016396602", 2024-09-13T18:46:45.970 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6819/1016396602", 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6814/1016396602", 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 3, 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "3b89a1fa-2088-4a23-b1e6-31644ebc6000", 2024-09-13T18:46:45.971 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 15, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.972 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6824", 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6825", 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6826", 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6827", 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.974 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6830", 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6831", 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.975 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6828", 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.976 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.32:6829", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2476570305 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.32:6825/2476570305", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.32:6827/2476570305", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.32:6831/2476570305", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.32:6829/2476570305", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.977 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 4, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "63973273-0c32-404c-9eb2-943b451d3da7", 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.978 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6808", 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.979 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6811", 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6815", 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.980 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6819", 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6829", 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6831", 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6822", 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6825", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 838245911 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6811/838245911", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6819/838245911", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6831/838245911", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6825/838245911", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 5, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "2678edb8-ca2a-497a-8439-5f1dc709dbe8", 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.984 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6810", 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6813", 2024-09-13T18:46:45.985 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6817", 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6820", 2024-09-13T18:46:45.986 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6828", 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6830", 2024-09-13T18:46:45.987 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6823", 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.988 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6827", 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 2187629356 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6813/2187629356", 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6820/2187629356", 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6830/2187629356", 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6827/2187629356", 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 6, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "8adaa119-857f-4d43-bf54-dcac614aba37", 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.990 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6800", 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6801", 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6802", 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6803", 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6806", 2024-09-13T18:46:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6807", 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.994 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6804", 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6805", 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4096931368 2024-09-13T18:46:45.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6801/4096931368", 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6803/4096931368", 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6807/4096931368", 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6805/4096931368", 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 7, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "uuid": "97880368-e206-4217-aeee-cf13756aa32b", 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "up": 1, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "in": 1, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "weight": 1, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_affinity": 1, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_begin": 0, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "last_clean_end": 0, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "up_from": 14, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "up_thru": 52, 2024-09-13T18:46:45.997 INFO:teuthology.orchestra.run.smithi032.stdout: "down_at": 0, 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "lost_at": 0, 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrs": { 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6809", 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6812", 2024-09-13T18:46:45.998 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addrs": { 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6814", 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:45.999 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6816", 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addrs": { 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6824", 2024-09-13T18:46:46.000 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6826", 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addrs": { 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: "addrvec": [ 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.001 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v2", 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6818", 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "172.21.15.86:6821", 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 943661157 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "172.21.15.86:6812/943661157", 2024-09-13T18:46:46.002 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "172.21.15.86:6816/943661157", 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_back_addr": "172.21.15.86:6826/943661157", 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_front_addr": "172.21.15.86:6821/943661157", 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "state": [ 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "exists", 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "up" 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_xinfo": [ 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 0, 2024-09-13T18:46:46.003 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.712403+0000", 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 1, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.004 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.585781+0000", 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 2, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.005 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.661542+0000", 2024-09-13T18:46:46.006 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.006 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 3, 2024-09-13T18:46:46.006 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.006 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.007 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.680620+0000", 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 4, 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.008 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.198765+0000", 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 5, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.009 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.211743+0000", 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 6, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:46.007910+0000", 2024-09-13T18:46:46.010 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": 7, 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "down_stamp": "0.000000", 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_probability": 0, 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "laggy_interval": 0, 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "features": 4540138322906710015, 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "old_weight": 0, 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "last_purged_snaps_scrub": "2024-09-13T18:44:45.769729+0000", 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "dead_epoch": 0 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:46.011 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_upmap": [ 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: "pgid": "4.17", 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: "osds": [ 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: 6, 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: 4, 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: 7, 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: 5 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_upmap_items": [ 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.012 INFO:teuthology.orchestra.run.smithi032.stdout: "pgid": "3.39", 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mappings": [ 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "from": 0, 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "to": 7 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "pgid": "4.18", 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "mappings": [ 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "from": 7, 2024-09-13T18:46:46.013 INFO:teuthology.orchestra.run.smithi032.stdout: "to": 0 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_upmap_primaries": [], 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "pg_temp": [], 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "primary_temp": [], 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklist": {}, 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "range_blocklist": {}, 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_profiles": { 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_data_ec": { 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-device-class": "", 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-failure-domain": "osd", 2024-09-13T18:46:46.014 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-root": "default", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "k": "2", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "m": "2", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin": "jerasure", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "technique": "reed_sol_van", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "w": "8" 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "default": { 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "crush-failure-domain": "osd", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "k": "2", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "m": "1", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin": "jerasure", 2024-09-13T18:46:46.015 INFO:teuthology.orchestra.run.smithi032.stdout: "technique": "reed_sol_van" 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "removed_snaps_queue": [], 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "new_removed_snaps": [], 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "new_purged_snaps": [], 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_node_flags": {}, 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "device_class_flags": {}, 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_mode": { 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_mode_enabled": false, 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_bucket_count": 0, 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:46:46.016 INFO:teuthology.orchestra.run.smithi032.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:46:46.017 INFO:teuthology.orchestra.run.smithi032.stdout: "stretch_mode_bucket": 0 2024-09-13T18:46:46.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.017 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:46.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8534066730 msgr2=0x7f8534068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8534066730 0x7f8534068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f85480113d0 tx=0x7f8548009240 comp rx=0 tx=0).stop 2024-09-13T18:46:46.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85540c6f70 msgr2=0x7f855415c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85540c6f70 0x7f855415c5c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f854c016000 tx=0x7f854c004af0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 shutdown_connections 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8534066730 0x7f8534068bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f85540c6f70 0x7f855415c5c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85540c6150 0x7f85541f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 --2- 172.21.15.32:0/2438145522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8554070a80 0x7f8554154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 >> 172.21.15.32:0/2438145522 conn(0x7f8554071080 msgr2=0x7f85541577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 shutdown_connections 2024-09-13T18:46:46.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:45.915+0000 7f8546a00700 1 -- 172.21.15.32:0/2438145522 wait complete. 2024-09-13T18:46:46.020 INFO:tasks.thrashosds.thrasher:j is {'epoch': 55, 'fsid': 'e3c44028-1b11-4958-a433-ecab24d0f05e', 'created': '2024-09-13T18:44:38.402959+0000', 'modified': '2024-09-13T18:46:45.299926+0000', 'last_up_change': '2024-09-13T18:44:49.741600+0000', 'last_in_change': '2024-09-13T18:46:40.269675+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': '973dc52d-4a57-489e-b680-f484a091a77f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6813', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6815', 'nonce': 3679908055}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6816', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6818', 'nonce': 3679908055}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6822', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6823', 'nonce': 3679908055}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6820', 'nonce': 3679908055}, {'type': 'v1', 'addr': '172.21.15.32:6821', 'nonce': 3679908055}]}, 'public_addr': '172.21.15.32:6815/3679908055', 'cluster_addr': '172.21.15.32:6818/3679908055', 'heartbeat_back_addr': '172.21.15.32:6823/3679908055', 'heartbeat_front_addr': '172.21.15.32:6821/3679908055', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '354ae97e-51cf-423c-b257-37bf8960729b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6800', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6801', 'nonce': 1416437982}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6802', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6803', 'nonce': 1416437982}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6806', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6807', 'nonce': 1416437982}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6804', 'nonce': 1416437982}, {'type': 'v1', 'addr': '172.21.15.32:6805', 'nonce': 1416437982}]}, 'public_addr': '172.21.15.32:6801/1416437982', 'cluster_addr': '172.21.15.32:6803/1416437982', 'heartbeat_back_addr': '172.21.15.32:6807/1416437982', 'heartbeat_front_addr': '172.21.15.32:6805/1416437982', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'b76494fe-9ae4-4444-8f25-15b7bb18dece', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6808', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6809', 'nonce': 1016396602}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6810', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6811', 'nonce': 1016396602}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6817', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6819', 'nonce': 1016396602}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6812', 'nonce': 1016396602}, {'type': 'v1', 'addr': '172.21.15.32:6814', 'nonce': 1016396602}]}, 'public_addr': '172.21.15.32:6809/1016396602', 'cluster_addr': '172.21.15.32:6811/1016396602', 'heartbeat_back_addr': '172.21.15.32:6819/1016396602', 'heartbeat_front_addr': '172.21.15.32:6814/1016396602', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3b89a1fa-2088-4a23-b1e6-31644ebc6000', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6824', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6825', 'nonce': 2476570305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6826', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6827', 'nonce': 2476570305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6830', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6831', 'nonce': 2476570305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6828', 'nonce': 2476570305}, {'type': 'v1', 'addr': '172.21.15.32:6829', 'nonce': 2476570305}]}, 'public_addr': '172.21.15.32:6825/2476570305', 'cluster_addr': '172.21.15.32:6827/2476570305', 'heartbeat_back_addr': '172.21.15.32:6831/2476570305', 'heartbeat_front_addr': '172.21.15.32:6829/2476570305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '63973273-0c32-404c-9eb2-943b451d3da7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6808', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6811', 'nonce': 838245911}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6815', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6819', 'nonce': 838245911}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6829', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6831', 'nonce': 838245911}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6822', 'nonce': 838245911}, {'type': 'v1', 'addr': '172.21.15.86:6825', 'nonce': 838245911}]}, 'public_addr': '172.21.15.86:6811/838245911', 'cluster_addr': '172.21.15.86:6819/838245911', 'heartbeat_back_addr': '172.21.15.86:6831/838245911', 'heartbeat_front_addr': '172.21.15.86:6825/838245911', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2678edb8-ca2a-497a-8439-5f1dc709dbe8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6810', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6813', 'nonce': 2187629356}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6817', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6820', 'nonce': 2187629356}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6828', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6830', 'nonce': 2187629356}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6823', 'nonce': 2187629356}, {'type': 'v1', 'addr': '172.21.15.86:6827', 'nonce': 2187629356}]}, 'public_addr': '172.21.15.86:6813/2187629356', 'cluster_addr': '172.21.15.86:6820/2187629356', 'heartbeat_back_addr': '172.21.15.86:6830/2187629356', 'heartbeat_front_addr': '172.21.15.86:6827/2187629356', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8adaa119-857f-4d43-bf54-dcac614aba37', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6801', 'nonce': 4096931368}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6802', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 4096931368}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6806', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 4096931368}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 4096931368}, {'type': 'v1', 'addr': '172.21.15.86:6805', 'nonce': 4096931368}]}, 'public_addr': '172.21.15.86:6801/4096931368', 'cluster_addr': '172.21.15.86:6803/4096931368', 'heartbeat_back_addr': '172.21.15.86:6807/4096931368', 'heartbeat_front_addr': '172.21.15.86:6805/4096931368', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '97880368-e206-4217-aeee-cf13756aa32b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6809', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6812', 'nonce': 943661157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6814', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6816', 'nonce': 943661157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6824', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6826', 'nonce': 943661157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6818', 'nonce': 943661157}, {'type': 'v1', 'addr': '172.21.15.86:6821', 'nonce': 943661157}]}, 'public_addr': '172.21.15.86:6812/943661157', 'cluster_addr': '172.21.15.86:6816/943661157', 'heartbeat_back_addr': '172.21.15.86:6826/943661157', 'heartbeat_front_addr': '172.21.15.86:6821/943661157', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.712403+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.585781+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.661542+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.680620+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.198765+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.211743+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:46.007910+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T18:44:45.769729+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.17', 'osds': [6, 4, 7, 5]}], 'pg_upmap_items': [{'pgid': '3.39', 'mappings': [{'from': 0, 'to': 7}]}, {'pgid': '4.18', 'mappings': [{'from': 7, 'to': 0}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T18:46:46.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:46:46.053 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:46.054 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:46.054 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:46.054 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:46.054 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:46.054 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:46.047+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:46.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:46.123 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:46.118+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:46.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 Processor -- start 2024-09-13T18:46:46.215 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 -- start start 2024-09-13T18:46:46.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8d0151680 0x7fd8d00c9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d00ca550 0x7fd8d0157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd8d0158040 0x7fd8d006c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d015a940 con 0x7fd8d0151680 2024-09-13T18:46:46.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d01573d0 con 0x7fd8d0158040 2024-09-13T18:46:46.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d015b8f0 con 0x7fd8d00ca550 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8d0151680 0x7fd8d00c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cf400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d00ca550 0x7fd8d0157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cf400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d00ca550 0x7fd8d0157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54276/0 (socket says 172.21.15.32:54276) 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cf400700 1 -- 172.21.15.32:0/680836479 learned_addr learned my addr 172.21.15.32:0/680836479 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd8d0151680 0x7fd8d00c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46948/0 (socket says 172.21.15.32:46948) 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8d4a00700 1 --2- 172.21.15.32:0/680836479 >> v2:172.21.15.86:3300/0 conn(0x7fd8d0158040 0x7fd8d006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 -- 172.21.15.32:0/680836479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d00ca550 msgr2=0x7fd8d0157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 --2- 172.21.15.32:0/680836479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d00ca550 0x7fd8d0157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 -- 172.21.15.32:0/680836479 >> v2:172.21.15.86:3300/0 conn(0x7fd8d0158040 msgr2=0x7fd8d006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 --2- 172.21.15.32:0/680836479 >> v2:172.21.15.86:3300/0 conn(0x7fd8d0158040 0x7fd8d006c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.211+0000 7fd8cfe00700 1 -- 172.21.15.32:0/680836479 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00c99d0 con 0x7fd8d0151680 2024-09-13T18:46:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8cfe00700 1 --2- 172.21.15.32:0/680836479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d0151680 0x7fd8d00c9490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd8d006f290 tx=0x7fd8c0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9052c039104b1b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8cea00700 1 -- 172.21.15.32:0/680836479 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011830 con 0x7fd8d0151680 2024-09-13T18:46:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8cea00700 1 -- 172.21.15.32:0/680836479 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c0011990 con 0x7fd8d0151680 2024-09-13T18:46:46.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8cea00700 1 -- 172.21.15.32:0/680836479 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011d20 con 0x7fd8d0151680 2024-09-13T18:46:46.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 -- 172.21.15.32:0/680836479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d0151680 msgr2=0x7fd8d00c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 --2- 172.21.15.32:0/680836479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d0151680 0x7fd8d00c9490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd8d006f290 tx=0x7fd8c0009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:46.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 -- 172.21.15.32:0/680836479 shutdown_connections 2024-09-13T18:46:46.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 --2- 172.21.15.32:0/680836479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d00ca550 0x7fd8d0157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 --2- 172.21.15.32:0/680836479 >> v2:172.21.15.86:3300/0 conn(0x7fd8d0158040 0x7fd8d006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 --2- 172.21.15.32:0/680836479 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d0151680 0x7fd8d00c9490 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 -- 172.21.15.32:0/680836479 >> 172.21.15.32:0/680836479 conn(0x7fd8d006a390 msgr2=0x7fd8d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:46.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 -- 172.21.15.32:0/680836479 shutdown_connections 2024-09-13T18:46:46.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.215+0000 7fd8d5400700 1 -- 172.21.15.32:0/680836479 wait complete. 2024-09-13T18:46:46.223 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:46.218+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 Processor -- start 2024-09-13T18:46:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 -- start start 2024-09-13T18:46:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 0x7fd8d014c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8d0151680 0x7fd8d00c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d0158040 0x7fd8d01f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f2d50 con 0x7fd8d00ca550 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00cc250 con 0x7fd8d0151680 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d5400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f2a70 con 0x7fd8d0158040 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 0x7fd8d014c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 0x7fd8d014c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46952/0 (socket says 172.21.15.32:46952) 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 -- 172.21.15.32:0/690032994 learned_addr learned my addr 172.21.15.32:0/690032994 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cf400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8d0151680 0x7fd8d00c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d4a00700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d0158040 0x7fd8d01f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 -- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d0158040 msgr2=0x7fd8d01f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d0158040 0x7fd8d01f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 -- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8d0151680 msgr2=0x7fd8d00c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8d0151680 0x7fd8d00c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8cfe00700 1 -- 172.21.15.32:0/690032994 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00094b0 con 0x7fd8d00ca550 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.219+0000 7fd8d4a00700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d0158040 0x7fd8d01f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8cfe00700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 0x7fd8d014c5c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00090b0 tx=0x7fd8c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00044d0 con 0x7fd8d00ca550 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c001e070 con 0x7fd8d00ca550 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d00cb920 con 0x7fd8d00ca550 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0003900 con 0x7fd8d00ca550 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d00cbee0 con 0x7fd8d00ca550 2024-09-13T18:46:46.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d01575e0 con 0x7fd8d00ca550 2024-09-13T18:46:46.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.223+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8c0003a60 con 0x7fd8d00ca550 2024-09-13T18:46:46.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.227+0000 7fd8c7e00700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd8b0066730 0x7fd8b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.227+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fd8c00851f0 con 0x7fd8d00ca550 2024-09-13T18:46:46.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.227+0000 7fd8cf400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd8b0066730 0x7fd8b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.227+0000 7fd8cf400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd8b0066730 0x7fd8b0068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00c6530 tx=0x7fd8bc0092e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.235+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8c00521f0 con 0x7fd8d00ca550 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.325 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.998945899000006, 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:46.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.998925978000003, 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.331 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:46.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:46.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.998913552000005, 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:46.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:46.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.998905828999995, 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.346 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.998865644999995, 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:46.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:46.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.994885762999999, 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:46.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.993521216000005, 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.355 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:46.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.993483785999999, 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:46.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.993019406000002, 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:46.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.367 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.992588041000005, 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:46.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.991979626000003, 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:46.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.375 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.991585208000004, 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:46.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:46.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.991531187999996, 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:46.380 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:46.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 99.990046475, 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:ff5b34d6:::1.00000000:head, version: 26'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:ff5b34d6:::1.00000000:head@26'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.9678555729999996, 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034838499999999999, 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352959+0000", 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352975+0000", 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352987+0000", 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1989e-05 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353001+0000", 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4423000000000001e-05 2024-09-13T18:46:46.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353061+0000", 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9616e-05 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353073+0000", 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659e-05 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353308+0000", 2024-09-13T18:46:46.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023517500000000001 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.7 53/52 [PushOp(2:e0b41d06:::609.00000000:head, version: 25'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:e0b41d06:::609.00000000:head@25'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.9675956750000001, 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000323679, 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.393 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353231+0000", 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2559e-05 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353244+0000", 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2952000000000001e-05 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353258+0000", 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4218e-05 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353335+0000", 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6889000000000002e-05 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353341+0000", 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9630000000000003e-06 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353543+0000", 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020175099999999999 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:fe07bba1:::100.00000000.inode:head, version: 26'3, data_included: [0~582], data_size: 582, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:fe07bba1:::100.00000000.inode:head@26'3, size: 582, copy_subset: [0~582], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:582, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.9575815109999999, 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045910699999999999, 2024-09-13T18:46:46.397 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363233+0000", 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363248+0000", 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5116000000000001e-05 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363269+0000", 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1433999999999998e-05 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363285+0000", 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5342999999999999e-05 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363354+0000", 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9274000000000001e-05 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363362+0000", 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2439999999999993e-06 2024-09-13T18:46:46.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363693+0000", 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033038099999999998 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.b 53/52 [PushOp(2:d0630e4c:::mds0_sessionmap:head, version: 25'1, data_included: [], data_size: 0, omap_header_size: 14, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:d0630e4c:::mds0_sessionmap:head@25'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.9565222880000004, 2024-09-13T18:46:46.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043993199999999997, 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364292+0000", 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364304+0000", 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1576000000000001e-05 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364317+0000", 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3227999999999999e-05 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364329+0000", 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2383e-05 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364400+0000", 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0310999999999998e-05 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364413+0000", 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2994e-05 2024-09-13T18:46:46.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364733+0000", 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000320088 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:46.405 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:46.406 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:46.322+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:46.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:46.452 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:46.450+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:46.526 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:46.526 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:46.526 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:46.526 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:46.526 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:46.522+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:46.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:46.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.547+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8d00cd930 con 0x7fd8b0066730 2024-09-13T18:46:46.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.559+0000 7fd8c7e00700 1 -- 172.21.15.32:0/690032994 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367540 (secure 0 0 0) 0x7fd8bc011780 con 0x7fd8b0066730 2024-09-13T18:46:46.572 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd8b0066730 msgr2=0x7fd8b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd8b0066730 0x7fd8b0068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00c6530 tx=0x7fd8bc0092e0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 msgr2=0x7fd8d014c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 0x7fd8d014c5c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00090b0 tx=0x7fd8c0004770 comp rx=0 tx=0).stop 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 shutdown_connections 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd8b0066730 0x7fd8b0068bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd8d0158040 0x7fd8d01f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8d0151680 0x7fd8d00c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 --2- 172.21.15.32:0/690032994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8d00ca550 0x7fd8d014c5c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 >> 172.21.15.32:0/690032994 conn(0x7fd8d006a390 msgr2=0x7fd8d006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:46.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 shutdown_connections 2024-09-13T18:46:46.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.571+0000 7fd8d5400700 1 -- 172.21.15.32:0/690032994 wait complete. 2024-09-13T18:46:46.577 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:46:46.591 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:46.596 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-13T18:46:46.099615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598905,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":350,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246792,"kb_used_data":6032,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754727928,"statfs":{"total":773094113280,"available":772841398272,"internally_reserved":0,"allocated":6176768,"data_stored":3594258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.820120"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.367075+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:46:41.367075+0000","last_peered":"2024-09-13T18:46:41.367075+0000","last_clean":"2024-09-13T18:46:41.367075+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:46:41.367075+0000","last_undegraded":"2024-09-13T18:46:41.367075+0000","last_fullsized":"2024-09-13T18:46:41.367075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298176+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:46:41.298176+0000","last_peered":"2024-09-13T18:46:41.298176+0000","last_clean":"2024-09-13T18:46:41.298176+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:46:41.298176+0000","last_undegraded":"2024-09-13T18:46:41.298176+0000","last_fullsized":"2024-09-13T18:46:41.298176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.299846+0000","last_change":"2024-09-13T18:46:17.888737+0000","last_active":"2024-09-13T18:46:41.299846+0000","last_peered":"2024-09-13T18:46:41.299846+0000","last_clean":"2024-09-13T18:46:41.299846+0000","last_became_active":"2024-09-13T18:46:17.888200+0000","last_became_peered":"2024-09-13T18:46:17.888200+0000","last_unstale":"2024-09-13T18:46:41.299846+0000","last_undegraded":"2024-09-13T18:46:41.299846+0000","last_fullsized":"2024-09-13T18:46:41.299846+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:47.183329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298468+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:46:41.298468+0000","last_peered":"2024-09-13T18:46:41.298468+0000","last_clean":"2024-09-13T18:46:41.298468+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:46:41.298468+0000","last_undegraded":"2024-09-13T18:46:41.298468+0000","last_fullsized":"2024-09-13T18:46:41.298468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298852+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:46:41.298852+0000","last_peered":"2024-09-13T18:46:41.298852+0000","last_clean":"2024-09-13T18:46:41.298852+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:46:41.298852+0000","last_undegraded":"2024-09-13T18:46:41.298852+0000","last_fullsized":"2024-09-13T18:46:41.298852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.311652+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:46:41.311652+0000","last_peered":"2024-09-13T18:46:41.311652+0000","last_clean":"2024-09-13T18:46:41.311652+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:46:41.311652+0000","last_undegraded":"2024-09-13T18:46:41.311652+0000","last_fullsized":"2024-09-13T18:46:41.311652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":44,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.307804+0000","last_change":"2024-09-13T18:45:00.856556+0000","last_active":"2024-09-13T18:46:41.307804+0000","last_peered":"2024-09-13T18:46:41.307804+0000","last_clean":"2024-09-13T18:46:41.307804+0000","last_became_active":"2024-09-13T18:45:00.856265+0000","last_became_peered":"2024-09-13T18:45:00.856265+0000","last_unstale":"2024-09-13T18:46:41.307804+0000","last_undegraded":"2024-09-13T18:46:41.307804+0000","last_fullsized":"2024-09-13T18:46:41.307804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:18.107597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.296093+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:46:41.296093+0000","last_peered":"2024-09-13T18:46:41.296093+0000","last_clean":"2024-09-13T18:46:41.296093+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:46:41.296093+0000","last_undegraded":"2024-09-13T18:46:41.296093+0000","last_fullsized":"2024-09-13T18:46:41.296093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.354136+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:46:41.354136+0000","last_peered":"2024-09-13T18:46:41.354136+0000","last_clean":"2024-09-13T18:46:41.354136+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:46:41.354136+0000","last_undegraded":"2024-09-13T18:46:41.354136+0000","last_fullsized":"2024-09-13T18:46:41.354136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":44,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.306309+0000","last_change":"2024-09-13T18:45:00.855255+0000","last_active":"2024-09-13T18:46:41.306309+0000","last_peered":"2024-09-13T18:46:41.306309+0000","last_clean":"2024-09-13T18:46:41.306309+0000","last_became_active":"2024-09-13T18:45:00.855027+0000","last_became_peered":"2024-09-13T18:45:00.855027+0000","last_unstale":"2024-09-13T18:46:41.306309+0000","last_undegraded":"2024-09-13T18:46:41.306309+0000","last_fullsized":"2024-09-13T18:46:41.306309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:26.506528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821504+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:46:42.821504+0000","last_peered":"2024-09-13T18:46:42.821504+0000","last_clean":"2024-09-13T18:46:42.821504+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:46:42.821504+0000","last_undegraded":"2024-09-13T18:46:42.821504+0000","last_fullsized":"2024-09-13T18:46:42.821504+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.310227+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:46:41.310227+0000","last_peered":"2024-09-13T18:46:41.310227+0000","last_clean":"2024-09-13T18:46:41.310227+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:46:41.310227+0000","last_undegraded":"2024-09-13T18:46:41.310227+0000","last_fullsized":"2024-09-13T18:46:41.310227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820910+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:46:42.820910+0000","last_peered":"2024-09-13T18:46:42.820910+0000","last_clean":"2024-09-13T18:46:42.820910+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:46:42.820910+0000","last_undegraded":"2024-09-13T18:46:42.820910+0000","last_fullsized":"2024-09-13T18:46:42.820910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.822012+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:46:42.822012+0000","last_peered":"2024-09-13T18:46:42.822012+0000","last_clean":"2024-09-13T18:46:42.822012+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:46:42.822012+0000","last_undegraded":"2024-09-13T18:46:42.822012+0000","last_fullsized":"2024-09-13T18:46:42.822012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821841+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:46:42.821841+0000","last_peered":"2024-09-13T18:46:42.821841+0000","last_clean":"2024-09-13T18:46:42.821841+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:46:42.821841+0000","last_undegraded":"2024-09-13T18:46:42.821841+0000","last_fullsized":"2024-09-13T18:46:42.821841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.301863+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:46:41.301863+0000","last_peered":"2024-09-13T18:46:41.301863+0000","last_clean":"2024-09-13T18:46:41.301863+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:46:41.301863+0000","last_undegraded":"2024-09-13T18:46:41.301863+0000","last_fullsized":"2024-09-13T18:46:41.301863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.302607+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:46:41.302607+0000","last_peered":"2024-09-13T18:46:41.302607+0000","last_clean":"2024-09-13T18:46:41.302607+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:46:41.302607+0000","last_undegraded":"2024-09-13T18:46:41.302607+0000","last_fullsized":"2024-09-13T18:46:41.302607+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.305935+0000","last_change":"2024-09-13T18:46:17.888387+0000","last_active":"2024-09-13T18:46:41.305935+0000","last_peered":"2024-09-13T18:46:41.305935+0000","last_clean":"2024-09-13T18:46:41.305935+0000","last_became_active":"2024-09-13T18:46:17.887921+0000","last_became_peered":"2024-09-13T18:46:17.887921+0000","last_unstale":"2024-09-13T18:46:41.305935+0000","last_undegraded":"2024-09-13T18:46:41.305935+0000","last_fullsized":"2024-09-13T18:46:41.305935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:36.763250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.301264+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:46:41.301264+0000","last_peered":"2024-09-13T18:46:41.301264+0000","last_clean":"2024-09-13T18:46:41.301264+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:46:41.301264+0000","last_undegraded":"2024-09-13T18:46:41.301264+0000","last_fullsized":"2024-09-13T18:46:41.301264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.302116+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:46:41.302116+0000","last_peered":"2024-09-13T18:46:41.302116+0000","last_clean":"2024-09-13T18:46:41.302116+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:46:41.302116+0000","last_undegraded":"2024-09-13T18:46:41.302116+0000","last_fullsized":"2024-09-13T18:46:41.302116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.322319+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:46:41.322319+0000","last_peered":"2024-09-13T18:46:41.322319+0000","last_clean":"2024-09-13T18:46:41.322319+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:46:41.322319+0000","last_undegraded":"2024-09-13T18:46:41.322319+0000","last_fullsized":"2024-09-13T18:46:41.322319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820745+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:46:42.820745+0000","last_peered":"2024-09-13T18:46:42.820745+0000","last_clean":"2024-09-13T18:46:42.820745+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:46:42.820745+0000","last_undegraded":"2024-09-13T18:46:42.820745+0000","last_fullsized":"2024-09-13T18:46:42.820745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304214+0000","last_change":"2024-09-13T18:45:00.856564+0000","last_active":"2024-09-13T18:46:41.304214+0000","last_peered":"2024-09-13T18:46:41.304214+0000","last_clean":"2024-09-13T18:46:41.304214+0000","last_became_active":"2024-09-13T18:45:00.855895+0000","last_became_peered":"2024-09-13T18:45:00.855895+0000","last_unstale":"2024-09-13T18:46:41.304214+0000","last_undegraded":"2024-09-13T18:46:41.304214+0000","last_fullsized":"2024-09-13T18:46:41.304214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:09.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.354985+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:46:41.354985+0000","last_peered":"2024-09-13T18:46:41.354985+0000","last_clean":"2024-09-13T18:46:41.354985+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:46:41.354985+0000","last_undegraded":"2024-09-13T18:46:41.354985+0000","last_fullsized":"2024-09-13T18:46:41.354985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303831+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:46:41.303831+0000","last_peered":"2024-09-13T18:46:41.303831+0000","last_clean":"2024-09-13T18:46:41.303831+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:46:41.303831+0000","last_undegraded":"2024-09-13T18:46:41.303831+0000","last_fullsized":"2024-09-13T18:46:41.303831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.822322+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:46:42.822322+0000","last_peered":"2024-09-13T18:46:42.822322+0000","last_clean":"2024-09-13T18:46:42.822322+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:46:42.822322+0000","last_undegraded":"2024-09-13T18:46:42.822322+0000","last_fullsized":"2024-09-13T18:46:42.822322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.343977+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:46:41.343977+0000","last_peered":"2024-09-13T18:46:41.343977+0000","last_clean":"2024-09-13T18:46:41.343977+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:46:41.343977+0000","last_undegraded":"2024-09-13T18:46:41.343977+0000","last_fullsized":"2024-09-13T18:46:41.343977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.305032+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:46:41.305032+0000","last_peered":"2024-09-13T18:46:41.305032+0000","last_clean":"2024-09-13T18:46:41.305032+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:46:41.305032+0000","last_undegraded":"2024-09-13T18:46:41.305032+0000","last_fullsized":"2024-09-13T18:46:41.305032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"44'4","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304639+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:46:41.304639+0000","last_peered":"2024-09-13T18:46:41.304639+0000","last_clean":"2024-09-13T18:46:41.304639+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:46:41.304639+0000","last_undegraded":"2024-09-13T18:46:41.304639+0000","last_fullsized":"2024-09-13T18:46:41.304639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.328101+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:46:41.328101+0000","last_peered":"2024-09-13T18:46:41.328101+0000","last_clean":"2024-09-13T18:46:41.328101+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:46:41.328101+0000","last_undegraded":"2024-09-13T18:46:41.328101+0000","last_fullsized":"2024-09-13T18:46:41.328101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303511+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:46:41.303511+0000","last_peered":"2024-09-13T18:46:41.303511+0000","last_clean":"2024-09-13T18:46:41.303511+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:46:41.303511+0000","last_undegraded":"2024-09-13T18:46:41.303511+0000","last_fullsized":"2024-09-13T18:46:41.303511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821710+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:46:42.821710+0000","last_peered":"2024-09-13T18:46:42.821710+0000","last_clean":"2024-09-13T18:46:42.821710+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:46:42.821710+0000","last_undegraded":"2024-09-13T18:46:42.821710+0000","last_fullsized":"2024-09-13T18:46:42.821710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.302923+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:46:41.302923+0000","last_peered":"2024-09-13T18:46:41.302923+0000","last_clean":"2024-09-13T18:46:41.302923+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:46:41.302923+0000","last_undegraded":"2024-09-13T18:46:41.302923+0000","last_fullsized":"2024-09-13T18:46:41.302923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.319356+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:46:41.319356+0000","last_peered":"2024-09-13T18:46:41.319356+0000","last_clean":"2024-09-13T18:46:41.319356+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:46:41.319356+0000","last_undegraded":"2024-09-13T18:46:41.319356+0000","last_fullsized":"2024-09-13T18:46:41.319356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298140+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:46:41.298140+0000","last_peered":"2024-09-13T18:46:41.298140+0000","last_clean":"2024-09-13T18:46:41.298140+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:46:41.298140+0000","last_undegraded":"2024-09-13T18:46:41.298140+0000","last_fullsized":"2024-09-13T18:46:41.298140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.335027+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:46:41.335027+0000","last_peered":"2024-09-13T18:46:41.335027+0000","last_clean":"2024-09-13T18:46:41.335027+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:46:41.335027+0000","last_undegraded":"2024-09-13T18:46:41.335027+0000","last_fullsized":"2024-09-13T18:46:41.335027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.305800+0000","last_change":"2024-09-13T18:45:01.337077+0000","last_active":"2024-09-13T18:46:41.305800+0000","last_peered":"2024-09-13T18:46:41.305800+0000","last_clean":"2024-09-13T18:46:41.305800+0000","last_became_active":"2024-09-13T18:45:01.332541+0000","last_became_peered":"2024-09-13T18:45:01.332541+0000","last_unstale":"2024-09-13T18:46:41.305800+0000","last_undegraded":"2024-09-13T18:46:41.305800+0000","last_fullsized":"2024-09-13T18:46:41.305800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:46.501040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820747+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:46:42.820747+0000","last_peered":"2024-09-13T18:46:42.820747+0000","last_clean":"2024-09-13T18:46:42.820747+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:46:42.820747+0000","last_undegraded":"2024-09-13T18:46:42.820747+0000","last_fullsized":"2024-09-13T18:46:42.820747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.334967+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:46:41.334967+0000","last_peered":"2024-09-13T18:46:41.334967+0000","last_clean":"2024-09-13T18:46:41.334967+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:46:41.334967+0000","last_undegraded":"2024-09-13T18:46:41.334967+0000","last_fullsized":"2024-09-13T18:46:41.334967+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297649+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:46:41.297649+0000","last_peered":"2024-09-13T18:46:41.297649+0000","last_clean":"2024-09-13T18:46:41.297649+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:46:41.297649+0000","last_undegraded":"2024-09-13T18:46:41.297649+0000","last_fullsized":"2024-09-13T18:46:41.297649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.300155+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:46:41.300155+0000","last_peered":"2024-09-13T18:46:41.300155+0000","last_clean":"2024-09-13T18:46:41.300155+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:46:41.300155+0000","last_undegraded":"2024-09-13T18:46:41.300155+0000","last_fullsized":"2024-09-13T18:46:41.300155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304264+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:46:41.304264+0000","last_peered":"2024-09-13T18:46:41.304264+0000","last_clean":"2024-09-13T18:46:41.304264+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:46:41.304264+0000","last_undegraded":"2024-09-13T18:46:41.304264+0000","last_fullsized":"2024-09-13T18:46:41.304264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.301614+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:46:41.301614+0000","last_peered":"2024-09-13T18:46:41.301614+0000","last_clean":"2024-09-13T18:46:41.301614+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:46:41.301614+0000","last_undegraded":"2024-09-13T18:46:41.301614+0000","last_fullsized":"2024-09-13T18:46:41.301614+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820550+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:46:42.820550+0000","last_peered":"2024-09-13T18:46:42.820550+0000","last_clean":"2024-09-13T18:46:42.820550+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:46:42.820550+0000","last_undegraded":"2024-09-13T18:46:42.820550+0000","last_fullsized":"2024-09-13T18:46:42.820550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297782+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:46:41.297782+0000","last_peered":"2024-09-13T18:46:41.297782+0000","last_clean":"2024-09-13T18:46:41.297782+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:46:41.297782+0000","last_undegraded":"2024-09-13T18:46:41.297782+0000","last_fullsized":"2024-09-13T18:46:41.297782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304397+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:46:41.304397+0000","last_peered":"2024-09-13T18:46:41.304397+0000","last_clean":"2024-09-13T18:46:41.304397+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:46:41.304397+0000","last_undegraded":"2024-09-13T18:46:41.304397+0000","last_fullsized":"2024-09-13T18:46:41.304397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820948+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:46:42.820948+0000","last_peered":"2024-09-13T18:46:42.820948+0000","last_clean":"2024-09-13T18:46:42.820948+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:46:42.820948+0000","last_undegraded":"2024-09-13T18:46:42.820948+0000","last_fullsized":"2024-09-13T18:46:42.820948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.293072+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:46:41.293072+0000","last_peered":"2024-09-13T18:46:41.293072+0000","last_clean":"2024-09-13T18:46:41.293072+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:46:41.293072+0000","last_undegraded":"2024-09-13T18:46:41.293072+0000","last_fullsized":"2024-09-13T18:46:41.293072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821645+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:46:42.821645+0000","last_peered":"2024-09-13T18:46:42.821645+0000","last_clean":"2024-09-13T18:46:42.821645+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:46:42.821645+0000","last_undegraded":"2024-09-13T18:46:42.821645+0000","last_fullsized":"2024-09-13T18:46:42.821645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821425+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:46:42.821425+0000","last_peered":"2024-09-13T18:46:42.821425+0000","last_clean":"2024-09-13T18:46:42.821425+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:46:42.821425+0000","last_undegraded":"2024-09-13T18:46:42.821425+0000","last_fullsized":"2024-09-13T18:46:42.821425+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303302+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:46:41.303302+0000","last_peered":"2024-09-13T18:46:41.303302+0000","last_clean":"2024-09-13T18:46:41.303302+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:46:41.303302+0000","last_undegraded":"2024-09-13T18:46:41.303302+0000","last_fullsized":"2024-09-13T18:46:41.303302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.341916+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:46:41.341916+0000","last_peered":"2024-09-13T18:46:41.341916+0000","last_clean":"2024-09-13T18:46:41.341916+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:46:41.341916+0000","last_undegraded":"2024-09-13T18:46:41.341916+0000","last_fullsized":"2024-09-13T18:46:41.341916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.306240+0000","last_change":"2024-09-13T18:45:01.330847+0000","last_active":"2024-09-13T18:46:41.306240+0000","last_peered":"2024-09-13T18:46:41.306240+0000","last_clean":"2024-09-13T18:46:41.306240+0000","last_became_active":"2024-09-13T18:45:01.330616+0000","last_became_peered":"2024-09-13T18:45:01.330616+0000","last_unstale":"2024-09-13T18:46:41.306240+0000","last_undegraded":"2024-09-13T18:46:41.306240+0000","last_fullsized":"2024-09-13T18:46:41.306240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.021946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297948+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:46:41.297948+0000","last_peered":"2024-09-13T18:46:41.297948+0000","last_clean":"2024-09-13T18:46:41.297948+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:46:41.297948+0000","last_undegraded":"2024-09-13T18:46:41.297948+0000","last_fullsized":"2024-09-13T18:46:41.297948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.334353+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:46:41.334353+0000","last_peered":"2024-09-13T18:46:41.334353+0000","last_clean":"2024-09-13T18:46:41.334353+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:46:41.334353+0000","last_undegraded":"2024-09-13T18:46:41.334353+0000","last_fullsized":"2024-09-13T18:46:41.334353+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.307965+0000","last_change":"2024-09-13T18:45:01.346559+0000","last_active":"2024-09-13T18:46:41.307965+0000","last_peered":"2024-09-13T18:46:41.307965+0000","last_clean":"2024-09-13T18:46:41.307965+0000","last_became_active":"2024-09-13T18:45:01.346315+0000","last_became_peered":"2024-09-13T18:45:01.346315+0000","last_unstale":"2024-09-13T18:46:41.307965+0000","last_undegraded":"2024-09-13T18:46:41.307965+0000","last_fullsized":"2024-09-13T18:46:41.307965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:33.427020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":45,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304593+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:46:41.304593+0000","last_peered":"2024-09-13T18:46:41.304593+0000","last_clean":"2024-09-13T18:46:41.304593+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:46:41.304593+0000","last_undegraded":"2024-09-13T18:46:41.304593+0000","last_fullsized":"2024-09-13T18:46:41.304593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820477+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:46:42.820477+0000","last_peered":"2024-09-13T18:46:42.820477+0000","last_clean":"2024-09-13T18:46:42.820477+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:46:42.820477+0000","last_undegraded":"2024-09-13T18:46:42.820477+0000","last_fullsized":"2024-09-13T18:46:42.820477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.320091+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:46:41.320091+0000","last_peered":"2024-09-13T18:46:41.320091+0000","last_clean":"2024-09-13T18:46:41.320091+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:46:41.320091+0000","last_undegraded":"2024-09-13T18:46:41.320091+0000","last_fullsized":"2024-09-13T18:46:41.320091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.308045+0000","last_change":"2024-09-13T18:45:00.852694+0000","last_active":"2024-09-13T18:46:41.308045+0000","last_peered":"2024-09-13T18:46:41.308045+0000","last_clean":"2024-09-13T18:46:41.308045+0000","last_became_active":"2024-09-13T18:45:00.852368+0000","last_became_peered":"2024-09-13T18:45:00.852368+0000","last_unstale":"2024-09-13T18:46:41.308045+0000","last_undegraded":"2024-09-13T18:46:41.308045+0000","last_fullsized":"2024-09-13T18:46:41.308045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:13.708570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.292928+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:46:41.292928+0000","last_peered":"2024-09-13T18:46:41.292928+0000","last_clean":"2024-09-13T18:46:41.292928+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:46:41.292928+0000","last_undegraded":"2024-09-13T18:46:41.292928+0000","last_fullsized":"2024-09-13T18:46:41.292928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820614+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:46:42.820614+0000","last_peered":"2024-09-13T18:46:42.820614+0000","last_clean":"2024-09-13T18:46:42.820614+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:46:42.820614+0000","last_undegraded":"2024-09-13T18:46:42.820614+0000","last_fullsized":"2024-09-13T18:46:42.820614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.301378+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:46:41.301378+0000","last_peered":"2024-09-13T18:46:41.301378+0000","last_clean":"2024-09-13T18:46:41.301378+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:46:41.301378+0000","last_undegraded":"2024-09-13T18:46:41.301378+0000","last_fullsized":"2024-09-13T18:46:41.301378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298901+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:46:41.298901+0000","last_peered":"2024-09-13T18:46:41.298901+0000","last_clean":"2024-09-13T18:46:41.298901+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:46:41.298901+0000","last_undegraded":"2024-09-13T18:46:41.298901+0000","last_fullsized":"2024-09-13T18:46:41.298901+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.292993+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:46:41.292993+0000","last_peered":"2024-09-13T18:46:41.292993+0000","last_clean":"2024-09-13T18:46:41.292993+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:46:41.292993+0000","last_undegraded":"2024-09-13T18:46:41.292993+0000","last_fullsized":"2024-09-13T18:46:41.292993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.326902+0000","last_change":"2024-09-13T18:46:41.323909+0000","last_active":"2024-09-13T18:46:41.326902+0000","last_peered":"2024-09-13T18:46:41.326902+0000","last_clean":"2024-09-13T18:46:41.326902+0000","last_became_active":"2024-09-13T18:46:41.323627+0000","last_became_peered":"2024-09-13T18:46:41.323627+0000","last_unstale":"2024-09-13T18:46:41.326902+0000","last_undegraded":"2024-09-13T18:46:41.326902+0000","last_fullsized":"2024-09-13T18:46:41.326902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:11.244383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303414+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:46:41.303414+0000","last_peered":"2024-09-13T18:46:41.303414+0000","last_clean":"2024-09-13T18:46:41.303414+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:46:41.303414+0000","last_undegraded":"2024-09-13T18:46:41.303414+0000","last_fullsized":"2024-09-13T18:46:41.303414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820818+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:46:42.820818+0000","last_peered":"2024-09-13T18:46:42.820818+0000","last_clean":"2024-09-13T18:46:42.820818+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:46:42.820818+0000","last_undegraded":"2024-09-13T18:46:42.820818+0000","last_fullsized":"2024-09-13T18:46:42.820818+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820828+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:46:42.820828+0000","last_peered":"2024-09-13T18:46:42.820828+0000","last_clean":"2024-09-13T18:46:42.820828+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:46:42.820828+0000","last_undegraded":"2024-09-13T18:46:42.820828+0000","last_fullsized":"2024-09-13T18:46:42.820828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303400+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:46:41.303400+0000","last_peered":"2024-09-13T18:46:41.303400+0000","last_clean":"2024-09-13T18:46:41.303400+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:46:41.303400+0000","last_undegraded":"2024-09-13T18:46:41.303400+0000","last_fullsized":"2024-09-13T18:46:41.303400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.334942+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:46:41.334942+0000","last_peered":"2024-09-13T18:46:41.334942+0000","last_clean":"2024-09-13T18:46:41.334942+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:46:41.334942+0000","last_undegraded":"2024-09-13T18:46:41.334942+0000","last_fullsized":"2024-09-13T18:46:41.334942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":44,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304172+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:46:41.304172+0000","last_peered":"2024-09-13T18:46:41.304172+0000","last_clean":"2024-09-13T18:46:41.304172+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:46:41.304172+0000","last_undegraded":"2024-09-13T18:46:41.304172+0000","last_fullsized":"2024-09-13T18:46:41.304172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821573+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:46:42.821573+0000","last_peered":"2024-09-13T18:46:42.821573+0000","last_clean":"2024-09-13T18:46:42.821573+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:46:42.821573+0000","last_undegraded":"2024-09-13T18:46:42.821573+0000","last_fullsized":"2024-09-13T18:46:42.821573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.307639+0000","last_change":"2024-09-13T18:46:17.892850+0000","last_active":"2024-09-13T18:46:41.307639+0000","last_peered":"2024-09-13T18:46:41.307639+0000","last_clean":"2024-09-13T18:46:41.307639+0000","last_became_active":"2024-09-13T18:46:17.892525+0000","last_became_peered":"2024-09-13T18:46:17.892525+0000","last_unstale":"2024-09-13T18:46:41.307639+0000","last_undegraded":"2024-09-13T18:46:41.307639+0000","last_fullsized":"2024-09-13T18:46:41.307639+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:57.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"42'14","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.318175+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:46:41.318175+0000","last_peered":"2024-09-13T18:46:41.318175+0000","last_clean":"2024-09-13T18:46:41.318175+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:46:41.318175+0000","last_undegraded":"2024-09-13T18:46:41.318175+0000","last_fullsized":"2024-09-13T18:46:41.318175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.328215+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:46:41.328215+0000","last_peered":"2024-09-13T18:46:41.328215+0000","last_clean":"2024-09-13T18:46:41.328215+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:46:41.328215+0000","last_undegraded":"2024-09-13T18:46:41.328215+0000","last_fullsized":"2024-09-13T18:46:41.328215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821311+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:46:42.821311+0000","last_peered":"2024-09-13T18:46:42.821311+0000","last_clean":"2024-09-13T18:46:42.821311+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:46:42.821311+0000","last_undegraded":"2024-09-13T18:46:42.821311+0000","last_fullsized":"2024-09-13T18:46:42.821311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":45,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304008+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:46:41.304008+0000","last_peered":"2024-09-13T18:46:41.304008+0000","last_clean":"2024-09-13T18:46:41.304008+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:46:41.304008+0000","last_undegraded":"2024-09-13T18:46:41.304008+0000","last_fullsized":"2024-09-13T18:46:41.304008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.342208+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:46:41.342208+0000","last_peered":"2024-09-13T18:46:41.342208+0000","last_clean":"2024-09-13T18:46:41.342208+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:46:41.342208+0000","last_undegraded":"2024-09-13T18:46:41.342208+0000","last_fullsized":"2024-09-13T18:46:41.342208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.334042+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:46:41.334042+0000","last_peered":"2024-09-13T18:46:41.334042+0000","last_clean":"2024-09-13T18:46:41.334042+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:46:41.334042+0000","last_undegraded":"2024-09-13T18:46:41.334042+0000","last_fullsized":"2024-09-13T18:46:41.334042+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.307818+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:46:41.307818+0000","last_peered":"2024-09-13T18:46:41.307818+0000","last_clean":"2024-09-13T18:46:41.307818+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:46:41.307818+0000","last_undegraded":"2024-09-13T18:46:41.307818+0000","last_fullsized":"2024-09-13T18:46:41.307818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.324601+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:46:41.324601+0000","last_peered":"2024-09-13T18:46:41.324601+0000","last_clean":"2024-09-13T18:46:41.324601+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:46:41.324601+0000","last_undegraded":"2024-09-13T18:46:41.324601+0000","last_fullsized":"2024-09-13T18:46:41.324601+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.341031+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:46:41.341031+0000","last_peered":"2024-09-13T18:46:41.341031+0000","last_clean":"2024-09-13T18:46:41.341031+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:46:41.341031+0000","last_undegraded":"2024-09-13T18:46:41.341031+0000","last_fullsized":"2024-09-13T18:46:41.341031+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298846+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:46:41.298846+0000","last_peered":"2024-09-13T18:46:41.298846+0000","last_clean":"2024-09-13T18:46:41.298846+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:46:41.298846+0000","last_undegraded":"2024-09-13T18:46:41.298846+0000","last_fullsized":"2024-09-13T18:46:41.298846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.328342+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:46:41.328342+0000","last_peered":"2024-09-13T18:46:41.328342+0000","last_clean":"2024-09-13T18:46:41.328342+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:46:41.328342+0000","last_undegraded":"2024-09-13T18:46:41.328342+0000","last_fullsized":"2024-09-13T18:46:41.328342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.328496+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:46:41.328496+0000","last_peered":"2024-09-13T18:46:41.328496+0000","last_clean":"2024-09-13T18:46:41.328496+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:46:41.328496+0000","last_undegraded":"2024-09-13T18:46:41.328496+0000","last_fullsized":"2024-09-13T18:46:41.328496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.301006+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:46:41.301006+0000","last_peered":"2024-09-13T18:46:41.301006+0000","last_clean":"2024-09-13T18:46:41.301006+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:46:41.301006+0000","last_undegraded":"2024-09-13T18:46:41.301006+0000","last_fullsized":"2024-09-13T18:46:41.301006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820317+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:46:42.820317+0000","last_peered":"2024-09-13T18:46:42.820317+0000","last_clean":"2024-09-13T18:46:42.820317+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:46:42.820317+0000","last_undegraded":"2024-09-13T18:46:42.820317+0000","last_fullsized":"2024-09-13T18:46:42.820317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.823559+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:46:42.823559+0000","last_peered":"2024-09-13T18:46:42.823559+0000","last_clean":"2024-09-13T18:46:42.823559+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:46:42.823559+0000","last_undegraded":"2024-09-13T18:46:42.823559+0000","last_fullsized":"2024-09-13T18:46:42.823559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297893+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:46:41.297893+0000","last_peered":"2024-09-13T18:46:41.297893+0000","last_clean":"2024-09-13T18:46:41.297893+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:46:41.297893+0000","last_undegraded":"2024-09-13T18:46:41.297893+0000","last_fullsized":"2024-09-13T18:46:41.297893+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.301517+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:46:41.301517+0000","last_peered":"2024-09-13T18:46:41.301517+0000","last_clean":"2024-09-13T18:46:41.301517+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:46:41.301517+0000","last_undegraded":"2024-09-13T18:46:41.301517+0000","last_fullsized":"2024-09-13T18:46:41.301517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821053+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:46:42.821053+0000","last_peered":"2024-09-13T18:46:42.821053+0000","last_clean":"2024-09-13T18:46:42.821053+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:46:42.821053+0000","last_undegraded":"2024-09-13T18:46:42.821053+0000","last_fullsized":"2024-09-13T18:46:42.821053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303781+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:46:41.303781+0000","last_peered":"2024-09-13T18:46:41.303781+0000","last_clean":"2024-09-13T18:46:41.303781+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:46:41.303781+0000","last_undegraded":"2024-09-13T18:46:41.303781+0000","last_fullsized":"2024-09-13T18:46:41.303781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303950+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:46:41.303950+0000","last_peered":"2024-09-13T18:46:41.303950+0000","last_clean":"2024-09-13T18:46:41.303950+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:46:41.303950+0000","last_undegraded":"2024-09-13T18:46:41.303950+0000","last_fullsized":"2024-09-13T18:46:41.303950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298505+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:46:41.298505+0000","last_peered":"2024-09-13T18:46:41.298505+0000","last_clean":"2024-09-13T18:46:41.298505+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:46:41.298505+0000","last_undegraded":"2024-09-13T18:46:41.298505+0000","last_fullsized":"2024-09-13T18:46:41.298505+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.293462+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:46:41.293462+0000","last_peered":"2024-09-13T18:46:41.293462+0000","last_clean":"2024-09-13T18:46:41.293462+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:46:41.293462+0000","last_undegraded":"2024-09-13T18:46:41.293462+0000","last_fullsized":"2024-09-13T18:46:41.293462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303656+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:46:41.303656+0000","last_peered":"2024-09-13T18:46:41.303656+0000","last_clean":"2024-09-13T18:46:41.303656+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:46:41.303656+0000","last_undegraded":"2024-09-13T18:46:41.303656+0000","last_fullsized":"2024-09-13T18:46:41.303656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.311946+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:46:41.311946+0000","last_peered":"2024-09-13T18:46:41.311946+0000","last_clean":"2024-09-13T18:46:41.311946+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:46:41.311946+0000","last_undegraded":"2024-09-13T18:46:41.311946+0000","last_fullsized":"2024-09-13T18:46:41.311946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.299975+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:46:41.299975+0000","last_peered":"2024-09-13T18:46:41.299975+0000","last_clean":"2024-09-13T18:46:41.299975+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:46:41.299975+0000","last_undegraded":"2024-09-13T18:46:41.299975+0000","last_fullsized":"2024-09-13T18:46:41.299975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820898+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:46:42.820898+0000","last_peered":"2024-09-13T18:46:42.820898+0000","last_clean":"2024-09-13T18:46:42.820898+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:46:42.820898+0000","last_undegraded":"2024-09-13T18:46:42.820898+0000","last_fullsized":"2024-09-13T18:46:42.820898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.299154+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:46:41.299154+0000","last_peered":"2024-09-13T18:46:41.299154+0000","last_clean":"2024-09-13T18:46:41.299154+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:46:41.299154+0000","last_undegraded":"2024-09-13T18:46:41.299154+0000","last_fullsized":"2024-09-13T18:46:41.299154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303190+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:46:41.303190+0000","last_peered":"2024-09-13T18:46:41.303190+0000","last_clean":"2024-09-13T18:46:41.303190+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:46:41.303190+0000","last_undegraded":"2024-09-13T18:46:41.303190+0000","last_fullsized":"2024-09-13T18:46:41.303190+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303306+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:46:41.303306+0000","last_peered":"2024-09-13T18:46:41.303306+0000","last_clean":"2024-09-13T18:46:41.303306+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:46:41.303306+0000","last_undegraded":"2024-09-13T18:46:41.303306+0000","last_fullsized":"2024-09-13T18:46:41.303306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.354930+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:46:41.354930+0000","last_peered":"2024-09-13T18:46:41.354930+0000","last_clean":"2024-09-13T18:46:41.354930+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:46:41.354930+0000","last_undegraded":"2024-09-13T18:46:41.354930+0000","last_fullsized":"2024-09-13T18:46:41.354930+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298745+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:46:41.298745+0000","last_peered":"2024-09-13T18:46:41.298745+0000","last_clean":"2024-09-13T18:46:41.298745+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:46:41.298745+0000","last_undegraded":"2024-09-13T18:46:41.298745+0000","last_fullsized":"2024-09-13T18:46:41.298745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820615+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:46:42.820615+0000","last_peered":"2024-09-13T18:46:42.820615+0000","last_clean":"2024-09-13T18:46:42.820615+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:46:42.820615+0000","last_undegraded":"2024-09-13T18:46:42.820615+0000","last_fullsized":"2024-09-13T18:46:42.820615+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297778+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:46:41.297778+0000","last_peered":"2024-09-13T18:46:41.297778+0000","last_clean":"2024-09-13T18:46:41.297778+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:46:41.297778+0000","last_undegraded":"2024-09-13T18:46:41.297778+0000","last_fullsized":"2024-09-13T18:46:41.297778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.293269+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:46:41.293269+0000","last_peered":"2024-09-13T18:46:41.293269+0000","last_clean":"2024-09-13T18:46:41.293269+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:46:41.293269+0000","last_undegraded":"2024-09-13T18:46:41.293269+0000","last_fullsized":"2024-09-13T18:46:41.293269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303666+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:46:41.303666+0000","last_peered":"2024-09-13T18:46:41.303666+0000","last_clean":"2024-09-13T18:46:41.303666+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:46:41.303666+0000","last_undegraded":"2024-09-13T18:46:41.303666+0000","last_fullsized":"2024-09-13T18:46:41.303666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.306178+0000","last_change":"2024-09-13T18:45:01.350397+0000","last_active":"2024-09-13T18:46:41.306178+0000","last_peered":"2024-09-13T18:46:41.306178+0000","last_clean":"2024-09-13T18:46:41.306178+0000","last_became_active":"2024-09-13T18:45:01.349367+0000","last_became_peered":"2024-09-13T18:45:01.349367+0000","last_unstale":"2024-09-13T18:46:41.306178+0000","last_undegraded":"2024-09-13T18:46:41.306178+0000","last_fullsized":"2024-09-13T18:46:41.306178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:36.405955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.821773+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:46:42.821773+0000","last_peered":"2024-09-13T18:46:42.821773+0000","last_clean":"2024-09-13T18:46:42.821773+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:46:42.821773+0000","last_undegraded":"2024-09-13T18:46:42.821773+0000","last_fullsized":"2024-09-13T18:46:42.821773+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.304255+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:46:41.304255+0000","last_peered":"2024-09-13T18:46:41.304255+0000","last_clean":"2024-09-13T18:46:41.304255+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:46:41.304255+0000","last_undegraded":"2024-09-13T18:46:41.304255+0000","last_fullsized":"2024-09-13T18:46:41.304255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.822292+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:46:42.822292+0000","last_peered":"2024-09-13T18:46:42.822292+0000","last_clean":"2024-09-13T18:46:42.822292+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:46:42.822292+0000","last_undegraded":"2024-09-13T18:46:42.822292+0000","last_fullsized":"2024-09-13T18:46:42.822292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-13T18:46:42.820399+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:46:42.820399+0000","last_peered":"2024-09-13T18:46:42.820399+0000","last_clean":"2024-09-13T18:46:42.820399+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:46:42.820399+0000","last_undegraded":"2024-09-13T18:46:42.820399+0000","last_fullsized":"2024-09-13T18:46:42.820399+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298800+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:46:41.298800+0000","last_peered":"2024-09-13T18:46:41.298800+0000","last_clean":"2024-09-13T18:46:41.298800+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:46:41.298800+0000","last_undegraded":"2024-09-13T18:46:41.298800+0000","last_fullsized":"2024-09-13T18:46:41.298800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.302859+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:46:41.302859+0000","last_peered":"2024-09-13T18:46:41.302859+0000","last_clean":"2024-09-13T18:46:41.302859+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:46:41.302859+0000","last_undegraded":"2024-09-13T18:46:41.302859+0000","last_fullsized":"2024-09-13T18:46:41.302859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.303021+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:46:41.303021+0000","last_peered":"2024-09-13T18:46:41.303021+0000","last_clean":"2024-09-13T18:46:41.303021+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:46:41.303021+0000","last_undegraded":"2024-09-13T18:46:41.303021+0000","last_fullsized":"2024-09-13T18:46:41.303021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.306115+0000","last_change":"2024-09-13T18:45:01.350541+0000","last_active":"2024-09-13T18:46:41.306115+0000","last_peered":"2024-09-13T18:46:41.306115+0000","last_clean":"2024-09-13T18:46:41.306115+0000","last_became_active":"2024-09-13T18:45:01.349667+0000","last_became_peered":"2024-09-13T18:45:01.349667+0000","last_unstale":"2024-09-13T18:46:41.306115+0000","last_undegraded":"2024-09-13T18:46:41.306115+0000","last_fullsized":"2024-09-13T18:46:41.306115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:16.438527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.327174+0000","last_change":"2024-09-13T18:46:41.324323+0000","last_active":"2024-09-13T18:46:41.327174+0000","last_peered":"2024-09-13T18:46:41.327174+0000","last_clean":"2024-09-13T18:46:41.327174+0000","last_became_active":"2024-09-13T18:46:41.324073+0000","last_became_peered":"2024-09-13T18:46:41.324073+0000","last_unstale":"2024-09-13T18:46:41.327174+0000","last_undegraded":"2024-09-13T18:46:41.327174+0000","last_fullsized":"2024-09-13T18:46:41.327174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:00.386189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.307692+0000","last_change":"2024-09-13T18:45:01.337983+0000","last_active":"2024-09-13T18:46:41.307692+0000","last_peered":"2024-09-13T18:46:41.307692+0000","last_clean":"2024-09-13T18:46:41.307692+0000","last_became_active":"2024-09-13T18:45:01.336767+0000","last_became_peered":"2024-09-13T18:45:01.336767+0000","last_unstale":"2024-09-13T18:46:41.307692+0000","last_undegraded":"2024-09-13T18:46:41.307692+0000","last_fullsized":"2024-09-13T18:46:41.307692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:21.478538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.329122+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:46:41.329122+0000","last_peered":"2024-09-13T18:46:41.329122+0000","last_clean":"2024-09-13T18:46:41.329122+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:46:41.329122+0000","last_undegraded":"2024-09-13T18:46:41.329122+0000","last_fullsized":"2024-09-13T18:46:41.329122+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.298331+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:46:41.298331+0000","last_peered":"2024-09-13T18:46:41.298331+0000","last_clean":"2024-09-13T18:46:41.298331+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:46:41.298331+0000","last_undegraded":"2024-09-13T18:46:41.298331+0000","last_fullsized":"2024-09-13T18:46:41.298331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":36,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.299561+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:46:41.299561+0000","last_peered":"2024-09-13T18:46:41.299561+0000","last_clean":"2024-09-13T18:46:41.299561+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:46:41.299561+0000","last_undegraded":"2024-09-13T18:46:41.299561+0000","last_fullsized":"2024-09-13T18:46:41.299561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.310357+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:46:41.310357+0000","last_peered":"2024-09-13T18:46:41.310357+0000","last_clean":"2024-09-13T18:46:41.310357+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:46:41.310357+0000","last_undegraded":"2024-09-13T18:46:41.310357+0000","last_fullsized":"2024-09-13T18:46:41.310357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.305878+0000","last_change":"2024-09-13T18:45:01.331021+0000","last_active":"2024-09-13T18:46:41.305878+0000","last_peered":"2024-09-13T18:46:41.305878+0000","last_clean":"2024-09-13T18:46:41.305878+0000","last_became_active":"2024-09-13T18:45:01.330757+0000","last_became_peered":"2024-09-13T18:45:01.330757+0000","last_unstale":"2024-09-13T18:46:41.305878+0000","last_undegraded":"2024-09-13T18:46:41.305878+0000","last_fullsized":"2024-09-13T18:46:41.305878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:05.018843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.316540+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:46:41.316540+0000","last_peered":"2024-09-13T18:46:41.316540+0000","last_clean":"2024-09-13T18:46:41.316540+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:46:41.316540+0000","last_undegraded":"2024-09-13T18:46:41.316540+0000","last_fullsized":"2024-09-13T18:46:41.316540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297704+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:46:41.297704+0000","last_peered":"2024-09-13T18:46:41.297704+0000","last_clean":"2024-09-13T18:46:41.297704+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:46:41.297704+0000","last_undegraded":"2024-09-13T18:46:41.297704+0000","last_fullsized":"2024-09-13T18:46:41.297704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.297929+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:46:41.297929+0000","last_peered":"2024-09-13T18:46:41.297929+0000","last_clean":"2024-09-13T18:46:41.297929+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:46:41.297929+0000","last_undegraded":"2024-09-13T18:46:41.297929+0000","last_fullsized":"2024-09-13T18:46:41.297929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:46:41.341557+0000","last_change":"2024-09-13T18:46:41.338863+0000","last_active":"2024-09-13T18:46:41.341557+0000","last_peered":"2024-09-13T18:46:41.341557+0000","last_clean":"2024-09-13T18:46:41.341557+0000","last_became_active":"2024-09-13T18:46:41.338647+0000","last_became_peered":"2024-09-13T18:46:41.338647+0000","last_unstale":"2024-09-13T18:46:41.341557+0000","last_undegraded":"2024-09-13T18:46:41.341557+0000","last_fullsized":"2024-09-13T18:46:41.341557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:49.653575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8537,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":300138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.86799999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.502},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.38}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.72599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.71099999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":630784,"data_stored":307295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.89500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.046},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.264}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.343}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.462},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.3819999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.504},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.611}]}]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1212416,"data_stored":889994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.872}]},{"osd":2,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.97299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.1180000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.5979999999999999,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.1020000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:51 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.264,"5min":1.264,"15min":1.264},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.1539999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":299612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.85699999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.073}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.747}]},{"osd":7,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.86899999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":299680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.099}]},{"osd":1,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.496}]},{"osd":2,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.1299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.032}]},{"osd":6,"last update":"Fri Sep 13 18:45:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.526}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":299556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.59299999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1216512,"data_stored":890016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.748}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.98399999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.87},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.93500000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":638976,"data_stored":307967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.45}]},{"osd":2,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.99399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:53 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":10.058999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.732,"5min":1.732,"15min":1.732},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":10.223000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.1699999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.87},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.2}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.89800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":8411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:46:46.602 INFO:tasks.thrashosds.thrasher:Setting 4.19 to [1, 4, 3, 6] 2024-09-13T18:46:46.602 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.19', '1', '4', '3', '6'] 2024-09-13T18:46:46.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.19 1 4 3 6 2024-09-13T18:46:46.627 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:46.622+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:46.641 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:46.641 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:46.641 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:46.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:46.727 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:46.726+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:46.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b7e00700 1 Processor -- start 2024-09-13T18:46:46.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b7e00700 1 -- start start 2024-09-13T18:46:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c3400 0x7f62b80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b7e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b80c7f70 con 0x7f62b8156e30 2024-09-13T18:46:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b7e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b815cd80 con 0x7f62b80c7a50 2024-09-13T18:46:46.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b7e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815cb70 con 0x7f62b80c3400 2024-09-13T18:46:46.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c3400 0x7f62b80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f62b8156e30 0x7f62b81575e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47226/0 (socket says 172.21.15.32:47226) 2024-09-13T18:46:46.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6a00700 1 -- 172.21.15.32:0/3490738738 learned_addr learned my addr 172.21.15.32:0/3490738738 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:46.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b5600700 1 -- 172.21.15.32:0/3490738738 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151811377 0 0) 0x7f62b80c7f70 con 0x7f62b8156e30 2024-09-13T18:46:46.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b5600700 1 -- 172.21.15.32:0/3490738738 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f629c0035d0 con 0x7f62b8156e30 2024-09-13T18:46:46.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6000700 1 -- 172.21.15.32:0/3490738738 >> v1:172.21.15.86:6789/0 conn(0x7f62b80c7a50 legacy=0x7f62b8163ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b5600700 1 -- 172.21.15.32:0/3490738738 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366342836 0 0) 0x7f62b815cd80 con 0x7f62b80c7a50 2024-09-13T18:46:46.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6000700 1 -- 172.21.15.32:0/3490738738 >> v1:172.21.15.32:6789/0 conn(0x7f62b8156e30 legacy=0x7f62b81575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6000700 1 -- 172.21.15.32:0/3490738738 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b815d060 con 0x7f62b80c3400 2024-09-13T18:46:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.731+0000 7f62b6000700 1 --2- 172.21.15.32:0/3490738738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c3400 0x7f62b80ccfe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009880 tx=0x7f62a4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d15c96ec66020d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b5600700 1 -- 172.21.15.32:0/3490738738 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4011830 con 0x7f62b80c3400 2024-09-13T18:46:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b5600700 1 -- 172.21.15.32:0/3490738738 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4011990 con 0x7f62b80c3400 2024-09-13T18:46:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b5600700 1 -- 172.21.15.32:0/3490738738 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4011d00 con 0x7f62b80c3400 2024-09-13T18:46:46.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 -- 172.21.15.32:0/3490738738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c3400 msgr2=0x7f62b80ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3490738738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c3400 0x7f62b80ccfe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009880 tx=0x7f62a4009b90 comp rx=0 tx=0).stop 2024-09-13T18:46:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 -- 172.21.15.32:0/3490738738 shutdown_connections 2024-09-13T18:46:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3490738738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c3400 0x7f62b80ccfe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 -- 172.21.15.32:0/3490738738 >> 172.21.15.32:0/3490738738 conn(0x7f62b806a7d0 msgr2=0x7f62b806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 -- 172.21.15.32:0/3490738738 shutdown_connections 2024-09-13T18:46:46.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 -- 172.21.15.32:0/3490738738 wait complete. 2024-09-13T18:46:46.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 Processor -- start 2024-09-13T18:46:46.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.735+0000 7f62b7e00700 1 -- start start 2024-09-13T18:46:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b80c3400 0x7f62b81559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 0x7f62b81e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62b8156e30 0x7f62b81e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81eef90 con 0x7f62b8156e30 2024-09-13T18:46:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80c9160 con 0x7f62b80c3400 2024-09-13T18:46:46.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81ef250 con 0x7f62b80c7a50 2024-09-13T18:46:46.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 0x7f62b81e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b80c3400 0x7f62b81559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 0x7f62b81e5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54304/0 (socket says 172.21.15.32:54304) 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 -- 172.21.15.32:0/3298398360 learned_addr learned my addr 172.21.15.32:0/3298398360 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62b8156e30 0x7f62b81e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b80c3400 msgr2=0x7f62b81559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b80c3400 0x7f62b81559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62b8156e30 msgr2=0x7f62b81e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62b8156e30 0x7f62b81e63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40094b0 con 0x7f62b80c7a50 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62b8156e30 0x7f62b81e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:46.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 0x7f62b81e5e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62a40090b0 tx=0x7f62a4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4004550 con 0x7f62b80c7a50 2024-09-13T18:46:46.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40036c0 con 0x7f62b80c7a50 2024-09-13T18:46:46.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4003a70 con 0x7f62b80c7a50 2024-09-13T18:46:46.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b8157580 con 0x7f62b80c7a50 2024-09-13T18:46:46.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.739+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b8157b40 con 0x7f62b80c7a50 2024-09-13T18:46:46.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.743+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f62b806d040 con 0x7f62b80c7a50 2024-09-13T18:46:46.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.743+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62a4003bd0 con 0x7f62b80c7a50 2024-09-13T18:46:46.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.743+0000 7f62af400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6298066730 0x7f6298068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.743+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6587+0+0 (secure 0 0 0) 0x7f62a4085bf0 con 0x7f62b80c7a50 2024-09-13T18:46:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.743+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v55) v1 ==== 54+0+16 (secure 0 0 0) 0x7f62a40860a0 con 0x7f62b80c7a50 2024-09-13T18:46:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.743+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6298066730 0x7f6298068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.747+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f62b8158060 0x7f62b8158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.747+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b815d620 con 0x7f62b8158060 2024-09-13T18:46:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.747+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f62b8158060 0x7f62b8158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.747+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6298066730 0x7f6298068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62a8007fd0 tx=0x7f62a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.747+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f62b8158060 0x7f62b8158440 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.747+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b0001ed0 con 0x7f62b8158060 2024-09-13T18:46:46.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.767+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b8157210 con 0x7f62b8158060 2024-09-13T18:46:46.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.767+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b0003ae0 con 0x7f62b8158060 2024-09-13T18:46:46.774 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.767+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f62b81f2a10 0x7f62b81f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.767+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b81f3330 con 0x7f62b81f2a10 2024-09-13T18:46:46.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.767+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f62b81f2a10 0x7f62b81f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.771+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f62b81f2a10 0x7f62b81f2df0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.771+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b81f3330 con 0x7f62b81f2a10 2024-09-13T18:46:46.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.787+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b80c2070 con 0x7f62b81f2a10 2024-09-13T18:46:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.791+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b80c2070 con 0x7f62b81f2a10 2024-09-13T18:46:46.795 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:46.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.791+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f62b8153a20 0x7f62b8153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.791+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b8154340 con 0x7f62b8153a20 2024-09-13T18:46:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.791+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f62b8153a20 0x7f62b8153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.791+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f62b8153a20 0x7f62b8153e00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.791+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b8154340 con 0x7f62b8153a20 2024-09-13T18:46:46.806 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:46.806 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:46.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.477056144, 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:46.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.811 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47629938999999, 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:46.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:46.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.476280731, 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.817 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:46.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:46.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:46.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47626864199999, 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:46.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:46.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.830 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.476261917, 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:46.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:46.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.476255075, 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.836 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:46.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:46.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.841 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47624898399999, 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:46.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.847 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47622389599999, 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:46.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:46.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47621924000001, 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.853 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:46.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:46.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.858 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47620514099999, 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:46.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.864 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47619318700001, 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:46.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.476184667, 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:46.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:46.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:46.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.476179562, 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:46.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.881 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47610526699999, 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:46.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:46.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:46.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.886 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.475183845, 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:46.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:46.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:46.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.47515868799999, 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:46.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.896 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.475101978, 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:46.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:46.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.901 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.471738225, 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:46.906 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 100.470958434, 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:46.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:46.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 94.976165366999993, 2024-09-13T18:46:46.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:46.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:46.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:46.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:46.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.916 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.916 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.916 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:46.916 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:46.916 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:46.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.807+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b80c8300 con 0x7f62b8153a20 2024-09-13T18:46:46.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.811+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b80c8300 con 0x7f62b8153a20 2024-09-13T18:46:46.918 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:46.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:46.919 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:46.914+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:46.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.811+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f62b80612c0 0x7f62b80616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.811+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b80b1f80 con 0x7f62b80612c0 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.811+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f62b80612c0 0x7f62b80616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.811+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f62b80612c0 0x7f62b80616e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.815+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b80b1f80 con 0x7f62b80612c0 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.835+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b80c9630 con 0x7f62b80612c0 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.839+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b80c9630 con 0x7f62b80612c0 2024-09-13T18:46:46.920 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:46.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.839+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f62b80c9cb0 0x7f62b80ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.839+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b80ca630 con 0x7f62b80c9cb0 2024-09-13T18:46:46.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.839+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f62b80c9cb0 0x7f62b80ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.839+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f62b80c9cb0 0x7f62b80ca0f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.839+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62a800fa70 con 0x7f62b80c9cb0 2024-09-13T18:46:46.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 Processor -- start 2024-09-13T18:46:46.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 -- start start 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 0x7f89d00b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89d006d9e0 0x7f89d006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00b22e0 con 0x7f89d0150470 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d00c1850 con 0x7f89d006d9e0 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c7580 con 0x7f89d0150850 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cf400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 0x7f89d00b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cfe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f89d0150470 0x7f89d00c68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:39960/0 (socket says 172.21.15.32:39960) 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89d5200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f89d006d9e0 0x7f89d006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cfe00700 1 -- 172.21.15.32:0/1199958320 learned_addr learned my addr 172.21.15.32:0/1199958320 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cf400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 0x7f89d00b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:54314/0 (socket says 172.21.15.32:54314) 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cf400700 1 -- 172.21.15.32:0/1199958320 >> v2:172.21.15.86:3300/0 conn(0x7f89d006d9e0 msgr2=0x7f89d006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cf400700 1 --2- 172.21.15.32:0/1199958320 >> v2:172.21.15.86:3300/0 conn(0x7f89d006d9e0 0x7f89d006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cf400700 1 -- 172.21.15.32:0/1199958320 >> v1:172.21.15.86:6789/0 conn(0x7f89d0150470 legacy=0x7f89d00c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cf400700 1 -- 172.21.15.32:0/1199958320 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00c7000 con 0x7f89d0150850 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.855+0000 7f89cea00700 1 -- 172.21.15.32:0/1199958320 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137758724 0 0) 0x7f89d00b22e0 con 0x7f89d0150470 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89cf400700 1 --2- 172.21.15.32:0/1199958320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 0x7f89d00b1da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009850 tx=0x7f89bc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ebabbf4d2498 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89cea00700 1 -- 172.21.15.32:0/1199958320 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011830 con 0x7f89d0150850 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89cea00700 1 -- 172.21.15.32:0/1199958320 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc011990 con 0x7f89d0150850 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89cea00700 1 -- 172.21.15.32:0/1199958320 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc011d40 con 0x7f89d0150850 2024-09-13T18:46:46.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b802b6a0 con 0x7f62b80c9cb0 2024-09-13T18:46:46.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 -- 172.21.15.32:0/1199958320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 msgr2=0x7f89d00b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 --2- 172.21.15.32:0/1199958320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 0x7f89d00b1da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009850 tx=0x7f89bc009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:46.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 -- 172.21.15.32:0/1199958320 shutdown_connections 2024-09-13T18:46:46.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 --2- 172.21.15.32:0/1199958320 >> v2:172.21.15.86:3300/0 conn(0x7f89d006d9e0 0x7f89d006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 --2- 172.21.15.32:0/1199958320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d0150850 0x7f89d00b1da0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 -- 172.21.15.32:0/1199958320 >> 172.21.15.32:0/1199958320 conn(0x7f89d00c89f0 msgr2=0x7f89d00c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:46.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 -- 172.21.15.32:0/1199958320 shutdown_connections 2024-09-13T18:46:46.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.859+0000 7f89d5c00700 1 -- 172.21.15.32:0/1199958320 wait complete. 2024-09-13T18:46:46.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 Processor -- start 2024-09-13T18:46:46.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 -- start start 2024-09-13T18:46:46.926 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b802b6a0 con 0x7f62b80c9cb0 2024-09-13T18:46:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f62b802bd20 0x7f62b802c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b802c6c0 con 0x7f62b802bd20 2024-09-13T18:46:46.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f62b802bd20 0x7f62b802c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d006d9e0 0x7f89d01e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 0x7f89d0162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d0150850 0x7f89d00c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d014f000 con 0x7f89d0150470 2024-09-13T18:46:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d015ef80 con 0x7f89d0150850 2024-09-13T18:46:46.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d015f220 con 0x7f89d006d9e0 2024-09-13T18:46:46.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 0x7f89d0162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cfe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d006d9e0 0x7f89d01e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 0x7f89d0162d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46966/0 (socket says 172.21.15.32:46966) 2024-09-13T18:46:46.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 -- 172.21.15.32:0/3731026960 learned_addr learned my addr 172.21.15.32:0/3731026960 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:46.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f62b6000700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f62b802bd20 0x7f62b802c180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5200700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d0150850 0x7f89d00c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 -- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d006d9e0 msgr2=0x7f89d01e8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d006d9e0 0x7f89d01e8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 -- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d0150850 msgr2=0x7f89d00c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d0150850 0x7f89d00c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 -- 172.21.15.32:0/3731026960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0094b0 con 0x7f89d0150470 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89cf400700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 0x7f89d0162d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0090b0 tx=0x7f89bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc004550 con 0x7f89d0150470 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc01e070 con 0x7f89d0150470 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc003900 con 0x7f89d0150470 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d015f4e0 con 0x7f89d0150470 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.863+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d01ef7c0 con 0x7f89d0150470 2024-09-13T18:46:46.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.867+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b802c6c0 con 0x7f62b802bd20 2024-09-13T18:46:46.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.867+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d00c2e50 con 0x7f89d0150470 2024-09-13T18:46:46.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.867+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89bc003a60 con 0x7f89d0150470 2024-09-13T18:46:46.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.871+0000 7f89c7e00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f89b0066760 0x7f89b0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.871+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6587+0+0 (secure 0 0 0) 0x7f89bc0853f0 con 0x7f89d0150470 2024-09-13T18:46:46.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.871+0000 7f89cfe00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f89b0066760 0x7f89b0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.871+0000 7f89cfe00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f89b0066760 0x7f89b0068c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007b30 tx=0x7f89c0007a80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.879+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89bc0522c0 con 0x7f89d0150470 2024-09-13T18:46:46.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.887+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b802c6c0 con 0x7f62b802bd20 2024-09-13T18:46:46.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.891+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b802c6c0 con 0x7f62b802bd20 2024-09-13T18:46:46.933 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:46.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.891+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f62b8205aa0 0x7f62b8207e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.891+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b820ad10 con 0x7f62b8205aa0 2024-09-13T18:46:46.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.895+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f62b8205aa0 0x7f62b8207e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.895+0000 7f62b7400700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f62b8205aa0 0x7f62b8207e90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.895+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b820ad10 con 0x7f62b8205aa0 2024-09-13T18:46:46.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.915+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b82083d0 con 0x7f62b8205aa0 2024-09-13T18:46:46.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.919+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b82083d0 con 0x7f62b8205aa0 2024-09-13T18:46:46.935 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:46.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.919+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f62b8208a50 0x7f62b8208e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:46.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.919+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62b820e070 con 0x7f62b8208a50 2024-09-13T18:46:46.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.919+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f62b8208a50 0x7f62b8208e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:46.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.919+0000 7f62b6a00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f62b8208a50 0x7f62b8208e90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:46.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.923+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f62b820e070 con 0x7f62b8208a50 2024-09-13T18:46:46.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.943+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f62b82094e0 con 0x7f62b8208a50 2024-09-13T18:46:46.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.943+0000 7f62af400700 1 -- 172.21.15.32:0/3298398360 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f62b82094e0 con 0x7f62b8208a50 2024-09-13T18:46:46.950 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f62b8158060 msgr2=0x7f62b8158440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f62b8158060 0x7f62b8158440 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f62b81f2a10 msgr2=0x7f62b81f2df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f62b81f2a10 0x7f62b81f2df0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f62b8153a20 msgr2=0x7f62b8153e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f62b8153a20 0x7f62b8153e00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f62b80612c0 msgr2=0x7f62b80616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f62b80612c0 0x7f62b80616e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f62b80c9cb0 msgr2=0x7f62b80ca0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f62b80c9cb0 0x7f62b80ca0f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f62b802bd20 msgr2=0x7f62b802c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f62b802bd20 0x7f62b802c180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f62b8205aa0 msgr2=0x7f62b8207e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f62b8205aa0 0x7f62b8207e90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f62b8208a50 msgr2=0x7f62b8208e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f62b8208a50 0x7f62b8208e90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7400700 1 -- 172.21.15.32:0/3298398360 reap_dead start 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7400700 1 -- 172.21.15.32:0/3298398360 reap_dead start 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7400700 1 -- 172.21.15.32:0/3298398360 reap_dead start 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7400700 1 -- 172.21.15.32:0/3298398360 reap_dead start 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7400700 1 -- 172.21.15.32:0/3298398360 reap_dead start 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6298066730 msgr2=0x7f6298068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6298066730 0x7f6298068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62a8007fd0 tx=0x7f62a8009040 comp rx=0 tx=0).stop 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 msgr2=0x7f62b81e5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 0x7f62b81e5e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f62a40090b0 tx=0x7f62a4004770 comp rx=0 tx=0).stop 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 shutdown_connections 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6298066730 0x7f6298068bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 --2- 172.21.15.32:0/3298398360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62b80c7a50 0x7f62b81e5e60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 >> 172.21.15.32:0/3298398360 conn(0x7f62b806a7d0 msgr2=0x7f62b80c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 shutdown_connections 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:46.947+0000 7f62b7e00700 1 -- 172.21.15.32:0/3298398360 wait complete. 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:47.018 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:47.014+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:47.075 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.075 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:47.119 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:47.114+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:47.188 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.188 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:47.240 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:47.238+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:47.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.235+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pg-upmap", "pgid": "4.19", "id": [1, 4, 3, 6]} v 0) v1 -- 0x7f89d014dc90 con 0x7f89d0150470 2024-09-13T18:46:47.321 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:47.315+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.323+0000 7f89c7e00700 1 -- 172.21.15.32:0/3731026960 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pg-upmap", "pgid": "4.19", "id": [1, 4, 3, 6]}]=0 set 4.19 pg_upmap mapping to [1,4,3,6] v56) v1 ==== 134+0+0 (secure 0 0 0) 0x7f89bc0558e0 con 0x7f89d0150470 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f89b0066760 msgr2=0x7f89b0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f89b0066760 0x7f89b0068c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007b30 tx=0x7f89c0007a80 comp rx=0 tx=0).stop 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 msgr2=0x7f89d0162d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 0x7f89d0162d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0090b0 tx=0x7f89bc004770 comp rx=0 tx=0).stop 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 shutdown_connections 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f89b0066760 0x7f89b0068c20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89d0150850 0x7f89d00c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89d0150470 0x7f89d0162d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 --2- 172.21.15.32:0/3731026960 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89d006d9e0 0x7f89d01e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 >> 172.21.15.32:0/3731026960 conn(0x7f89d00c89f0 msgr2=0x7f89d006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 shutdown_connections 2024-09-13T18:46:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.327+0000 7f89d5c00700 1 -- 172.21.15.32:0/3731026960 wait complete. 2024-09-13T18:46:47.336 INFO:teuthology.orchestra.run.smithi032.stderr:set 4.19 pg_upmap mapping to [1,4,3,6] 2024-09-13T18:46:47.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:46:47.361 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.361 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:47.422 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:47.415+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:47.475 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.475 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:47.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061ae00700 1 Processor -- start 2024-09-13T18:46:47.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061ae00700 1 -- start start 2024-09-13T18:46:47.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061ae00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0614073990 0x7f061406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061ae00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061415a560 con 0x7f061406f530 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061ae00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061406d5e0 con 0x7f0614073d70 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061ae00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061406f150 con 0x7f0614073990 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f0619a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0614073990 0x7f061406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f0619a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0614073990 0x7f061406ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39644/0 (socket says 172.21.15.32:39644) 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f061a400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f0614073d70 0x7f06141533c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:39976/0 (socket says 172.21.15.32:39976) 2024-09-13T18:46:47.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.487+0000 7f0619a00700 1 -- 172.21.15.32:0/2176124508 learned_addr learned my addr 172.21.15.32:0/2176124508 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:47.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0619a00700 1 -- 172.21.15.32:0/2176124508 >> v1:172.21.15.86:6789/0 conn(0x7f0614073d70 legacy=0x7f06141533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0619a00700 1 -- 172.21.15.32:0/2176124508 >> v1:172.21.15.32:6789/0 conn(0x7f061406f530 legacy=0x7f0614159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0619a00700 1 -- 172.21.15.32:0/2176124508 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614159fa0 con 0x7f0614073990 2024-09-13T18:46:47.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0613e00700 1 -- 172.21.15.32:0/2176124508 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73808729 0 0) 0x7f061406d5e0 con 0x7f0614073d70 2024-09-13T18:46:47.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0619a00700 1 --2- 172.21.15.32:0/2176124508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0614073990 0x7f061406ec10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0608009910 tx=0x7f0608009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d3073b99b3bbc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:47.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0613e00700 1 -- 172.21.15.32:0/2176124508 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060800ba60 con 0x7f0614073990 2024-09-13T18:46:47.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0613e00700 1 -- 172.21.15.32:0/2176124508 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060800bbc0 con 0x7f0614073990 2024-09-13T18:46:47.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f0613e00700 1 -- 172.21.15.32:0/2176124508 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608009e60 con 0x7f0614073990 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 -- 172.21.15.32:0/2176124508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0614073990 msgr2=0x7f061406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 --2- 172.21.15.32:0/2176124508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0614073990 0x7f061406ec10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0608009910 tx=0x7f0608009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 -- 172.21.15.32:0/2176124508 shutdown_connections 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 --2- 172.21.15.32:0/2176124508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0614073990 0x7f061406ec10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 -- 172.21.15.32:0/2176124508 >> 172.21.15.32:0/2176124508 conn(0x7f06140c8a60 msgr2=0x7f06140c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 -- 172.21.15.32:0/2176124508 shutdown_connections 2024-09-13T18:46:47.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.491+0000 7f061ae00700 1 -- 172.21.15.32:0/2176124508 wait complete. 2024-09-13T18:46:47.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 Processor -- start 2024-09-13T18:46:47.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 -- start start 2024-09-13T18:46:47.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f061406f530 0x7f06141596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 0x7f06141f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0614073d70 0x7f06141f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06140c3490 con 0x7f0614073990 2024-09-13T18:46:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06141543e0 con 0x7f061406f530 2024-09-13T18:46:47.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061ae00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06141f0110 con 0x7f0614073d70 2024-09-13T18:46:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 0x7f06141f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f061406f530 0x7f06141596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 0x7f06141f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46980/0 (socket says 172.21.15.32:46980) 2024-09-13T18:46:47.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 -- 172.21.15.32:0/3060966617 learned_addr learned my addr 172.21.15.32:0/3060966617 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f061a400700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0614073d70 0x7f06141f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 -- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0614073d70 msgr2=0x7f06141f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0614073d70 0x7f06141f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 -- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f061406f530 msgr2=0x7f06141596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f061406f530 0x7f06141596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 -- 172.21.15.32:0/3060966617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009570 con 0x7f0614073990 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619a00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f061406f530 0x7f06141596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:47.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.495+0000 7f0619000700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 0x7f06141f2e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f060000c4d0 tx=0x7f060000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000052d0 con 0x7f0614073990 2024-09-13T18:46:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600005430 con 0x7f0614073990 2024-09-13T18:46:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000055a0 con 0x7f0614073990 2024-09-13T18:46:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0614154680 con 0x7f0614073990 2024-09-13T18:46:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0614153550 con 0x7f0614073990 2024-09-13T18:46:47.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614067df0 con 0x7f0614073990 2024-09-13T18:46:47.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06000038c0 con 0x7f0614073990 2024-09-13T18:46:47.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.499+0000 7f0611600700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05f4066780 0x7f05f4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:47.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.503+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f0600083770 con 0x7f0614073990 2024-09-13T18:46:47.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.503+0000 7f0619a00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05f4066780 0x7f05f4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:47.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.503+0000 7f0619a00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05f4066780 0x7f05f4068c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0608000c00 tx=0x7f0608008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.507+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0600050850 con 0x7f0614073990 2024-09-13T18:46:47.522 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:47.518+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:47.593 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.593 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.603 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:47.622 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:47.619+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:47.724 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:47.719+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:47.752 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.752 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:47.825 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:47.822+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:47.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:47.859+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7f06140caf90 con 0x7f0614073990 2024-09-13T18:46:47.868 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.868 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:47.926 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:47.922+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:47.988 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:47.988 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:47.997 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:48.027 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:48.023+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:48.127 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:48.123+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:48.148 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:48.148 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:48.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:48.228 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:48.223+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:48.313 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:48.313 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:48.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:48.329 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:48.326+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:48.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.335+0000 7f0611600700 1 -- 172.21.15.32:0/3060966617 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v57) v1 ==== 87+0+0 (secure 0 0 0) 0x7f0600053e70 con 0x7f0614073990 2024-09-13T18:46:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05f4066780 msgr2=0x7f05f4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05f4066780 0x7f05f4068c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0608000c00 tx=0x7f0608008030 comp rx=0 tx=0).stop 2024-09-13T18:46:48.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 msgr2=0x7f06141f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 0x7f06141f2e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f060000c4d0 tx=0x7f060000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 shutdown_connections 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05f4066780 0x7f05f4068c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0614073d70 0x7f06141f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0614073990 0x7f06141f2e40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 --2- 172.21.15.32:0/3060966617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f061406f530 0x7f06141596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 >> 172.21.15.32:0/3060966617 conn(0x7f06140c8a60 msgr2=0x7f06140708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.339+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 shutdown_connections 2024-09-13T18:46:48.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:48.343+0000 7f061ae00700 1 -- 172.21.15.32:0/3060966617 wait complete. 2024-09-13T18:46:48.350 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:46:48.430 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:48.423+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:48.485 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:48.485 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:48.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:48.547 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:48.543+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:48.632 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:48.627+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:48.700 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:48.700 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:48.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:48.732 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:48.730+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:48.833 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:48.830+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:48.907 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:48.907 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:48.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:48.967 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:48.963+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:48.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:49.035 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:49.030+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:49.123 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:49.123 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:49.135 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:49.130+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:49.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:49.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.159+0000 7f0f9aa00700 1 Processor -- start 2024-09-13T18:46:49.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.159+0000 7f0f9aa00700 1 -- start start 2024-09-13T18:46:49.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f9aa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f94150730 0x7f0f9406adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f9aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f9406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f9aa00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f94150b10 con 0x7f0f9406e1e0 2024-09-13T18:46:49.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f9aa00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f940c72b0 con 0x7f0f94150730 2024-09-13T18:46:49.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f9aa00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9406d820 con 0x7f0f9415a250 2024-09-13T18:46:49.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f99600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0f94150730 0x7f0f9406adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f98c00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0f9406e1e0 0x7f0f94159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38084/0 (socket says 172.21.15.32:38084) 2024-09-13T18:46:49.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f98c00700 1 -- 172.21.15.32:0/3644641998 learned_addr learned my addr 172.21.15.32:0/3644641998 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:49.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f9406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f99600700 1 -- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 msgr2=0x7f0f9406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:49.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f99600700 1 --2- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f9406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f99600700 1 -- 172.21.15.32:0/3644641998 >> v1:172.21.15.32:6789/0 conn(0x7f0f9406e1e0 legacy=0x7f0f94159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f99600700 1 -- 172.21.15.32:0/3644641998 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940c7500 con 0x7f0f94150730 2024-09-13T18:46:49.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f93e00700 1 -- 172.21.15.32:0/3644641998 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388031860 0 0) 0x7f0f94150b10 con 0x7f0f9406e1e0 2024-09-13T18:46:49.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f99600700 1 --2- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f94150730 0x7f0f9406adc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009850 tx=0x7f0f88009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ecb896dee2a5b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f93e00700 1 -- 172.21.15.32:0/3644641998 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88011830 con 0x7f0f94150730 2024-09-13T18:46:49.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f93e00700 1 -- 172.21.15.32:0/3644641998 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f88011990 con 0x7f0f94150730 2024-09-13T18:46:49.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.163+0000 7f0f93e00700 1 -- 172.21.15.32:0/3644641998 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88011d40 con 0x7f0f94150730 2024-09-13T18:46:49.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f94150730 msgr2=0x7f0f9406adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f94150730 0x7f0f9406adc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009850 tx=0x7f0f88009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3644641998 shutdown_connections 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f9406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3644641998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f94150730 0x7f0f9406adc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3644641998 >> 172.21.15.32:0/3644641998 conn(0x7f0f94072680 msgr2=0x7f0f940cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3644641998 shutdown_connections 2024-09-13T18:46:49.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3644641998 wait complete. 2024-09-13T18:46:49.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 Processor -- start 2024-09-13T18:46:49.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.167+0000 7f0f9aa00700 1 -- start start 2024-09-13T18:46:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 0x7f0f940cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f94150730 0x7f0f94150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f94151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941533f0 con 0x7f0f94150730 2024-09-13T18:46:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941ecb40 con 0x7f0f9406e1e0 2024-09-13T18:46:49.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941f0230 con 0x7f0f9415a250 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9a000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f94151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 0x7f0f940cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 0x7f0f940cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:48230/0 (socket says 172.21.15.32:48230) 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 -- 172.21.15.32:0/3708254636 learned_addr learned my addr 172.21.15.32:0/3708254636 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f94151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51848/0 (socket says 172.21.15.32:51848) 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f94150730 0x7f0f94150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.176 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 msgr2=0x7f0f94151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f9415a250 0x7f0f94151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f94150730 msgr2=0x7f0f94150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f94150730 0x7f0f94150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880094b0 con 0x7f0f9406e1e0 2024-09-13T18:46:49.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f94150730 0x7f0f94150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 0x7f0f940cb550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0f88000c00 tx=0x7f0f88004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8801a990 con 0x7f0f9406e1e0 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8801f070 con 0x7f0f9406e1e0 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8801ad30 con 0x7f0f9406e1e0 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f941ecdc0 con 0x7f0f9406e1e0 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.171+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f941ed380 con 0x7f0f9406e1e0 2024-09-13T18:46:49.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.175+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f0f9406d470 con 0x7f0f9406e1e0 2024-09-13T18:46:49.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.175+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0f8801b430 con 0x7f0f9406e1e0 2024-09-13T18:46:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.175+0000 7f0f91600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0f74066730 0x7f0f74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.175+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f0f88085cd0 con 0x7f0f9406e1e0 2024-09-13T18:46:49.182 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0f74066730 0x7f0f74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v57) v1 ==== 54+0+16 (secure 0 0 0) 0x7f0f880860a0 con 0x7f0f9406e1e0 2024-09-13T18:46:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0f941ed5a0 0x7f0f94151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f940c7ac0 con 0x7f0f941ed5a0 2024-09-13T18:46:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0f941ed5a0 0x7f0f94151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0f74066730 0x7f0f74068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f940cbe70 tx=0x7f0f80007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0f941ed5a0 0x7f0f94151980 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.179+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f8c00f040 con 0x7f0f941ed5a0 2024-09-13T18:46:49.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.207+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f9406d470 con 0x7f0f941ed5a0 2024-09-13T18:46:49.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.211+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f9406d470 con 0x7f0f941ed5a0 2024-09-13T18:46:49.218 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:49.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.211+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0f940c1da0 0x7f0f941474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.211+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f9406db70 con 0x7f0f940c1da0 2024-09-13T18:46:49.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.211+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0f940c1da0 0x7f0f941474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.215+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0f940c1da0 0x7f0f941474c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.215+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f9406db70 con 0x7f0f940c1da0 2024-09-13T18:46:49.236 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:49.234+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.243+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f9406eaf0 con 0x7f0f940c1da0 2024-09-13T18:46:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.247+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f9406eaf0 con 0x7f0f940c1da0 2024-09-13T18:46:49.253 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.247+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0f94153a40 0x7f0f94147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.247+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f940cbc00 con 0x7f0f94153a40 2024-09-13T18:46:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.247+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0f94153a40 0x7f0f94147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.247+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0f94153a40 0x7f0f94147f10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.251+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f940cbc00 con 0x7f0f94153a40 2024-09-13T18:46:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.275+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f94060db0 con 0x7f0f94153a40 2024-09-13T18:46:49.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.279+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f94060db0 con 0x7f0f94153a40 2024-09-13T18:46:49.286 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:49.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.279+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0f94061840 0x7f0f9414b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.283+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f94061cc0 con 0x7f0f94061840 2024-09-13T18:46:49.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.283+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0f94061840 0x7f0f9414b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.283+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0f94061840 0x7f0f9414b9a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.283+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f94061cc0 con 0x7f0f94061840 2024-09-13T18:46:49.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.311+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f9414c1a0 con 0x7f0f94061840 2024-09-13T18:46:49.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.315+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f9414c1a0 con 0x7f0f94061840 2024-09-13T18:46:49.319 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:49.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.315+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0f9402b6a0 0x7f0f9402bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.315+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f9414c820 con 0x7f0f9402b6a0 2024-09-13T18:46:49.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.315+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0f9402b6a0 0x7f0f9402bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.315+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0f9402b6a0 0x7f0f9402bac0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.319+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f9414c820 con 0x7f0f9402b6a0 2024-09-13T18:46:49.338 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:49.335+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:49.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.343+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f9414c820 con 0x7f0f9402b6a0 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 117.580167317, 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54912064599999999, 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767529+0000", 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767528+0000", 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767539+0000", 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1324e-05 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767567+0000", 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8101000000000001e-05 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767580+0000", 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2755000000000001e-05 2024-09-13T18:46:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767646+0000", 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5974000000000002e-05 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:51.767654+0000", 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2460000000000003e-06 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313567+0000", 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.54591268000000004 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.313981+0000", 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041414799999999998 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.314216+0000", 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023475899999999999 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.315986+0000", 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001770296 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316370+0000", 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038407699999999998 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316511+0000", 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140877 2024-09-13T18:46:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.316650+0000", 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138851 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.887776233, 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099055770000000005, 2024-09-13T18:46:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 87 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459921+0000", 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.459920+0000", 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460031+0000", 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110635 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460390+0000", 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035963999999999999 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460418+0000", 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7447e-05 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466764+0000", 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063458029999999997 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.466876+0000", 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112552 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.467062+0000", 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018608599999999999 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469339+0000", 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002276924 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469777+0000", 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043838999999999998 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469807+0000", 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9754999999999999e-05 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.469826+0000", 2024-09-13T18:46:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8885e-05 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.887662441, 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012117798000000001, 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 88 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460034+0000", 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460038+0000", 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5419999999999999e-06 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460448+0000", 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041011800000000001 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.460459+0000", 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1036000000000001e-05 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468204+0000", 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077443160000000002 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468371+0000", 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167164 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.468614+0000", 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.470101+0000", 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001486631 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472056+0000", 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955076 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472113+0000", 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6659000000000001e-05 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.472152+0000", 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9499999999999998e-05 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.544112312, 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010733042, 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 111 2024-09-13T18:46:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803584+0000", 2024-09-13T18:46:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803587+0000", 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5239999999999999e-06 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803856+0000", 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026959400000000001 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803859+0000", 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.039e-06 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.809967+0000", 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061074140000000002 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810084+0000", 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117044 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810257+0000", 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017316799999999999 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814181+0000", 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039239560000000001 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814235+0000", 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4561999999999997e-05 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814276+0000", 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0431e-05 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814317+0000", 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1584e-05 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.54410842199999, 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012675390999999999, 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 112 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803588+0000", 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803796+0000", 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000207741 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803865+0000", 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9249000000000001e-05 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803868+0000", 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2009999999999999e-06 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810857+0000", 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069892360000000002 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.810984+0000", 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012689999999999999 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811208+0000", 2024-09-13T18:46:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223305 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814886+0000", 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036787590000000002 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816179+0000", 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012928950000000001 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816229+0000", 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9962e-05 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816264+0000", 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4418000000000001e-05 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.543896542, 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015314398999999999, 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 113 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803800+0000", 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803803+0000", 2024-09-13T18:46:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9799999999999998e-06 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803874+0000", 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0879999999999999e-05 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803878+0000", 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1989999999999999e-06 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811837+0000", 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079595010000000008 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811897+0000", 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9446e-05 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.811991+0000", 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4164000000000002e-05 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814891+0000", 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002900452 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819026+0000", 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041343910000000003 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819079+0000", 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3143000000000003e-05 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819115+0000", 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5778999999999997e-05 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.543887058, 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015429696, 2024-09-13T18:46:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 114 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803810+0000", 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803809+0000", 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803812+0000", 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.717e-06 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803886+0000", 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4097000000000006e-05 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.803890+0000", 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2990000000000001e-06 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812494+0000", 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086043979999999992 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812609+0000", 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011534700000000001 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.812804+0000", 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000194575 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814902+0000", 2024-09-13T18:46:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020978450000000001 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819169+0000", 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004267196 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819212+0000", 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3259e-05 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819239+0000", 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7234e-05 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.54362218599999, 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015306528, 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 115 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804075+0000", 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804074+0000", 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804268+0000", 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019423199999999999 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804295+0000", 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7149999999999999e-05 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804301+0000", 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4110000000000004e-06 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813223+0000", 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089219820000000002 2024-09-13T18:46:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813344+0000", 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121249 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.813509+0000", 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016484299999999999 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815578+0000", 2024-09-13T18:46:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00206931 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819289+0000", 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037108710000000001 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819344+0000", 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4806999999999999e-05 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819381+0000", 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7203000000000003e-05 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.543425036, 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015195946, 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 116 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804272+0000", 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804271+0000", 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804274+0000", 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2480000000000001e-06 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804308+0000", 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3147e-05 2024-09-13T18:46:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804312+0000", 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3590000000000001e-06 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814399+0000", 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010087254 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814479+0000", 2024-09-13T18:46:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9354e-05 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814608+0000", 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012903599999999999 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815776+0000", 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011687959999999999 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819416+0000", 2024-09-13T18:46:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036395619999999998 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819447+0000", 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819468+0000", 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0545999999999999e-05 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.54342079200001, 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015324772, 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 117 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804276+0000", 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804279+0000", 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4180000000000001e-06 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804322+0000", 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2830000000000002e-05 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.804329+0000", 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3239999999999997e-06 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.814934+0000", 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010604257000000001 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815045+0000", 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111072 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.815230+0000", 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018569999999999999 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.816280+0000", 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010500080000000001 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819510+0000", 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293449999999998 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819568+0000", 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8017999999999999e-05 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.819601+0000", 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3068000000000003e-05 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:121 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 116.52736548999999, 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.092095938000000002, 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 121 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820331+0000", 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.820419+0000", 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8111999999999999e-05 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909285+0000", 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.088865754000000005 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909299+0000", 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4809e-05 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909395+0000", 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5387e-05 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909530+0000", 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135501 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.909707+0000", 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017688599999999999 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.911606+0000", 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018989460000000001 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912201+0000", 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059467999999999999 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912338+0000", 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013721499999999999 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:52.912427+0000", 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9185999999999996e-05 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.642978099, 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010593997000000001, 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 134 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704719+0000", 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.704718+0000", 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705271+0000", 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055327499999999999 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705843+0000", 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057122200000000003 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705850+0000", 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4189999999999996e-06 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710542+0000", 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00469214 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710740+0000", 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019796500000000001 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.710956+0000", 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021551099999999999 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714243+0000", 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003287337 2024-09-13T18:46:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715234+0000", 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099158100000000006 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715281+0000", 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7017000000000001e-05 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715313+0000", 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1157e-05 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.642402518, 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010895194, 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 135 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705294+0000", 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705293+0000", 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705299+0000", 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4580000000000001e-06 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705859+0000", 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056017999999999997 2024-09-13T18:46:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705875+0000", 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712781+0000", 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006906049 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.712904+0000", 2024-09-13T18:46:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012299500000000001 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713037+0000", 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013289500000000001 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716082+0000", 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003045121 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716102+0000", 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9570000000000001e-05 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716153+0000", 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1595999999999999e-05 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716189+0000", 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6219e-05 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.64239112999999, 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011085774, 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 136 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705306+0000", 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705305+0000", 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705311+0000", 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4879999999999998e-06 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705884+0000", 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057327099999999998 2024-09-13T18:46:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705889+0000", 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5959999999999997e-06 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713536+0000", 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076473720000000004 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713618+0000", 2024-09-13T18:46:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1916000000000006e-05 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.713771+0000", 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015359099999999999 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716201+0000", 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024295789999999999 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716286+0000", 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4572000000000003e-05 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716346+0000", 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0872000000000003e-05 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716391+0000", 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4935000000000003e-05 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.642383532, 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003552999999999, 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 137 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705313+0000", 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705521+0000", 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020815300000000001 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705897+0000", 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000376084 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705914+0000", 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6985000000000001e-05 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714292+0000", 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083780929999999997 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714361+0000", 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9164000000000004e-05 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.714473+0000", 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111428 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718169+0000", 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036966880000000001 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718240+0000", 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0504000000000001e-05 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718288+0000", 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7876e-05 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718317+0000", 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8994000000000001e-05 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.64217211499999, 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012853671000000001, 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 138 2024-09-13T18:46:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705525+0000", 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705524+0000", 2024-09-13T18:46:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705528+0000", 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2080000000000002e-06 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705923+0000", 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000394325 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705931+0000", 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9249999999999995e-06 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715358+0000", 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094278469999999996 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715434+0000", 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5508999999999998e-05 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.715597+0000", 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016337099999999999 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718229+0000", 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026313439999999999 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718329+0000", 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9983999999999997e-05 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718357+0000", 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8036000000000001e-05 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718378+0000", 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1591999999999999e-05 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.446 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.64216634100001, 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013647308, 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 139 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:49.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705530+0000", 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705547+0000", 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705940+0000", 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000393223 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705944+0000", 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4399999999999998e-06 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716444+0000", 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010499099 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716519+0000", 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5282000000000002e-05 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.716684+0000", 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016495 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718390+0000", 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001705774 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719092+0000", 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070283300000000004 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719143+0000", 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0665999999999999e-05 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719178+0000", 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4700000000000003e-05 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.6421473, 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015575284, 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.452 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 140 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705549+0000", 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705778+0000", 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000228879 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705954+0000", 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017580499999999999 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705965+0000", 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.134e-05 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717132+0000", 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011167191999999999 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717257+0000", 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124494 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.717426+0000", 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016954200000000001 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719245+0000", 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018190770000000001 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721057+0000", 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018122419999999999 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721097+0000", 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9249999999999999e-05 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.721125+0000", 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8073e-05 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.457 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 115.641915135, 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018088317, 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 141 2024-09-13T18:46:49.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705782+0000", 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705781+0000", 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705791+0000", 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9320000000000008e-06 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705974+0000", 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182669 2024-09-13T18:46:49.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.705978+0000", 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4129999999999999e-06 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718426+0000", 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012448221000000001 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718538+0000", 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111723 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.718691+0000", 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015337700000000001 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.719898+0000", 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012068490000000001 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723812+0000", 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039137340000000003 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723848+0000", 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.561e-05 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:53.723870+0000", 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2351e-05 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.463 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4198.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 114.7687986, 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097077229999999997, 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4198", 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.86:0/3215691737", 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 159 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.464 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578898+0000", 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578897+0000", 2024-09-13T18:46:49.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.578905+0000", 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.588e-06 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579070+0000", 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165005 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.579075+0000", 2024-09-13T18:46:49.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9599999999999999e-06 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586196+0000", 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071218150000000001 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586339+0000", 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014266800000000001 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:49.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.586488+0000", 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014877799999999999 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.587867+0000", 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013791840000000001 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588515+0000", 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064776000000000005 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:49.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588570+0000", 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5275999999999997e-05 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:44:54.588606+0000", 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5784999999999997e-05 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:49.469 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:49.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.347+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f9414c820 con 0x7f0f9402b6a0 2024-09-13T18:46:49.470 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:49.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.347+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0f9402c510 0x7f0f94203440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.347+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f9402c950 con 0x7f0f9402c510 2024-09-13T18:46:49.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.347+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0f9402c510 0x7f0f94203440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.351+0000 7f0f98c00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0f9402c510 0x7f0f94203440 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.471 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.351+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f9402c950 con 0x7f0f9402c510 2024-09-13T18:46:49.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:49.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.371+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f9414c990 con 0x7f0f9402c510 2024-09-13T18:46:49.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.375+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f9414c990 con 0x7f0f9402c510 2024-09-13T18:46:49.473 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.375+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0f94203980 0x7f0f94205d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.375+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f94208bf0 con 0x7f0f94203980 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.375+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0f94203980 0x7f0f94205d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.375+0000 7f0f9a000700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0f94203980 0x7f0f94205d70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.375+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f94208bf0 con 0x7f0f94203980 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.395+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f942062b0 con 0x7f0f94203980 2024-09-13T18:46:49.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.399+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f942062b0 con 0x7f0f94203980 2024-09-13T18:46:49.475 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:49.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.399+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0f94206930 0x7f0f94208d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:49.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.399+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f9420bba0 con 0x7f0f94206930 2024-09-13T18:46:49.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.399+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0f94206930 0x7f0f94208d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:49.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.399+0000 7f0f99600700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0f94206930 0x7f0f94208d20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:49.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.399+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f9420bba0 con 0x7f0f94206930 2024-09-13T18:46:49.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.419+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f0f94209260 con 0x7f0f94206930 2024-09-13T18:46:49.476 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f91600700 1 -- 172.21.15.32:0/3708254636 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f0f94209260 con 0x7f0f94206930 2024-09-13T18:46:49.476 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:49.478 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:49.466+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:49.478 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0f941ed5a0 msgr2=0x7f0f94151980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f0f941ed5a0 0x7f0f94151980 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0f940c1da0 msgr2=0x7f0f941474c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0f940c1da0 0x7f0f941474c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0f94153a40 msgr2=0x7f0f94147f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f0f94153a40 0x7f0f94147f10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0f94061840 msgr2=0x7f0f9414b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f0f94061840 0x7f0f9414b9a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0f9402b6a0 msgr2=0x7f0f9402bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f0f9402b6a0 0x7f0f9402bac0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9a000700 1 -- 172.21.15.32:0/3708254636 reap_dead start 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9a000700 1 -- 172.21.15.32:0/3708254636 reap_dead start 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0f9402c510 msgr2=0x7f0f94203440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.479 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f0f9402c510 0x7f0f94203440 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0f94203980 msgr2=0x7f0f94205d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f0f94203980 0x7f0f94205d70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0f94206930 msgr2=0x7f0f94208d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f0f94206930 0x7f0f94208d20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0f74066730 msgr2=0x7f0f74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0f74066730 0x7f0f74068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f940cbe70 tx=0x7f0f80007e00 comp rx=0 tx=0).stop 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 msgr2=0x7f0f940cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 0x7f0f940cb550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0f88000c00 tx=0x7f0f88004770 comp rx=0 tx=0).stop 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9a000700 1 -- 172.21.15.32:0/3708254636 reap_dead start 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 shutdown_connections 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 --2- 172.21.15.32:0/3708254636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f9406e1e0 0x7f0f940cb550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 >> 172.21.15.32:0/3708254636 conn(0x7f0f94072680 msgr2=0x7f0f94073fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 shutdown_connections 2024-09-13T18:46:49.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:49.423+0000 7f0f9aa00700 1 -- 172.21.15.32:0/3708254636 wait complete. 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:49.481 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:49.571 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:49.567+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:49.666 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:49.666 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:49.666 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:49.666 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:49.673 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:49.669+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:49.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:49.774 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:49.769+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:49.869 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:49.869 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:49.875 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:49.871+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:49.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:49.977 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:49.971+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:50.078 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:50.073+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:50.084 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:50.084 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.757789445, 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:50.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.756483661, 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:50.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.755807612, 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:50.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:50.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:50.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.755795292, 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:50.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:50.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.75578053700001, 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:50.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:50.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:50.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.755775485, 2024-09-13T18:46:50.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:50.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:50.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.755770185, 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.122 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.75004377899999, 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.126 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:50.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.748721871, 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:50.130 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.134 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.74868357299999, 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:50.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:50.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:50.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:50.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:50.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:50.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:50.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.140 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 103.744330824, 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:50.141 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:50.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:50.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 96.139347395000001, 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:50.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:50.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 94.302909408000005, 2024-09-13T18:46:50.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:50.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 89.059694566999994, 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:50.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:50.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:50.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.748492366999997, 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:50.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:50.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:50.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:50.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:50.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:50.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:50.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:50.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:50.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:50.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:50.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.748463170999997, 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:50.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:50.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.177 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.745289847999999, 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:50.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:50.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.182 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.674132628000002, 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:50.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:50.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5398~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.222451566, 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031271250000000001, 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858261+0000", 2024-09-13T18:46:50.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858278+0000", 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858331+0000", 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2884999999999999e-05 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858345+0000", 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4154e-05 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858429+0000", 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3588e-05 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858547+0000", 2024-09-13T18:46:50.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011875 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858693+0000", 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001461 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860297+0000", 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603033 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861283+0000", 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098661600000000006 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861346+0000", 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2866000000000004e-05 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861391+0000", 2024-09-13T18:46:50.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4713999999999999e-05 2024-09-13T18:46:50.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.194 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.195 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.222424110999999, 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038877360000000001, 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:50.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858295+0000", 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.656e-06 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858375+0000", 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9847999999999999e-05 2024-09-13T18:46:50.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858386+0000", 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0665999999999999e-05 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859128+0000", 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074182399999999998 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859200+0000", 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2170999999999997e-05 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859298+0000", 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8455000000000005e-05 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860602+0000", 2024-09-13T18:46:50.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013036510000000001 2024-09-13T18:46:50.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862094+0000", 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492581 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862141+0000", 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6585999999999997e-05 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862179+0000", 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7796000000000002e-05 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.203 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.204 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.204 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:50.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:50.206 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:50.201+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:50.306 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:50.299+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:50.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:46:50.404 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:50.405 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:50.407 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:50.403+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:50.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:50.509 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:50.505+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:50.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.527+0000 7f11a6200700 1 Processor -- start 2024-09-13T18:46:50.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a6200700 1 -- start start 2024-09-13T18:46:50.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a6200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f11a00c8f10 0x7f11a00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a6200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f11a00c8950 0x7f11a015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a6200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00c8370 con 0x7f11a0153840 2024-09-13T18:46:50.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a6200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a006b810 con 0x7f11a00c8f10 2024-09-13T18:46:50.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a6200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a00c8650 con 0x7f11a00c8950 2024-09-13T18:46:50.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a4e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f11a0153840 0x7f11a00ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38098/0 (socket says 172.21.15.32:38098) 2024-09-13T18:46:50.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f11a00c8f10 0x7f11a00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a4e00700 1 -- 172.21.15.32:0/177352907 learned_addr learned my addr 172.21.15.32:0/177352907 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f11a5800700 1 --2- 172.21.15.32:0/177352907 >> v2:172.21.15.86:3300/0 conn(0x7f11a00c8950 0x7f11a015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119f400700 1 -- 172.21.15.32:0/177352907 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670553267 0 0) 0x7f11a00c8370 con 0x7f11a0153840 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119f400700 1 -- 172.21.15.32:0/177352907 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11880035d0 con 0x7f11a0153840 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119fe00700 1 -- 172.21.15.32:0/177352907 >> v2:172.21.15.86:3300/0 conn(0x7f11a00c8950 msgr2=0x7f11a015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119fe00700 1 --2- 172.21.15.32:0/177352907 >> v2:172.21.15.86:3300/0 conn(0x7f11a00c8950 0x7f11a015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119fe00700 1 -- 172.21.15.32:0/177352907 >> v1:172.21.15.32:6789/0 conn(0x7f11a0153840 legacy=0x7f11a00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119fe00700 1 -- 172.21.15.32:0/177352907 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a006ae70 con 0x7f11a00c8f10 2024-09-13T18:46:50.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.531+0000 7f119fe00700 1 --2- 172.21.15.32:0/177352907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a00c93e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11a0066cf0 tx=0x7f118c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbda64fcced21a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:50.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f119f400700 1 -- 172.21.15.32:0/177352907 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c011830 con 0x7f11a00c8f10 2024-09-13T18:46:50.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f119f400700 1 -- 172.21.15.32:0/177352907 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c011990 con 0x7f11a00c8f10 2024-09-13T18:46:50.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f119f400700 1 -- 172.21.15.32:0/177352907 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c011d00 con 0x7f11a00c8f10 2024-09-13T18:46:50.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 -- 172.21.15.32:0/177352907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 msgr2=0x7f11a00c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 --2- 172.21.15.32:0/177352907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a00c93e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11a0066cf0 tx=0x7f118c009b30 comp rx=0 tx=0).stop 2024-09-13T18:46:50.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 -- 172.21.15.32:0/177352907 shutdown_connections 2024-09-13T18:46:50.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 --2- 172.21.15.32:0/177352907 >> v2:172.21.15.86:3300/0 conn(0x7f11a00c8950 0x7f11a015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 --2- 172.21.15.32:0/177352907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a00c93e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 -- 172.21.15.32:0/177352907 >> 172.21.15.32:0/177352907 conn(0x7f11a0071740 msgr2=0x7f11a0071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:50.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 -- 172.21.15.32:0/177352907 shutdown_connections 2024-09-13T18:46:50.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 -- 172.21.15.32:0/177352907 wait complete. 2024-09-13T18:46:50.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 Processor -- start 2024-09-13T18:46:50.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.535+0000 7f11a6200700 1 -- start start 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11a00c8950 0x7f11a0157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a014bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a0153840 0x7f11a01f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0144340 con 0x7f11a00c8f10 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0157aa0 con 0x7f11a0153840 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a01f3660 con 0x7f11a00c8950 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a014bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a014bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34600/0 (socket says 172.21.15.32:34600) 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 -- 172.21.15.32:0/315086337 learned_addr learned my addr 172.21.15.32:0/315086337 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:50.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a4e00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11a00c8950 0x7f11a0157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a5800700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a0153840 0x7f11a01f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 -- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11a00c8950 msgr2=0x7f11a0157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11a00c8950 0x7f11a0157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 -- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a0153840 msgr2=0x7f11a01f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a0153840 0x7f11a01f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 -- 172.21.15.32:0/315086337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0094b0 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119fe00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a014bef0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f118c0090b0 tx=0x7f118c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0044d0 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c01f070 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0038c0 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a0159490 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a0157450 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.539+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a0070560 con 0x7f11a00c8f10 2024-09-13T18:46:50.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.543+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f118c003a20 con 0x7f11a00c8f10 2024-09-13T18:46:50.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.543+0000 7f119cc00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1180066800 0x7f1180068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.543+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f118c021070 con 0x7f11a00c8f10 2024-09-13T18:46:50.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.543+0000 7f11a4e00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1180066800 0x7f1180068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.543+0000 7f11a4e00700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1180066800 0x7f1180068cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1194007fd0 tx=0x7f1194009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:50.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.551+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f118c052c50 con 0x7f11a00c8f10 2024-09-13T18:46:50.610 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:50.603+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:50.670 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:50.671 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:50.671 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:50.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:50.727 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:50.723+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:50.811 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:50.805+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:50.874 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:50.874 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:50.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:50.874 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:50.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.874 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.54901778199999, 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:50.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:50.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:50.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.548997861, 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:50.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:50.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.54898543500001, 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:50.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:50.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.548977712, 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:50.892 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:50.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:50.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:50.896 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.548937528, 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:50.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.900 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.544957646, 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:50.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.904 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.54359309900001, 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:50.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.543555669, 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:50.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.543091289, 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:50.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.914 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:50.914 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:50.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:50.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:50.918 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.54265992400001, 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:50.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:50.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.542051509, 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:50.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:50.927 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.541657091, 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:50.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:50.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.541603071, 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:50.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:50.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:50.936 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 104.540118358, 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:50.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:ff5b34d6:::1.00000000:head, version: 26'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:ff5b34d6:::1.00000000:head@26'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:50.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5179274560000007, 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034838499999999999, 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352959+0000", 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352975+0000", 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352987+0000", 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1989e-05 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353001+0000", 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4423000000000001e-05 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353061+0000", 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9616e-05 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353073+0000", 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659e-05 2024-09-13T18:46:50.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353308+0000", 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023517500000000001 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.7 53/52 [PushOp(2:e0b41d06:::609.00000000:head, version: 25'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:e0b41d06:::609.00000000:head@25'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5176675579999994, 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000323679, 2024-09-13T18:46:50.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353231+0000", 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2559e-05 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353244+0000", 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2952000000000001e-05 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353258+0000", 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4218e-05 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353335+0000", 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6889000000000002e-05 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353341+0000", 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9630000000000003e-06 2024-09-13T18:46:50.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353543+0000", 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020175099999999999 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:fe07bba1:::100.00000000.inode:head, version: 26'3, data_included: [0~582], data_size: 582, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:fe07bba1:::100.00000000.inode:head@26'3, size: 582, copy_subset: [0~582], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:582, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5076533940000001, 2024-09-13T18:46:50.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045910699999999999, 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363233+0000", 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363248+0000", 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5116000000000001e-05 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363269+0000", 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1433999999999998e-05 2024-09-13T18:46:50.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363285+0000", 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5342999999999999e-05 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363354+0000", 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9274000000000001e-05 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363362+0000", 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2439999999999993e-06 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363693+0000", 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033038099999999998 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.b 53/52 [PushOp(2:d0630e4c:::mds0_sessionmap:head, version: 25'1, data_included: [], data_size: 0, omap_header_size: 14, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:d0630e4c:::mds0_sessionmap:head@25'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:50.953 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5065941709999997, 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043993199999999997, 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:50.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364292+0000", 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364304+0000", 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1576000000000001e-05 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364317+0000", 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3227999999999999e-05 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364329+0000", 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2383e-05 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364400+0000", 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0310999999999998e-05 2024-09-13T18:46:50.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364413+0000", 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2994e-05 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364733+0000", 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000320088 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:50.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:50.958 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:50.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:50.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:50.903+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7f11a0153c20 con 0x7f11a00c8f10 2024-09-13T18:46:50.960 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:50.953+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:51.060 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:51.057+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:51.074 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:51.074 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:51.074 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:51.084 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:51.161 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:51.157+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:51.189 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:51.189 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:51.189 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:51.199 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:51.262 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:51.257+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:51.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.347+0000 7f119cc00700 1 -- 172.21.15.32:0/315086337 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f118c015090 con 0x7f11a00c8f10 2024-09-13T18:46:51.355 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:51.355 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.025144403, 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:51.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:51.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024387649, 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:51.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:51.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.02436899, 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:51.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:51.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:51.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.375 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024356901, 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.376 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:51.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:51.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024350176, 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:51.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:51.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.02434333399999, 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.391 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:51.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:51.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.398 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.02433724300001, 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:51.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024312155, 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:51.405 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:51.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:51.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:51.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024307499, 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.412 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:51.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:51.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:51.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:51.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.419 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.0242934, 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:51.427 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024281446, 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.02427292599999, 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.441 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024267821, 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:51.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:51.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.024193526, 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:51.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.023272104, 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.454 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:51.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:51.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.461 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.023246947, 2024-09-13T18:46:51.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:51.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.467 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.02319023699999, 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:51.472 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.01982648400001, 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:51.473 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:51.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:51.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.01904669300001, 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 99.524253626000004, 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:51.483 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:51.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:51.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:51.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.491 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:51.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:51.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:51.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1180066800 msgr2=0x7f1180068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1180066800 0x7f1180068cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1194007fd0 tx=0x7f1194009040 comp rx=0 tx=0).stop 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 msgr2=0x7f11a014bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a014bef0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f118c0090b0 tx=0x7f118c004770 comp rx=0 tx=0).stop 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 shutdown_connections 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1180066800 0x7f1180068cc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a0153840 0x7f11a01f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11a00c8f10 0x7f11a014bef0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 --2- 172.21.15.32:0/315086337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11a00c8950 0x7f11a0157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 >> 172.21.15.32:0/315086337 conn(0x7f11a0071740 msgr2=0x7f11a00cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 shutdown_connections 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.351+0000 7f11a6200700 1 -- 172.21.15.32:0/315086337 wait complete. 2024-09-13T18:46:51.496 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:46:51.497 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:51.487+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:51.593 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:51.589+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:51.614 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:51.614 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:51.614 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:51.614 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:51.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b88a00700 1 Processor -- start 2024-09-13T18:46:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b88a00700 1 -- start start 2024-09-13T18:46:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b88a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2b840c2c00 0x7f2b8415da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b88a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b840c8460 con 0x7f2b84070840 2024-09-13T18:46:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b88a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b84158170 con 0x7f2b84157d90 2024-09-13T18:46:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b88a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b840c6cd0 con 0x7f2b840c2c00 2024-09-13T18:46:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b81e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2b84070840 0x7f2b841663f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38102/0 (socket says 172.21.15.32:38102) 2024-09-13T18:46:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b81e00700 1 -- 172.21.15.32:0/3853066376 learned_addr learned my addr 172.21.15.32:0/3853066376 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b83200700 1 --2- 172.21.15.32:0/3853066376 >> v2:172.21.15.86:3300/0 conn(0x7f2b840c2c00 0x7f2b8415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.671+0000 7f2b81400700 1 -- 172.21.15.32:0/3853066376 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199504965 0 0) 0x7f2b840c8460 con 0x7f2b84070840 2024-09-13T18:46:51.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b81400700 1 -- 172.21.15.32:0/3853066376 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b680035d0 con 0x7f2b84070840 2024-09-13T18:46:51.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b83200700 1 -- 172.21.15.32:0/3853066376 >> v1:172.21.15.86:6789/0 conn(0x7f2b84157d90 legacy=0x7f2b84073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b83200700 1 -- 172.21.15.32:0/3853066376 >> v1:172.21.15.32:6789/0 conn(0x7f2b84070840 legacy=0x7f2b841663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b83200700 1 -- 172.21.15.32:0/3853066376 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840c86d0 con 0x7f2b840c2c00 2024-09-13T18:46:51.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b83200700 1 --2- 172.21.15.32:0/3853066376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b8415da80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009d90 tx=0x7f2b7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d329122c8e2f6f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b81400700 1 -- 172.21.15.32:0/3853066376 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00e070 con 0x7f2b840c2c00 2024-09-13T18:46:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b81400700 1 -- 172.21.15.32:0/3853066376 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c00bb20 con 0x7f2b840c2c00 2024-09-13T18:46:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b81400700 1 -- 172.21.15.32:0/3853066376 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00be90 con 0x7f2b840c2c00 2024-09-13T18:46:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 -- 172.21.15.32:0/3853066376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 msgr2=0x7f2b8415da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 --2- 172.21.15.32:0/3853066376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b8415da80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009d90 tx=0x7f2b7c00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 -- 172.21.15.32:0/3853066376 shutdown_connections 2024-09-13T18:46:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 --2- 172.21.15.32:0/3853066376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b8415da80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 -- 172.21.15.32:0/3853066376 >> 172.21.15.32:0/3853066376 conn(0x7f2b84072680 msgr2=0x7f2b840cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 -- 172.21.15.32:0/3853066376 shutdown_connections 2024-09-13T18:46:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.675+0000 7f2b88a00700 1 -- 172.21.15.32:0/3853066376 wait complete. 2024-09-13T18:46:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 Processor -- start 2024-09-13T18:46:51.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 -- start start 2024-09-13T18:46:51.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 0x7f2b841544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b841f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b84157d90 0x7f2b84159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840cc400 con 0x7f2b84070840 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8415ab00 con 0x7f2b840c2c00 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84154a10 con 0x7f2b84157d90 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 0x7f2b841544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b81e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b841f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 0x7f2b841544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34604/0 (socket says 172.21.15.32:34604) 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b81e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b841f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:48258/0 (socket says 172.21.15.32:48258) 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 -- 172.21.15.32:0/830311426 learned_addr learned my addr 172.21.15.32:0/830311426 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b84157d90 0x7f2b84159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b84157d90 msgr2=0x7f2b84159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b84157d90 0x7f2b84159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 msgr2=0x7f2b841f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b840c2c00 0x7f2b841f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c009a70 con 0x7f2b84070840 2024-09-13T18:46:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 0x7f2b841544d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c500 tx=0x7f2b7400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740052d0 con 0x7f2b84070840 2024-09-13T18:46:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74005430 con 0x7f2b84070840 2024-09-13T18:46:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b841584a0 con 0x7f2b84070840 2024-09-13T18:46:51.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740055a0 con 0x7f2b84070840 2024-09-13T18:46:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.679+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8415a790 con 0x7f2b84070840 2024-09-13T18:46:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.683+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f2b8415a920 con 0x7f2b84070840 2024-09-13T18:46:51.689 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.683+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b740038e0 con 0x7f2b84070840 2024-09-13T18:46:51.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b7aa00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2b64066730 0x7f2b64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f2b740838b0 con 0x7f2b84070840 2024-09-13T18:46:51.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b81e00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2b64066730 0x7f2b64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v58) v1 ==== 54+0+16 (secure 0 0 0) 0x7f2b74083b90 con 0x7f2b84070840 2024-09-13T18:46:51.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f2b8415c420 0x7f2b8415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8406ec60 con 0x7f2b8415c420 2024-09-13T18:46:51.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b81e00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2b64066730 0x7f2b64068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b840c1b30 tx=0x7f2b70007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f2b8415c420 0x7f2b8415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f2b8415c420 0x7f2b8415b8f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.693 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:51.687+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:51.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.687+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b8406ec60 con 0x7f2b8415c420 2024-09-13T18:46:51.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.711+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b840c68f0 con 0x7f2b8415c420 2024-09-13T18:46:51.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.711+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b7c0098f0 con 0x7f2b8415c420 2024-09-13T18:46:51.718 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.711+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f2b8415af70 0x7f2b841f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.711+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8406d490 con 0x7f2b8415af70 2024-09-13T18:46:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.715+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f2b8415af70 0x7f2b841f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.715+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f2b8415af70 0x7f2b841f68b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.715+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b74054010 con 0x7f2b8415af70 2024-09-13T18:46:51.726 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:51.726 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:51.726 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:51.726 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:51.726 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:51.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:51.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.731+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b8415b4a0 con 0x7f2b8415af70 2024-09-13T18:46:51.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.735+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b8415b4a0 con 0x7f2b8415af70 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.735+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f2b841f7300 0x7f2b84060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.735+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b841f7740 con 0x7f2b841f7300 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.735+0000 7f2b81e00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f2b841f7300 0x7f2b84060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.735+0000 7f2b81e00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f2b841f7300 0x7f2b84060db0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.735+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b70001390 con 0x7f2b841f7300 2024-09-13T18:46:51.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.763+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b8415a4a0 con 0x7f2b841f7300 2024-09-13T18:46:51.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.767+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b8415a4a0 con 0x7f2b841f7300 2024-09-13T18:46:51.771 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:51.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.767+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f2b84061970 0x7f2b84154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.767+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b84061db0 con 0x7f2b84061970 2024-09-13T18:46:51.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.767+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f2b84061970 0x7f2b84154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.767+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f2b84061970 0x7f2b84154b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.767+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b7c0040c0 con 0x7f2b84061970 2024-09-13T18:46:51.794 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:51.789+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:51.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.791+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b84155380 con 0x7f2b84061970 2024-09-13T18:46:51.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.791+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b84155380 con 0x7f2b84061970 2024-09-13T18:46:51.797 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:51.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.791+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f2b8402b6a0 0x7f2b8402bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.791+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b84155a00 con 0x7f2b8402b6a0 2024-09-13T18:46:51.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.791+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f2b8402b6a0 0x7f2b8402bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.791+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f2b8402b6a0 0x7f2b8402bac0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.795+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b84155a00 con 0x7f2b8402b6a0 2024-09-13T18:46:51.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.819+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b84155a00 con 0x7f2b8402b6a0 2024-09-13T18:46:51.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.823+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b84155a00 con 0x7f2b8402b6a0 2024-09-13T18:46:51.829 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:51.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.823+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f2b8402c510 0x7f2b84209c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.823+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b84155b70 con 0x7f2b8402c510 2024-09-13T18:46:51.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.823+0000 7f2b81e00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f2b8402c510 0x7f2b84209c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.827+0000 7f2b81e00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f2b8402c510 0x7f2b84209c40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.827+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b84155b70 con 0x7f2b8402c510 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.506572312, 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:46:51.848 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:46:51.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.852 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.495335318, 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:46:51.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:46:51.857 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.432563812, 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.859 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:46:51.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.40232567300001, 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:46:51.862 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:46:51.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.866 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.40171730500001, 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:46:51.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:46:51.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:51.871 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.033398478, 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:51.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.875 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.032616893, 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:51.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:46:51.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.031849704, 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:46:51.880 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:46:51.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.884 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.031014445, 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:46:51.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:46:51.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:46:51.889 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.030023833, 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:46:51.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:46:51.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.02941033899999, 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:46:51.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.898 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.127124233, 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.125850529, 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.903 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:46:51.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:46:51.907 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.118046902, 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:51.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.117274014, 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:46:51.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:46:51.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.519040022, 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.917 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:46:51.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.922 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.51901476499999, 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:51.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.518982622, 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:51.927 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:46:51.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:46:51.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:51.931 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.51622177, 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:46:51.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:46:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 105.513260999, 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:46:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:46:51.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:46:51.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.941 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.942 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:51.942 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:51.942 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:51.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.851+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b84155b70 con 0x7f2b8402c510 2024-09-13T18:46:51.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.855+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b84155b70 con 0x7f2b8402c510 2024-09-13T18:46:51.944 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:51.945 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:51.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.855+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f2b8402c990 0x7f2b8420c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.855+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8420f520 con 0x7f2b8402c990 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.859+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f2b8402c990 0x7f2b8420c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.859+0000 7f2b83200700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f2b8402c990 0x7f2b8420c6a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.859+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b8420f520 con 0x7f2b8402c990 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.875+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b8420cbe0 con 0x7f2b8402c990 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.879+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b8420cbe0 con 0x7f2b8402c990 2024-09-13T18:46:51.946 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:51.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.879+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f2b8420d260 0x7f2b8420f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.879+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b842124d0 con 0x7f2b8420d260 2024-09-13T18:46:51.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.879+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f2b8420d260 0x7f2b8420f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.883+0000 7f2b82800700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f2b8420d260 0x7f2b8420f650 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.883+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b842124d0 con 0x7f2b8420d260 2024-09-13T18:46:51.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.911+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7f2b8420fb90 con 0x7f2b8420d260 2024-09-13T18:46:51.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.911+0000 7f2b7aa00700 1 -- 172.21.15.32:0/830311426 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f2b8420fb90 con 0x7f2b8420d260 2024-09-13T18:46:51.948 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f2b8415c420 msgr2=0x7f2b8415b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f2b8415c420 0x7f2b8415b8f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f2b8415af70 msgr2=0x7f2b841f68b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f2b8415af70 0x7f2b841f68b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f2b841f7300 msgr2=0x7f2b84060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f2b841f7300 0x7f2b84060db0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b83200700 1 -- 172.21.15.32:0/830311426 reap_dead start 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f2b84061970 msgr2=0x7f2b84154b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f2b84061970 0x7f2b84154b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f2b8402b6a0 msgr2=0x7f2b8402bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f2b8402b6a0 0x7f2b8402bac0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f2b8402c510 msgr2=0x7f2b84209c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f2b8402c510 0x7f2b84209c40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f2b8402c990 msgr2=0x7f2b8420c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f2b8402c990 0x7f2b8420c6a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f2b8420d260 msgr2=0x7f2b8420f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f2b8420d260 0x7f2b8420f650 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b83200700 1 -- 172.21.15.32:0/830311426 reap_dead start 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2b64066730 msgr2=0x7f2b64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2b64066730 0x7f2b64068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b840c1b30 tx=0x7f2b70007de0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 msgr2=0x7f2b841544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 0x7f2b841544d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c500 tx=0x7f2b7400c810 comp rx=0 tx=0).stop 2024-09-13T18:46:51.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 shutdown_connections 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2b64066730 0x7f2b64068bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 --2- 172.21.15.32:0/830311426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b84070840 0x7f2b841544d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 >> 172.21.15.32:0/830311426 conn(0x7f2b84072680 msgr2=0x7f2b841563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 shutdown_connections 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:51.915+0000 7f2b88a00700 1 -- 172.21.15.32:0/830311426 wait complete. 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:51.952 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:51.953 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:51.939+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:52.044 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:52.041+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:52.104 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.105 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:52.160 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:52.157+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:52.224 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.225 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.234 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:52.246 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:52.241+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:52.341 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.341 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.347 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:52.343+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:52.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:52.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:46:52.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:46:52.357 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-13T18:46:52.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-13T18:46:52.447 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:52.441+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:52.504 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.504 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.507+0000 7fe2ba400700 1 Processor -- start 2024-09-13T18:46:52.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.507+0000 7fe2ba400700 1 -- start start 2024-09-13T18:46:52.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:52.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2ba400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe2b40c58e0 0x7fe2b406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2ba400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b415aac0 con 0x7fe2b4070930 2024-09-13T18:46:52.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2ba400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b415ada0 con 0x7fe2b40c5cc0 2024-09-13T18:46:52.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2ba400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b406fa70 con 0x7fe2b40c58e0 2024-09-13T18:46:52.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe2b4070930 0x7fe2b41578a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38106/0 (socket says 172.21.15.32:38106) 2024-09-13T18:46:52.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9a00700 1 -- 172.21.15.32:0/551858652 learned_addr learned my addr 172.21.15.32:0/551858652 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:52.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9000700 1 --2- 172.21.15.32:0/551858652 >> v2:172.21.15.32:3300/0 conn(0x7fe2b40c58e0 0x7fe2b406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b3400700 1 -- 172.21.15.32:0/551858652 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733704008 0 0) 0x7fe2b415ada0 con 0x7fe2b40c5cc0 2024-09-13T18:46:52.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b3400700 1 -- 172.21.15.32:0/551858652 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c0035d0 con 0x7fe2b40c5cc0 2024-09-13T18:46:52.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9000700 1 -- 172.21.15.32:0/551858652 >> v1:172.21.15.86:6789/0 conn(0x7fe2b40c5cc0 legacy=0x7fe2b406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9000700 1 -- 172.21.15.32:0/551858652 >> v1:172.21.15.32:6789/0 conn(0x7fe2b4070930 legacy=0x7fe2b41578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9000700 1 -- 172.21.15.32:0/551858652 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b415b080 con 0x7fe2b40c58e0 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.511+0000 7fe2b9000700 1 --2- 172.21.15.32:0/551858652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b406f530 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009850 tx=0x7fe2a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810d7aae33aed037 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2b3400700 1 -- 172.21.15.32:0/551858652 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011830 con 0x7fe2b40c58e0 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2b3400700 1 -- 172.21.15.32:0/551858652 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8011990 con 0x7fe2b40c58e0 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2b3400700 1 -- 172.21.15.32:0/551858652 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011d00 con 0x7fe2b40c58e0 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 -- 172.21.15.32:0/551858652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 msgr2=0x7fe2b406f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 --2- 172.21.15.32:0/551858652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b406f530 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009850 tx=0x7fe2a8009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:52.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 -- 172.21.15.32:0/551858652 shutdown_connections 2024-09-13T18:46:52.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 --2- 172.21.15.32:0/551858652 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b406f530 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 -- 172.21.15.32:0/551858652 >> 172.21.15.32:0/551858652 conn(0x7fe2b40c8a60 msgr2=0x7fe2b40c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 -- 172.21.15.32:0/551858652 shutdown_connections 2024-09-13T18:46:52.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 -- 172.21.15.32:0/551858652 wait complete. 2024-09-13T18:46:52.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 Processor -- start 2024-09-13T18:46:52.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.515+0000 7fe2ba400700 1 -- start start 2024-09-13T18:46:52.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2b4070930 0x7fe2b4073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b4151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2b40c5cc0 0x7fe2b4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40c1fe0 con 0x7fe2b40c58e0 2024-09-13T18:46:52.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4153b00 con 0x7fe2b40c5cc0 2024-09-13T18:46:52.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4153d30 con 0x7fe2b4070930 2024-09-13T18:46:52.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b9a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2b40c5cc0 0x7fe2b4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2b4070930 0x7fe2b4073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b4151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2b4070930 0x7fe2b4073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51880/0 (socket says 172.21.15.32:51880) 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b9000700 1 -- 172.21.15.32:0/3758373021 learned_addr learned my addr 172.21.15.32:0/3758373021 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2b4070930 msgr2=0x7fe2b4073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2b4070930 0x7fe2b4073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2b40c5cc0 msgr2=0x7fe2b4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2b40c5cc0 0x7fe2b4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 -- 172.21.15.32:0/3758373021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a80094b0 con 0x7fe2b40c58e0 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b3e00700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b4151f30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c430 tx=0x7fe2a000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00052d0 con 0x7fe2b40c58e0 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a0005450 con 0x7fe2b40c58e0 2024-09-13T18:46:52.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b41ef000 con 0x7fe2b40c58e0 2024-09-13T18:46:52.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00038e0 con 0x7fe2b40c58e0 2024-09-13T18:46:52.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b41ef5c0 con 0x7fe2b40c58e0 2024-09-13T18:46:52.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.519+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b406fe80 con 0x7fe2b40c58e0 2024-09-13T18:46:52.528 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.523+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2a0003c50 con 0x7fe2b40c58e0 2024-09-13T18:46:52.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.523+0000 7fe2b0c00700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe294066760 0x7fe294068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.523+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fe2a0083a10 con 0x7fe2b40c58e0 2024-09-13T18:46:52.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.523+0000 7fe2b9000700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe294066760 0x7fe294068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.530 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.527+0000 7fe2b9000700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe294066760 0x7fe294068c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009ba0 tx=0x7fe2a801c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.531+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2a0050970 con 0x7fe2b40c58e0 2024-09-13T18:46:52.560 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:52.557+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:52.622 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.623 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:52.649 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:52.645+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:52.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.711+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd reweight-by-utilization", "oload": 110, "max_change": 1.0, "target": ["mon-mgr", ""]}) v1 -- 0x7fe2b40713c0 con 0x7fe294066760 2024-09-13T18:46:52.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.711+0000 7fe2b0c00700 1 -- 172.21.15.32:0/3758373021 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 no change) v1 ==== 17+0+294 (secure 0 0 0) 0x7fe2b40713c0 con 0x7fe294066760 2024-09-13T18:46:52.717 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 322 (0%) 2024-09-13T18:46:52.717 INFO:teuthology.orchestra.run.smithi032.stdout:avg 40.25 2024-09-13T18:46:52.717 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 4.91808 -> 4.91808 (expected baseline 5.93454) 2024-09-13T18:46:52.717 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.7 with 35 -> 35 pgs (0.869565 -> 0.869565 * mean) 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 50 -> 50 pgs (1.24224 -> 1.24224 * mean) 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout:oload 110 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 1 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-13T18:46:52.718 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0004 2024-09-13T18:46:52.720 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe294066760 msgr2=0x7fe294068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe294066760 0x7fe294068c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009ba0 tx=0x7fe2a801c040 comp rx=0 tx=0).stop 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 msgr2=0x7fe2b4151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b4151f30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c430 tx=0x7fe2a000c740 comp rx=0 tx=0).stop 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 shutdown_connections 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe294066760 0x7fe294068c20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2b40c5cc0 0x7fe2b4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2b40c58e0 0x7fe2b4151f30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 --2- 172.21.15.32:0/3758373021 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe2b4070930 0x7fe2b4073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 >> 172.21.15.32:0/3758373021 conn(0x7fe2b40c8a60 msgr2=0x7fe2b40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 shutdown_connections 2024-09-13T18:46:52.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.715+0000 7fe2ba400700 1 -- 172.21.15.32:0/3758373021 wait complete. 2024-09-13T18:46:52.724 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-13T18:46:52.737 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.737 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:52.749 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-13T18:46:52.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-13T18:46:52.798 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:52.791+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:52.850 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:52.847+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:52.945 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:52.945 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:52.952 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:52.949+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:52.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:52.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.991+0000 7f060aa00700 1 Processor -- start 2024-09-13T18:46:52.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 -- start start 2024-09-13T18:46:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0604153840 0x7f06040c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06040c8f10 0x7f06040ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040c8370 con 0x7f06040c8950 2024-09-13T18:46:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060406b810 con 0x7f06040c8f10 2024-09-13T18:46:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06040c8650 con 0x7f0604153840 2024-09-13T18:46:53.003 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06040c8f10 0x7f06040ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06040c8f10 0x7f06040ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34640/0 (socket says 172.21.15.32:34640) 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 -- 172.21.15.32:0/2950583458 learned_addr learned my addr 172.21.15.32:0/2950583458 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0609600700 1 --2- 172.21.15.32:0/2950583458 >> v2:172.21.15.86:3300/0 conn(0x7f0604153840 0x7f06040c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 -- 172.21.15.32:0/2950583458 >> v2:172.21.15.86:3300/0 conn(0x7f0604153840 msgr2=0x7f06040c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 --2- 172.21.15.32:0/2950583458 >> v2:172.21.15.86:3300/0 conn(0x7f0604153840 0x7f06040c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 -- 172.21.15.32:0/2950583458 >> v1:172.21.15.86:6789/0 conn(0x7f06040c8950 legacy=0x7f060415cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 -- 172.21.15.32:0/2950583458 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060406ae70 con 0x7f06040c8f10 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0608c00700 1 --2- 172.21.15.32:0/2950583458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8f10 0x7f06040ccf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f060406d7b0 tx=0x7f05f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250d85e0a16e933 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0603e00700 1 -- 172.21.15.32:0/2950583458 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011830 con 0x7f06040c8f10 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0603e00700 1 -- 172.21.15.32:0/2950583458 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0011990 con 0x7f06040c8f10 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f0603e00700 1 -- 172.21.15.32:0/2950583458 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011d20 con 0x7f06040c8f10 2024-09-13T18:46:53.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 -- 172.21.15.32:0/2950583458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8f10 msgr2=0x7f06040ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.995+0000 7f060aa00700 1 --2- 172.21.15.32:0/2950583458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8f10 0x7f06040ccf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f060406d7b0 tx=0x7f05f0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 -- 172.21.15.32:0/2950583458 shutdown_connections 2024-09-13T18:46:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 --2- 172.21.15.32:0/2950583458 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8f10 0x7f06040ccf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 --2- 172.21.15.32:0/2950583458 >> v2:172.21.15.86:3300/0 conn(0x7f0604153840 0x7f06040c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 -- 172.21.15.32:0/2950583458 >> 172.21.15.32:0/2950583458 conn(0x7f0604071740 msgr2=0x7f0604071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 -- 172.21.15.32:0/2950583458 shutdown_connections 2024-09-13T18:46:53.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 -- 172.21.15.32:0/2950583458 wait complete. 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 Processor -- start 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:52.999+0000 7f060aa00700 1 -- start start 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8950 0x7f0604146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 0x7f0604158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0604153840 0x7f0604158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06041ef2d0 con 0x7f06040c8950 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06041ef590 con 0x7f0604153840 2024-09-13T18:46:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06041ef870 con 0x7f06040c8f10 2024-09-13T18:46:53.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 0x7f0604158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 0x7f0604158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51884/0 (socket says 172.21.15.32:51884) 2024-09-13T18:46:53.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060a000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0604153840 0x7f0604158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 -- 172.21.15.32:0/383560603 learned_addr learned my addr 172.21.15.32:0/383560603 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0609600700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8950 0x7f0604146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 -- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0604153840 msgr2=0x7f0604158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0604153840 0x7f0604158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 -- 172.21.15.32:0/383560603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8950 msgr2=0x7f0604146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8950 0x7f0604146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 -- 172.21.15.32:0/383560603 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009570 con 0x7f06040c8f10 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060a000700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0604153840 0x7f0604158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0608c00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 0x7f0604158600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06040cab80 tx=0x7f05f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0004450 con 0x7f06040c8f10 2024-09-13T18:46:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06041efb50 con 0x7f06040c8f10 2024-09-13T18:46:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f001f070 con 0x7f06040c8f10 2024-09-13T18:46:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0003900 con 0x7f06040c8f10 2024-09-13T18:46:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.003+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06041f0110 con 0x7f06040c8f10 2024-09-13T18:46:53.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.007+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06040714c0 con 0x7f06040c8f10 2024-09-13T18:46:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.007+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05f0003a60 con 0x7f06040c8f10 2024-09-13T18:46:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.011+0000 7f0601600700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05e4066730 0x7f05e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.011+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f05f0021070 con 0x7f06040c8f10 2024-09-13T18:46:53.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.011+0000 7f0609600700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05e4066730 0x7f05e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.011+0000 7f0609600700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05e4066730 0x7f05e4068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009b50 tx=0x7f05f8009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.015+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05f0052eb0 con 0x7f06040c8f10 2024-09-13T18:46:53.052 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:53.047+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:53.143 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:53.143 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:53.153 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:53.149+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:53.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:53.255 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:53.249+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:53.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.347+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 1.0, "target": ["mon-mgr", ""]}) v1 -- 0x7f060406b430 con 0x7f05e4066730 2024-09-13T18:46:53.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.347+0000 7f0601600700 1 -- 172.21.15.32:0/383560603 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 no change) v1 ==== 17+0+295 (secure 0 0 0) 0x7f05f80118e0 con 0x7f05e4066730 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 322 (0%) 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:avg 40.25 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 4.91808 -> 4.91808 (expected baseline 5.93454) 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.7 with 35 -> 35 pgs (0.869565 -> 0.869565 * mean) 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 50 -> 50 pgs (1.24224 -> 1.24224 * mean) 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 1 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-13T18:46:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0033 2024-09-13T18:46:53.356 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:53.349+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:53.356 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:53.356 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05e4066730 msgr2=0x7f05e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05e4066730 0x7f05e4068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009b50 tx=0x7f05f8009240 comp rx=0 tx=0).stop 2024-09-13T18:46:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 msgr2=0x7f0604158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 0x7f0604158600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06040cab80 tx=0x7f05f0004770 comp rx=0 tx=0).stop 2024-09-13T18:46:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 shutdown_connections 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f05e4066730 0x7f05e4068bf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0604153840 0x7f0604158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f06040c8f10 0x7f0604158600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 --2- 172.21.15.32:0/383560603 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06040c8950 0x7f0604146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 >> 172.21.15.32:0/383560603 conn(0x7f0604071740 msgr2=0x7f060406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 shutdown_connections 2024-09-13T18:46:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.351+0000 7f060aa00700 1 -- 172.21.15.32:0/383560603 wait complete. 2024-09-13T18:46:53.360 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-13T18:46:53.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:53.385 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-13T18:46:53.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-13T18:46:53.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:53.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:53.481 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:53.477+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:53.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:46:53.557 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:53.553+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:53.562 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:53.562 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:53.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.619+0000 7f6972400700 1 Processor -- start 2024-09-13T18:46:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.619+0000 7f6972400700 1 -- start start 2024-09-13T18:46:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.619+0000 7f6972400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f696c0c27a0 0x7f696c156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0c2b80 0x7f696c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c157420 con 0x7f696c0b1e00 2024-09-13T18:46:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c06edc0 con 0x7f696c0c27a0 2024-09-13T18:46:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c06ded0 con 0x7f696c0c2b80 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f696c0c27a0 0x7f696c156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f696be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0c2b80 0x7f696c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f696c0c27a0 0x7f696c156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:48294/0 (socket says 172.21.15.32:48294) 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 -- 172.21.15.32:0/910356182 learned_addr learned my addr 172.21.15.32:0/910356182 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 -- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0c2b80 msgr2=0x7f696c06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 --2- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0c2b80 0x7f696c06f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 -- 172.21.15.32:0/910356182 >> v1:172.21.15.86:6789/0 conn(0x7f696c0b1e00 legacy=0x7f696c150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 -- 172.21.15.32:0/910356182 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c06e1b0 con 0x7f696c0c27a0 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6971000700 1 --2- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c156ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6960009910 tx=0x7f6960009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48add751f77084da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f696b400700 1 -- 172.21.15.32:0/910356182 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960011830 con 0x7f696c0c27a0 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f696b400700 1 -- 172.21.15.32:0/910356182 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6960011990 con 0x7f696c0c27a0 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f696b400700 1 -- 172.21.15.32:0/910356182 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960011d40 con 0x7f696c0c27a0 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 msgr2=0x7f696c156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 --2- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c156ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6960009910 tx=0x7f6960009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- 172.21.15.32:0/910356182 shutdown_connections 2024-09-13T18:46:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 --2- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0c2b80 0x7f696c06f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 --2- 172.21.15.32:0/910356182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c156ee0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- 172.21.15.32:0/910356182 >> 172.21.15.32:0/910356182 conn(0x7f696c0c8a60 msgr2=0x7f696c0c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- 172.21.15.32:0/910356182 shutdown_connections 2024-09-13T18:46:53.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.623+0000 7f6972400700 1 -- 172.21.15.32:0/910356182 wait complete. 2024-09-13T18:46:53.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.627+0000 7f6972400700 1 Processor -- start 2024-09-13T18:46:53.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.627+0000 7f6972400700 1 -- start start 2024-09-13T18:46:53.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6972400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0b1e00 0x7f696c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6972400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6972400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f696c0c2b80 0x7f696c0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6972400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c152880 con 0x7f696c0c2b80 2024-09-13T18:46:53.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6972400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0ca310 con 0x7f696c0c27a0 2024-09-13T18:46:53.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6972400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1f0100 con 0x7f696c0b1e00 2024-09-13T18:46:53.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6971a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f696c0c2b80 0x7f696c0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6971a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f696c0c2b80 0x7f696c0cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34664/0 (socket says 172.21.15.32:34664) 2024-09-13T18:46:53.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6971a00700 1 -- 172.21.15.32:0/3032037341 learned_addr learned my addr 172.21.15.32:0/3032037341 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:53.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.639 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6971000700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0b1e00 0x7f696c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 -- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0b1e00 msgr2=0x7f696c151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0b1e00 0x7f696c151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 -- 172.21.15.32:0/3032037341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f696c0c2b80 msgr2=0x7f696c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f696c0c2b80 0x7f696c0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 -- 172.21.15.32:0/3032037341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960009570 con 0x7f696c0c27a0 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f6971000700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0b1e00 0x7f696c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.631+0000 7f696be00700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c0ca7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f695800e870 tx=0x7f695800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.635+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958013680 con 0x7f696c0c27a0 2024-09-13T18:46:53.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.635+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69580137e0 con 0x7f696c0c27a0 2024-09-13T18:46:53.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.635+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958013b70 con 0x7f696c0c27a0 2024-09-13T18:46:53.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.635+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c156240 con 0x7f696c0c27a0 2024-09-13T18:46:53.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.635+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c1506e0 con 0x7f696c0c27a0 2024-09-13T18:46:53.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.635+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c156430 con 0x7f696c0c27a0 2024-09-13T18:46:53.644 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.639+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6958013cd0 con 0x7f696c0c27a0 2024-09-13T18:46:53.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.639+0000 7f6968c00700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f694c066760 0x7f694c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.646 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.639+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f69580846b0 con 0x7f696c0c27a0 2024-09-13T18:46:53.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.643+0000 7f6971000700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f694c066760 0x7f694c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.643+0000 7f6971000700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f694c066760 0x7f694c068c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f6960008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.647+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6958051600 con 0x7f696c0c27a0 2024-09-13T18:46:53.658 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:53.651+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:53.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 Processor -- start 2024-09-13T18:46:53.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 -- start start 2024-09-13T18:46:53.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcf74073d70 0x7fcf74159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf74070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7406fd20 con 0x7fcf74073990 2024-09-13T18:46:53.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740c7940 con 0x7fcf74073d70 2024-09-13T18:46:53.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.735+0000 7fcf79600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74070b80 con 0x7fcf740701b0 2024-09-13T18:46:53.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcf74073d70 0x7fcf74159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fcf74073990 0x7fcf740c6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:36490/0 (socket says 172.21.15.32:36490) 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73e00700 1 -- 172.21.15.32:0/279399535 learned_addr learned my addr 172.21.15.32:0/279399535 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf78c00700 1 --2- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf74070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf72a00700 1 -- 172.21.15.32:0/279399535 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939825974 0 0) 0x7fcf7406fd20 con 0x7fcf74073990 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf72a00700 1 -- 172.21.15.32:0/279399535 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf580035d0 con 0x7fcf74073990 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73400700 1 -- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 msgr2=0x7fcf74070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73400700 1 --2- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf74070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73400700 1 -- 172.21.15.32:0/279399535 >> v1:172.21.15.86:6789/0 conn(0x7fcf74073990 legacy=0x7fcf740c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73400700 1 -- 172.21.15.32:0/279399535 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740c7380 con 0x7fcf74073d70 2024-09-13T18:46:53.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf73400700 1 --2- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf74159600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009850 tx=0x7fcf60009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdba65e53a09bb3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf72a00700 1 -- 172.21.15.32:0/279399535 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60011830 con 0x7fcf74073d70 2024-09-13T18:46:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf72a00700 1 -- 172.21.15.32:0/279399535 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60011990 con 0x7fcf74073d70 2024-09-13T18:46:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf72a00700 1 -- 172.21.15.32:0/279399535 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60011d00 con 0x7fcf74073d70 2024-09-13T18:46:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 -- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 msgr2=0x7fcf74159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 --2- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf74159600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009850 tx=0x7fcf60009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 -- 172.21.15.32:0/279399535 shutdown_connections 2024-09-13T18:46:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 --2- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf74070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 --2- 172.21.15.32:0/279399535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf74159600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 -- 172.21.15.32:0/279399535 >> 172.21.15.32:0/279399535 conn(0x7fcf740c8a60 msgr2=0x7fcf740c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 -- 172.21.15.32:0/279399535 shutdown_connections 2024-09-13T18:46:53.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.739+0000 7fcf79600700 1 -- 172.21.15.32:0/279399535 wait complete. 2024-09-13T18:46:53.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 Processor -- start 2024-09-13T18:46:53.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 -- start start 2024-09-13T18:46:53.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf7415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 0x7fcf741efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf7414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415c200 con 0x7fcf74073990 2024-09-13T18:46:53.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74155e50 con 0x7fcf74073d70 2024-09-13T18:46:53.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf79600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74159640 con 0x7fcf740701b0 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf73400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 0x7fcf741efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf73400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 0x7fcf741efa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34678/0 (socket says 172.21.15.32:34678) 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf73400700 1 -- 172.21.15.32:0/1856219512 learned_addr learned my addr 172.21.15.32:0/1856219512 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.743+0000 7fcf78c00700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf7414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73e00700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf7415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73400700 1 -- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 msgr2=0x7fcf7415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73400700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf7415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73400700 1 -- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 msgr2=0x7fcf7414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73400700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf7414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73400700 1 -- 172.21.15.32:0/1856219512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600094b0 con 0x7fcf74073990 2024-09-13T18:46:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf73400700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 0x7fcf741efa60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf600090b0 tx=0x7fcf60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60003ad0 con 0x7fcf74073990 2024-09-13T18:46:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6001e070 con 0x7fcf74073990 2024-09-13T18:46:53.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60003e70 con 0x7fcf74073990 2024-09-13T18:46:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf74159b70 con 0x7fcf74073990 2024-09-13T18:46:53.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf741ef3f0 con 0x7fcf74073990 2024-09-13T18:46:53.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.747+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74155fc0 con 0x7fcf74073990 2024-09-13T18:46:53.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.751+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf6001a420 con 0x7fcf74073990 2024-09-13T18:46:53.759 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:53.755+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.751+0000 7fcf6be00700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcf54066780 0x7fcf54068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.755+0000 7fcf73e00700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcf54066780 0x7fcf54068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.755+0000 7fcf73e00700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcf54066780 0x7fcf54068c40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf640011e0 tx=0x7fcf64009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.759+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fcf60020070 con 0x7fcf74073990 2024-09-13T18:46:53.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.763+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf60053050 con 0x7fcf74073990 2024-09-13T18:46:53.847 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:53.848 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:53.859 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:53.853+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:53.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:53.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.939+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 0.05, "target": ["mon-mgr", ""]}) v1 -- 0x7f696c14f560 con 0x7f694c066760 2024-09-13T18:46:53.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6968c00700 1 -- 172.21.15.32:0/3032037341 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 no change) v1 ==== 17+0+298 (secure 0 0 0) 0x7f696c14f560 con 0x7f694c066760 2024-09-13T18:46:53.950 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 322 (0%) 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:avg 40.25 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 4.91808 -> 4.91808 (expected baseline 5.93454) 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.7 with 35 -> 35 pgs (0.869565 -> 0.869565 * mean) 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 50 -> 50 pgs (1.24224 -> 1.24224 * mean) 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 0.05 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-13T18:46:53.951 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0033 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f694c066760 msgr2=0x7f694c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f694c066760 0x7f694c068c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f6960008030 comp rx=0 tx=0).stop 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 msgr2=0x7f696c0ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c0ca7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f695800e870 tx=0x7f695800eb80 comp rx=0 tx=0).stop 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 shutdown_connections 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f694c066760 0x7f694c068c20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f696c0c2b80 0x7f696c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f696c0c27a0 0x7f696c0ca7a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 --2- 172.21.15.32:0/3032037341 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f696c0b1e00 0x7f696c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 >> 172.21.15.32:0/3032037341 conn(0x7f696c0c8a60 msgr2=0x7f696c14ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 shutdown_connections 2024-09-13T18:46:53.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:53.947+0000 7f6972400700 1 -- 172.21.15.32:0/3032037341 wait complete. 2024-09-13T18:46:53.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:53.955 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-13T18:46:53.978 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-13T18:46:53.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-09-13T18:46:53.979 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:53.971+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:54.073 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:54.067+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.115+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7fcf74155fc0 con 0x7fcf74073990 2024-09-13T18:46:54.122 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:54.122 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:54.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 Processor -- start 2024-09-13T18:46:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 -- start start 2024-09-13T18:46:54.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45cc0719b0 0x7f45cc15b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45cc071d90 0x7f45cc1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc15b8a0 con 0x7f45cc0c7070 2024-09-13T18:46:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc0c2230 con 0x7f45cc071d90 2024-09-13T18:46:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d3000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc0c24f0 con 0x7f45cc0719b0 2024-09-13T18:46:54.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d1200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45cc071d90 0x7f45cc1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d1c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45cc0719b0 0x7f45cc15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d1c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f45cc0719b0 0x7f45cc15b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:48322/0 (socket says 172.21.15.32:48322) 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d1c00700 1 -- 172.21.15.32:0/1402450271 learned_addr learned my addr 172.21.15.32:0/1402450271 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.127+0000 7f45d1200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45cc071d90 0x7f45cc1511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34686/0 (socket says 172.21.15.32:34686) 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d1c00700 1 -- 172.21.15.32:0/1402450271 >> v2:172.21.15.32:3300/0 conn(0x7f45cc071d90 msgr2=0x7f45cc1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d1c00700 1 --2- 172.21.15.32:0/1402450271 >> v2:172.21.15.32:3300/0 conn(0x7f45cc071d90 0x7f45cc1511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d1c00700 1 -- 172.21.15.32:0/1402450271 >> v1:172.21.15.86:6789/0 conn(0x7f45cc0c7070 legacy=0x7f45cc157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d1c00700 1 -- 172.21.15.32:0/1402450271 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0c3ed0 con 0x7f45cc0719b0 2024-09-13T18:46:54.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d1c00700 1 --2- 172.21.15.32:0/1402450271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0719b0 0x7f45cc15b360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f45cc072290 tx=0x7f45c0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda0a1752310ee3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45cbe00700 1 -- 172.21.15.32:0/1402450271 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0011830 con 0x7f45cc0719b0 2024-09-13T18:46:54.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45cbe00700 1 -- 172.21.15.32:0/1402450271 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c0011990 con 0x7f45cc0719b0 2024-09-13T18:46:54.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45cbe00700 1 -- 172.21.15.32:0/1402450271 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0011d20 con 0x7f45cc0719b0 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 -- 172.21.15.32:0/1402450271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0719b0 msgr2=0x7f45cc15b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 --2- 172.21.15.32:0/1402450271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0719b0 0x7f45cc15b360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f45cc072290 tx=0x7f45c0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 -- 172.21.15.32:0/1402450271 shutdown_connections 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 --2- 172.21.15.32:0/1402450271 >> v2:172.21.15.32:3300/0 conn(0x7f45cc071d90 0x7f45cc1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 --2- 172.21.15.32:0/1402450271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0719b0 0x7f45cc15b360 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 -- 172.21.15.32:0/1402450271 >> 172.21.15.32:0/1402450271 conn(0x7f45cc06a7d0 msgr2=0x7f45cc06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 -- 172.21.15.32:0/1402450271 shutdown_connections 2024-09-13T18:46:54.138 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.131+0000 7f45d3000700 1 -- 172.21.15.32:0/1402450271 wait complete. 2024-09-13T18:46:54.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.135+0000 7f45d3000700 1 Processor -- start 2024-09-13T18:46:54.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.135+0000 7f45d3000700 1 -- start start 2024-09-13T18:46:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45cc0719b0 0x7f45cc1f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45cc071d90 0x7f45cc0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0c7070 0x7f45cc0c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc1f4690 con 0x7f45cc071d90 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0c9fd0 con 0x7f45cc0c7070 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc157220 con 0x7f45cc0719b0 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45cc071d90 0x7f45cc0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45cc071d90 0x7f45cc0c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34702/0 (socket says 172.21.15.32:34702) 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 -- 172.21.15.32:0/2846303704 learned_addr learned my addr 172.21.15.32:0/2846303704 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0c7070 0x7f45cc0c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45cc0719b0 0x7f45cc1f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45cc0719b0 msgr2=0x7f45cc1f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45cc0719b0 0x7f45cc1f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0c7070 msgr2=0x7f45cc0c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45cc0c7070 0x7f45cc0c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0009570 con 0x7f45cc071d90 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45cc0719b0 0x7f45cc1f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45cc071d90 0x7f45cc0c9a90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45b800bea0 tx=0x7f45b800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800dbc0 con 0x7f45cc071d90 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800f850 con 0x7f45cc071d90 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc156f40 con 0x7f45cc071d90 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800fc00 con 0x7f45cc071d90 2024-09-13T18:46:54.149 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.139+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc1f6fc0 con 0x7f45cc071d90 2024-09-13T18:46:54.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.143+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7f45cc15b360 con 0x7f45cc071d90 2024-09-13T18:46:54.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.143+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45b8014070 con 0x7f45cc071d90 2024-09-13T18:46:54.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45c9600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f45ac066760 0x7f45ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f45b8083b40 con 0x7f45cc071d90 2024-09-13T18:46:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v58) v1 ==== 54+0+16 (secure 0 0 0) 0x7f45b8083e60 con 0x7f45cc071d90 2024-09-13T18:46:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f45ac066760 0x7f45ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f45cc0b1ca0 0x7f45cc14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc157470 con 0x7f45cc0b1ca0 2024-09-13T18:46:54.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f45cc0b1ca0 0x7f45cc14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f45ac066760 0x7f45ac068c20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c0000c00 tx=0x7f45c0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.147+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f45cc0b1ca0 0x7f45cc14cb90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.151+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45c4001d70 con 0x7f45cc0b1ca0 2024-09-13T18:46:54.162 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:54.159+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:54.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.179+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc0c7b30 con 0x7f45cc0b1ca0 2024-09-13T18:46:54.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.179+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45c4003a20 con 0x7f45cc0b1ca0 2024-09-13T18:46:54.185 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:54.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.179+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f45cc0b2080 0x7f45cc070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.179+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc14d6e0 con 0x7f45cc0b2080 2024-09-13T18:46:54.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.179+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f45cc0b2080 0x7f45cc070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.179+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f45cc0b2080 0x7f45cc070580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.183+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45cc14d6e0 con 0x7f45cc0b2080 2024-09-13T18:46:54.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.199+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc0c6c40 con 0x7f45cc0b2080 2024-09-13T18:46:54.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.203+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45cc0c6c40 con 0x7f45cc0b2080 2024-09-13T18:46:54.208 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:54.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.203+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f45cc070fd0 0x7f45cc060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.203+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc0713d0 con 0x7f45cc070fd0 2024-09-13T18:46:54.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.203+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f45cc070fd0 0x7f45cc060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.203+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f45cc070fd0 0x7f45cc060db0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.207+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45cc0713d0 con 0x7f45cc070fd0 2024-09-13T18:46:54.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.219+0000 7f3df3200700 1 Processor -- start 2024-09-13T18:46:54.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.219+0000 7f3df3200700 1 -- start start 2024-09-13T18:46:54.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df3200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3dec073d70 0x7f3dec0c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df3200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec06fd20 con 0x7f3dec0c6da0 2024-09-13T18:46:54.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df3200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0c7940 con 0x7f3dec073d70 2024-09-13T18:46:54.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c7380 con 0x7f3dec073990 2024-09-13T18:46:54.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df2800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3dec0c6da0 0x7f3dec0701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38108/0 (socket says 172.21.15.32:38108) 2024-09-13T18:46:54.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df2800700 1 -- 172.21.15.32:0/2539902566 learned_addr learned my addr 172.21.15.32:0/2539902566 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:54.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3dec073d70 0x7f3dec0c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1e00700 1 -- 172.21.15.32:0/2539902566 >> v2:172.21.15.32:3300/0 conn(0x7f3dec073d70 msgr2=0x7f3dec0c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:54.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1e00700 1 --2- 172.21.15.32:0/2539902566 >> v2:172.21.15.32:3300/0 conn(0x7f3dec073d70 0x7f3dec0c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1e00700 1 -- 172.21.15.32:0/2539902566 >> v1:172.21.15.32:6789/0 conn(0x7f3dec0c6da0 legacy=0x7f3dec0701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:54.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1e00700 1 -- 172.21.15.32:0/2539902566 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0c7660 con 0x7f3dec073990 2024-09-13T18:46:54.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df1e00700 1 --2- 172.21.15.32:0/2539902566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec159600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009850 tx=0x7f3de0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b25cac78fb30e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc0c36d0 con 0x7f45cc070fd0 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df0a00700 1 -- 172.21.15.32:0/2539902566 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011830 con 0x7f3dec073990 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df0a00700 1 -- 172.21.15.32:0/2539902566 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0011990 con 0x7f3dec073990 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.223+0000 7f3df0a00700 1 -- 172.21.15.32:0/2539902566 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011d40 con 0x7f3dec073990 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- 172.21.15.32:0/2539902566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 msgr2=0x7f3dec159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 --2- 172.21.15.32:0/2539902566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec159600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009850 tx=0x7f3de0009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- 172.21.15.32:0/2539902566 shutdown_connections 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 --2- 172.21.15.32:0/2539902566 >> v2:172.21.15.32:3300/0 conn(0x7f3dec073d70 0x7f3dec0c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 --2- 172.21.15.32:0/2539902566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec159600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- 172.21.15.32:0/2539902566 >> 172.21.15.32:0/2539902566 conn(0x7f3dec0c8a60 msgr2=0x7f3dec0c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- 172.21.15.32:0/2539902566 shutdown_connections 2024-09-13T18:46:54.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- 172.21.15.32:0/2539902566 wait complete. 2024-09-13T18:46:54.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45cc0c36d0 con 0x7f45cc070fd0 2024-09-13T18:46:54.232 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:54.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 Processor -- start 2024-09-13T18:46:54.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f45cc061800 0x7f45cc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc061c20 con 0x7f45cc061800 2024-09-13T18:46:54.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- start start 2024-09-13T18:46:54.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f45cc061800 0x7f45cc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f45cc061800 0x7f45cc0cae50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec073d70 0x7f3dec1f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3dec0c6da0 0x7f3dec1f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec14cbf0 con 0x7f3dec0c6da0 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec15c030 con 0x7f3dec073d70 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.227+0000 7f3df3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1f0900 con 0x7f3dec073990 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df2800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3dec0c6da0 0x7f3dec1f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51938/0 (socket says 172.21.15.32:51938) 2024-09-13T18:46:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 -- 172.21.15.32:0/842653784 learned_addr learned my addr 172.21.15.32:0/842653784 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1400700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec073d70 0x7f3dec1f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 -- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec073d70 msgr2=0x7f3dec1f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec073d70 0x7f3dec1f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 -- 172.21.15.32:0/842653784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3dec0c6da0 msgr2=0x7f3dec1f12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3dec0c6da0 0x7f3dec1f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 -- 172.21.15.32:0/842653784 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00094b0 con 0x7f3dec073990 2024-09-13T18:46:54.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f3df1e00700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec14c6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3de00090b0 tx=0x7f3de0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.231+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45cc061c20 con 0x7f45cc061800 2024-09-13T18:46:54.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004480 con 0x7f3dec073990 2024-09-13T18:46:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de001f070 con 0x7f3dec073990 2024-09-13T18:46:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0003900 con 0x7f3dec073990 2024-09-13T18:46:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec15c280 con 0x7f3dec073990 2024-09-13T18:46:54.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec15c840 con 0x7f3dec073990 2024-09-13T18:46:54.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec158790 con 0x7f3dec073990 2024-09-13T18:46:54.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.235+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3de0021030 con 0x7f3dec073990 2024-09-13T18:46:54.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.239+0000 7f3de6000700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066780 0x7f3dd0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.239+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f3de0085780 con 0x7f3dec073990 2024-09-13T18:46:54.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.239+0000 7f3df1400700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066780 0x7f3dd0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.239+0000 7f3df1400700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066780 0x7f3dd0068c40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dec157060 tx=0x7f3ddc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.247+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3de0052760 con 0x7f3dec073990 2024-09-13T18:46:54.262 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:54.257+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:54.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.259+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc061dc0 con 0x7f45cc061800 2024-09-13T18:46:54.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.263+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45cc061dc0 con 0x7f45cc061800 2024-09-13T18:46:54.267 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:54.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.263+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f45cc0cb8a0 0x7f45cc02b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.263+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc0c4d80 con 0x7f45cc0cb8a0 2024-09-13T18:46:54.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.263+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f45cc0cb8a0 0x7f45cc02b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.263+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f45cc0cb8a0 0x7f45cc02b6a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.267+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45c002f040 con 0x7f45cc0cb8a0 2024-09-13T18:46:54.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.291+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc0cbce0 con 0x7f45cc0cb8a0 2024-09-13T18:46:54.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.295+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45c002f020 con 0x7f45cc0cb8a0 2024-09-13T18:46:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:54.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.295+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f45cc02c0f0 0x7f45cc02c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.295+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc02ca90 con 0x7f45cc02c0f0 2024-09-13T18:46:54.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.299+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f45cc02c0f0 0x7f45cc02c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.299+0000 7f45d1200700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f45cc02c0f0 0x7f45cc02c550 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.299+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45cc02ca90 con 0x7f45cc02c0f0 2024-09-13T18:46:54.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.327+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc02ca90 con 0x7f45cc02c0f0 2024-09-13T18:46:54.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.331+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45cc02ca90 con 0x7f45cc02c0f0 2024-09-13T18:46:54.336 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:54.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.331+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f45cc20a500 0x7f45cc20c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.331+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc20f770 con 0x7f45cc20a500 2024-09-13T18:46:54.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.331+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f45cc20a500 0x7f45cc20c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.331+0000 7f45d2600700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f45cc20a500 0x7f45cc20c8f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.335+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45cc20f770 con 0x7f45cc20a500 2024-09-13T18:46:54.357 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:54.357 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:54.358 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:54.358 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:54.364 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:54.361+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:54.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.359+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc20ce30 con 0x7f45cc20a500 2024-09-13T18:46:54.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.367+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45cc20ce30 con 0x7f45cc20a500 2024-09-13T18:46:54.372 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:54.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.367+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f45cc20d4b0 0x7f45cc20f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.367+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45cc2127a0 con 0x7f45cc20d4b0 2024-09-13T18:46:54.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.367+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f45cc20d4b0 0x7f45cc20f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.374 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.367+0000 7fcf6be00700 1 -- 172.21.15.32:0/1856219512 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v59) v1 ==== 91+0+0 (secure 0 0 0) 0x7fcf74155fc0 con 0x7fcf74073990 2024-09-13T18:46:54.375 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.367+0000 7f45d1c00700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f45cc20d4b0 0x7f45cc20f8a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.379 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.371+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f45cc2127a0 con 0x7f45cc20d4b0 2024-09-13T18:46:54.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:54.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcf54066780 msgr2=0x7fcf54068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.380 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcf54066780 0x7fcf54068c40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf640011e0 tx=0x7fcf64009040 comp rx=0 tx=0).stop 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 msgr2=0x7fcf741efa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 0x7fcf741efa60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf600090b0 tx=0x7fcf60004770 comp rx=0 tx=0).stop 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 shutdown_connections 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcf54066780 0x7fcf54068c40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf74073d70 0x7fcf7414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf74073990 0x7fcf741efa60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 --2- 172.21.15.32:0/1856219512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcf740701b0 0x7fcf7415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 >> 172.21.15.32:0/1856219512 conn(0x7fcf740c8a60 msgr2=0x7fcf740c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 shutdown_connections 2024-09-13T18:46:54.382 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.375+0000 7fcf79600700 1 -- 172.21.15.32:0/1856219512 wait complete. 2024-09-13T18:46:54.382 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:46:54.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.399+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7f45cc20fe60 con 0x7f45cc20d4b0 2024-09-13T18:46:54.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45c9600700 1 -- 172.21.15.32:0/2846303704 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7f45cc20fe60 con 0x7f45cc20d4b0 2024-09-13T18:46:54.411 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f45cc0b1ca0 msgr2=0x7f45cc14cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f45cc0b1ca0 0x7f45cc14cb90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f45cc0b2080 msgr2=0x7f45cc070580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f45cc0b2080 0x7f45cc070580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f45cc070fd0 msgr2=0x7f45cc060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f45cc070fd0 0x7f45cc060db0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f45cc061800 msgr2=0x7f45cc0cae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f45cc061800 0x7f45cc0cae50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f45cc0cb8a0 msgr2=0x7f45cc02b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f45cc0cb8a0 0x7f45cc02b6a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f45cc02c0f0 msgr2=0x7f45cc02c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7f45cc02c0f0 0x7f45cc02c550 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f45cc20a500 msgr2=0x7f45cc20c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f45cc20a500 0x7f45cc20c8f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f45cc20d4b0 msgr2=0x7f45cc20f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.403+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f45cc20d4b0 0x7f45cc20f8a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d2600700 1 -- 172.21.15.32:0/2846303704 reap_dead start 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d2600700 1 -- 172.21.15.32:0/2846303704 reap_dead start 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f45ac066760 msgr2=0x7f45ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f45ac066760 0x7f45ac068c20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c0000c00 tx=0x7f45c0008030 comp rx=0 tx=0).stop 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45cc071d90 msgr2=0x7f45cc0c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 --2- 172.21.15.32:0/2846303704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45cc071d90 0x7f45cc0c9a90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45b800bea0 tx=0x7f45b800bf80 comp rx=0 tx=0).stop 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d2600700 1 -- 172.21.15.32:0/2846303704 reap_dead start 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d2600700 1 -- 172.21.15.32:0/2846303704 reap_dead start 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d2600700 1 -- 172.21.15.32:0/2846303704 reap_dead start 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 shutdown_connections 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 >> 172.21.15.32:0/2846303704 conn(0x7f45cc06a7d0 msgr2=0x7f45cc14fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 shutdown_connections 2024-09-13T18:46:54.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.407+0000 7f45d3000700 1 -- 172.21.15.32:0/2846303704 wait complete. 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:54.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:54.466 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:54.461+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:54.538 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:54.538 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:54.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:54.566 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:54.565+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:54.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.583+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd reweight-by-utilization", "oload": 1000, "max_change": 3.0, "target": ["mon-mgr", ""]}) v1 -- 0x7f3dec0c99e0 con 0x7f3dd0066780 2024-09-13T18:46:54.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3de6000700 1 -- 172.21.15.32:0/842653784 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 no change) v1 ==== 17+0+295 (secure 0 0 0) 0x7f3dec0c99e0 con 0x7f3dd0066780 2024-09-13T18:46:54.590 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 322 (0%) 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:avg 40.25 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 4.91808 -> 4.91808 (expected baseline 5.93454) 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.7 with 35 -> 35 pgs (0.869565 -> 0.869565 * mean) 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 50 -> 50 pgs (1.24224 -> 1.24224 * mean) 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 3 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-13T18:46:54.591 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0033 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066780 msgr2=0x7f3dd0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066780 0x7f3dd0068c40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dec157060 tx=0x7f3ddc008040 comp rx=0 tx=0).stop 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 msgr2=0x7f3dec14c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec14c6b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3de00090b0 tx=0x7f3de0004770 comp rx=0 tx=0).stop 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 shutdown_connections 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3dd0066780 0x7f3dd0068c40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3dec0c6da0 0x7f3dec1f12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dec073d70 0x7f3dec1f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 --2- 172.21.15.32:0/842653784 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3dec073990 0x7f3dec14c6b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 >> 172.21.15.32:0/842653784 conn(0x7f3dec0c8a60 msgr2=0x7f3dec158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 shutdown_connections 2024-09-13T18:46:54.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.587+0000 7f3df3200700 1 -- 172.21.15.32:0/842653784 wait complete. 2024-09-13T18:46:54.595 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-13T18:46:54.619 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-13T18:46:54.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-13T18:46:54.667 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:54.663+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:54.717 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:54.717 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:54.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:54.717 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:28 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.38998166, 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002903858, 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322926+0000", 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322925+0000", 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322956+0000", 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1579999999999999e-05 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322993+0000", 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6526999999999998e-05 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323012+0000", 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8848e-05 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323179+0000", 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016782599999999999 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323226+0000", 2024-09-13T18:46:54.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6529999999999997e-05 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325783+0000", 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025568029999999999 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325830+0000", 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6757e-05 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 3 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.38867587599999, 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026630619999999999, 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324231+0000", 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324242+0000", 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0842999999999999e-05 2024-09-13T18:46:54.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324262+0000", 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9998999999999999e-05 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324273+0000", 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1029999999999999e-05 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324387+0000", 2024-09-13T18:46:54.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114812 2024-09-13T18:46:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326895+0000", 2024-09-13T18:46:54.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025071889999999999 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.387999827, 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064118609999999996, 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324908+0000", 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324906+0000", 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324915+0000", 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6670000000000008e-06 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325374+0000", 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000458546 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325388+0000", 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3985000000000001e-05 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325821+0000", 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043282599999999998 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326009+0000", 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018826499999999999 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326196+0000", 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018720400000000001 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330848+0000", 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004651606 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330976+0000", 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012841600000000001 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331286+0000", 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030957800000000002 2024-09-13T18:46:54.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331319+0000", 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3478e-05 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.38798750700001, 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008364804, 2024-09-13T18:46:54.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324920+0000", 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324919+0000", 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324932+0000", 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2488e-05 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326723+0000", 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017909689999999999 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326733+0000", 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7089999999999997e-06 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326961+0000", 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022851999999999999 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327097+0000", 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013589200000000001 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327260+0000", 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163287 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330855+0000", 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003594196 2024-09-13T18:46:54.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333132+0000", 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022777370000000002 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333228+0000", 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6231999999999996e-05 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333285+0000", 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6166999999999999e-05 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.387972752, 2024-09-13T18:46:54.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084921609999999998, 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324935+0000", 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324934+0000", 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324938+0000", 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4999999999999999e-06 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326760+0000", 2024-09-13T18:46:54.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001822822 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326767+0000", 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327505+0000", 2024-09-13T18:46:54.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073852 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113404 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327745+0000", 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012652299999999999 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330859+0000", 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003113644 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333353+0000", 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024944250000000002 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333391+0000", 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7614000000000003e-05 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333427+0000", 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6123e-05 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:4 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.3879677, 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149849, 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.745 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324940+0000", 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324939+0000", 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324943+0000", 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5149999999999998e-06 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326778+0000", 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018348450000000001 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326784+0000", 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.477e-06 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328205+0000", 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014213139999999999 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328317+0000", 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011146600000000001 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328423+0000", 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105988 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330862+0000", 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024395710000000002 2024-09-13T18:46:54.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336033+0000", 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708780000000003 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336069+0000", 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5571999999999998e-05 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336090+0000", 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0579999999999999e-05 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.38796240000001, 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011235431000000001, 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324945+0000", 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324975+0000", 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0454999999999999e-05 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326795+0000", 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018197280000000001 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326828+0000", 2024-09-13T18:46:54.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3476999999999998e-05 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328917+0000", 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020888980000000001 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329035+0000", 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011780799999999999 2024-09-13T18:46:54.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336180+0000", 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071454480000000004 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:18 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.382235994, 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065443599999999999, 2024-09-13T18:46:54.755 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330671+0000", 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330679+0000", 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4239999999999993e-06 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3739999999999998e-06 2024-09-13T18:46:54.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330692+0000", 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.729e-06 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330963+0000", 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027072000000000001 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330970+0000", 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6839999999999999e-06 2024-09-13T18:46:54.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331326+0000", 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035616000000000001 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:19 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.380914086, 2024-09-13T18:46:54.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013032180000000001, 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331993+0000", 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331997+0000", 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2150000000000003e-06 2024-09-13T18:46:54.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332007+0000", 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8519999999999999e-06 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332013+0000", 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5529999999999998e-06 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333120+0000", 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001106437 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333127+0000", 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2470000000000002e-06 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333296+0000", 2024-09-13T18:46:54.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016953500000000001 2024-09-13T18:46:54.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.764 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:1 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.380875788, 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014019919999999999, 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332032+0000", 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332031+0000", 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332034+0000", 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2440000000000002e-06 2024-09-13T18:46:54.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332041+0000", 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0299999999999996e-06 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332047+0000", 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5539999999999997e-06 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333341+0000", 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012940060000000001 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333348+0000", 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9160000000000004e-06 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.333434+0000", 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5599000000000005e-05 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.768 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~892] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 108.37652303900001, 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001339656, 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336384+0000", 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336383+0000", 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336390+0000", 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3130000000000001e-06 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336409+0000", 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8955999999999999e-05 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336415+0000", 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4570000000000002e-06 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336468+0000", 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930999999999999e-05 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336515+0000", 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6996999999999997e-05 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.336608+0000", 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3064000000000002e-05 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337535+0000", 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092692000000000002 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337663+0000", 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337699+0000", 2024-09-13T18:46:54.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6266000000000001e-05 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.337724+0000", 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4749999999999999e-05 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 892~450 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 100.77153961, 2024-09-13T18:46:54.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003348012, 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941368+0000", 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941365+0000", 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941425+0000", 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9590999999999999e-05 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941478+0000", 2024-09-13T18:46:54.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2902000000000003e-05 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941497+0000", 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9550000000000001e-05 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941607+0000", 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109559 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.941754+0000", 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146816 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.942001+0000", 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024740800000000001 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944225+0000", 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022241990000000001 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944567+0000", 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034210499999999999 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944653+0000", 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5401000000000004e-05 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:13.944716+0000", 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3010999999999997e-05 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.779 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1342~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 98.935101622999994, 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031302299999999999, 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.780 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777806+0000", 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777802+0000", 2024-09-13T18:46:54.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777826+0000", 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3799e-05 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777881+0000", 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5485000000000002e-05 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777901+0000", 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9916e-05 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.777963+0000", 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1499000000000002e-05 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778038+0000", 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4737e-05 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.778210+0000", 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206099999999999 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780091+0000", 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001881223 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780731+0000", 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063965400000000003 2024-09-13T18:46:54.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780845+0000", 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114299 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:15.780936+0000", 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1130000000000003e-05 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 2982~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 93.691886781999997, 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034341409999999999, 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021021+0000", 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021017+0000", 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:54.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021042+0000", 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.425e-05 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021108+0000", 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6858000000000003e-05 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021180+0000", 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2070000000000006e-05 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021301+0000", 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012063899999999999 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021448+0000", 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014738199999999999 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.021678+0000", 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229984 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024132+0000", 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002453748 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024165+0000", 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3247999999999997e-05 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024327+0000", 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:21.024455+0000", 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127599 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.791 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3123~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.380684582000001, 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036671949999999998, 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332223+0000", 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332219+0000", 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332241+0000", 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1899000000000002e-05 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332316+0000", 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5072000000000002e-05 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332339+0000", 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.232e-05 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332446+0000", 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010745 2024-09-13T18:46:54.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332581+0000", 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134575 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332845+0000", 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026425500000000002 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334337+0000", 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001491795 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335644+0000", 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001306958 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335776+0000", 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013229600000000001 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335890+0000", 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113962 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.380655386000001, 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040859060000000003, 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.797 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332252+0000", 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332251+0000", 2024-09-13T18:46:54.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332260+0000", 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2029999999999992e-06 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332382+0000", 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012286400000000001 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.332401+0000", 2024-09-13T18:46:54.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8998999999999999e-05 2024-09-13T18:46:54.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333602+0000", 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012004299999999999 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333689+0000", 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6811999999999995e-05 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.333790+0000", 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010134200000000001 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.334941+0000", 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011511360000000001 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336238+0000", 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001296813 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336286+0000", 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8395e-05 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.336338+0000", 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1518999999999999e-05 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-13T18:46:54.803 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 71.377482063000002, 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048565799999999998, 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335425+0000", 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335424+0000", 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335435+0000", 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1780000000000001e-05 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335464+0000", 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8493e-05 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335479+0000", 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396e-05 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335608+0000", 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012889100000000001 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335629+0000", 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1162000000000002e-05 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:43.335911+0000", 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028170300000000001 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.807 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3382~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e28)", 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.306324842999999, 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00329766, 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406583+0000", 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406580+0000", 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406600+0000", 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0414000000000001e-05 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406641+0000", 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0321000000000002e-05 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406656+0000", 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5642999999999999e-05 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406740+0000", 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3862000000000004e-05 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.406863+0000", 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122731 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.407016+0000", 2024-09-13T18:46:54.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015335500000000001 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.408578+0000", 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015615570000000001 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409775+0000", 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011975829999999999 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409833+0000", 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7609999999999999e-05 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:46.409880+0000", 2024-09-13T18:46:54.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7209000000000002e-05 2024-09-13T18:46:54.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5398~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.854643781, 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031271250000000001, 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858264+0000", 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858261+0000", 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999971 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858278+0000", 2024-09-13T18:46:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858331+0000", 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2884999999999999e-05 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858345+0000", 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4154e-05 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858429+0000", 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3588e-05 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858547+0000", 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011875 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858693+0000", 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001461 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860297+0000", 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001603033 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861283+0000", 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098661600000000006 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861346+0000", 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2866000000000004e-05 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.861391+0000", 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4713999999999999e-05 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e42)", 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.854616325999999, 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038877360000000001, 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:54.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858291+0000", 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858295+0000", 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.656e-06 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858375+0000", 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9847999999999999e-05 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.858386+0000", 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0665999999999999e-05 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859128+0000", 2024-09-13T18:46:54.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074182399999999998 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859200+0000", 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2170999999999997e-05 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.859298+0000", 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8455000000000005e-05 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:54.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.860602+0000", 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013036510000000001 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862094+0000", 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492581 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862141+0000", 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6585999999999997e-05 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:54.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:18.862179+0000", 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7796000000000002e-05 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:54.828 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:54.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:54.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 Processor -- start 2024-09-13T18:46:54.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 -- start start 2024-09-13T18:46:54.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a0153840 0x7f65a00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f65a00c8f10 0x7f65a00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65a00c8950 0x7f65a00cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a006b810 con 0x7f65a00c8950 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a00c8370 con 0x7f65a00c8f10 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.807+0000 7f659fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00c8650 con 0x7f65a0153840 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65a00c8950 0x7f65a00cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f65a00c8950 0x7f65a00cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34736/0 (socket says 172.21.15.32:34736) 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 -- 172.21.15.32:0/2054425104 learned_addr learned my addr 172.21.15.32:0/2054425104 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659e000700 1 --2- 172.21.15.32:0/2054425104 >> v2:172.21.15.86:3300/0 conn(0x7f65a00c8f10 0x7f65a00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659ea00700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a0153840 0x7f65a00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 -- 172.21.15.32:0/2054425104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a0153840 msgr2=0x7f65a00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a0153840 0x7f65a00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 -- 172.21.15.32:0/2054425104 >> v2:172.21.15.86:3300/0 conn(0x7f65a00c8f10 msgr2=0x7f65a00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 --2- 172.21.15.32:0/2054425104 >> v2:172.21.15.86:3300/0 conn(0x7f65a00c8f10 0x7f65a00ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 -- 172.21.15.32:0/2054425104 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a006ae70 con 0x7f65a00c8950 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659ea00700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a0153840 0x7f65a00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659f400700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a00c8950 0x7f65a00cd470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65a00cddf0 tx=0x7f659800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d484c77f609ef90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659d600700 1 -- 172.21.15.32:0/2054425104 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659800e070 con 0x7f65a00c8950 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659d600700 1 -- 172.21.15.32:0/2054425104 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659800b910 con 0x7f65a00c8950 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659d600700 1 -- 172.21.15.32:0/2054425104 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659800bcc0 con 0x7f65a00c8950 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 -- 172.21.15.32:0/2054425104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a00c8950 msgr2=0x7f65a00cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a00c8950 0x7f65a00cd470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65a00cddf0 tx=0x7f659800b330 comp rx=0 tx=0).stop 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 -- 172.21.15.32:0/2054425104 shutdown_connections 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a00c8950 0x7f65a00cd470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 --2- 172.21.15.32:0/2054425104 >> v2:172.21.15.86:3300/0 conn(0x7f65a00c8f10 0x7f65a00ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 --2- 172.21.15.32:0/2054425104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a0153840 0x7f65a00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 -- 172.21.15.32:0/2054425104 >> 172.21.15.32:0/2054425104 conn(0x7f65a0071740 msgr2=0x7f65a0071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 -- 172.21.15.32:0/2054425104 shutdown_connections 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.811+0000 7f659fe00700 1 -- 172.21.15.32:0/2054425104 wait complete. 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 Processor -- start 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 -- start start 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a00c8950 0x7f65a0145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65a00c8f10 0x7f65a014dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 0x7f65a014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0149110 con 0x7f65a0153840 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0150510 con 0x7f65a00c8f10 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a014b150 con 0x7f65a00c8950 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 0x7f65a014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 0x7f65a014e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34748/0 (socket says 172.21.15.32:34748) 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 -- 172.21.15.32:0/262581429 learned_addr learned my addr 172.21.15.32:0/262581429 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659e000700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65a00c8f10 0x7f65a014dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659ea00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a00c8950 0x7f65a0145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 -- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a00c8950 msgr2=0x7f65a0145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a00c8950 0x7f65a0145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 -- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65a00c8f10 msgr2=0x7f65a014dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65a00c8f10 0x7f65a014dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 -- 172.21.15.32:0/262581429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6598009b30 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659f400700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 0x7f65a014e230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65a00cab80 tx=0x7f6598004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980099b0 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65980092e0 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a0149270 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598004470 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.815+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a0148e30 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.819+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a0152820 con 0x7f65a0153840 2024-09-13T18:46:54.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.819+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65980045d0 con 0x7f65a0153840 2024-09-13T18:46:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.819+0000 7f6596a00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6580066730 0x7f6580068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.819+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f6598085510 con 0x7f65a0153840 2024-09-13T18:46:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.823+0000 7f659ea00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6580066730 0x7f6580068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.823+0000 7f659ea00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6580066730 0x7f6580068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65900099f0 tx=0x7f6590008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:54.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:54.827+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6598055fc0 con 0x7f65a0153840 2024-09-13T18:46:54.840 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:54.825+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:54.930 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:54.929+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:55.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.019+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd test-reweight-by-utilization", "oload": 1000, "max_change": 3.0, "target": ["mon-mgr", ""]}) v1 -- 0x7f65a006b430 con 0x7f6580066730 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.023+0000 7f6596a00700 1 -- 172.21.15.32:0/262581429 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 no change) v1 ==== 17+0+295 (secure 0 0 0) 0x7f6590009e60 con 0x7f6580066730 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 322 (0%) 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:avg 40.25 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 4.91808 -> 4.91808 (expected baseline 5.93454) 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.7 with 35 -> 35 pgs (0.869565 -> 0.869565 * mean) 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 50 -> 50 pgs (1.24224 -> 1.24224 * mean) 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-13T18:46:55.028 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 3 2024-09-13T18:46:55.029 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-13T18:46:55.029 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0003 2024-09-13T18:46:55.029 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0033 2024-09-13T18:46:55.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6580066730 msgr2=0x7f6580068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6580066730 0x7f6580068bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65900099f0 tx=0x7f6590008040 comp rx=0 tx=0).stop 2024-09-13T18:46:55.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 msgr2=0x7f65a014e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 0x7f65a014e230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65a00cab80 tx=0x7f6598004af0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 shutdown_connections 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6580066730 0x7f6580068bf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f65a0153840 0x7f65a014e230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65a00c8f10 0x7f65a014dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 --2- 172.21.15.32:0/262581429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f65a00c8950 0x7f65a0145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 >> 172.21.15.32:0/262581429 conn(0x7f65a0071740 msgr2=0x7f65a0151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 shutdown_connections 2024-09-13T18:46:55.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f659fe00700 1 -- 172.21.15.32:0/262581429 wait complete. 2024-09-13T18:46:55.033 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:55.027+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:55.033 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-13T18:46:55.050 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:55.050 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:55.050 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:55.050 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:55.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:55.132 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:55.129+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:55.233 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:55.227+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:55.255 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:55.256 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:55.256 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:55.256 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:55.256 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:55.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:55.333 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:55.329+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:55.434 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:55.427+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:55.463 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:55.463 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:55.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.138514886, 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:55.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:55.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13849496500001, 2024-09-13T18:46:55.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:55.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:55.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.474 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13848253899999, 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:55.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:55.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.138474816, 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:55.480 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:55.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:55.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.138434632, 2024-09-13T18:46:55.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:55.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:55.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13445475, 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:55.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.492 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13309020299999, 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:55.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:55.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.496 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.133052773, 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13258839300001, 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:55.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13215702799999, 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:55.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13154861300001, 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:55.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.13115419499999, 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:55.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.131100175, 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:55.517 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:55.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 109.129615462, 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:55.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:55.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:ff5b34d6:::1.00000000:head, version: 26'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:ff5b34d6:::1.00000000:head@26'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:55.525 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.10742456, 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034838499999999999, 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352959+0000", 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352975+0000", 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352987+0000", 2024-09-13T18:46:55.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1989e-05 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353001+0000", 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4423000000000001e-05 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353061+0000", 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9616e-05 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353073+0000", 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659e-05 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353308+0000", 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023517500000000001 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.529 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.7 53/52 [PushOp(2:e0b41d06:::609.00000000:head, version: 25'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:e0b41d06:::609.00000000:head@25'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.107164662000001, 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000323679, 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353231+0000", 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2559e-05 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353244+0000", 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2952000000000001e-05 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353258+0000", 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4218e-05 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353335+0000", 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6889000000000002e-05 2024-09-13T18:46:55.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353341+0000", 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9630000000000003e-06 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353543+0000", 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020175099999999999 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:fe07bba1:::100.00000000.inode:head, version: 26'3, data_included: [0~582], data_size: 582, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:fe07bba1:::100.00000000.inode:head@26'3, size: 582, copy_subset: [0~582], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:582, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.097150498, 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045910699999999999, 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363233+0000", 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363248+0000", 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5116000000000001e-05 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363269+0000", 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1433999999999998e-05 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363285+0000", 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5342999999999999e-05 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363354+0000", 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9274000000000001e-05 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363362+0000", 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2439999999999993e-06 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363693+0000", 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033038099999999998 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.537 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.b 53/52 [PushOp(2:d0630e4c:::mds0_sessionmap:head, version: 25'1, data_included: [], data_size: 0, omap_header_size: 14, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:d0630e4c:::mds0_sessionmap:head@25'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.096091274999999, 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043993199999999997, 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364292+0000", 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364304+0000", 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1576000000000001e-05 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364317+0000", 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3227999999999999e-05 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364329+0000", 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2383e-05 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364400+0000", 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0310999999999998e-05 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364413+0000", 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2994e-05 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364733+0000", 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000320088 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:55.541 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:55.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:55.543 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:55.537+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:55.644 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:55.639+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:55.662 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:55.662 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:55.662 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:55.662 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:55.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:46:55.745 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:55.741+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:55.775 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:55.775 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:55.776 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:55.776 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:55.776 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:55.785 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:46:55.846 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:55.839+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:55.897 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.56731651699999, 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.898 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:46:55.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:46:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:46:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566559763, 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:46:55.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:46:55.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:46:55.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566541104, 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:46:55.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:46:55.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.914 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566529015, 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.919 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.56652228999999, 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:55.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:46:55.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:46:55.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566515448, 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:46:55.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:46:55.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:55.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566509357, 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:46:55.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566484269, 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.937 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:46:55.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.942 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566479613, 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:46:55.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:46:55.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:46:55.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.566465514, 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:46:55.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:46:55.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.56645356, 2024-09-13T18:46:55.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:46:55.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:46:55.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.958 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.56644504, 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:46:55.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:46:55.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.56643993500001, 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:46:55.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.969 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.56636564, 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:46:55.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:46:55.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.974 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.565444218, 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:46:55.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.565419061, 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:55.980 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:46:55.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.565362351, 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.984 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.561998598, 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:46:55.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:46:55.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 109.561218807, 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.996 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 104.06642574, 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:55.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:55.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.001 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.002 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.002 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:56.003 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:46:56.004 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:55.999+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:56.104 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:56.101+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:56.118 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:56.118 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:56.118 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:56.118 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:56.128 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:46:56.205 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:56.201+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:56.237 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:56.237 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:56.237 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:56.238 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:56.238 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:56.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:46:56.305 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:56.299+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:56.404 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 124.063750348, 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.405 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:46:56.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.409 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 124.052513354, 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.98974184799999, 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:46:56.419 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:56.420 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.959503709, 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:46:56.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.958895341, 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.425 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:46:56.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:46:56.429 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.59057651400001, 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:46:56.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:46:56.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.58979492899999, 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:46:56.434 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.58902774000001, 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.439 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:46:56.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.443 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.58819248099999, 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:56.448 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.587201869, 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:46:56.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.58658837500001, 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.454 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:56.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:46:56.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:46:56.459 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.684302269, 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:46:56.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:46:56.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:46:56.464 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.683028565, 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:46:56.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:46:56.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:46:56.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:46:56.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.675224938, 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:46:56.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:46:56.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.67445205, 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:46:56.474 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 110.07621805799999, 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:46:56.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:46:56.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:46:56.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 110.076192801, 2024-09-13T18:46:56.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:46:56.488 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 110.07616065800001, 2024-09-13T18:46:56.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:46:56.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 110.073399806, 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:46:56.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 110.07043903500001, 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:46:56.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:46:56.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:46:56.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.502 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:46:56.503 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:46:56.503 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:56.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:46:56.504 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:46:56.505 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:56.499+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:56.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:46:56.605 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:56.601+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:56.618 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:56.618 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:56.619 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:56.619 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:56.628 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:46:56.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2e4e00700 1 Processor -- start 2024-09-13T18:46:56.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2e4e00700 1 -- start start 2024-09-13T18:46:56.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2e4e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2e00719b0 0x7fd2e015b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2e4e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e015b8a0 con 0x7fd2e0071d90 2024-09-13T18:46:56.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2e4e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e00c2230 con 0x7fd2e00c7070 2024-09-13T18:46:56.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2e4e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e00c24f0 con 0x7fd2e00719b0 2024-09-13T18:46:56.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2df400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2e00719b0 0x7fd2e015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2dea00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd2e0071d90 0x7fd2e01511d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38122/0 (socket says 172.21.15.32:38122) 2024-09-13T18:46:56.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2dea00700 1 -- 172.21.15.32:0/1886613319 learned_addr learned my addr 172.21.15.32:0/1886613319 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:56.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2de000700 1 -- 172.21.15.32:0/1886613319 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947879917 0 0) 0x7fd2e015b8a0 con 0x7fd2e0071d90 2024-09-13T18:46:56.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2de000700 1 -- 172.21.15.32:0/1886613319 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c40035d0 con 0x7fd2e0071d90 2024-09-13T18:46:56.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2df400700 1 -- 172.21.15.32:0/1886613319 >> v1:172.21.15.86:6789/0 conn(0x7fd2e00c7070 legacy=0x7fd2e0157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2df400700 1 -- 172.21.15.32:0/1886613319 >> v1:172.21.15.32:6789/0 conn(0x7fd2e0071d90 legacy=0x7fd2e01511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.647+0000 7fd2df400700 1 -- 172.21.15.32:0/1886613319 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00c3ed0 con 0x7fd2e00719b0 2024-09-13T18:46:56.655 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2df400700 1 --2- 172.21.15.32:0/1886613319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e00719b0 0x7fd2e015b360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009850 tx=0x7fd2d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f9e59ba6bdd82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2de000700 1 -- 172.21.15.32:0/1886613319 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0011830 con 0x7fd2e00719b0 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2de000700 1 -- 172.21.15.32:0/1886613319 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0011990 con 0x7fd2e00719b0 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2de000700 1 -- 172.21.15.32:0/1886613319 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0011d40 con 0x7fd2e00719b0 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 -- 172.21.15.32:0/1886613319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e00719b0 msgr2=0x7fd2e015b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/1886613319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e00719b0 0x7fd2e015b360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009850 tx=0x7fd2d0009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 -- 172.21.15.32:0/1886613319 shutdown_connections 2024-09-13T18:46:56.656 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/1886613319 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e00719b0 0x7fd2e015b360 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 -- 172.21.15.32:0/1886613319 >> 172.21.15.32:0/1886613319 conn(0x7fd2e006a7d0 msgr2=0x7fd2e006e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:56.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 -- 172.21.15.32:0/1886613319 shutdown_connections 2024-09-13T18:46:56.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 -- 172.21.15.32:0/1886613319 wait complete. 2024-09-13T18:46:56.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.651+0000 7fd2e4e00700 1 Processor -- start 2024-09-13T18:46:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 -- start start 2024-09-13T18:46:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e00719b0 0x7fd2e0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e0071d90 0x7fd2e01f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e00c7070 0x7fd2e014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e014c100 con 0x7fd2e0071d90 2024-09-13T18:46:56.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e014d0c0 con 0x7fd2e00c7070 2024-09-13T18:46:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e014bea0 con 0x7fd2e00719b0 2024-09-13T18:46:56.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2df400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e00719b0 0x7fd2e0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e00c7070 0x7fd2e014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2df400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e00719b0 0x7fd2e0151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51968/0 (socket says 172.21.15.32:51968) 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2df400700 1 -- 172.21.15.32:0/2682691029 learned_addr learned my addr 172.21.15.32:0/2682691029 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e0071d90 0x7fd2e01f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e00719b0 msgr2=0x7fd2e0151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2e00719b0 0x7fd2e0151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e0071d90 msgr2=0x7fd2e01f71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2e0071d90 0x7fd2e01f71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00094b0 con 0x7fd2e00c7070 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e00c7070 0x7fd2e014d550 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00c74e0 tx=0x7fd2d800cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003c20 con 0x7fd2e00c7070 2024-09-13T18:46:56.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e00c6120 con 0x7fd2e00c7070 2024-09-13T18:46:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8003d80 con 0x7fd2e00c7070 2024-09-13T18:46:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e014ef40 con 0x7fd2e00c7070 2024-09-13T18:46:56.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.655+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d800aa20 con 0x7fd2e00c7070 2024-09-13T18:46:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fd2b80052f0 con 0x7fd2e00c7070 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2d800ab80 con 0x7fd2e00c7070 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2d7400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2c0066730 0x7fd2c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fd2d8084b60 con 0x7fd2e00c7070 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v59) v1 ==== 54+0+16 (secure 0 0 0) 0x7fd2d80850a0 con 0x7fd2e00c7070 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2c0066730 0x7fd2c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd2b8000f90 0x7fd2b8004660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.659+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b8005590 con 0x7fd2b8000f90 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.663+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd2b8000f90 0x7fd2b8004660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.663+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2c0066730 0x7fd2c0068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009ba0 tx=0x7fd2d0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.663+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd2b8000f90 0x7fd2b8004660 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.671 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.667+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b8005590 con 0x7fd2b8000f90 2024-09-13T18:46:56.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.695+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b8004e60 con 0x7fd2b8000f90 2024-09-13T18:46:56.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.699+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b8004e60 con 0x7fd2b8000f90 2024-09-13T18:46:56.705 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:56.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.699+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd2b8001a60 0x7fd2b8001ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.699+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b800aef0 con 0x7fd2b8001a60 2024-09-13T18:46:56.706 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:56.699+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:56.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.699+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd2b8001a60 0x7fd2b8001ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.699+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd2b8001a60 0x7fd2b8001ee0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.703+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b800aef0 con 0x7fd2b8001a60 2024-09-13T18:46:56.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 Processor -- start 2024-09-13T18:46:56.719 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 -- start start 2024-09-13T18:46:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f529004ce00 0x7f529004d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f52900470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52900e1c00 con 0x7f52900e2930 2024-09-13T18:46:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529004d720 con 0x7f529004ce00 2024-09-13T18:46:56.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529e000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5290009550 con 0x7f5290047a30 2024-09-13T18:46:56.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f529004ce00 0x7f529004d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f529004ce00 0x7f529004d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34776/0 (socket says 172.21.15.32:34776) 2024-09-13T18:46:56.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 -- 172.21.15.32:0/2684450876 learned_addr learned my addr 172.21.15.32:0/2684450876 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f5297e00700 1 --1- 172.21.15.32:0/2684450876 >> v1:172.21.15.32:6789/0 conn(0x7f52900e2930 0x7f5290051ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38134/0 (socket says 172.21.15.32:38134) 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529d600700 1 --2- 172.21.15.32:0/2684450876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f52900470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 -- 172.21.15.32:0/2684450876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 msgr2=0x7f52900470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 --2- 172.21.15.32:0/2684450876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f52900470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 -- 172.21.15.32:0/2684450876 >> v1:172.21.15.32:6789/0 conn(0x7f52900e2930 legacy=0x7f5290051ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.715+0000 7f529cc00700 1 -- 172.21.15.32:0/2684450876 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900d5880 con 0x7f529004ce00 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529cc00700 1 --2- 172.21.15.32:0/2684450876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529004ce00 0x7f529004d1e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f528c009910 tx=0x7f528c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07d9fd16d1b7b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f5297400700 1 -- 172.21.15.32:0/2684450876 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c011830 con 0x7f529004ce00 2024-09-13T18:46:56.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f5297400700 1 -- 172.21.15.32:0/2684450876 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c011990 con 0x7f529004ce00 2024-09-13T18:46:56.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f5297400700 1 -- 172.21.15.32:0/2684450876 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c011d40 con 0x7f529004ce00 2024-09-13T18:46:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 -- 172.21.15.32:0/2684450876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529004ce00 msgr2=0x7f529004d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 --2- 172.21.15.32:0/2684450876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529004ce00 0x7f529004d1e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f528c009910 tx=0x7f528c009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 -- 172.21.15.32:0/2684450876 shutdown_connections 2024-09-13T18:46:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 --2- 172.21.15.32:0/2684450876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f52900470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 --2- 172.21.15.32:0/2684450876 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f529004ce00 0x7f529004d1e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 -- 172.21.15.32:0/2684450876 >> 172.21.15.32:0/2684450876 conn(0x7f5290009a40 msgr2=0x7f5290009e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:56.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 -- 172.21.15.32:0/2684450876 shutdown_connections 2024-09-13T18:46:56.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.719+0000 7f529e000700 1 -- 172.21.15.32:0/2684450876 wait complete. 2024-09-13T18:46:56.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 Processor -- start 2024-09-13T18:46:56.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 -- start start 2024-09-13T18:46:56.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f5290178830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f529004ce00 0x7f52900d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52900e2930 0x7f52900363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900da720 con 0x7f52900e2930 2024-09-13T18:46:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52900dbe00 con 0x7f529004ce00 2024-09-13T18:46:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529e000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900db840 con 0x7f5290047a30 2024-09-13T18:46:56.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b800a020 con 0x7fd2b8001a60 2024-09-13T18:46:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f5290178830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529d600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52900e2930 0x7f52900363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f5297e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f529004ce00 0x7f52900d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f5290178830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:51992/0 (socket says 172.21.15.32:51992) 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529cc00700 1 -- 172.21.15.32:0/3217455961 learned_addr learned my addr 172.21.15.32:0/3217455961 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529d600700 1 -- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 msgr2=0x7f5290178830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.723+0000 7f529d600700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f5290178830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529d600700 1 -- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f529004ce00 msgr2=0x7f52900d99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529d600700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f529004ce00 0x7f52900d99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529d600700 1 -- 172.21.15.32:0/3217455961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c009570 con 0x7f52900e2930 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f5297e00700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f529004ce00 0x7f52900d99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529d600700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52900e2930 0x7f52900363d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f529804f480 tx=0x7f52980672a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529806f530 con 0x7f52900e2930 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529806f6b0 con 0x7f52900e2930 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52900dbb20 con 0x7f52900e2930 2024-09-13T18:46:56.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529806fa60 con 0x7f52900e2930 2024-09-13T18:46:56.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5290178030 con 0x7f52900e2930 2024-09-13T18:46:56.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b800a020 con 0x7fd2b8001a60 2024-09-13T18:46:56.733 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:56.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd2b800aa90 0x7fd2b8002960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b80030f0 con 0x7fd2b800aa90 2024-09-13T18:46:56.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd2b800aa90 0x7fd2b8002960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52900e2410 con 0x7f52900e2930 2024-09-13T18:46:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd2b800aa90 0x7fd2b8002960 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.727+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b80030f0 con 0x7fd2b800aa90 2024-09-13T18:46:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.731+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f529806fbc0 con 0x7f52900e2930 2024-09-13T18:46:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.731+0000 7f5294c00700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5278066730 0x7f5278068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.731+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f52980ff610 con 0x7f52900e2930 2024-09-13T18:46:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.731+0000 7f529cc00700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5278066730 0x7f5278068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.731+0000 7f529cc00700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5278066730 0x7f5278068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f528c009c60 tx=0x7f528c01d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.735+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52980cc580 con 0x7f52900e2930 2024-09-13T18:46:56.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.755+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b80035b0 con 0x7fd2b800aa90 2024-09-13T18:46:56.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.759+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b80035b0 con 0x7fd2b800aa90 2024-09-13T18:46:56.763 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:56.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.759+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd2b800d100 0x7fd2b800f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.759+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b8012420 con 0x7fd2b800d100 2024-09-13T18:46:56.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.759+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd2b800d100 0x7fd2b800f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.759+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd2b800d100 0x7fd2b800f4f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.759+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b8012420 con 0x7fd2b800d100 2024-09-13T18:46:56.785 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:56.785 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:46:56.786 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:46:56.786 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.787+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b800fcf0 con 0x7fd2b800d100 2024-09-13T18:46:56.795 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:46:56.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.791+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b800fcf0 con 0x7fd2b800d100 2024-09-13T18:46:56.796 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:56.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.791+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd2b8011c40 0x7fd2b800fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.791+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b8012210 con 0x7fd2b8011c40 2024-09-13T18:46:56.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.791+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd2b8011c40 0x7fd2b800fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.791+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd2b8011c40 0x7fd2b800fef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.791+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b8012210 con 0x7fd2b8011c40 2024-09-13T18:46:56.806 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:56.801+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.819+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b8012190 con 0x7fd2b8011c40 2024-09-13T18:46:56.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.823+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b8012190 con 0x7fd2b8011c40 2024-09-13T18:46:56.828 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:56.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.823+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd2b8010ab0 0x7fd2b8010f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.823+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b8018f80 con 0x7fd2b8010ab0 2024-09-13T18:46:56.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.823+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd2b8010ab0 0x7fd2b8010f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.823+0000 7fd2dea00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd2b8010ab0 0x7fd2b8010f30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.827+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b8018f80 con 0x7fd2b8010ab0 2024-09-13T18:46:56.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.855+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b8016640 con 0x7fd2b8010ab0 2024-09-13T18:46:56.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.859+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b8016640 con 0x7fd2b8010ab0 2024-09-13T18:46:56.863 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:56.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.859+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd2b8016d50 0x7fd2b8019140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.859+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b801c100 con 0x7fd2b8016d50 2024-09-13T18:46:56.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.859+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd2b8016d50 0x7fd2b8019140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.859+0000 7fd2dfe00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd2b8016d50 0x7fd2b8019140 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.859+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b801c100 con 0x7fd2b8016d50 2024-09-13T18:46:56.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.887+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b801c100 con 0x7fd2b8016d50 2024-09-13T18:46:56.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.891+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b801c100 con 0x7fd2b8016d50 2024-09-13T18:46:56.897 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:56.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.891+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd2b801b3d0 0x7fd2b801b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:56.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.891+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2b801f490 con 0x7fd2b801b3d0 2024-09-13T18:46:56.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.891+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd2b801b3d0 0x7fd2b801b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:56.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.895+0000 7fd2df400700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd2b801b3d0 0x7fd2b801b810 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:56.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.895+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2b801f490 con 0x7fd2b801b3d0 2024-09-13T18:46:56.905 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:56.905 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:56.906 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:56.901+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:56.915 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:46:56.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.923+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd2b8019680 con 0x7fd2b801b3d0 2024-09-13T18:46:56.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2d7400700 1 -- 172.21.15.32:0/2682691029 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd2b8019680 con 0x7fd2b801b3d0 2024-09-13T18:46:56.931 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd2b8000f90 msgr2=0x7fd2b8004660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd2b8000f90 0x7fd2b8004660 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd2b8001a60 msgr2=0x7fd2b8001ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd2b8001a60 0x7fd2b8001ee0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd2b800aa90 msgr2=0x7fd2b8002960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd2b800aa90 0x7fd2b8002960 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd2b800d100 msgr2=0x7fd2b800f4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd2b800d100 0x7fd2b800f4f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd2b8011c40 msgr2=0x7fd2b800fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd2b8011c40 0x7fd2b800fef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2dfe00700 1 -- 172.21.15.32:0/2682691029 reap_dead start 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd2b8010ab0 msgr2=0x7fd2b8010f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd2b8010ab0 0x7fd2b8010f30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2dfe00700 1 -- 172.21.15.32:0/2682691029 reap_dead start 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd2b8016d50 msgr2=0x7fd2b8019140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd2b8016d50 0x7fd2b8019140 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd2b801b3d0 msgr2=0x7fd2b801b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd2b801b3d0 0x7fd2b801b810 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2dfe00700 1 -- 172.21.15.32:0/2682691029 reap_dead start 2024-09-13T18:46:56.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2c0066730 msgr2=0x7fd2c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2c0066730 0x7fd2c0068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009ba0 tx=0x7fd2d0008030 comp rx=0 tx=0).stop 2024-09-13T18:46:56.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e00c7070 msgr2=0x7fd2e014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:56.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e00c7070 0x7fd2e014d550 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00c74e0 tx=0x7fd2d800cdc0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 shutdown_connections 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd2c0066730 0x7fd2c0068bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 --2- 172.21.15.32:0/2682691029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2e00c7070 0x7fd2e014d550 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 >> 172.21.15.32:0/2682691029 conn(0x7fd2e006a7d0 msgr2=0x7fd2e0157890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 shutdown_connections 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.927+0000 7fd2e4e00700 1 -- 172.21.15.32:0/2682691029 wait complete. 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:56.935 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:56.936 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:56.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:56.971+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7f529004d920 con 0x7f52900e2930 2024-09-13T18:46:57.007 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:46:57.001+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:46:57.066 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:57.068 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:57.075 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:46:57.120 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:57.117+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:57.182 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:57.182 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:57.192 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:46:57.208 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:57.203+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:57.297 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:57.297 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:57.307 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:46:57.308 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:57.303+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:57.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.387+0000 7f5294c00700 1 -- 172.21.15.32:0/3217455961 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v60) v1 ==== 101+0+0 (secure 0 0 0) 0x7f52980cfba0 con 0x7f52900e2930 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5278066730 msgr2=0x7f5278068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5278066730 0x7f5278068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f528c009c60 tx=0x7f528c01d040 comp rx=0 tx=0).stop 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52900e2930 msgr2=0x7f52900363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52900e2930 0x7f52900363d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f529804f480 tx=0x7f52980672a0 comp rx=0 tx=0).stop 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 shutdown_connections 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5278066730 0x7f5278068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52900e2930 0x7f52900363d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f529004ce00 0x7f52900d99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:57.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 --2- 172.21.15.32:0/3217455961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5290047a30 0x7f5290178830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 >> 172.21.15.32:0/3217455961 conn(0x7f5290009a40 msgr2=0x7f5290046e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 shutdown_connections 2024-09-13T18:46:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:57.391+0000 7f529e000700 1 -- 172.21.15.32:0/3217455961 wait complete. 2024-09-13T18:46:57.397 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:46:57.410 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:57.403+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:57.470 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:57.471 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:57.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:46:57.539 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:57.535+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:57.612 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:57.607+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:57.645 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:57.645 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:57.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:46:57.713 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:57.709+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:57.814 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:57.807+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:57.859 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:57.860 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:57.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:46:57.919 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:57.915+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:58.015 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:58.011+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:58.096 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:58.097 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:58.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:46:58.155 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:58.151+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:58.216 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:58.210+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:58.317 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:58.313+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:58.322 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:58.322 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:58.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:46:58.427 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:58.422+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:58.535 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:58.535 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:58.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:46:58.612 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:58.514+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:58.620 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:58.617+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:58.721 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:58.717+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:58.726 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:58.726 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:58.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:46:58.831 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:58.826+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:58.923 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:58.918+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:58.951 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:58.951 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:58.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:46:58.968 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:46:59.055 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:46:59.050+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:46:59.126 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:59.118+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 Processor -- start 2024-09-13T18:46:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 -- start start 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff040153770 0x7ff0400cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff04006cc30 0x7ff04006f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0401594b0 con 0x7ff04006fa70 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04006fe80 con 0x7ff040153770 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03f200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400cc1b0 con 0x7ff04006cc30 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff040153770 0x7ff0400cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff040153770 0x7ff0400cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59948/0 (socket says 172.21.15.32:59948) 2024-09-13T18:46:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 -- 172.21.15.32:0/3550231519 learned_addr learned my addr 172.21.15.32:0/3550231519 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03d400700 1 --2- 172.21.15.32:0/3550231519 >> v2:172.21.15.86:3300/0 conn(0x7ff04006cc30 0x7ff04006f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 -- 172.21.15.32:0/3550231519 >> v2:172.21.15.86:3300/0 conn(0x7ff04006cc30 msgr2=0x7ff04006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 --2- 172.21.15.32:0/3550231519 >> v2:172.21.15.86:3300/0 conn(0x7ff04006cc30 0x7ff04006f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 -- 172.21.15.32:0/3550231519 >> v1:172.21.15.32:6789/0 conn(0x7ff04006fa70 legacy=0x7ff04015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 -- 172.21.15.32:0/3550231519 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040159770 con 0x7ff040153770 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03de00700 1 --2- 172.21.15.32:0/3550231519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff040153770 0x7ff0400cbb70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff04006d5a0 tx=0x7ff030009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ad3cba7e275759 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.126+0000 7ff03ca00700 1 -- 172.21.15.32:0/3550231519 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030004230 con 0x7ff040153770 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03ca00700 1 -- 172.21.15.32:0/3550231519 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff030004390 con 0x7ff040153770 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03ca00700 1 -- 172.21.15.32:0/3550231519 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300036c0 con 0x7ff040153770 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 -- 172.21.15.32:0/3550231519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff040153770 msgr2=0x7ff0400cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 --2- 172.21.15.32:0/3550231519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff040153770 0x7ff0400cbb70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff04006d5a0 tx=0x7ff030009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 -- 172.21.15.32:0/3550231519 shutdown_connections 2024-09-13T18:46:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 --2- 172.21.15.32:0/3550231519 >> v2:172.21.15.86:3300/0 conn(0x7ff04006cc30 0x7ff04006f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 --2- 172.21.15.32:0/3550231519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff040153770 0x7ff0400cbb70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 -- 172.21.15.32:0/3550231519 >> 172.21.15.32:0/3550231519 conn(0x7ff040073900 msgr2=0x7ff0400cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 -- 172.21.15.32:0/3550231519 shutdown_connections 2024-09-13T18:46:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 -- 172.21.15.32:0/3550231519 wait complete. 2024-09-13T18:46:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 Processor -- start 2024-09-13T18:46:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.130+0000 7ff03f200700 1 -- start start 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff04006cc30 0x7ff0401f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 0x7ff0400c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff040153770 0x7ff0400c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400ca300 con 0x7ff04006fa70 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400c48d0 con 0x7ff04006cc30 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04014f610 con 0x7ff040153770 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 0x7ff0400c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 0x7ff0400c2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59954/0 (socket says 172.21.15.32:59954) 2024-09-13T18:46:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 -- 172.21.15.32:0/3680128474 learned_addr learned my addr 172.21.15.32:0/3680128474 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:59.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff04006cc30 0x7ff0401f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff040153770 0x7ff0400c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff040153770 msgr2=0x7ff0400c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff040153770 0x7ff0400c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff04006cc30 msgr2=0x7ff0401f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff04006cc30 0x7ff0401f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030009570 con 0x7ff04006fa70 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 0x7ff0400c2fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00d800 tx=0x7ff02c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0125f0 con 0x7ff04006fa70 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c012750 con 0x7ff04006fa70 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c012b00 con 0x7ff04006fa70 2024-09-13T18:46:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0400c4dc0 con 0x7ff04006fa70 2024-09-13T18:46:59.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0400c4ae0 con 0x7ff04006fa70 2024-09-13T18:46:59.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.134+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7ff04006e050 con 0x7ff04006fa70 2024-09-13T18:46:59.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff02c012c60 con 0x7ff04006fa70 2024-09-13T18:46:59.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff036000700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff020066730 0x7ff020068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6624+0+0 (secure 0 0 0) 0x7ff02c0845d0 con 0x7ff04006fa70 2024-09-13T18:46:59.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v60) v1 ==== 54+0+16 (secure 0 0 0) 0x7ff02c08b070 con 0x7ff04006fa70 2024-09-13T18:46:59.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff020066730 0x7ff020068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff0400c9e80 0x7ff04014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.138+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff040159d30 con 0x7ff0400c9e80 2024-09-13T18:46:59.146 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.142+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff0400c9e80 0x7ff04014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.142+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff020066730 0x7ff020068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff04006d5a0 tx=0x7ff030008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.142+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff0400c9e80 0x7ff04014cbb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.142+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff038009bb0 con 0x7ff0400c9e80 2024-09-13T18:46:59.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.162+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff040153b50 con 0x7ff0400c9e80 2024-09-13T18:46:59.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.162+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff038003a20 con 0x7ff0400c9e80 2024-09-13T18:46:59.169 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:46:59.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.162+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff0400caf00 0x7ff0401eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.162+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0400c2a60 con 0x7ff0400caf00 2024-09-13T18:46:59.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.162+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff0400caf00 0x7ff0401eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.170 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:46:59.170 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:46:59.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.166+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff0400caf00 0x7ff0401eeff0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.166+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff0400c2a60 con 0x7ff0400caf00 2024-09-13T18:46:59.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:46:59.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.182+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff04014d600 con 0x7ff0400caf00 2024-09-13T18:46:59.195 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:46:59.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.186+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff04014d600 con 0x7ff0400caf00 2024-09-13T18:46:59.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.186+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff0401efa40 0x7ff040060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.186+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0401efe20 con 0x7ff0401efa40 2024-09-13T18:46:59.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.190+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff0401efa40 0x7ff040060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.190+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff0401efa40 0x7ff040060db0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.190+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff0401efe20 con 0x7ff0401efa40 2024-09-13T18:46:59.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.206+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff0400008d0 con 0x7ff0401efa40 2024-09-13T18:46:59.216 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.210+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff0400008d0 con 0x7ff0401efa40 2024-09-13T18:46:59.216 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:46:59.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.210+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff040061800 0x7ff04014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.210+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0401f2e80 con 0x7ff040061800 2024-09-13T18:46:59.217 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.210+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff040061800 0x7ff04014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.214+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff040061800 0x7ff04014e010 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.214+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff0401f2e80 con 0x7ff040061800 2024-09-13T18:46:59.227 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:59.222+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:59.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.230+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff04014e550 con 0x7ff040061800 2024-09-13T18:46:59.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.234+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff04014e550 con 0x7ff040061800 2024-09-13T18:46:59.241 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:46:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.234+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff04014ebd0 0x7ff04002b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.234+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff04014f010 con 0x7ff04014ebd0 2024-09-13T18:46:59.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.234+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff04014ebd0 0x7ff04002b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.238+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff04014ebd0 0x7ff04002b6a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.238+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff030003db0 con 0x7ff04014ebd0 2024-09-13T18:46:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.258+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff04002bbe0 con 0x7ff04014ebd0 2024-09-13T18:46:59.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.262+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff04002bbe0 con 0x7ff04014ebd0 2024-09-13T18:46:59.269 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:46:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.262+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff04002c260 0x7ff04002c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.262+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff040208230 con 0x7ff04002c260 2024-09-13T18:46:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.262+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff04002c260 0x7ff04002c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.266+0000 7ff03d400700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff04002c260 0x7ff04002c6c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.266+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff040208230 con 0x7ff04002c260 2024-09-13T18:46:59.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.282+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff0402058f0 con 0x7ff04002c260 2024-09-13T18:46:59.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.286+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff0402058f0 con 0x7ff04002c260 2024-09-13T18:46:59.294 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:46:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.290+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff040205f70 0x7ff040208360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.290+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff04020b1e0 con 0x7ff040205f70 2024-09-13T18:46:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.290+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff040205f70 0x7ff040208360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.290+0000 7ff03e800700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff040205f70 0x7ff040208360 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.290+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff04020b1e0 con 0x7ff040205f70 2024-09-13T18:46:59.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.314+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff0402088a0 con 0x7ff040205f70 2024-09-13T18:46:59.322 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.318+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff0402088a0 con 0x7ff040205f70 2024-09-13T18:46:59.323 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:46:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.318+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff040208f20 0x7ff04020b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.318+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff04020e260 con 0x7ff040208f20 2024-09-13T18:46:59.323 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.318+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff040208f20 0x7ff04020b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.324 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.318+0000 7ff03de00700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff040208f20 0x7ff04020b310 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.318+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff04020e260 con 0x7ff040208f20 2024-09-13T18:46:59.328 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:46:59.325+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:46:59.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.334+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff04020e260 con 0x7ff040208f20 2024-09-13T18:46:59.345 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff036000700 1 -- 172.21.15.32:0/3680128474 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff04020e260 con 0x7ff040208f20 2024-09-13T18:46:59.345 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:46:59.346 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff0400c9e80 msgr2=0x7ff04014cbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff0400c9e80 0x7ff04014cbb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff0400caf00 msgr2=0x7ff0401eeff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff0400caf00 0x7ff0401eeff0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff0401efa40 msgr2=0x7ff040060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff0401efa40 0x7ff040060db0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff040061800 msgr2=0x7ff04014e010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff040061800 0x7ff04014e010 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03e800700 1 -- 172.21.15.32:0/3680128474 reap_dead start 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff04014ebd0 msgr2=0x7ff04002b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff04014ebd0 0x7ff04002b6a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff04002c260 msgr2=0x7ff04002c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff04002c260 0x7ff04002c6c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff040205f70 msgr2=0x7ff040208360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff040205f70 0x7ff040208360 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff040208f20 msgr2=0x7ff04020b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff040208f20 0x7ff04020b310 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03e800700 1 -- 172.21.15.32:0/3680128474 reap_dead start 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff020066730 msgr2=0x7ff020068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff020066730 0x7ff020068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff04006d5a0 tx=0x7ff030008030 comp rx=0 tx=0).stop 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 msgr2=0x7ff0400c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.338+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 0x7ff0400c2fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00d800 tx=0x7ff02c00db10 comp rx=0 tx=0).stop 2024-09-13T18:46:59.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.342+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 shutdown_connections 2024-09-13T18:46:59.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.342+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff020066730 0x7ff020068bf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.349 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.342+0000 7ff03f200700 1 --2- 172.21.15.32:0/3680128474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff04006fa70 0x7ff0400c2fd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.349 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:59.349 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:59.349 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:46:59.349 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.342+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 >> 172.21.15.32:0/3680128474 conn(0x7ff040073900 msgr2=0x7ff0400c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.342+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 shutdown_connections 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.342+0000 7ff03f200700 1 -- 172.21.15.32:0/3680128474 wait complete. 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:46:59.350 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:46:59.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:46:59.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T18:46:59.428 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:59.425+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:59.530 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:46:59.525+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:46:59.566 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:59.567 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:46:59.567 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:46:59.567 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:46:59.567 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:59.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:46:59.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 Processor -- start 2024-09-13T18:46:59.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 -- start start 2024-09-13T18:46:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c071ca0 0x7fb32c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb32c15a450 0x7fb32c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32c0c8b40 con 0x7fb32c0c75c0 2024-09-13T18:46:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32c0c9330 con 0x7fb32c15a450 2024-09-13T18:46:59.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb330a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c072790 con 0x7fb32c071ca0 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c071ca0 0x7fb32c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb32c0c75c0 0x7fb32c072080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:49036/0 (socket says 172.21.15.32:49036) 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329400700 1 -- 172.21.15.32:0/2618579137 learned_addr learned my addr 172.21.15.32:0/2618579137 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb32a800700 1 --2- 172.21.15.32:0/2618579137 >> v2:172.21.15.86:3300/0 conn(0x7fb32c15a450 0x7fb32c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329e00700 1 -- 172.21.15.32:0/2618579137 >> v2:172.21.15.86:3300/0 conn(0x7fb32c15a450 msgr2=0x7fb32c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb328a00700 1 -- 172.21.15.32:0/2618579137 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591545771 0 0) 0x7fb32c0c8b40 con 0x7fb32c0c75c0 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329e00700 1 --2- 172.21.15.32:0/2618579137 >> v2:172.21.15.86:3300/0 conn(0x7fb32c15a450 0x7fb32c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329e00700 1 -- 172.21.15.32:0/2618579137 >> v1:172.21.15.86:6789/0 conn(0x7fb32c0c75c0 legacy=0x7fb32c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.610+0000 7fb329e00700 1 -- 172.21.15.32:0/2618579137 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c0a9e90 con 0x7fb32c071ca0 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb329e00700 1 --2- 172.21.15.32:0/2618579137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c071ca0 0x7fb32c0aa320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009850 tx=0x7fb31c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46aeb9f4d7ab2d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb328a00700 1 -- 172.21.15.32:0/2618579137 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c011830 con 0x7fb32c071ca0 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb328a00700 1 -- 172.21.15.32:0/2618579137 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c011990 con 0x7fb32c071ca0 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb328a00700 1 -- 172.21.15.32:0/2618579137 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c011d40 con 0x7fb32c071ca0 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 -- 172.21.15.32:0/2618579137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c071ca0 msgr2=0x7fb32c0aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 --2- 172.21.15.32:0/2618579137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c071ca0 0x7fb32c0aa320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009850 tx=0x7fb31c009b60 comp rx=0 tx=0).stop 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 -- 172.21.15.32:0/2618579137 shutdown_connections 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 --2- 172.21.15.32:0/2618579137 >> v2:172.21.15.86:3300/0 conn(0x7fb32c15a450 0x7fb32c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 --2- 172.21.15.32:0/2618579137 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c071ca0 0x7fb32c0aa320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 -- 172.21.15.32:0/2618579137 >> 172.21.15.32:0/2618579137 conn(0x7fb32c0cad40 msgr2=0x7fb32c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:59.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 -- 172.21.15.32:0/2618579137 shutdown_connections 2024-09-13T18:46:59.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 -- 172.21.15.32:0/2618579137 wait complete. 2024-09-13T18:46:59.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 Processor -- start 2024-09-13T18:46:59.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.614+0000 7fb330a00700 1 -- start start 2024-09-13T18:46:59.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 0x7fb32c0aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c0c75c0 0x7fb32c0c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c15a450 0x7fb32c0c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c0c3870 con 0x7fb32c071ca0 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c0c40a0 con 0x7fb32c15a450 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c1ef4c0 con 0x7fb32c0c75c0 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 0x7fb32c0aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 0x7fb32c0aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59966/0 (socket says 172.21.15.32:59966) 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 -- 172.21.15.32:0/3041678444 learned_addr learned my addr 172.21.15.32:0/3041678444 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb32a800700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c15a450 0x7fb32c0c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329400700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c0c75c0 0x7fb32c0c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 -- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c0c75c0 msgr2=0x7fb32c0c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c0c75c0 0x7fb32c0c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 -- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c15a450 msgr2=0x7fb32c0c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c15a450 0x7fb32c0c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:59.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 -- 172.21.15.32:0/3041678444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0094b0 con 0x7fb32c071ca0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb329e00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 0x7fb32c0aad90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009ba0 tx=0x7fb31c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c004610 con 0x7fb32c071ca0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c01f070 con 0x7fb32c071ca0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0038e0 con 0x7fb32c071ca0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c1ef720 con 0x7fb32c071ca0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.618+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c0c3d30 con 0x7fb32c071ca0 2024-09-13T18:46:59.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.622+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c0a9b20 con 0x7fb32c071ca0 2024-09-13T18:46:59.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.622+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb31c003a40 con 0x7fb32c071ca0 2024-09-13T18:46:59.631 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:46:59.626+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:46:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.626+0000 7fb322000700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb30c066730 0x7fb30c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.626+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb31c021070 con 0x7fb32c071ca0 2024-09-13T18:46:59.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.626+0000 7fb329400700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb30c066730 0x7fb30c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:59.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.626+0000 7fb329400700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb30c066730 0x7fb30c068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb32c156bb0 tx=0x7fb318007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:59.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.630+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb31c052d80 con 0x7fb32c071ca0 2024-09-13T18:46:59.735 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:46:59.729+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:46:59.739 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:46:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:46:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:46:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:46:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.409485516, 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056329329999999997, 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321869+0000", 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321868+0000", 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321885+0000", 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6764000000000001e-05 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321986+0000", 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010197800000000001 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322024+0000", 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7160999999999999e-05 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322149+0000", 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012501 2024-09-13T18:46:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322619+0000", 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047016099999999997 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322697+0000", 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8374000000000006e-05 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326405+0000", 2024-09-13T18:46:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037079470000000001 2024-09-13T18:46:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327430+0000", 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001025139 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327468+0000", 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8009000000000001e-05 2024-09-13T18:46:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327502+0000", 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.383e-05 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.409465595, 2024-09-13T18:46:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057222369999999998, 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321889+0000", 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.027e-05 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:46:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017390600000000001 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322083+0000", 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8160000000000005e-06 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323481+0000", 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013989 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323568+0000", 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6348999999999996e-05 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323731+0000", 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016284599999999999 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326826+0000", 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030950830000000002 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327538+0000", 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071233099999999997 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327577+0000", 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9103000000000002e-05 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327611+0000", 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4208999999999997e-05 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:28 2.b 2:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.409453169, 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004355205, 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321902+0000", 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321901+0000", 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321905+0000", 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0380000000000001e-06 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322098+0000", 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019278700000000001 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322106+0000", 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0860000000000002e-06 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322220+0000", 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011428 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322333+0000", 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112378 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322431+0000", 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8182000000000003e-05 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325435+0000", 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030041489999999998 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326050+0000", 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061501899999999996 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149569 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326257+0000", 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7256999999999997e-05 2024-09-13T18:46:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.40944544600001, 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060340899999999998, 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321944+0000", 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5332e-05 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322144+0000", 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000199426 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322152+0000", 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5949999999999999e-06 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322723+0000", 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057034999999999996 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322841+0000", 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011801 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327943+0000", 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051028150000000001 2024-09-13T18:46:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.40940526200001, 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070566860000000004, 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321949+0000", 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321952+0000", 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.247e-06 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322167+0000", 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214594 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322174+0000", 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3150000000000003e-06 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322226+0000", 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2159e-05 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322332+0000", 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105457 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329006+0000", 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066745980000000003 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:28 2.b e25/19 ondisk, result = 0)", 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.40542538, 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033409599999999998, 2024-09-13T18:46:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325929+0000", 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325928+0000", 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325935+0000", 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3890000000000002e-06 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325953+0000", 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8896999999999999e-05 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325961+0000", 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7470000000000005e-06 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4309999999999998e-05 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326044+0000", 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4190000000000002e-06 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326263+0000", 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021950999999999999 2024-09-13T18:46:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:24 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.404060833, 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021457799999999999, 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327294+0000", 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327293+0000", 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327299+0000", 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9669999999999998e-06 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327310+0000", 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0648e-05 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1640000000000004e-06 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327418+0000", 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101239 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327425+0000", 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3300000000000001e-06 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327508+0000", 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3158000000000006e-05 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:25 2.7 e25/19 ondisk, result = 0)", 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.404023403, 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028630600000000001, 2024-09-13T18:46:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327334+0000", 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0879999999999999e-06 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327341+0000", 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2740000000000002e-06 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327346+0000", 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9069999999999998e-06 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327527+0000", 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018031000000000001 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327533+0000", 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3199999999999996e-06 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327618+0000", 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4711999999999998e-05 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.b epoch 25/19 rep_tid 3 lcod 25'2)", 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.403559023, 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015218799999999999, 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327796+0000", 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327795+0000", 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327801+0000", 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1369999999999999e-06 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327810+0000", 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9309999999999997e-06 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327815+0000", 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6179999999999997e-06 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327852+0000", 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7697999999999997e-05 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327948+0000", 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5521999999999998e-05 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:3 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:46:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.403127658, 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001835901, 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328232+0000", 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.271e-06 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328253+0000", 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0502000000000001e-05 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328283+0000", 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0411000000000001e-05 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328326+0000", 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2605999999999998e-05 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328339+0000", 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3857e-05 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330018+0000", 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016784059999999999 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330063+0000", 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5142999999999998e-05 2024-09-13T18:46:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing_reply(2.1a epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.402519243, 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017530599999999999, 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328835+0000", 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328840+0000", 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1359999999999996e-06 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328850+0000", 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7939999999999997e-06 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328856+0000", 2024-09-13T18:46:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8090000000000004e-06 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328910+0000", 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3077e-05 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329011+0000", 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101211 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:5 2.1f e26/19 2:ff5b34d6:::1.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.402124825, 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001089064, 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329230+0000", 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329229+0000", 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329237+0000", 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4660000000000002e-06 2024-09-13T18:46:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329247+0000", 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0633e-05 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329256+0000", 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9879999999999993e-06 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329430+0000", 2024-09-13T18:46:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000173659 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329447+0000", 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7204e-05 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330278+0000", 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083092300000000001 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0973000000000002e-05 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:26 2.1f e26/19 2:fe07bba1:::100.00000000.inode:head v 26'3, mlcod=0'0)", 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.40207080499999, 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018008130000000001, 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329284+0000", 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329297+0000", 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3773e-05 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329305+0000", 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8080000000000005e-06 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329311+0000", 2024-09-13T18:46:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7350000000000001e-06 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329599+0000", 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028792100000000001 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.329616+0000", 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7025e-05 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:46:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331045+0000", 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014294519999999999 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.331085+0000", 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9477000000000002e-05 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1f epoch 26/19 rep_tid 9 entries 26'4 (0'0) error 2:f83d65d8:::200.00000004:head by mds.0.4:35 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:46:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 113.400586092, 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00157957, 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330769+0000", 2024-09-13T18:46:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330768+0000", 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330777+0000", 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2050000000000008e-06 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330799+0000", 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1877000000000001e-05 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330810+0000", 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0553e-05 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.330860+0000", 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0368000000000003e-05 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.332348+0000", 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014882910000000001 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:ff5b34d6:::1.00000000:head, version: 26'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:ff5b34d6:::1.00000000:head@26'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.378395189999999, 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034838499999999999, 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352960+0000", 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352959+0000", 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352975+0000", 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5987000000000001e-05 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.352987+0000", 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1989e-05 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353001+0000", 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4423000000000001e-05 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353061+0000", 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9616e-05 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353073+0000", 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659e-05 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353308+0000", 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023517500000000001 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.7 53/52 [PushOp(2:e0b41d06:::609.00000000:head, version: 25'2, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(2:e0b41d06:::609.00000000:head@25'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.378135292, 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000323679, 2024-09-13T18:46:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353219+0000", 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353231+0000", 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2559e-05 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353244+0000", 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2952000000000001e-05 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353258+0000", 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4218e-05 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353335+0000", 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6889000000000002e-05 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353341+0000", 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9630000000000003e-06 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.353543+0000", 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020175099999999999 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.1f 53/52 [PushOp(2:fe07bba1:::100.00000000.inode:head, version: 26'3, data_included: [0~582], data_size: 582, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:fe07bba1:::100.00000000.inode:head@26'3, size: 582, copy_subset: [0~582], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:582, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.368121127999999, 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045910699999999999, 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363234+0000", 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363233+0000", 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363248+0000", 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5116000000000001e-05 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363269+0000", 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1433999999999998e-05 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363285+0000", 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5342999999999999e-05 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363354+0000", 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9274000000000001e-05 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363362+0000", 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2439999999999993e-06 2024-09-13T18:46:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.363693+0000", 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033038099999999998 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPush(2.b 53/52 [PushOp(2:d0630e4c:::mds0_sessionmap:head, version: 25'1, data_included: [], data_size: 0, omap_header_size: 14, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:d0630e4c:::mds0_sessionmap:head@25'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.367061905, 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043993199999999997, 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:46:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364293+0000", 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:46:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364292+0000", 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364304+0000", 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1576000000000001e-05 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364317+0000", 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3227999999999999e-05 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364329+0000", 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2383e-05 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364400+0000", 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0310999999999998e-05 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364413+0000", 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2994e-05 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:46:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:41.364733+0000", 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000320088 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:46:59.821 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:46:59.822 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:46:59.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:46:59.818+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) v1 -- 0x7fb32c071450 con 0x7fb32c071ca0 2024-09-13T18:46:59.836 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:46:59.830+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:46:59.937 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:46:59.930+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:46:59.941 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:46:59.941 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:46:59.941 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:46:59.941 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:46:59.951 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:47:00.039 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:00.033+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:00.056 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:47:00.056 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:47:00.056 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-13T18:47:00.057 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T18:47:00.057 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T18:47:00.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-13T18:47:00.065 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.065 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:00.065 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:00.065 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:00.065 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.076 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:47:00.139 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:00.133+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.854502454, 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.183 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:47:00.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.8537457, 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:47:00.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.190 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:47:00.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:47:00.193 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853727041, 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:47:00.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.196 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853714952, 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:47:00.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.200 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:47:00.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:47:00.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:47:00.204 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853708227, 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:47:00.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:47:00.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.85370138499999, 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:47:00.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853695294, 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.215 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:47:00.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:47:00.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853670206, 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:47:00.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.85366555, 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:47:00.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:47:00.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853651451, 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:47:00.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:47:00.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:00.237 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853639497, 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:00.240 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:00.240 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T18:47:00.240 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:00.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:47:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.85363097699999, 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.245 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:47:00.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.85362587199999, 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:47:00.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.853551577, 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.256 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:47:00.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.260 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.852630155, 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:47:00.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:47:00.265 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.852604998, 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:47:00.269 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.85254828799999, 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:47:00.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.84918453500001, 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:47:00.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:47:00.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 113.84840474400001, 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:47:00.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.282 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 108.353611677, 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:47:00.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.288 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.288 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:47:00.290 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:00.286+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:00.391 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:00.386+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:00.395 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.396 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:00.396 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:00.396 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.398+0000 7fb322000700 1 -- 172.21.15.32:0/3041678444 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v61) v1 ==== 87+0+0 (secure 0 0 0) 0x7fb31c02b020 con 0x7fb32c071ca0 2024-09-13T18:47:00.407 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:47:00.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb30c066730 msgr2=0x7fb30c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:00.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb30c066730 0x7fb30c068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb32c156bb0 tx=0x7fb318007e00 comp rx=0 tx=0).stop 2024-09-13T18:47:00.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 msgr2=0x7fb32c0aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:00.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 0x7fb32c0aad90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009ba0 tx=0x7fb31c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 shutdown_connections 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb30c066730 0x7fb30c068bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c15a450 0x7fb32c0c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb32c0c75c0 0x7fb32c0c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 --2- 172.21.15.32:0/3041678444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb32c071ca0 0x7fb32c0aad90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 >> 172.21.15.32:0/3041678444 conn(0x7fb32c0cad40 msgr2=0x7fb32c072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 shutdown_connections 2024-09-13T18:47:00.410 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:00.402+0000 7fb330a00700 1 -- 172.21.15.32:0/3041678444 wait complete. 2024-09-13T18:47:00.411 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-13T18:47:00.492 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:00.486+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:00.504 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.504 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:00.504 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:00.504 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:00.504 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.514 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:47:00.592 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:00.589+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:47:00.622 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 128.280588784, 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:00.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:47:00.626 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 128.26935179, 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:47:00.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 128.20658028400001, 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:47:00.631 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:47:00.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.635 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 128.17634214500001, 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:00.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 128.175733777, 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.640 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:47:00.643 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.80741494999999, 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:47:00.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:47:00.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.806633365, 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.649 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:00.650 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:47:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.652 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:47:00.653 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.80586617599999, 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:00.654 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.655 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.656 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:47:00.657 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.805030917, 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.658 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.659 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.660 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:47:00.661 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.804040305, 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:47:00.662 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.663 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:47:00.664 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:47:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.666 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 127.80342681099999, 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.667 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:47:00.668 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.669 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.670 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 126.901140705, 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.671 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:47:00.672 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:47:00.673 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.674 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:00.675 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 126.899867001, 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.676 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:47:00.677 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.678 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.679 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 126.892063374, 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:47:00.680 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.681 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:47:00.682 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:47:00.683 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.684 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 126.891290486, 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.685 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:47:00.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:47:00.687 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.688 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 114.293056494, 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.689 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:47:00.690 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.691 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.692 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:47:00.693 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.694 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 114.29303123699999, 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.695 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:47:00.696 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.697 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.698 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 114.292999094, 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.699 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:47:00.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.702 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 114.290238242, 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.705 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 114.287277471, 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:00.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:47:00.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:00.711 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:00.712 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.713 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:47:00.713 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:00.709+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:00.814 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:00.806+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:00.832 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:00.832 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:00.832 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:47:00.916 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:00.910+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:00.945 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:00.946 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:00.946 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:00.946 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:00.946 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:00.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:47:01.018 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:01.013+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:01.060 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 114.731388231, 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:47:01.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDPGPull(2.7 e53/52 cost 1048576)", 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 19.705927975000002, 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033282299999999999, 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353761+0000", 2024-09-13T18:47:01.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4487999999999999e-05 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353769+0000", 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1629999999999996e-06 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353782+0000", 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2394e-05 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353840+0000", 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7970000000000002e-05 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.354080+0000", 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024017099999999999 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.068 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:01.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:47:01.119 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:01.113+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:01.181 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:01.181 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:01.182 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:01.182 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:01.190 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:47:01.219 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:01.217+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:01.298 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:01.298 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:01.298 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:01.298 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:01.298 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:01.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:47:01.356 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:01.353+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:01.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:47:01.423 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:01.418+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:01.468 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.14330393500001, 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.469 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:47:01.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:47:01.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:47:01.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.143280068, 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:01.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:47:01.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:47:01.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.143269558, 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:47:01.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:01.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:01.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:01.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.143253558, 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:47:01.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:01.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.143246721, 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:47:01.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:47:01.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:47:01.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:01.499 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.139688595, 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:01.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:47:01.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.137877769, 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:01.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:47:01.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:47:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:47:01.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:47:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:47:01.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:47:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:47:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:47:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:47:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:47:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:47:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.137824077, 2024-09-13T18:47:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:47:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:01.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:47:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.13678013000001, 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.13522444199999, 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:47:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.135170695, 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:47:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.133931515, 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:47:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.13388628, 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:47:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:47:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:47:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:47:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:47:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:47:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:47:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:47:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.13385124600001, 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:47:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.133811016, 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:47:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:47:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.133118594, 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:47:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.13306790599999, 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.132674266, 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 115.132277702, 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:47:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:47:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:01.576 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:01.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.538+0000 7fa34e600700 1 Processor -- start 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.538+0000 7fa34e600700 1 -- start start 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34e600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa348157d50 0x7fa3480c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34e600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 0x7fa3480ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34e600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3480c7e30 0x7fa3480cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34e600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34815ee50 con 0x7fa3480c7e30 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34e600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34815d960 con 0x7fa348157d50 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34e600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815dc00 con 0x7fa3480c7a50 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 0x7fa3480ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34d200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa348157d50 0x7fa3480c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 0x7fa3480ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:39524/0 (socket says 172.21.15.32:39524) 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 -- 172.21.15.32:0/1600565087 learned_addr learned my addr 172.21.15.32:0/1600565087 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa34dc00700 1 --2- 172.21.15.32:0/1600565087 >> v2:172.21.15.32:3300/0 conn(0x7fa3480c7e30 0x7fa3480cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 -- 172.21.15.32:0/1600565087 >> v2:172.21.15.86:3300/0 conn(0x7fa348157d50 msgr2=0x7fa3480c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 --2- 172.21.15.32:0/1600565087 >> v2:172.21.15.86:3300/0 conn(0x7fa348157d50 0x7fa3480c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 -- 172.21.15.32:0/1600565087 >> v2:172.21.15.32:3300/0 conn(0x7fa3480c7e30 msgr2=0x7fa3480cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 --2- 172.21.15.32:0/1600565087 >> v2:172.21.15.32:3300/0 conn(0x7fa3480c7e30 0x7fa3480cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 -- 172.21.15.32:0/1600565087 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34815dec0 con 0x7fa3480c7a50 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347e00700 1 --2- 172.21.15.32:0/1600565087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 0x7fa3480ccfe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3480cab60 tx=0x7fa334009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe0499ddc848764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347400700 1 -- 172.21.15.32:0/1600565087 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334011830 con 0x7fa3480c7a50 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347400700 1 -- 172.21.15.32:0/1600565087 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334011990 con 0x7fa3480c7a50 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.542+0000 7fa347400700 1 -- 172.21.15.32:0/1600565087 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334011d20 con 0x7fa3480c7a50 2024-09-13T18:47:01.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- 172.21.15.32:0/1600565087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 msgr2=0x7fa3480ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- 172.21.15.32:0/1600565087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 0x7fa3480ccfe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3480cab60 tx=0x7fa334009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- 172.21.15.32:0/1600565087 shutdown_connections 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- 172.21.15.32:0/1600565087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7a50 0x7fa3480ccfe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- 172.21.15.32:0/1600565087 >> v2:172.21.15.32:3300/0 conn(0x7fa3480c7e30 0x7fa3480cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- 172.21.15.32:0/1600565087 >> v2:172.21.15.86:3300/0 conn(0x7fa348157d50 0x7fa3480c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- 172.21.15.32:0/1600565087 >> 172.21.15.32:0/1600565087 conn(0x7fa34806a7d0 msgr2=0x7fa34806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- 172.21.15.32:0/1600565087 shutdown_connections 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- 172.21.15.32:0/1600565087 wait complete. 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 Processor -- start 2024-09-13T18:47:01.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- start start 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3480c7a50 0x7fa3481f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7e30 0x7fa3480c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348157d50 0x7fa3481f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480ca040 con 0x7fa348157d50 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480ca290 con 0x7fa3480c7a50 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.546+0000 7fa34e600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480ca570 con 0x7fa3480c7e30 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34d200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3480c7a50 0x7fa3481f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7e30 0x7fa3480c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34dc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348157d50 0x7fa3481f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34d200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3480c7a50 0x7fa3481f74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:55854/0 (socket says 172.21.15.32:55854) 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34d200700 1 -- 172.21.15.32:0/2125880881 learned_addr learned my addr 172.21.15.32:0/2125880881 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3480c7a50 msgr2=0x7fa3481f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3480c7a50 0x7fa3481f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348157d50 msgr2=0x7fa3481f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa348157d50 0x7fa3481f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009570 con 0x7fa3480c7e30 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7e30 0x7fa3480c8d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa334016000 tx=0x7fa334004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334004240 con 0x7fa3480c7e30 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33401f070 con 0x7fa3480c7e30 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3481f3880 con 0x7fa3480c7e30 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334004600 con 0x7fa3480c7e30 2024-09-13T18:47:01.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3481f3530 con 0x7fa3480c7e30 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.550+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fa3480c3270 con 0x7fa3480c7e30 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa334021030 con 0x7fa3480c7e30 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa344c00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa328066730 0x7fa328068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fa334085610 con 0x7fa3480c7e30 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v61) v1 ==== 54+0+16 (secure 0 0 0) 0x7fa334085980 con 0x7fa3480c7e30 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa328066730 0x7fa328068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa348155ef0 0x7fa348150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.554+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3480cd910 con 0x7fa348155ef0 2024-09-13T18:47:01.588 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.558+0000 7fa34dc00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa348155ef0 0x7fa348150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.558+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa328066730 0x7fa328068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009c10 tx=0x7fa33c009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.558+0000 7fa34dc00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa348155ef0 0x7fa348150c00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.558+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3480cd910 con 0x7fa348155ef0 2024-09-13T18:47:01.589 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:01.570+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:01.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.578+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa3480c47a0 con 0x7fa348155ef0 2024-09-13T18:47:01.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.582+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa3480c47a0 con 0x7fa348155ef0 2024-09-13T18:47:01.590 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:47:01.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.582+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa3481562d0 0x7fa34815bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.582+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa34815e480 con 0x7fa3481562d0 2024-09-13T18:47:01.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.582+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa3481562d0 0x7fa34815bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.582+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa3481562d0 0x7fa34815bce0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.586+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa33c004030 con 0x7fa3481562d0 2024-09-13T18:47:01.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.606+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa34815f2e0 con 0x7fa3481562d0 2024-09-13T18:47:01.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.606+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa33c0041a0 con 0x7fa3481562d0 2024-09-13T18:47:01.614 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:47:01.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.606+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa3480c6070 0x7fa3480c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.606+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3480c6990 con 0x7fa3480c6070 2024-09-13T18:47:01.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.610+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa3480c6070 0x7fa3480c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.610+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa3480c6070 0x7fa3480c6450 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.610+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3480c6990 con 0x7fa3480c6070 2024-09-13T18:47:01.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.626+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa348060ff0 con 0x7fa3480c6070 2024-09-13T18:47:01.636 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.630+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa348060ff0 con 0x7fa3480c6070 2024-09-13T18:47:01.636 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:47:01.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.630+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa348061a80 0x7fa348152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.630+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa348161df0 con 0x7fa348061a80 2024-09-13T18:47:01.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.630+0000 7fa34dc00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa348061a80 0x7fa348152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.630+0000 7fa34dc00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa348061a80 0x7fa348152580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.634+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa348161df0 con 0x7fa348061a80 2024-09-13T18:47:01.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.650+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa348152d80 con 0x7fa348061a80 2024-09-13T18:47:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.654+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa348152d80 con 0x7fa348061a80 2024-09-13T18:47:01.660 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:47:01.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.654+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa348153210 0x7fa34802b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.654+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3482095e0 con 0x7fa348153210 2024-09-13T18:47:01.661 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.654+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa348153210 0x7fa34802b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.654+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa348153210 0x7fa34802b6a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.658+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3482095e0 con 0x7fa348153210 2024-09-13T18:47:01.678 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:01.674+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:01.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.674+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa34802bbe0 con 0x7fa348153210 2024-09-13T18:47:01.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.678+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa34802bbe0 con 0x7fa348153210 2024-09-13T18:47:01.685 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:47:01.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.678+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa34802c260 0x7fa34802c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.678+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa34802cbe0 con 0x7fa34802c260 2024-09-13T18:47:01.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.678+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa34802c260 0x7fa34802c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.682+0000 7fa347e00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa34802c260 0x7fa34802c6a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.682+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa34802cbe0 con 0x7fa34802c260 2024-09-13T18:47:01.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.698+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa34802cbe0 con 0x7fa34802c260 2024-09-13T18:47:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.702+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa34802cbe0 con 0x7fa34802c260 2024-09-13T18:47:01.710 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:47:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.702+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa34820a340 0x7fa34820c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.702+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa34820f5b0 con 0x7fa34820a340 2024-09-13T18:47:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.706+0000 7fa34dc00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa34820a340 0x7fa34820c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.706+0000 7fa34dc00700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa34820a340 0x7fa34820c730 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.706+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa34820f5b0 con 0x7fa34820a340 2024-09-13T18:47:01.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.726+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa34820cc70 con 0x7fa34820a340 2024-09-13T18:47:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.730+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa34820cc70 con 0x7fa34820a340 2024-09-13T18:47:01.739 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:47:01.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.734+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa34820d2f0 0x7fa34820f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:01.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.734+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa348212560 con 0x7fa34820d2f0 2024-09-13T18:47:01.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.734+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa34820d2f0 0x7fa34820f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:01.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.734+0000 7fa34d200700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa34820d2f0 0x7fa34820f6e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:01.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.734+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa348212560 con 0x7fa34820d2f0 2024-09-13T18:47:01.758 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:01.758 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:01.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.754+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fa34820fc20 con 0x7fa34820d2f0 2024-09-13T18:47:01.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.758+0000 7fa344c00700 1 -- 172.21.15.32:0/2125880881 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fa34820fc20 con 0x7fa34820d2f0 2024-09-13T18:47:01.766 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:47:01.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa348155ef0 msgr2=0x7fa348150c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fa348155ef0 0x7fa348150c00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa3481562d0 msgr2=0x7fa34815bce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fa3481562d0 0x7fa34815bce0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa3480c6070 msgr2=0x7fa3480c6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fa3480c6070 0x7fa3480c6450 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa348061a80 msgr2=0x7fa348152580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fa348061a80 0x7fa348152580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34dc00700 1 -- 172.21.15.32:0/2125880881 reap_dead start 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa348153210 msgr2=0x7fa34802b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fa348153210 0x7fa34802b6a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa34802c260 msgr2=0x7fa34802c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa34802c260 0x7fa34802c6a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa34820a340 msgr2=0x7fa34820c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fa34820a340 0x7fa34820c730 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa34820d2f0 msgr2=0x7fa34820f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fa34820d2f0 0x7fa34820f6e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34dc00700 1 -- 172.21.15.32:0/2125880881 reap_dead start 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa328066730 msgr2=0x7fa328068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa328066730 0x7fa328068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009c10 tx=0x7fa33c009240 comp rx=0 tx=0).stop 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7e30 msgr2=0x7fa3480c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7e30 0x7fa3480c8d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa334016000 tx=0x7fa334004770 comp rx=0 tx=0).stop 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 shutdown_connections 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa328066730 0x7fa328068bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 --2- 172.21.15.32:0/2125880881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3480c7e30 0x7fa3480c8d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 >> 172.21.15.32:0/2125880881 conn(0x7fa34806a7d0 msgr2=0x7fa348156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 shutdown_connections 2024-09-13T18:47:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:01.762+0000 7fa34e600700 1 -- 172.21.15.32:0/2125880881 wait complete. 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:47:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:47:01.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:47:01.779 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:01.773+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:01.883 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:01.878+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:01.982 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:01.977+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:01.997 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:01.997 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:02.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:47:02.103 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:02.098+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:02.184 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:02.181+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:02.212 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:02.212 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:02.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:47:02.319 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:02.314+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:02.385 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:02.381+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:02.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T18:47:02.441 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:02.441 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:02.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:47:02.487 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:02.481+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:02.588 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:02.585+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:02.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.594+0000 7f1645600700 1 Processor -- start 2024-09-13T18:47:02.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.594+0000 7f1645600700 1 -- start start 2024-09-13T18:47:02.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f1640070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f16400aa360 0x7f164015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16400ca7a0 0x7f16401581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400c9e70 con 0x7f16400ca7a0 2024-09-13T18:47:02.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400c8b40 con 0x7f16400aa360 2024-09-13T18:47:02.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1640157d60 con 0x7f16400a9f80 2024-09-13T18:47:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f1640070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f16400aa360 0x7f164015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f1640070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:39528/0 (socket says 172.21.15.32:39528) 2024-09-13T18:47:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f16400ca7a0 0x7f16401581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163ea00700 1 -- 172.21.15.32:0/1944730168 learned_addr learned my addr 172.21.15.32:0/1944730168 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 -- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 msgr2=0x7f1640070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 --2- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f1640070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 -- 172.21.15.32:0/1944730168 >> v2:172.21.15.32:3300/0 conn(0x7f16400ca7a0 msgr2=0x7f16401581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 --2- 172.21.15.32:0/1944730168 >> v2:172.21.15.32:3300/0 conn(0x7f16400ca7a0 0x7f16401581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 -- 172.21.15.32:0/1944730168 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400c8d70 con 0x7f16400aa360 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1636000700 1 --2- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400aa360 0x7f164015b6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f16400a9700 tx=0x7f1628009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc7179fc8a4c6ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163e000700 1 -- 172.21.15.32:0/1944730168 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628011830 con 0x7f16400aa360 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163e000700 1 -- 172.21.15.32:0/1944730168 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628011990 con 0x7f16400aa360 2024-09-13T18:47:02.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f163e000700 1 -- 172.21.15.32:0/1944730168 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628011d20 con 0x7f16400aa360 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 -- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400aa360 msgr2=0x7f164015b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.598+0000 7f1645600700 1 --2- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400aa360 0x7f164015b6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f16400a9700 tx=0x7f1628009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 -- 172.21.15.32:0/1944730168 shutdown_connections 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 --2- 172.21.15.32:0/1944730168 >> v2:172.21.15.32:3300/0 conn(0x7f16400ca7a0 0x7f16401581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 --2- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400aa360 0x7f164015b6b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 --2- 172.21.15.32:0/1944730168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f1640070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 -- 172.21.15.32:0/1944730168 >> 172.21.15.32:0/1944730168 conn(0x7f16400cad40 msgr2=0x7f16400cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 -- 172.21.15.32:0/1944730168 shutdown_connections 2024-09-13T18:47:02.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 -- 172.21.15.32:0/1944730168 wait complete. 2024-09-13T18:47:02.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 Processor -- start 2024-09-13T18:47:02.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.602+0000 7f1645600700 1 -- start start 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f16400acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 0x7f16400aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400ca7a0 0x7f16400aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16401e2130 con 0x7f16400aa360 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640159060 con 0x7f16400ca7a0 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16401e2550 con 0x7f16400a9f80 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 0x7f16400aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 0x7f16400aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60012/0 (socket says 172.21.15.32:60012) 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 -- 172.21.15.32:0/3570901208 learned_addr learned my addr 172.21.15.32:0/3570901208 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:02.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f163f400700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400ca7a0 0x7f16400aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f163ea00700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f16400acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 -- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 msgr2=0x7f16400acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f16400acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 -- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400ca7a0 msgr2=0x7f16400aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400ca7a0 0x7f16400aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 -- 172.21.15.32:0/3570901208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280094b0 con 0x7f16400aa360 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1636000700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 0x7f16400aa960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1628009b70 tx=0x7f1628004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628004510 con 0x7f16400aa360 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1640159290 con 0x7f16400aa360 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162801f070 con 0x7f16400aa360 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628003900 con 0x7f16400aa360 2024-09-13T18:47:02.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.606+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16401e1790 con 0x7f16400aa360 2024-09-13T18:47:02.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.610+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16401e2270 con 0x7f16400aa360 2024-09-13T18:47:02.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.610+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1628003a60 con 0x7f16400aa360 2024-09-13T18:47:02.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.614+0000 7f1637400700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f161c066730 0x7f161c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.614+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f1628021070 con 0x7f16400aa360 2024-09-13T18:47:02.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.614+0000 7f163ea00700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f161c066730 0x7f161c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.614+0000 7f163ea00700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f161c066730 0x7f161c068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1630009b20 tx=0x7f1630008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:02.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.618+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16401e2270 con 0x7f16400aa360 2024-09-13T18:47:02.668 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:02.669 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:02.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:47:02.690 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:02.686+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:02.789 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:02.785+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:02.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:02.822+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) v1 -- 0x7f16401e2270 con 0x7f16400aa360 2024-09-13T18:47:02.842 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:02.842 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:02.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:47:02.890 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:02.886+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:02.991 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:02.985+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:03.025 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:03.026 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:03.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:47:03.110 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:03.106+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:03.193 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:03.186+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:03.244 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:03.244 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:03.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:47:03.294 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:03.290+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:03.395 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:03.389+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:03.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.406+0000 7f1637400700 1 -- 172.21.15.32:0/3570901208 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f16401e2270 con 0x7f16400aa360 2024-09-13T18:47:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f161c066730 msgr2=0x7f161c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f161c066730 0x7f161c068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1630009b20 tx=0x7f1630008040 comp rx=0 tx=0).stop 2024-09-13T18:47:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 msgr2=0x7f16400aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 0x7f16400aa960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1628009b70 tx=0x7f1628004770 comp rx=0 tx=0).stop 2024-09-13T18:47:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 shutdown_connections 2024-09-13T18:47:03.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f161c066730 0x7f161c068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16400ca7a0 0x7f16400aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16400aa360 0x7f16400aa960 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1628009b70 tx=0x7f1628004770 comp rx=0 tx=0).stop 2024-09-13T18:47:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 --2- 172.21.15.32:0/3570901208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16400a9f80 0x7f16400acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 >> 172.21.15.32:0/3570901208 conn(0x7f16400cad40 msgr2=0x7f1640159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 shutdown_connections 2024-09-13T18:47:03.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.410+0000 7f1645600700 1 -- 172.21.15.32:0/3570901208 wait complete. 2024-09-13T18:47:03.419 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-13T18:47:03.438 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:03.438 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:03.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:47:03.462 INFO:tasks.workunit.client.0.smithi032.stderr:Updating files: 63% (8022/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:47:03.515 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:03.510+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:03.597 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:03.590+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:03.635 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:03.635 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:03.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:47:03.699 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:03.694+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:03.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:47:03.798 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:03.793+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:03.851 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:03.851 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:03.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:47:03.911 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:03.906+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:03.943 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.938+0000 7ff385000700 1 Processor -- start 2024-09-13T18:47:03.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.938+0000 7ff385000700 1 -- start start 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff385000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3801514a0 0x7ff380066c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff385000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c6440 0x7ff3800c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff385000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3800c8630 0x7ff3800cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff385000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38015b2d0 con 0x7ff3801514a0 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff385000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3800c61e0 con 0x7ff3800c8630 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff385000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38015b6f0 con 0x7ff3800c6440 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3801514a0 0x7ff380066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c6440 0x7ff3800c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3801514a0 0x7ff380066c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60018/0 (socket says 172.21.15.32:60018) 2024-09-13T18:47:03.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c6440 0x7ff3800c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:39548/0 (socket says 172.21.15.32:39548) 2024-09-13T18:47:03.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 -- 172.21.15.32:0/527365241 learned_addr learned my addr 172.21.15.32:0/527365241 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:03.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37fe00700 1 --2- 172.21.15.32:0/527365241 >> v2:172.21.15.86:3300/0 conn(0x7ff3800c8630 0x7ff3800cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 -- 172.21.15.32:0/527365241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c6440 msgr2=0x7ff3800c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 --2- 172.21.15.32:0/527365241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c6440 0x7ff3800c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 -- 172.21.15.32:0/527365241 >> v2:172.21.15.86:3300/0 conn(0x7ff3800c8630 msgr2=0x7ff3800cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 --2- 172.21.15.32:0/527365241 >> v2:172.21.15.86:3300/0 conn(0x7ff3800c8630 0x7ff3800cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 -- 172.21.15.32:0/527365241 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800c57f0 con 0x7ff3801514a0 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37fe00700 1 --2- 172.21.15.32:0/527365241 >> v2:172.21.15.86:3300/0 conn(0x7ff3800c8630 0x7ff3800cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37f400700 1 --2- 172.21.15.32:0/527365241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff380066c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff380070c50 tx=0x7ff370009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d37c225baa5339 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37e000700 1 -- 172.21.15.32:0/527365241 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370011830 con 0x7ff3801514a0 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37e000700 1 -- 172.21.15.32:0/527365241 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff370011990 con 0x7ff3801514a0 2024-09-13T18:47:03.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.942+0000 7ff37e000700 1 -- 172.21.15.32:0/527365241 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370011d20 con 0x7ff3801514a0 2024-09-13T18:47:03.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 -- 172.21.15.32:0/527365241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 msgr2=0x7ff380066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:03.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 --2- 172.21.15.32:0/527365241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff380066c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff380070c50 tx=0x7ff370009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 -- 172.21.15.32:0/527365241 shutdown_connections 2024-09-13T18:47:03.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 --2- 172.21.15.32:0/527365241 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c6440 0x7ff3800c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 --2- 172.21.15.32:0/527365241 >> v2:172.21.15.86:3300/0 conn(0x7ff3800c8630 0x7ff3800cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 --2- 172.21.15.32:0/527365241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff380066c20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 -- 172.21.15.32:0/527365241 >> 172.21.15.32:0/527365241 conn(0x7ff380073720 msgr2=0x7ff380073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:03.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 -- 172.21.15.32:0/527365241 shutdown_connections 2024-09-13T18:47:03.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 -- 172.21.15.32:0/527365241 wait complete. 2024-09-13T18:47:03.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 Processor -- start 2024-09-13T18:47:03.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.946+0000 7ff385000700 1 -- start start 2024-09-13T18:47:03.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff385000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3800c6440 0x7ff380156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff385000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c8630 0x7ff3801f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff385000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff3801f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff385000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800ca8c0 con 0x7ff3801514a0 2024-09-13T18:47:03.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff385000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c21b0 con 0x7ff3800c6440 2024-09-13T18:47:03.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff385000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c2450 con 0x7ff3800c8630 2024-09-13T18:47:03.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3800c6440 0x7ff380156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff3801f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c8630 0x7ff3801f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3800c6440 0x7ff380156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:55896/0 (socket says 172.21.15.32:55896) 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37f400700 1 -- 172.21.15.32:0/85509470 learned_addr learned my addr 172.21.15.32:0/85509470 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c8630 msgr2=0x7ff3801f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800c8630 0x7ff3801f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3800c6440 msgr2=0x7ff380156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3800c6440 0x7ff380156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009a70 con 0x7ff3801514a0 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3800c6440 0x7ff380156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:03.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff3801f2930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff37800ef90 tx=0x7ff37800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:03.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37800cc90 con 0x7ff3801514a0 2024-09-13T18:47:03.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37800f040 con 0x7ff3801514a0 2024-09-13T18:47:03.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.950+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780146c0 con 0x7ff3801514a0 2024-09-13T18:47:03.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.954+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff370009570 con 0x7ff3801514a0 2024-09-13T18:47:03.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.954+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3800caea0 con 0x7ff3801514a0 2024-09-13T18:47:03.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.954+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7ff38015aeb0 con 0x7ff3801514a0 2024-09-13T18:47:03.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.954+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff378014820 con 0x7ff3801514a0 2024-09-13T18:47:03.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff377400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff360066730 0x7ff360068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6624+0+0 (secure 0 0 0) 0x7ff3780859e0 con 0x7ff3801514a0 2024-09-13T18:47:03.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v62) v1 ==== 54+0+16 (secure 0 0 0) 0x7ff3780860a0 con 0x7ff3801514a0 2024-09-13T18:47:03.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff360066730 0x7ff360068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff38014a990 0x7ff38014b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3800c6870 con 0x7ff38014a990 2024-09-13T18:47:03.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff37ea00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff38014a990 0x7ff38014b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff360066730 0x7ff360068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a010 tx=0x7ff370008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:03.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.958+0000 7ff37ea00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff38014a990 0x7ff38014b760 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:03.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.962+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff36c009b60 con 0x7ff38014a990 2024-09-13T18:47:03.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.986+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff3800c5ad0 con 0x7ff38014a990 2024-09-13T18:47:03.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.986+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff3800c5ad0 con 0x7ff38014a990 2024-09-13T18:47:03.994 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:47:03.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.986+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff380148410 0x7ff380157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:03.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.986+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3800008d0 con 0x7ff380148410 2024-09-13T18:47:03.995 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.990+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff380148410 0x7ff380157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:03.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.990+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff380148410 0x7ff380157320 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:03.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:03.990+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff3800008d0 con 0x7ff380148410 2024-09-13T18:47:04.000 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:03.997+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:04.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.010+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff3800c9490 con 0x7ff380148410 2024-09-13T18:47:04.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.014+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff3800c9490 con 0x7ff380148410 2024-09-13T18:47:04.020 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:47:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.014+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff3801487f0 0x7ff380157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.014+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3800c2c90 con 0x7ff3801487f0 2024-09-13T18:47:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.014+0000 7ff37ea00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff3801487f0 0x7ff380157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.014+0000 7ff37ea00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff3801487f0 0x7ff380157d70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:04.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.014+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff3800c2c90 con 0x7ff3801487f0 2024-09-13T18:47:04.029 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:04.029 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:04.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.030+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff380060db0 con 0x7ff3801487f0 2024-09-13T18:47:04.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.034+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff380060db0 con 0x7ff3801487f0 2024-09-13T18:47:04.039 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:47:04.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.034+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff380061840 0x7ff38014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:04.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.034+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff380061c40 con 0x7ff380061840 2024-09-13T18:47:04.039 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.034+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff380061840 0x7ff38014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:04.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.034+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff380061840 0x7ff38014e900 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:04.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.034+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff380061c40 con 0x7ff380061840 2024-09-13T18:47:04.045 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:47:04.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.054+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff38014f100 con 0x7ff380061840 2024-09-13T18:47:04.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.058+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff38014f100 con 0x7ff380061840 2024-09-13T18:47:04.066 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:47:04.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.058+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff38002b6a0 0x7ff38002bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:04.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.058+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff380061db0 con 0x7ff38002b6a0 2024-09-13T18:47:04.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.062+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff38002b6a0 0x7ff38002bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:04.067 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.062+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff38002b6a0 0x7ff38002bae0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:04.068 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.062+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff370012d30 con 0x7ff38002b6a0 2024-09-13T18:47:04.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.090+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff38014f7e0 con 0x7ff38002b6a0 2024-09-13T18:47:04.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.090+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff38014f7e0 con 0x7ff38002b6a0 2024-09-13T18:47:04.099 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:47:04.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.094+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff38002c530 0x7ff380205610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:04.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.094+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff38002c990 con 0x7ff38002c530 2024-09-13T18:47:04.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.094+0000 7ff37ea00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff38002c530 0x7ff380205610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:04.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.094+0000 7ff37ea00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff38002c530 0x7ff380205610 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:04.101 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:04.094+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:04.102 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.094+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff38002c990 con 0x7ff38002c530 2024-09-13T18:47:04.128 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.122+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff38002c990 con 0x7ff38002c530 2024-09-13T18:47:04.132 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.126+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff38002c990 con 0x7ff38002c530 2024-09-13T18:47:04.133 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:47:04.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.126+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff380206060 0x7ff380208450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:04.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.126+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff38002cb00 con 0x7ff380206060 2024-09-13T18:47:04.133 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.126+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff380206060 0x7ff380208450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:04.134 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.130+0000 7ff37fe00700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff380206060 0x7ff380208450 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:04.136 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.130+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff38002cb00 con 0x7ff380206060 2024-09-13T18:47:04.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.150+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff38002ccd0 con 0x7ff380206060 2024-09-13T18:47:04.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.154+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff38002ccd0 con 0x7ff380206060 2024-09-13T18:47:04.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:47:04.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.154+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff380208ea0 0x7ff38020b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:04.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.154+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff38020e110 con 0x7ff380208ea0 2024-09-13T18:47:04.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.154+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff380208ea0 0x7ff38020b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:04.162 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:04.162 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:04.162 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:04.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.154+0000 7ff37f400700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff380208ea0 0x7ff38020b290 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:04.163 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.158+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff38020e110 con 0x7ff380208ea0 2024-09-13T18:47:04.172 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:47:04.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.178+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff38020b7d0 con 0x7ff380208ea0 2024-09-13T18:47:04.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff377400700 1 -- 172.21.15.32:0/85509470 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff38020b7d0 con 0x7ff380208ea0 2024-09-13T18:47:04.188 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff38014a990 msgr2=0x7ff38014b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff38014a990 0x7ff38014b760 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff380148410 msgr2=0x7ff380157320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff380148410 0x7ff380157320 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff3801487f0 msgr2=0x7ff380157d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff3801487f0 0x7ff380157d70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff380061840 msgr2=0x7ff38014e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff37fe00700 1 -- 172.21.15.32:0/85509470 reap_dead start 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff380061840 0x7ff38014e900 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff38002b6a0 msgr2=0x7ff38002bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff38002b6a0 0x7ff38002bae0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff38002c530 msgr2=0x7ff380205610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff38002c530 0x7ff380205610 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff380206060 msgr2=0x7ff380208450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff380206060 0x7ff380208450 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff380208ea0 msgr2=0x7ff38020b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff380208ea0 0x7ff38020b290 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff37fe00700 1 -- 172.21.15.32:0/85509470 reap_dead start 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff360066730 msgr2=0x7ff360068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff360066730 0x7ff360068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a010 tx=0x7ff370008030 comp rx=0 tx=0).stop 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 msgr2=0x7ff3801f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff3801f2930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff37800ef90 tx=0x7ff37800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 shutdown_connections 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff360066730 0x7ff360068bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 --2- 172.21.15.32:0/85509470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3801514a0 0x7ff3801f2930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 >> 172.21.15.32:0/85509470 conn(0x7ff380073720 msgr2=0x7ff38014b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 shutdown_connections 2024-09-13T18:47:04.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:04.182+0000 7ff385000700 1 -- 172.21.15.32:0/85509470 wait complete. 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:47:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:47:04.201 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:04.197+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:04.275 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:04.275 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:04.275 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:04.275 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:04.276 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:04.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:47:04.303 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:04.297+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:04.392 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:15 2.15 e26/19 2:a93a17c2:::604.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.063065554, 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003980173, 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325369+0000", 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325368+0000", 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325380+0000", 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1277999999999999e-05 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325395+0000", 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5102e-05 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325403+0000", 2024-09-13T18:47:04.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1780000000000003e-06 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325461+0000", 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8153999999999999e-05 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325497+0000", 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5703e-05 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329259+0000", 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003762034 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329350+0000", 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0853999999999994e-05 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:3 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:47:04.397 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.0623088, 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055640469999999999, 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326126+0000", 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326124+0000", 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326139+0000", 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5211999999999999e-05 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326276+0000", 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013727600000000001 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326289+0000", 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2775999999999999e-05 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326559+0000", 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027034200000000002 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.400 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326813+0000", 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025346800000000002 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326994+0000", 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000181261 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331452+0000", 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00445773 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331472+0000", 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0207000000000002e-05 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331597+0000", 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012548999999999999 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331690+0000", 2024-09-13T18:47:04.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2824000000000004e-05 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.06229014100001, 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005919105, 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326145+0000", 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326144+0000", 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326154+0000", 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9219999999999992e-06 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326332+0000", 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017812700000000001 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326341+0000", 2024-09-13T18:47:04.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4919999999999993e-06 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327516+0000", 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011757790000000001 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327648+0000", 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013117099999999999 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:47:04.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327870+0000", 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00022226200000000001 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331733+0000", 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038630409999999998 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331983+0000", 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025007499999999999 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332030+0000", 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6739000000000001e-05 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332064+0000", 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4162999999999998e-05 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062278052, 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0068942530000000004, 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326157+0000", 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326156+0000", 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0769999999999998e-06 2024-09-13T18:47:04.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326674+0000", 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051265600000000001 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7353000000000001e-05 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326776+0000", 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4163e-05 2024-09-13T18:47:04.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326951+0000", 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000175188 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327122+0000", 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017140100000000001 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332159+0000", 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050368119999999999 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332982+0000", 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082341599999999999 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333017+0000", 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4542000000000002e-05 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333051+0000", 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4224000000000003e-05 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062271327, 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069731419999999999, 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326164+0000", 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326163+0000", 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326168+0000", 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5199999999999999e-06 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326741+0000", 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00057340699999999995 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326755+0000", 2024-09-13T18:47:04.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4134000000000001e-05 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327591+0000", 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00083529700000000004 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327706+0000", 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000115068 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327888+0000", 2024-09-13T18:47:04.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018264799999999999 2024-09-13T18:47:04.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.418 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332191+0000", 2024-09-13T18:47:04.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043025930000000004 2024-09-13T18:47:04.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.419 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333061+0000", 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00087031299999999995 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333106+0000", 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4950000000000002e-05 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333137+0000", 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0614000000000002e-05 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.420 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062264485, 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010246369999999999, 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:04.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326170+0000", 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326174+0000", 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2520000000000001e-06 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326781+0000", 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00060728099999999999 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326796+0000", 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4752999999999999e-05 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328227+0000", 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014305640000000001 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329462+0000", 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001235435 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329658+0000", 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196295 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333145+0000", 2024-09-13T18:47:04.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034868880000000001 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336332+0000", 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003187044 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336381+0000", 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.8399000000000002e-05 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336417+0000", 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6270999999999999e-05 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062258394, 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010851796, 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326177+0000", 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326176+0000", 2024-09-13T18:47:04.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326199+0000", 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3019000000000001e-05 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326852+0000", 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00065249600000000002 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326865+0000", 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3523000000000001e-05 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330076+0000", 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032109790000000001 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330212+0000", 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013555699999999999 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000205183 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333149+0000", 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0027325689999999998 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336950+0000", 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038001659999999998 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336982+0000", 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2719999999999998e-05 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337028+0000", 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6109000000000002e-05 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062233306, 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010945949999999999, 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:47:04.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326202+0000", 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326201+0000", 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326205+0000", 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.737e-06 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326881+0000", 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067628499999999999 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326889+0000", 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2599999999999999e-06 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330792+0000", 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003903307 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331023+0000", 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00023157200000000001 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331232+0000", 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020846300000000001 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336459+0000", 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052276120000000004 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337085+0000", 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00062576199999999998 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337123+0000", 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7731000000000002e-05 2024-09-13T18:47:04.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337148+0000", 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4624e-05 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.06222864999999, 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011071976000000001, 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.438 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:04.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326206+0000", 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326219+0000", 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2672e-05 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326903+0000", 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00068390300000000003 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326910+0000", 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9739999999999996e-06 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331720+0000", 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048109570000000003 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331791+0000", 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0485e-05 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331930+0000", 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000139247 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336692+0000", 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047617379999999997 2024-09-13T18:47:04.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337198+0000", 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00050565899999999999 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337237+0000", 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8906000000000003e-05 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337278+0000", 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1783999999999998e-05 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062214551, 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011142516, 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.445 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326220+0000", 2024-09-13T18:47:04.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326223+0000", 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5909999999999998e-06 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326922+0000", 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00069976900000000004 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326931+0000", 2024-09-13T18:47:04.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0940000000000008e-06 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332226+0000", 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052950419999999998 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332333+0000", 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107328 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332428+0000", 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5519000000000005e-05 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336724+0000", 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042953690000000003 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337320+0000", 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00059643299999999995 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337345+0000", 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899e-05 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337363+0000", 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7827999999999999e-05 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.450 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062202597, 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011214828, 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326232+0000", 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326237+0000", 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2070000000000003e-06 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326944+0000", 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00070708499999999998 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326967+0000", 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2286999999999999e-05 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332651+0000", 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056847499999999997 2024-09-13T18:47:04.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332701+0000", 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0056999999999999e-05 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 7", 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332773+0000", 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1772000000000003e-05 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336726+0000", 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039531820000000004 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337389+0000", 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000662686 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337417+0000", 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7923999999999999e-05 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.337447+0000", 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0256e-05 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062194077, 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0076889819999999996, 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.456 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326241+0000", 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326244+0000", 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8449999999999996e-06 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326979+0000", 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00073461000000000002 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326985+0000", 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3169999999999998e-06 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327087+0000", 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101247 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327402+0000", 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031513899999999998 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327726+0000", 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00032404599999999998 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332132+0000", 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044064320000000001 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333849+0000", 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001716661 2024-09-13T18:47:04.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333899+0000", 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0557999999999999e-05 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333930+0000", 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0474999999999999e-05 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062188972, 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010225639999999999, 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326246+0000", 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326250+0000", 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2069999999999997e-06 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00078043299999999997 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327044+0000", 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3570000000000001e-05 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329262+0000", 2024-09-13T18:47:04.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022184639999999999 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329458+0000", 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000195885 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 5", 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329813+0000", 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00035500499999999998 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332139+0000", 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023255200000000002 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336387+0000", 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042480299999999999 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336440+0000", 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3687000000000003e-05 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336472+0000", 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1183000000000003e-05 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:29 2.15 e26/19 2:aa448500:::500.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.062114677, 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0055478519999999998, 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.467 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326320+0000", 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326318+0000", 2024-09-13T18:47:04.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326337+0000", 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9337000000000001e-05 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326361+0000", 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.372e-05 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326379+0000", 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7980000000000001e-05 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021548800000000001 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326650+0000", 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5989999999999998e-05 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331781+0000", 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0051309429999999998 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331868+0000", 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7014000000000004e-05 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.471 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.06119325500001, 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049343199999999999, 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327242+0000", 2024-09-13T18:47:04.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327239+0000", 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327258+0000", 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9264000000000001e-05 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327315+0000", 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999997e-05 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327331+0000", 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6283e-05 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328362+0000", 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001030778 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328563+0000", 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000201633 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 3", 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328780+0000", 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021656999999999999 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331831+0000", 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003051326 2024-09-13T18:47:04.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00027979699999999998 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332146+0000", 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5227e-05 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332176+0000", 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9785e-05 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.061168098, 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.009319038, 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327267+0000", 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327266+0000", 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327271+0000", 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6629999999999998e-06 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327363+0000", 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1953999999999994e-05 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327376+0000", 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2927e-05 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330516+0000", 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031392270000000001 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330823+0000", 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000307528 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336586+0000", 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005762802 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.061111388, 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037746310000000001, 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.481 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327324+0000", 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327323+0000", 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327335+0000", 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1687e-05 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327358+0000", 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2993000000000002e-05 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327374+0000", 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6966999999999999e-05 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327554+0000", 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017963500000000001 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327624+0000", 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0173999999999996e-05 2024-09-13T18:47:04.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331071+0000", 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034467170000000002 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331098+0000", 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7208000000000001e-05 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:4 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.057747635, 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0056861389999999998, 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330687+0000", 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330686+0000", 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330697+0000", 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0132999999999999e-05 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330707+0000", 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0397999999999999e-05 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330724+0000", 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7248000000000002e-05 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330819+0000", 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.4667999999999996e-05 2024-09-13T18:47:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330832+0000", 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2669e-05 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336319+0000", 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054878799999999997 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336373+0000", 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4078e-05 2024-09-13T18:47:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 4 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.056967844, 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049182519999999997, 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331467+0000", 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331466+0000", 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0462000000000001e-05 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331490+0000", 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3050999999999999e-05 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331502+0000", 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2109999999999999e-05 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331603+0000", 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000100523 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336385+0000", 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047828699999999998 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 112.562174777, 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00383059, 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826260+0000", 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826257+0000", 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826278+0000", 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0950000000000001e-05 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826330+0000", 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1734000000000003e-05 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826347+0000", 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7736000000000001e-05 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826515+0000", 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016796000000000001 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826763+0000", 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024722500000000001 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.826958+0000", 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019506300000000001 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.828545+0000", 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001587307 2024-09-13T18:47:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.829937+0000", 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001392587 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830022+0000", 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4816999999999998e-05 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:11.830091+0000", 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8484000000000004e-05 2024-09-13T18:47:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.499 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:04.500 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:47:04.501 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:04.497+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:04.601 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:04.597+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:04.659 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:04.659 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:04.659 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:04.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.674 INFO:tasks.workunit.client.0.smithi032.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: git switch -c 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr:Or undo this operation with: 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: git switch - 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:47:04.675 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-13T18:47:04.676 INFO:tasks.workunit.client.0.smithi032.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:47:04.696 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:47:04.702 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:04.698+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:04.731 INFO:tasks.workunit.client.0.smithi032.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:47:04.739 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:47:04.740 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:47:04.771 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:04.771 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:04.771 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:04.772 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:04.772 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:04.781 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:47:04.803 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:04.798+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.54965776899999, 2024-09-13T18:47:04.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.53842077499999, 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.895 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:47:04.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:47:04.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.475649269, 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:47:04.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:47:04.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:04.904 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.44541113, 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:04.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:47:04.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:47:04.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:47:04.909 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.44480276199999, 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:04.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:47:04.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.076483935, 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.07570235, 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:47:04.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:47:04.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.07493516100001, 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:47:04.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:04.927 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.074099902, 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:47:04.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:47:04.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.07310928999999, 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 132.072495796, 2024-09-13T18:47:04.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:47:04.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:47:04.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:140 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'98, mlcod=18'93)", 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 131.17020969000001, 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032576390000000001, 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.941 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717459+0000", 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717458+0000", 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717536+0000", 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8446000000000001e-05 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717547+0000", 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0812000000000001e-05 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717554+0000", 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9e-06 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717631+0000", 2024-09-13T18:47:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6525000000000003e-05 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.717663+0000", 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2035000000000001e-05 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720648+0000", 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002985443 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.720716+0000", 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8198e-05 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 131.16893598600001, 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:47:04.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:04.949 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 131.16113235899999, 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:47:04.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.953 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 131.16035947099999, 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.954 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:47:04.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.958 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.562125479, 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:47:04.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.562100222, 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:04.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.966 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.562068079, 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:47:04.968 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:47:04.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.55930722700001, 2024-09-13T18:47:04.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:47:04.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 118.556346456, 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:47:04.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:47:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:04.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:04.981 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:04.982 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:47:04.983 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:04.978+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:05.083 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:05.077+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:05.096 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:05.096 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:05.096 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:05.107 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:47:05.185 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:05.178+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:05.216 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:05.216 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:05.216 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:05.216 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:05.216 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:05.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:47:05.241 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 7, 6, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T18:47:05.241 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T18:47:05.242 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T18:47:05.242 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.085335 2024-09-13T18:47:05.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.0853350205947262 2024-09-13T18:47:05.298 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:05.290+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:05.341 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:05.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.011961528, 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:47:05.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.345 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDPGPull(2.7 e53/52 cost 1048576)", 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.986501272000002, 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033282299999999999, 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353761+0000", 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4487999999999999e-05 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353769+0000", 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1629999999999996e-06 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353782+0000", 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2394e-05 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353840+0000", 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7970000000000002e-05 2024-09-13T18:47:05.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.354080+0000", 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024017099999999999 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.349 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:05.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:47:05.400 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:05.397+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:05.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.426+0000 7fb76da00700 1 Processor -- start 2024-09-13T18:47:05.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.426+0000 7fb76da00700 1 -- start start 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb76da00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb768153b90 0x7fb7680c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb76da00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb7680c5fb0 0x7fb7680cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb76da00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76815cc20 con 0x7fb76806df80 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb76da00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb768072950 con 0x7fb7680c5fb0 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb76da00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680c6560 con 0x7fb768153b90 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb766a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb768153b90 0x7fb7680c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb767400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb7680c5fb0 0x7fb7680cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb766000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb76806df80 0x7fb76815ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:49038/0 (socket says 172.21.15.32:49038) 2024-09-13T18:47:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb766a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb768153b90 0x7fb7680c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:39572/0 (socket says 172.21.15.32:39572) 2024-09-13T18:47:05.438 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb766000700 1 -- 172.21.15.32:0/3626066225 learned_addr learned my addr 172.21.15.32:0/3626066225 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb767400700 1 -- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb768153b90 msgr2=0x7fb7680c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb767400700 1 --2- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb768153b90 0x7fb7680c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb767400700 1 -- 172.21.15.32:0/3626066225 >> v1:172.21.15.86:6789/0 conn(0x7fb76806df80 legacy=0x7fb76815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb767400700 1 -- 172.21.15.32:0/3626066225 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76815ce70 con 0x7fb7680c5fb0 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.430+0000 7fb767400700 1 --2- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cb540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb760009d90 tx=0x7fb76000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50d9437f8c591ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb765600700 1 -- 172.21.15.32:0/3626066225 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76000e070 con 0x7fb7680c5fb0 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb765600700 1 -- 172.21.15.32:0/3626066225 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76000bb20 con 0x7fb7680c5fb0 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb765600700 1 -- 172.21.15.32:0/3626066225 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760012430 con 0x7fb7680c5fb0 2024-09-13T18:47:05.440 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 -- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7680c5fb0 msgr2=0x7fb7680cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 --2- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cb540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb760009d90 tx=0x7fb76000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 -- 172.21.15.32:0/3626066225 shutdown_connections 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 --2- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cb540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 --2- 172.21.15.32:0/3626066225 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb768153b90 0x7fb7680c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 -- 172.21.15.32:0/3626066225 >> 172.21.15.32:0/3626066225 conn(0x7fb76806aec0 msgr2=0x7fb76806b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 -- 172.21.15.32:0/3626066225 shutdown_connections 2024-09-13T18:47:05.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.434+0000 7fb76da00700 1 -- 172.21.15.32:0/3626066225 wait complete. 2024-09-13T18:47:05.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:47:05.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 Processor -- start 2024-09-13T18:47:05.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 -- start start 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 0x7fb7681569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb768153b90 0x7fb7680c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680c8f40 con 0x7fb7680c5fb0 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681eefb0 con 0x7fb768153b90 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb76da00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681efdd0 con 0x7fb76806df80 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 0x7fb7681569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.446 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 0x7fb7681569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:39588/0 (socket says 172.21.15.32:39588) 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 -- 172.21.15.32:0/4144631222 learned_addr learned my addr 172.21.15.32:0/4144631222 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb767400700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb768153b90 0x7fb7680c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 -- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb768153b90 msgr2=0x7fb7680c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb768153b90 0x7fb7680c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 -- 172.21.15.32:0/4144631222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7680c5fb0 msgr2=0x7fb7680cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 -- 172.21.15.32:0/4144631222 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009a70 con 0x7fb76806df80 2024-09-13T18:47:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.438+0000 7fb766a00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 0x7fb7681569b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb75800e840 tx=0x7fb75800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580095a0 con 0x7fb76806df80 2024-09-13T18:47:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758013680 con 0x7fb76806df80 2024-09-13T18:47:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580139f0 con 0x7fb76806df80 2024-09-13T18:47:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb768156ef0 con 0x7fb76806df80 2024-09-13T18:47:05.448 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7681ef1c0 con 0x7fb76806df80 2024-09-13T18:47:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7680c55e0 con 0x7fb76806df80 2024-09-13T18:47:05.449 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.442+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb758013b50 con 0x7fb76806df80 2024-09-13T18:47:05.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.446+0000 7fb75ea00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb748066730 0x7fb748068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.446+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb7580846d0 con 0x7fb76806df80 2024-09-13T18:47:05.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.446+0000 7fb766000700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb748066730 0x7fb748068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.446+0000 7fb766000700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb748066730 0x7fb748068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb76815c910 tx=0x7fb754007f30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:05.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.454+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb758051630 con 0x7fb76806df80 2024-09-13T18:47:05.464 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:05.464 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:05.465 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:05.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:47:05.486 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:05.482+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:05.577 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:05.577 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:05.577 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:05.577 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:05.577 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:05.587 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:47:05.587 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:05.582+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:05.588 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:47:05.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 Processor -- start 2024-09-13T18:47:05.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 -- start start 2024-09-13T18:47:05.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38f0151680 0x7f38f006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f00cd640 0x7f38f006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f015aa50 con 0x7f38f0151a60 2024-09-13T18:47:05.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f015aca0 con 0x7f38f0151680 2024-09-13T18:47:05.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f015af80 con 0x7f38f00cd640 2024-09-13T18:47:05.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f5600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38f0151680 0x7f38f006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f5600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f38f0151680 0x7f38f006b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:55924/0 (socket says 172.21.15.32:55924) 2024-09-13T18:47:05.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f5600700 1 -- 172.21.15.32:0/2130551216 learned_addr learned my addr 172.21.15.32:0/2130551216 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:05.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f6000700 1 --2- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f00cd640 0x7f38f006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f5600700 1 -- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f00cd640 msgr2=0x7f38f006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:05.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f5600700 1 --2- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f00cd640 0x7f38f006b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.610+0000 7f38f5600700 1 -- 172.21.15.32:0/2130551216 >> v1:172.21.15.32:6789/0 conn(0x7f38f0151a60 legacy=0x7f38f00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:05.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f5600700 1 -- 172.21.15.32:0/2130551216 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f015b260 con 0x7f38f0151680 2024-09-13T18:47:05.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f5600700 1 --2- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0151680 0x7f38f006b260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009e50 tx=0x7f38e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc26d04abfd26b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:05.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38efe00700 1 -- 172.21.15.32:0/2130551216 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400e070 con 0x7f38f0151680 2024-09-13T18:47:05.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38efe00700 1 -- 172.21.15.32:0/2130551216 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e4003a40 con 0x7f38f0151680 2024-09-13T18:47:05.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38efe00700 1 -- 172.21.15.32:0/2130551216 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4003df0 con 0x7f38f0151680 2024-09-13T18:47:05.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 -- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0151680 msgr2=0x7f38f006b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 --2- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0151680 0x7f38f006b260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009e50 tx=0x7f38e400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 -- 172.21.15.32:0/2130551216 shutdown_connections 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 --2- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f00cd640 0x7f38f006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 --2- 172.21.15.32:0/2130551216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0151680 0x7f38f006b260 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 -- 172.21.15.32:0/2130551216 >> 172.21.15.32:0/2130551216 conn(0x7f38f0071740 msgr2=0x7f38f0071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 -- 172.21.15.32:0/2130551216 shutdown_connections 2024-09-13T18:47:05.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 -- 172.21.15.32:0/2130551216 wait complete. 2024-09-13T18:47:05.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.614+0000 7f38f6a00700 1 Processor -- start 2024-09-13T18:47:05.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 -- start start 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 0x7f38f00b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0151680 0x7f38f014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38f014f140 0x7f38f01f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00c43e0 con 0x7f38f014f140 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f014e490 con 0x7f38f00cd640 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f014e770 con 0x7f38f0151680 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 0x7f38f00b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 0x7f38f00b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:55930/0 (socket says 172.21.15.32:55930) 2024-09-13T18:47:05.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 -- 172.21.15.32:0/1402345951 learned_addr learned my addr 172.21.15.32:0/1402345951 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:05.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f4c00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0151680 0x7f38f014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6000700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38f014f140 0x7f38f01f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 -- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0151680 msgr2=0x7f38f014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0151680 0x7f38f014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 -- 172.21.15.32:0/1402345951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38f014f140 msgr2=0x7f38f01f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38f014f140 0x7f38f01f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 -- 172.21.15.32:0/1402345951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4009b30 con 0x7f38f00cd640 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f5600700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 0x7f38f00b2160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38f00cab80 tx=0x7f38e4004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4004440 con 0x7f38f00cd640 2024-09-13T18:47:05.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e40045c0 con 0x7f38f00cd640 2024-09-13T18:47:05.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f01f2c00 con 0x7f38f00cd640 2024-09-13T18:47:05.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4004970 con 0x7f38f00cd640 2024-09-13T18:47:05.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.618+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f014dd10 con 0x7f38f00cd640 2024-09-13T18:47:05.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.622+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f00ccf30 con 0x7f38f00cd640 2024-09-13T18:47:05.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.622+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38e4012430 con 0x7f38f00cd640 2024-09-13T18:47:05.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.622+0000 7f38ed600700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f38d0066730 0x7f38d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:05.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.622+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f38e4085610 con 0x7f38f00cd640 2024-09-13T18:47:05.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.622+0000 7f38f4c00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f38d0066730 0x7f38d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:05.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.622+0000 7f38f4c00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f38d0066730 0x7f38d0068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38f0070670 tx=0x7f38dc0090e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:05.637 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.630+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38e4055f70 con 0x7f38f00cd640 2024-09-13T18:47:05.669 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.662+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd primary-affinity", "id": 0, "weight": 0.0853350205947262} v 0) v1 -- 0x7fb7680c3410 con 0x7fb76806df80 2024-09-13T18:47:05.688 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:05.682+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:05.695 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:47:05.698 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:05.698 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:05.698 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.373081712, 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:05.699 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.700 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:47:05.701 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.702 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:47:05.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.704 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.37305784500001, 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.705 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:47:05.706 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.707 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.708 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:47:05.709 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.710 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.711 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.711 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:05.711 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:05.711 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.373047335, 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.713 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.714 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:47:05.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.716 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:05.717 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.37303133499999, 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.718 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.719 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:47:05.720 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:05.721 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:47:05.722 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:47:05.722 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.722 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.722 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:05.722 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.723 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.37302449800001, 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:47:05.724 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.725 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:47:05.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:47:05.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:47:05.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36946637200001, 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:47:05.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:47:05.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:47:05.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:47:05.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:47:05.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:47:05.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:47:05.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:47:05.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:47:05.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.736 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.736 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.737 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:05.737 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:05.737 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36765554599999, 2024-09-13T18:47:05.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:47:05.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:05.738 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:05.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:05.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:47:05.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:05.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:47:05.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:47:05.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:47:05.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:47:05.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:47:05.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:47:05.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:47:05.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:47:05.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.746 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:05.746 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:05.746 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.367601854, 2024-09-13T18:47:05.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:47:05.746 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.746 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.366557907, 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.751 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:47:05.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.755 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:47:05.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:47:05.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:47:05.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:47:05.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.757 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.757 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.758 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:47:05.758 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:05.758 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.365002219, 2024-09-13T18:47:05.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:47:05.758 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.758 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:05.759 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:05.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:05.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:47:05.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:05.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:47:05.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:47:05.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:47:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:47:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:47:05.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:47:05.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:47:05.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:47:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:47:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:47:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:47:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:47:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.766 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.767 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:47:05.767 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:05.767 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36494847199999, 2024-09-13T18:47:05.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:47:05.768 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.768 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:05.768 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:05.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:05.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:47:05.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:05.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:47:05.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:47:05.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:47:05.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:47:05.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:47:05.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:47:05.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:47:05.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:47:05.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:47:05.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:47:05.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:47:05.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:47:05.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.776 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.776 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.777 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:05.777 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:05.777 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.363709292, 2024-09-13T18:47:05.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:47:05.777 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.778 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:05.778 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:05.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:05.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:47:05.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:05.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.781 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.781 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:47:05.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:47:05.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:47:05.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:47:05.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:47:05.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:47:05.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36366405699999, 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:47:05.785 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.786 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:47:05.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.363629023, 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:47:05.794 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36358879300001, 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:47:05.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36289637100001, 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:05.800 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:47:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.362845683, 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:47:05.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:47:05.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.362452043, 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:05.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.812 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.814 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 119.36205547900001, 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:47:05.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:47:05.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:05.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:05.819 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:05.820 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:47:05.820 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:47:05.820 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:47:05.821 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:05.817+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:05.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T18:47:05.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:05.846+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7f38f00703c0 con 0x7f38f00cd640 2024-09-13T18:47:05.866 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:47:05.879 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:47:05.879 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:47:05.921 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:05.917+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:05.939 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-13T18:47:05.940 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-13T18:47:05.941 DEBUG:teuthology.orchestra.run.smithi032:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-13T18:47:05.982 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:05.982 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:47:05.982 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-13T18:47:05.982 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:05.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T18:47:06.021 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:06.017+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:06.122 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:06.117+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:06.198 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:06.198 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-13T18:47:06.199 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 180, 2024-09-13T18:47:06.199 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-13T18:47:06.199 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:06.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T18:47:06.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T18:47:06.259 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:06.254+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:06.324 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:06.321+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:06.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 Processor -- start 2024-09-13T18:47:06.392 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 -- start start 2024-09-13T18:47:06.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 0x7fd44c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fd44c071d90 0x7fd44c1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.393 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c15b8a0 con 0x7fd44c0c7070 2024-09-13T18:47:06.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c0c2230 con 0x7fd44c071d90 2024-09-13T18:47:06.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd453000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0c24f0 con 0x7fd44c0719b0 2024-09-13T18:47:06.394 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd451c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 0x7fd44c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd451c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 0x7fd44c15b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:39604/0 (socket says 172.21.15.32:39604) 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd452600700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd44c0c7070 0x7fd44c157990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52124/0 (socket says 172.21.15.32:52124) 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd451200700 1 --2- 172.21.15.32:0/1400467292 >> v2:172.21.15.86:3300/0 conn(0x7fd44c071d90 0x7fd44c1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.386+0000 7fd451c00700 1 -- 172.21.15.32:0/1400467292 learned_addr learned my addr 172.21.15.32:0/1400467292 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd451c00700 1 -- 172.21.15.32:0/1400467292 >> v2:172.21.15.86:3300/0 conn(0x7fd44c071d90 msgr2=0x7fd44c1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd451c00700 1 --2- 172.21.15.32:0/1400467292 >> v2:172.21.15.86:3300/0 conn(0x7fd44c071d90 0x7fd44c1511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd451c00700 1 -- 172.21.15.32:0/1400467292 >> v1:172.21.15.32:6789/0 conn(0x7fd44c0c7070 legacy=0x7fd44c157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd44be00700 1 -- 172.21.15.32:0/1400467292 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561673285 0 0) 0x7fd44c15b8a0 con 0x7fd44c0c7070 2024-09-13T18:47:06.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd451c00700 1 -- 172.21.15.32:0/1400467292 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0c3ed0 con 0x7fd44c0719b0 2024-09-13T18:47:06.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd451c00700 1 --2- 172.21.15.32:0/1400467292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 0x7fd44c15b360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd440009910 tx=0x7fd440009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f8ee4357e161c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd44be00700 1 -- 172.21.15.32:0/1400467292 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011830 con 0x7fd44c0719b0 2024-09-13T18:47:06.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd44be00700 1 -- 172.21.15.32:0/1400467292 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440011990 con 0x7fd44c0719b0 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd44be00700 1 -- 172.21.15.32:0/1400467292 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011d40 con 0x7fd44c0719b0 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 -- 172.21.15.32:0/1400467292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 msgr2=0x7fd44c15b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 --2- 172.21.15.32:0/1400467292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 0x7fd44c15b360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd440009910 tx=0x7fd440009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 -- 172.21.15.32:0/1400467292 shutdown_connections 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 --2- 172.21.15.32:0/1400467292 >> v2:172.21.15.86:3300/0 conn(0x7fd44c071d90 0x7fd44c1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 --2- 172.21.15.32:0/1400467292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0719b0 0x7fd44c15b360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 -- 172.21.15.32:0/1400467292 >> 172.21.15.32:0/1400467292 conn(0x7fd44c06a7d0 msgr2=0x7fd44c06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 -- 172.21.15.32:0/1400467292 shutdown_connections 2024-09-13T18:47:06.397 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 -- 172.21.15.32:0/1400467292 wait complete. 2024-09-13T18:47:06.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 Processor -- start 2024-09-13T18:47:06.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.390+0000 7fd453000700 1 -- start start 2024-09-13T18:47:06.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd44c0719b0 0x7fd44c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd44c071d90 0x7fd44c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0c7070 0x7fd44c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c14aff0 con 0x7fd44c071d90 2024-09-13T18:47:06.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0c81a0 con 0x7fd44c0719b0 2024-09-13T18:47:06.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0cc350 con 0x7fd44c0c7070 2024-09-13T18:47:06.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd44c071d90 0x7fd44c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd44c071d90 0x7fd44c14c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60054/0 (socket says 172.21.15.32:60054) 2024-09-13T18:47:06.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 -- 172.21.15.32:0/684977771 learned_addr learned my addr 172.21.15.32:0/684977771 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:06.400 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd44c0719b0 0x7fd44c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0c7070 0x7fd44c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0c7070 msgr2=0x7fd44c14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd44c0c7070 0x7fd44c14cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd44c0719b0 msgr2=0x7fd44c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd44c0719b0 0x7fd44c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440009570 con 0x7fd44c071d90 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd44c071d90 0x7fd44c14c9b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd43800e940 tx=0x7fd43800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438004020 con 0x7fd44c071d90 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438004180 con 0x7fd44c071d90 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c14b9c0 con 0x7fd44c071d90 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438004530 con 0x7fd44c071d90 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c0cc070 con 0x7fd44c071d90 2024-09-13T18:47:06.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.394+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7fd44c15b360 con 0x7fd44c071d90 2024-09-13T18:47:06.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.398+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4380036c0 con 0x7fd44c071d90 2024-09-13T18:47:06.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.398+0000 7fd449600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd42c066730 0x7fd42c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.398+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fd4380845b0 con 0x7fd44c071d90 2024-09-13T18:47:06.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.398+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd42c066730 0x7fd42c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.398+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v62) v1 ==== 54+0+16 (secure 0 0 0) 0x7fd438084920 con 0x7fd44c071d90 2024-09-13T18:47:06.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.402+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd44c0c6500 0x7fd44c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.402+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c0c3bd0 con 0x7fd44c0c6500 2024-09-13T18:47:06.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.402+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd44c0c6500 0x7fd44c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.402+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd42c066730 0x7fd42c068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd440000c00 tx=0x7fd440008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.402+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd44c0c6500 0x7fd44c0b1af0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.402+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd444001fc0 con 0x7fd44c0c6500 2024-09-13T18:47:06.417 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:16 2.1d 2:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.09317638500001, 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064486769999999999, 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320139+0000", 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320137+0000", 2024-09-13T18:47:06.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320154+0000", 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320221+0000", 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6347999999999996e-05 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320245+0000", 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4851999999999999e-05 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320466+0000", 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000220795 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320653+0000", 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018679800000000001 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320823+0000", 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017008299999999999 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324134+0000", 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003311179 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326499+0000", 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023650860000000002 2024-09-13T18:47:06.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326551+0000", 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1413999999999999e-05 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326588+0000", 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6684999999999999e-05 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.093152399, 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086402500000000004, 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320163+0000", 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320162+0000", 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320170+0000", 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.841e-06 2024-09-13T18:47:06.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320282+0000", 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011216 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320289+0000", 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4760000000000003e-06 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322592+0000", 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023029320000000002 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322754+0000", 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016180900000000001 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017898499999999999 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:47:06.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327076+0000", 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041433800000000003 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328705+0000", 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016295070000000001 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328765+0000", 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9227000000000001e-05 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328803+0000", 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8426000000000001e-05 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.093143493, 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005445648, 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.429 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320172+0000", 2024-09-13T18:47:06.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0320000000000002e-06 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320299+0000", 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012542200000000001 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320305+0000", 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9819999999999996e-06 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320465+0000", 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016034799999999999 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320641+0000", 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017532100000000001 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320810+0000", 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016904299999999999 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323354+0000", 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025442609999999999 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325505+0000", 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002151175 2024-09-13T18:47:06.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325574+0000", 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8410000000000004e-05 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325617+0000", 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3860999999999999e-05 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.093140621, 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073118920000000004, 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320175+0000", 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320174+0000", 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320176+0000", 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-13T18:47:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320325+0000", 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014878499999999999 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320330+0000", 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9620000000000001e-06 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322569+0000", 2024-09-13T18:47:06.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022389990000000002 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322752+0000", 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018322999999999999 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.322933+0000", 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018023099999999999 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:06.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327026+0000", 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040936619999999996 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327381+0000", 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035457000000000002 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327439+0000", 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705000000000001e-05 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327486+0000", 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7015000000000003e-05 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.09313791300001, 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0060210660000000003, 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.440 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320177+0000", 2024-09-13T18:47:06.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967296 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320193+0000", 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6226e-05 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320425+0000", 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023168 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320432+0000", 2024-09-13T18:47:06.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0620000000000003e-06 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.320798+0000", 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036630899999999999 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321119+0000", 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032065899999999999 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-13T18:47:06.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.321523+0000", 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040376300000000002 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324563+0000", 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030397789999999998 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326103+0000", 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001540788 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326161+0000", 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7420000000000003e-05 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326198+0000", 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7589000000000002e-05 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:30 2.13 e26/19 2:cd5a64a3:::100.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.090010846, 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050862579999999998, 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323304+0000", 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323324+0000", 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9383000000000001e-05 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323335+0000", 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022999999999999e-05 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323343+0000", 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1990000000000006e-06 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323404+0000", 2024-09-13T18:47:06.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1029000000000001e-05 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.323426+0000", 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2552999999999999e-05 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328354+0000", 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049276629999999997 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328391+0000", 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6656999999999998e-05 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:24 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'1, mlcod=0'0)", 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.08860557200001, 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002454099, 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324710+0000", 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324709+0000", 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:47:06.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324715+0000", 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4810000000000003e-06 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324727+0000", 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1398e-05 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324734+0000", 2024-09-13T18:47:06.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6529999999999994e-06 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325027+0000", 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029226700000000003 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325038+0000", 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869e-05 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327118+0000", 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020802120000000001 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327164+0000", 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5988000000000001e-05 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:25 2.7 e25/19 2:e0b41d06:::609.00000000:head v 25'2, mlcod=0'0)", 2024-09-13T18:47:06.454 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.088460414, 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023415290000000002, 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324855+0000", 2024-09-13T18:47:06.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324854+0000", 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324862+0000", 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0690000000000002e-06 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324875+0000", 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3108000000000001e-05 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324884+0000", 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.602e-06 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325285+0000", 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040089599999999998 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325311+0000", 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6061e-05 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327167+0000", 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018561739999999999 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327196+0000", 2024-09-13T18:47:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9400999999999999e-05 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.088363, 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034861739999999999, 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324952+0000", 2024-09-13T18:47:06.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324961+0000", 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2639999999999997e-06 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324977+0000", 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6112000000000001e-05 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.324991+0000", 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3677e-05 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325067+0000", 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5885999999999998e-05 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328438+0000", 2024-09-13T18:47:06.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033718060000000002 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:27 2.13 e26/19 2:c91d4a1d:::mds0_inotable:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.08828188699999, 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033797110000000001, 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325033+0000", 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325040+0000", 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1010000000000003e-06 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325049+0000", 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1190000000000003e-06 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325056+0000", 2024-09-13T18:47:06.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3889999999999999e-06 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325099+0000", 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2301e-05 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325119+0000", 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0582e-05 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328393+0000", 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032739380000000001 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328413+0000", 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:20 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:47:06.467 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.08803138499999, 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034199799999999999, 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325284+0000", 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325283+0000", 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325287+0000", 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3599999999999998e-06 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325299+0000", 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1341e-05 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325343+0000", 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4146000000000001e-05 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325487+0000", 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014373200000000001 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325499+0000", 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1875000000000001e-05 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.325626+0000", 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127236 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.471 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:16 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.08693710999999, 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216011, 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326378+0000", 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326377+0000", 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326383+0000", 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8529999999999997e-06 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326401+0000", 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7623000000000001e-05 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326409+0000", 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7340000000000008e-06 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326487+0000", 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8159999999999997e-05 2024-09-13T18:47:06.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326494+0000", 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3139999999999998e-06 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326594+0000", 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010011899999999999 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:21 2.1c e25/19 ondisk, result = 0)", 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.086856161, 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057124900000000002, 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326459+0000", 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326462+0000", 2024-09-13T18:47:06.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8700000000000002e-06 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326471+0000", 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.524e-06 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.326477+0000", 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9610000000000002e-06 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327004+0000", 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052736899999999997 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327014+0000", 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6320000000000003e-06 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.327030+0000", 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6328e-05 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.479 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(mds.0.4:17 2.1d e25/19 ondisk, result = 0)", 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 120.08475350800001, 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000248137, 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:47:06.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328562+0000", 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328561+0000", 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328566+0000", 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2429999999999996e-06 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328578+0000", 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.132e-05 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328584+0000", 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.742e-06 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328690+0000", 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010531600000000001 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328698+0000", 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7740000000000004e-06 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:06.328810+0000", 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112308 2024-09-13T18:47:06.483 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 114.58676182000001, 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002139195, 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826553+0000", 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826551+0000", 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999976 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826571+0000", 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.031e-05 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826604+0000", 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2184999999999998e-05 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826620+0000", 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6827e-05 2024-09-13T18:47:06.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826750+0000", 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012924599999999999 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.826806+0000", 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6276000000000001e-05 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828573+0000", 2024-09-13T18:47:06.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017670679999999999 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:45:11.828693+0000", 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011961299999999999 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDPGPushReply(2.7 35/34 [PushReplyOp(2:e0b41d06:::609.00000000:head)])", 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:47:06.488 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 65.622071520999995, 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229566, 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791244+0000", 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791243+0000", 2024-09-13T18:47:06.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791249+0000", 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6380000000000001e-06 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791257+0000", 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8639999999999996e-06 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791264+0000", 2024-09-13T18:47:06.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0469999999999996e-06 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791309+0000", 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4860000000000001e-05 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:46:00.791473+0000", 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164644 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(4.12s3 62/52 ECSubWrite(tid=18, reqid=client.4834.0:2, at_version=62'1, trim_to=0'0, roll_forward_to=0'0))", 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:47:06.286159+0000", 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.12715607800000001, 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001419523, 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286159+0000", 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286159+0000", 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286157+0000", 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286190+0000", 2024-09-13T18:47:06.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2591e-05 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286216+0000", 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6077000000000001e-05 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286229+0000", 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2516e-05 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286318+0000", 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9561000000000005e-05 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.286331+0000", 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2863e-05 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.287543+0000", 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012117040000000001 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.287579+0000", 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6010000000000003e-05 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(4.12s3 62/52 ECSubWrite(tid=19, reqid=client.4834.0:2, at_version=0'0, trim_to=0'0, roll_forward_to=62'1))", 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:47:06.288455+0000", 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.12485972200000001, 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001138827, 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.499 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288455+0000", 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288455+0000", 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288455+0000", 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.999999 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288465+0000", 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0318e-05 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288478+0000", 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.27e-05 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288486+0000", 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3550000000000005e-06 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288543+0000", 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7336000000000001e-05 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.288553+0000", 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5310000000000007e-06 2024-09-13T18:47:06.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.289542+0000", 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098878500000000005 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.289594+0000", 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2522000000000003e-05 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(4.12s3 62/52 ECSubWrite(tid=20, reqid=client.4834.0:3, at_version=62'2, trim_to=0'0, roll_forward_to=62'1))", 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:47:06.299853+0000", 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.113462174, 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013563990000000001, 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.299853+0000", 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.299853+0000", 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.299851+0000", 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.299980+0000", 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128064 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.300023+0000", 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3300999999999998e-05 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.300044+0000", 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0993999999999999e-05 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.300191+0000", 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014715900000000001 2024-09-13T18:47:06.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.300208+0000", 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7365999999999999e-05 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.301152+0000", 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094328900000000004 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.301209+0000", 2024-09-13T18:47:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7769999999999997e-05 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "MOSDECSubOpWrite(4.12s3 62/52 ECSubWrite(tid=21, reqid=client.4834.0:3, at_version=0'0, trim_to=0'0, roll_forward_to=62'2))", 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-13T18:47:06.302712+0000", 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.110603383, 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001006004, 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-13T18:47:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302712+0000", 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302712+0000", 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302711+0000", 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302722+0000", 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0583e-05 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302734+0000", 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2712e-05 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302741+0000", 2024-09-13T18:47:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2539999999999998e-06 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302803+0000", 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2497999999999997e-05 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_started", 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.302811+0000", 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3000000000000002e-06 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_committed", 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.303684+0000", 2024-09-13T18:47:06.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000872196 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-13T18:47:06.303718+0000", 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4164e-05 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-13T18:47:06.512 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.418+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c157470 con 0x7fd44c0c6500 2024-09-13T18:47:06.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.422+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd444007280 con 0x7fd44c0c6500 2024-09-13T18:47:06.514 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:47:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.422+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd44c1f2f10 0x7fd44c070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.422+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c06f160 con 0x7fd44c1f2f10 2024-09-13T18:47:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.422+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd44c1f2f10 0x7fd44c070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.422+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd44c1f2f10 0x7fd44c070580 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.422+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd44c06f160 con 0x7fd44c1f2f10 2024-09-13T18:47:06.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.430+0000 7fb75ea00700 1 -- 172.21.15.32:0/4144631222 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 0, "weight": 0.0853350205947262}]=0 set osd.0 primary-affinity to 0.085335 (855922) v63) v1 ==== 154+0+0 (secure 0 0 0) 0x7fb758054c50 con 0x7fb76806df80 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb748066730 msgr2=0x7fb748068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb748066730 0x7fb748068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb76815c910 tx=0x7fb754007f30 comp rx=0 tx=0).stop 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 msgr2=0x7fb7681569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 0x7fb7681569b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb75800e840 tx=0x7fb75800eb50 comp rx=0 tx=0).stop 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 shutdown_connections 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb748066730 0x7fb748068bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb768153b90 0x7fb7680c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7680c5fb0 0x7fb7680cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 --2- 172.21.15.32:0/4144631222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb76806df80 0x7fb7681569b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 >> 172.21.15.32:0/4144631222 conn(0x7fb76806aec0 msgr2=0x7fb7680cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:06.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 shutdown_connections 2024-09-13T18:47:06.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7fb76da00700 1 -- 172.21.15.32:0/4144631222 wait complete. 2024-09-13T18:47:06.518 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.0 primary-affinity to 0.085335 (855922) 2024-09-13T18:47:06.519 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:06.509+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.438+0000 7f38ed600700 1 -- 172.21.15.32:0/1402345951 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v63) v1 ==== 91+0+0 (secure 0 0 0) 0x7f38e4055b00 con 0x7f38f00cd640 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f38d0066730 msgr2=0x7f38d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f38d0066730 0x7f38d0068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38f0070670 tx=0x7f38dc0090e0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 msgr2=0x7f38f00b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 0x7f38f00b2160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38f00cab80 tx=0x7f38e4004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 shutdown_connections 2024-09-13T18:47:06.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f38d0066730 0x7f38d0068bf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38f014f140 0x7f38f01f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f38f0151680 0x7f38f014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 --2- 172.21.15.32:0/1402345951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f00cd640 0x7f38f00b2160 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 >> 172.21.15.32:0/1402345951 conn(0x7f38f0071740 msgr2=0x7f38f00708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 shutdown_connections 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7f38f6a00700 1 -- 172.21.15.32:0/1402345951 wait complete. 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.450+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c0c6c40 con 0x7fd44c1f2f10 2024-09-13T18:47:06.520 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:47:06.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.454+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c0c6c40 con 0x7fd44c1f2f10 2024-09-13T18:47:06.521 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:47:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.454+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd44c070fd0 0x7fd44c060db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.454+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c14b2a0 con 0x7fd44c070fd0 2024-09-13T18:47:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.454+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd44c070fd0 0x7fd44c060db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.454+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd44c070fd0 0x7fd44c060db0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.454+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd438054b30 con 0x7fd44c070fd0 2024-09-13T18:47:06.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.470+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c0713d0 con 0x7fd44c070fd0 2024-09-13T18:47:06.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.474+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c0713d0 con 0x7fd44c070fd0 2024-09-13T18:47:06.524 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.474+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd44c061800 0x7fd44c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.474+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c0c4560 con 0x7fd44c061800 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.474+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd44c061800 0x7fd44c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.474+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd44c061800 0x7fd44c0cae50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.474+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd44c0c4560 con 0x7fd44c061800 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.494+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c0cb390 con 0x7fd44c061800 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.498+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c0cb390 con 0x7fd44c061800 2024-09-13T18:47:06.525 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:47:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.498+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd44c0cba70 0x7fd44c02b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.498+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c204f80 con 0x7fd44c0cba70 2024-09-13T18:47:06.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.498+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd44c0cba70 0x7fd44c02b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.498+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd44c0cba70 0x7fd44c02b6a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.498+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd44c204f80 con 0x7fd44c0cba70 2024-09-13T18:47:06.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.518+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c02bbe0 con 0x7fd44c0cba70 2024-09-13T18:47:06.529 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.522+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c02bbe0 con 0x7fd44c0cba70 2024-09-13T18:47:06.529 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:47:06.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.522+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd44c02c2c0 0x7fd44c02c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.522+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c02cc60 con 0x7fd44c02c2c0 2024-09-13T18:47:06.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.526+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd44c02c2c0 0x7fd44c02c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.526+0000 7fd451200700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd44c02c2c0 0x7fd44c02c720 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.526+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd44c02cc60 con 0x7fd44c02c2c0 2024-09-13T18:47:06.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.542+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c02cc60 con 0x7fd44c02c2c0 2024-09-13T18:47:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.546+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c02cc60 con 0x7fd44c02c2c0 2024-09-13T18:47:06.551 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:47:06.551 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.546+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd44c205ce0 0x7fd44c2080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.546+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c20af50 con 0x7fd44c205ce0 2024-09-13T18:47:06.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.546+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd44c205ce0 0x7fd44c2080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.546+0000 7fd452600700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd44c205ce0 0x7fd44c2080d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.554 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.550+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd44c20af50 con 0x7fd44c205ce0 2024-09-13T18:47:06.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.566+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c208610 con 0x7fd44c205ce0 2024-09-13T18:47:06.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.570+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c208610 con 0x7fd44c205ce0 2024-09-13T18:47:06.577 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:47:06.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.570+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd44c208c90 0x7fd44c20b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:06.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.570+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c20df00 con 0x7fd44c208c90 2024-09-13T18:47:06.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.570+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd44c208c90 0x7fd44c20b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:06.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.574+0000 7fd451c00700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd44c208c90 0x7fd44c20b080 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:06.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.574+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd44c20df00 con 0x7fd44c208c90 2024-09-13T18:47:06.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.606+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) v1 -- 0x7fd44c20b5c0 con 0x7fd44c208c90 2024-09-13T18:47:06.614 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:06.609+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:06.616 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd449600700 1 -- 172.21.15.32:0/684977771 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7fd44c20b5c0 con 0x7fd44c208c90 2024-09-13T18:47:06.616 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd44c0c6500 msgr2=0x7fd44c0b1af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7fd44c0c6500 0x7fd44c0b1af0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd44c1f2f10 msgr2=0x7fd44c070580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7fd44c1f2f10 0x7fd44c070580 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd44c070fd0 msgr2=0x7fd44c060db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fd44c070fd0 0x7fd44c060db0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd44c061800 msgr2=0x7fd44c0cae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7fd44c061800 0x7fd44c0cae50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd44c0cba70 msgr2=0x7fd44c02b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fd44c0cba70 0x7fd44c02b6a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd44c02c2c0 msgr2=0x7fd44c02c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fd44c02c2c0 0x7fd44c02c720 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd44c205ce0 msgr2=0x7fd44c2080d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7fd44c205ce0 0x7fd44c2080d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd44c208c90 msgr2=0x7fd44c20b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7fd44c208c90 0x7fd44c20b080 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd42c066730 msgr2=0x7fd42c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd42c066730 0x7fd42c068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd440000c00 tx=0x7fd440008030 comp rx=0 tx=0).stop 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd44c071d90 msgr2=0x7fd44c14c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:06.618 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 --2- 172.21.15.32:0/684977771 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd44c071d90 0x7fd44c14c9b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd43800e940 tx=0x7fd43800ec50 comp rx=0 tx=0).stop 2024-09-13T18:47:06.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd452600700 1 -- 172.21.15.32:0/684977771 reap_dead start 2024-09-13T18:47:06.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd452600700 1 -- 172.21.15.32:0/684977771 reap_dead start 2024-09-13T18:47:06.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd452600700 1 -- 172.21.15.32:0/684977771 reap_dead start 2024-09-13T18:47:06.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd452600700 1 -- 172.21.15.32:0/684977771 reap_dead start 2024-09-13T18:47:06.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd452600700 1 -- 172.21.15.32:0/684977771 reap_dead start 2024-09-13T18:47:06.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 shutdown_connections 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 >> 172.21.15.32:0/684977771 conn(0x7fd44c06a7d0 msgr2=0x7fd44c157990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 shutdown_connections 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:06.610+0000 7fd453000700 1 -- 172.21.15.32:0/684977771 wait complete. 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:47:06.620 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:47:06.621 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:47:06.715 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:06.710+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:06.716 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:06.716 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:06.733 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T18:47:06.816 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:06.813+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:06.917 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:06.910+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:06.949 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:06.950 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:06.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T18:47:07.018 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:07.013+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:07.119 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:07.114+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:07.187 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:07.187 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:07.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T18:47:07.220 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:07.217+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:07.321 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:07.314+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:07.406 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:07.407 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:07.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T18:47:07.421 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:07.414+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:07.522 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:07.517+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:07.623 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:07.617+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:07.626 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:07.626 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:07.641 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T18:47:07.724 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:07.718+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:07.804 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:07.804 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:07.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T18:47:07.825 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-13T18:47:07.821+0000 7f8bb4160700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27255) UID: 0 2024-09-13T18:47:07.927 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:07.922+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:08.028 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:08.022+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:08.032 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.033 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.050 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T18:47:08.139 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:08.134+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:08.229 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:08.225+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:08.262 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.262 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.276 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T18:47:08.371 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-13T18:47:08.366+0000 7f1503e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26415) UID: 0 2024-09-13T18:47:08.431 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:08.425+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:08.478 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.479 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T18:47:08.516 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:47:08.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:47:08.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:47:08.559 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:08.554+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:08.612 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.612 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.613 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-13T18:47:08.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:47:08.622 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T18:47:08.632 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:08.629+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:08.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T18:47:08.725 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.725 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f25a00700 1 Processor -- start 2024-09-13T18:47:08.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f25a00700 1 -- start start 2024-09-13T18:47:08.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f25a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f201519b0 0x7f3f200c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f25a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f20151d90 con 0x7f3f200c8ad0 2024-09-13T18:47:08.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f25a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2006df90 con 0x7f3f200c84d0 2024-09-13T18:47:08.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f25a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200c6f80 con 0x7f3f201519b0 2024-09-13T18:47:08.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f201519b0 0x7f3f200c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f201519b0 0x7f3f200c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60060/0 (socket says 172.21.15.32:60060) 2024-09-13T18:47:08.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1456994088 learned_addr learned my addr 172.21.15.32:0/1456994088 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:08.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1f400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3f200c8ad0 0x7f3f20161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52140/0 (socket says 172.21.15.32:52140) 2024-09-13T18:47:08.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1456994088 >> v1:172.21.15.86:6789/0 conn(0x7f3f200c84d0 legacy=0x7f3f2015ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1456994088 >> v1:172.21.15.32:6789/0 conn(0x7f3f200c8ad0 legacy=0x7f3f20161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1456994088 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2006da10 con 0x7f3f201519b0 2024-09-13T18:47:08.734 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:08.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1ea00700 1 --2- 172.21.15.32:0/1456994088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f201519b0 0x7f3f200c6a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009910 tx=0x7f3f10009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bca3e71c66c2a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1e000700 1 -- 172.21.15.32:0/1456994088 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000ba60 con 0x7f3f201519b0 2024-09-13T18:47:08.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1e000700 1 -- 172.21.15.32:0/1456994088 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000bbc0 con 0x7f3f201519b0 2024-09-13T18:47:08.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.726+0000 7f3f1e000700 1 -- 172.21.15.32:0/1456994088 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10009e60 con 0x7f3f201519b0 2024-09-13T18:47:08.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 -- 172.21.15.32:0/1456994088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f201519b0 msgr2=0x7f3f200c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1456994088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f201519b0 0x7f3f200c6a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009910 tx=0x7f3f10009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:08.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 -- 172.21.15.32:0/1456994088 shutdown_connections 2024-09-13T18:47:08.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1456994088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f201519b0 0x7f3f200c6a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 -- 172.21.15.32:0/1456994088 >> 172.21.15.32:0/1456994088 conn(0x7f3f2006b1f0 msgr2=0x7f3f2006b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:08.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 -- 172.21.15.32:0/1456994088 shutdown_connections 2024-09-13T18:47:08.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.730+0000 7f3f25a00700 1 -- 172.21.15.32:0/1456994088 wait complete. 2024-09-13T18:47:08.737 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T18:47:08.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 Processor -- start 2024-09-13T18:47:08.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 -- start start 2024-09-13T18:47:08.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 0x7f3f2014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f200c8ad0 0x7f3f200cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f201519b0 0x7f3f20146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201e4b60 con 0x7f3f200c84d0 2024-09-13T18:47:08.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2006fcd0 con 0x7f3f200c8ad0 2024-09-13T18:47:08.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201e4db0 con 0x7f3f201519b0 2024-09-13T18:47:08.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 0x7f3f2014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 0x7f3f2014bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60072/0 (socket says 172.21.15.32:60072) 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1119852567 learned_addr learned my addr 172.21.15.32:0/1119852567 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f16000700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f200c8ad0 0x7f3f200cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1f400700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f201519b0 0x7f3f20146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f201519b0 msgr2=0x7f3f20146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f201519b0 0x7f3f20146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f200c8ad0 msgr2=0x7f3f200cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f200c8ad0 0x7f3f200cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 -- 172.21.15.32:0/1119852567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10009570 con 0x7f3f200c84d0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1f400700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f201519b0 0x7f3f20146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f1ea00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 0x7f3f2014bd50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f10014040 tx=0x7f3f10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f100045d0 con 0x7f3f200c84d0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1001e070 con 0x7f3f200c84d0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f201ee010 con 0x7f3f200c84d0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.734+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f100038e0 con 0x7f3f200c84d0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.738+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200cc130 con 0x7f3f200c84d0 2024-09-13T18:47:08.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.738+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f201ee530 con 0x7f3f200c84d0 2024-09-13T18:47:08.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.738+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f10003a40 con 0x7f3f200c84d0 2024-09-13T18:47:08.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.738+0000 7f3f17400700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3efc066730 0x7f3efc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.742+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f3f10020070 con 0x7f3f200c84d0 2024-09-13T18:47:08.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.742+0000 7f3f16000700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3efc066730 0x7f3efc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.742+0000 7f3f16000700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3efc066730 0x7f3efc068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3f20150c40 tx=0x7f3f08009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.746+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f10052b80 con 0x7f3f200c84d0 2024-09-13T18:47:08.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.822+0000 7ff6b9a00700 1 Processor -- start 2024-09-13T18:47:08.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.822+0000 7ff6b9a00700 1 -- start start 2024-09-13T18:47:08.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.822+0000 7ff6b9a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff6b40714c0 0x7ff6b40ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.822+0000 7ff6b9a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40718a0 0x7ff6b4157730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40adbb0 con 0x7ff6b40aa430 2024-09-13T18:47:08.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40ca400 con 0x7ff6b40714c0 2024-09-13T18:47:08.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40ad8d0 con 0x7ff6b40718a0 2024-09-13T18:47:08.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff6b40714c0 0x7ff6b40ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40718a0 0x7ff6b4157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff6b40714c0 0x7ff6b40ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41146/0 (socket says 172.21.15.32:41146) 2024-09-13T18:47:08.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 -- 172.21.15.32:0/364323034 learned_addr learned my addr 172.21.15.32:0/364323034 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:08.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 -- 172.21.15.32:0/364323034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40718a0 msgr2=0x7ff6b4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:08.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/364323034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40718a0 0x7ff6b4157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 -- 172.21.15.32:0/364323034 >> v1:172.21.15.86:6789/0 conn(0x7ff6b40aa430 legacy=0x7ff6b41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 -- 172.21.15.32:0/364323034 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40ca6a0 con 0x7ff6b40714c0 2024-09-13T18:47:08.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/364323034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40714c0 0x7ff6b40ca930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009910 tx=0x7ff6a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c564b17998b566 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b1600700 1 -- 172.21.15.32:0/364323034 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011830 con 0x7ff6b40714c0 2024-09-13T18:47:08.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b1600700 1 -- 172.21.15.32:0/364323034 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4011990 con 0x7ff6b40714c0 2024-09-13T18:47:08.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b1600700 1 -- 172.21.15.32:0/364323034 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011d40 con 0x7ff6b40714c0 2024-09-13T18:47:08.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- 172.21.15.32:0/364323034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40714c0 msgr2=0x7ff6b40ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/364323034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40714c0 0x7ff6b40ca930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009910 tx=0x7ff6a4009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:08.834 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:08.826+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- 172.21.15.32:0/364323034 shutdown_connections 2024-09-13T18:47:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/364323034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40718a0 0x7ff6b4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/364323034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40714c0 0x7ff6b40ca930 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- 172.21.15.32:0/364323034 >> 172.21.15.32:0/364323034 conn(0x7ff6b40accb0 msgr2=0x7ff6b40ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- 172.21.15.32:0/364323034 shutdown_connections 2024-09-13T18:47:08.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.826+0000 7ff6b9a00700 1 -- 172.21.15.32:0/364323034 wait complete. 2024-09-13T18:47:08.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.830+0000 7ff6b9a00700 1 Processor -- start 2024-09-13T18:47:08.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.830+0000 7ff6b9a00700 1 -- start start 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40714c0 0x7ff6b41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b40718a0 0x7ff6b40c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40aa430 0x7ff6b40aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40ae5e0 con 0x7ff6b40aa430 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4151c90 con 0x7ff6b40718a0 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4152460 con 0x7ff6b40714c0 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b2a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40714c0 0x7ff6b41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b2000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b40718a0 0x7ff6b40c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b2000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b40718a0 0x7ff6b40c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:36712/0 (socket says 172.21.15.32:36712) 2024-09-13T18:47:08.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b2000700 1 -- 172.21.15.32:0/3673518682 learned_addr learned my addr 172.21.15.32:0/3673518682 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:08.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b2a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40714c0 0x7ff6b41512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57532/0 (socket says 172.21.15.32:57532) 2024-09-13T18:47:08.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40aa430 0x7ff6b40aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.840 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.840 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40714c0 msgr2=0x7ff6b41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff6b40714c0 0x7ff6b41512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b40718a0 msgr2=0x7ff6b40c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b40718a0 0x7ff6b40c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009570 con 0x7ff6b40aa430 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6b40718a0 0x7ff6b40c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40aa430 0x7ff6b40aedf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00cb10 tx=0x7ff6ac00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac003c20 con 0x7ff6b40aa430 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac003d80 con 0x7ff6b40aa430 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40ae300 con 0x7ff6b40aa430 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00a9e0 con 0x7ff6b40aa430 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b4150d80 con 0x7ff6b40aa430 2024-09-13T18:47:08.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.834+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd ls"} v 0) v1 -- 0x7ff6b4151fb0 con 0x7ff6b40aa430 2024-09-13T18:47:08.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.838+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6ac00ab40 con 0x7ff6b40aa430 2024-09-13T18:47:08.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.838+0000 7ff6aaa00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff694066730 0x7ff694068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.838+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6624+0+0 (secure 0 0 0) 0x7ff6ac084350 con 0x7ff6b40aa430 2024-09-13T18:47:08.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.838+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff694066730 0x7ff694068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.838+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v64) v1 ==== 54+0+16 (secure 0 0 0) 0x7ff6ac08b070 con 0x7ff6b40aa430 2024-09-13T18:47:08.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.842+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff6b40adda0 0x7ff6b40c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.842+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b4150fa0 con 0x7ff6b40adda0 2024-09-13T18:47:08.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.842+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff6b40adda0 0x7ff6b40c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.842+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff694066730 0x7ff694068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000c00 tx=0x7ff6a4008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.842+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff6b40adda0 0x7ff6b40c6740 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.842+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b4150fa0 con 0x7ff6b40adda0 2024-09-13T18:47:08.850 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T18:47:08.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.866+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b40ca930 con 0x7ff6b40adda0 2024-09-13T18:47:08.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.866+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b40ca930 con 0x7ff6b40adda0 2024-09-13T18:47:08.873 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-13T18:47:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.866+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff6b41e1f50 0x7ff6b41e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.866+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 3: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b41e2870 con 0x7ff6b41e1f50 2024-09-13T18:47:08.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.866+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff6b41e1f50 0x7ff6b41e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.870+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff6b41e1f50 0x7ff6b41e2330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.870+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 3: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b41e2870 con 0x7ff6b41e1f50 2024-09-13T18:47:08.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.890+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b40c6c80 con 0x7ff6b41e1f50 2024-09-13T18:47:08.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.890+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b40c6c80 con 0x7ff6b41e1f50 2024-09-13T18:47:08.898 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-13T18:47:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.890+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff6b41f2f60 0x7ff6b41f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.890+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 5: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b40a9fe0 con 0x7ff6b41f2f60 2024-09-13T18:47:08.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.894+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff6b41f2f60 0x7ff6b41f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.894+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff6b41f2f60 0x7ff6b41f3340 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.894+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 5: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b40a9fe0 con 0x7ff6b41f2f60 2024-09-13T18:47:08.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.910+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b41f3880 con 0x7ff6b41f2f60 2024-09-13T18:47:08.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.914+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b41f3880 con 0x7ff6b41f2f60 2024-09-13T18:47:08.922 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-13T18:47:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.914+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff6b40612c0 0x7ff6b40616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.914+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 7: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b40afc20 con 0x7ff6b40612c0 2024-09-13T18:47:08.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.914+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff6b40612c0 0x7ff6b40616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.918+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff6b40612c0 0x7ff6b40616e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.918+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 7: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b40afc20 con 0x7ff6b40612c0 2024-09-13T18:47:08.934 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:08.930+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:08.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.934+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b406ce10 con 0x7ff6b40612c0 2024-09-13T18:47:08.944 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.938+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b406ce10 con 0x7ff6b40612c0 2024-09-13T18:47:08.945 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-13T18:47:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.938+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff6b406d4f0 0x7ff6b406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.938+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 9: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b4204ee0 con 0x7ff6b406d4f0 2024-09-13T18:47:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.938+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff6b406d4f0 0x7ff6b406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.938+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff6b406d4f0 0x7ff6b406d930 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.942+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 9: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b4204ee0 con 0x7ff6b406d4f0 2024-09-13T18:47:08.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.950+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7f3f201584c0 con 0x7f3f200c84d0 2024-09-13T18:47:08.960 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2024-09-13T18:47:08.960 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T18:47:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.962+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b402b6a0 con 0x7ff6b406d4f0 2024-09-13T18:47:08.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T18:47:08.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.966+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b402b6a0 con 0x7ff6b406d4f0 2024-09-13T18:47:08.971 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-13T18:47:08.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.966+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff6b402bd20 0x7ff6b402c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.966+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 11: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b402c6a0 con 0x7ff6b402bd20 2024-09-13T18:47:08.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.966+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff6b402bd20 0x7ff6b402c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.966+0000 7ff6b2000700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff6b402bd20 0x7ff6b402c160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.966+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 11: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b402c6a0 con 0x7ff6b402bd20 2024-09-13T18:47:08.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.986+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b402c6a0 con 0x7ff6b402bd20 2024-09-13T18:47:08.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.990+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b402c6a0 con 0x7ff6b402bd20 2024-09-13T18:47:08.998 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-13T18:47:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.990+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff6b4205d70 0x7ff6b4208160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.990+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 13: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b420b060 con 0x7ff6b4205d70 2024-09-13T18:47:08.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.990+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff6b4205d70 0x7ff6b4208160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:08.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.994+0000 7ff6b3400700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff6b4205d70 0x7ff6b4208160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:08.994+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 13: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b420b060 con 0x7ff6b4205d70 2024-09-13T18:47:09.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.022+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b4208960 con 0x7ff6b4205d70 2024-09-13T18:47:09.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.026+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b4208960 con 0x7ff6b4205d70 2024-09-13T18:47:09.033 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-13T18:47:09.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.026+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff6b4209040 0x7ff6b4209480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.026+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 15: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b420e440 con 0x7ff6b4209040 2024-09-13T18:47:09.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.026+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff6b4209040 0x7ff6b4209480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.026+0000 7ff6b2a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff6b4209040 0x7ff6b4209480 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.035 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-13T18:47:09.029+0000 7fb4fb827700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27254) UID: 0 2024-09-13T18:47:09.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.030+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 15: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff6b420e440 con 0x7ff6b4209040 2024-09-13T18:47:09.054 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.046+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) v1 -- 0x7ff6b4209a40 con 0x7ff6b4209040 2024-09-13T18:47:09.056 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6aaa00700 1 -- 172.21.15.32:0/3673518682 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) v1 ==== 35+0+3 (crc 0 0 0) 0x7ff6b4209a40 con 0x7ff6b4209040 2024-09-13T18:47:09.056 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-13T18:47:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff6b40adda0 msgr2=0x7ff6b40c6740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7ff6b40adda0 0x7ff6b40c6740 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff6b41e1f50 msgr2=0x7ff6b41e2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7ff6b41e1f50 0x7ff6b41e2330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff6b41f2f60 msgr2=0x7ff6b41f3340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7ff6b41f2f60 0x7ff6b41f3340 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff6b40612c0 msgr2=0x7ff6b40616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7ff6b40612c0 0x7ff6b40616e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff6b406d4f0 msgr2=0x7ff6b406d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b3400700 1 -- 172.21.15.32:0/3673518682 reap_dead start 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7ff6b406d4f0 0x7ff6b406d930 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b3400700 1 -- 172.21.15.32:0/3673518682 reap_dead start 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff6b402bd20 msgr2=0x7ff6b402c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7ff6b402bd20 0x7ff6b402c160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff6b4205d70 msgr2=0x7ff6b4208160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7ff6b4205d70 0x7ff6b4208160 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff6b4209040 msgr2=0x7ff6b4209480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7ff6b4209040 0x7ff6b4209480 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff694066730 msgr2=0x7ff694068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff694066730 0x7ff694068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000c00 tx=0x7ff6a4008030 comp rx=0 tx=0).stop 2024-09-13T18:47:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40aa430 msgr2=0x7ff6b40aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 --2- 172.21.15.32:0/3673518682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff6b40aa430 0x7ff6b40aedf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00cb10 tx=0x7ff6ac00ce20 comp rx=0 tx=0).stop 2024-09-13T18:47:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b3400700 1 -- 172.21.15.32:0/3673518682 reap_dead start 2024-09-13T18:47:09.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 shutdown_connections 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 >> 172.21.15.32:0/3673518682 conn(0x7ff6b40accb0 msgr2=0x7ff6b40ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 shutdown_connections 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.050+0000 7ff6b9a00700 1 -- 172.21.15.32:0/3673518682 wait complete. 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T18:47:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T18:47:09.080 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.081 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:09.081 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:09.081 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:09.081 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.090 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T18:47:09.136 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:09.130+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:09.199 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.199 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:14 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'5, mlcod=17'3)", 2024-09-13T18:47:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:09.200 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.85693258399999, 2024-09-13T18:47:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037461970000000002, 2024-09-13T18:47:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338011+0000", 2024-09-13T18:47:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338009+0000", 2024-09-13T18:47:09.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338025+0000", 2024-09-13T18:47:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5733e-05 2024-09-13T18:47:09.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338057+0000", 2024-09-13T18:47:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2014000000000002e-05 2024-09-13T18:47:09.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338078+0000", 2024-09-13T18:47:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1611e-05 2024-09-13T18:47:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338179+0000", 2024-09-13T18:47:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010075499999999999 2024-09-13T18:47:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.338218+0000", 2024-09-13T18:47:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8844999999999998e-05 2024-09-13T18:47:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341676+0000", 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034584300000000002 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.341757+0000", 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0562000000000006e-05 2024-09-13T18:47:09.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:18 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'8, mlcod=17'5)", 2024-09-13T18:47:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.84569558999999, 2024-09-13T18:47:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035959669999999998, 2024-09-13T18:47:09.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:09.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349248+0000", 2024-09-13T18:47:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349246+0000", 2024-09-13T18:47:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349261+0000", 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5234e-05 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349294+0000", 2024-09-13T18:47:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3086999999999997e-05 2024-09-13T18:47:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349307+0000", 2024-09-13T18:47:09.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2653999999999999e-05 2024-09-13T18:47:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349383+0000", 2024-09-13T18:47:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5825e-05 2024-09-13T18:47:09.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.349421+0000", 2024-09-13T18:47:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.8690999999999999e-05 2024-09-13T18:47:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352779+0000", 2024-09-13T18:47:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033572150000000002 2024-09-13T18:47:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.352844+0000", 2024-09-13T18:47:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.4950999999999995e-05 2024-09-13T18:47:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:54 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'32, mlcod=17'29)", 2024-09-13T18:47:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.782924084, 2024-09-13T18:47:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0035491310000000001, 2024-09-13T18:47:09.221 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412019+0000", 2024-09-13T18:47:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412018+0000", 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412040+0000", 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1946e-05 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412061+0000", 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1158e-05 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412088+0000", 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6446000000000001e-05 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412160+0000", 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2280999999999995e-05 2024-09-13T18:47:09.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.412197+0000", 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7351000000000002e-05 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415481+0000", 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0032834130000000002 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.415568+0000", 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7589000000000005e-05 2024-09-13T18:47:09.227 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.752685945, 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034392379999999998, 2024-09-13T18:47:09.228 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442257+0000", 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442256+0000", 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442340+0000", 2024-09-13T18:47:09.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3682000000000003e-05 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442350+0000", 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7580000000000004e-06 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442357+0000", 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0480000000000001e-06 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442420+0000", 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3082000000000004e-05 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442454+0000", 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3534000000000001e-05 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445579+0000", 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003125587 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.445696+0000", 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000117355 2024-09-13T18:47:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.75207757699999, 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0036029510000000001, 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442866+0000", 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442865+0000", 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442965+0000", 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00010032800000000001 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.442988+0000", 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2493e-05 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443001+0000", 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3597999999999999e-05 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443113+0000", 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000111554 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.443143+0000", 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0380999999999999e-05 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446403+0000", 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003259825 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.446469+0000", 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5432000000000006e-05 2024-09-13T18:47:09.238 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:112 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'74, mlcod=18'70)", 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.38375875, 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045460149999999996, 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811184+0000", 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811183+0000", 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.240 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811274+0000", 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.0679000000000004e-05 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811293+0000", 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9687999999999999e-05 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811306+0000", 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2726e-05 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811404+0000", 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7694000000000003e-05 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811475+0000", 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0964999999999996e-05 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815633+0000", 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041582040000000004 2024-09-13T18:47:09.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815730+0000", 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7425999999999999e-05 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:113 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'75, mlcod=18'70)", 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.382977165, 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065313020000000001, 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.243 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811966+0000", 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811965+0000", 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811976+0000", 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1516e-05 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.811992+0000", 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6062e-05 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812001+0000", 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2550000000000003e-06 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812525+0000", 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00052311999999999997 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812574+0000", 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9743999999999997e-05 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818415+0000", 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0058407870000000001 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818497+0000", 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2268000000000006e-05 2024-09-13T18:47:09.248 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:114 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'76, mlcod=18'71)", 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.38220997600001, 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005812004, 2024-09-13T18:47:09.249 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812733+0000", 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812732+0000", 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812741+0000", 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.098e-06 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812754+0000", 2024-09-13T18:47:09.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3035e-05 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.812762+0000", 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8900000000000007e-06 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813129+0000", 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00036643599999999999 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813157+0000", 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8288000000000001e-05 2024-09-13T18:47:09.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818502+0000", 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053453010000000002 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818545+0000", 2024-09-13T18:47:09.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3102999999999997e-05 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:115 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'77, mlcod=18'71)", 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.381374717, 2024-09-13T18:47:09.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0050376029999999999, 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813568+0000", 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813567+0000", 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813628+0000", 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0571e-05 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813648+0000", 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0174e-05 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813657+0000", 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.9870000000000005e-06 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813764+0000", 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107333 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.813818+0000", 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3845999999999999e-05 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818548+0000", 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047292940000000002 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818606+0000", 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8533999999999999e-05 2024-09-13T18:47:09.262 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:116 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'78, mlcod=18'72)", 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.38038410499999, 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040916939999999999, 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814559+0000", 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814558+0000", 2024-09-13T18:47:09.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814568+0000", 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.9129999999999998e-06 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814582+0000", 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3550000000000001e-05 2024-09-13T18:47:09.265 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814590+0000", 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5879999999999998e-06 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814662+0000", 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1842999999999996e-05 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.814687+0000", 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5052e-05 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818609+0000", 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039218059999999999 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.818651+0000", 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1755000000000003e-05 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.267 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:117 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'79, mlcod=18'72)", 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 136.379770611, 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038997509999999999, 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815173+0000", 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815172+0000", 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.270 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815180+0000", 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5839999999999995e-06 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815198+0000", 2024-09-13T18:47:09.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8026999999999999e-05 2024-09-13T18:47:09.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815211+0000", 2024-09-13T18:47:09.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.258e-05 2024-09-13T18:47:09.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815274+0000", 2024-09-13T18:47:09.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2539000000000006e-05 2024-09-13T18:47:09.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.815302+0000", 2024-09-13T18:47:09.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.8943000000000001e-05 2024-09-13T18:47:09.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819040+0000", 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0037378870000000001 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:52.819072+0000", 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1965000000000003e-05 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:141 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'99, mlcod=18'95)", 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 135.47621080100001, 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047061100000000003, 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718732+0000", 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718731+0000", 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718743+0000", 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2292e-05 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718764+0000", 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0942999999999999e-05 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718775+0000", 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.063e-05 2024-09-13T18:47:09.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718876+0000", 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101399 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.718916+0000", 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0166999999999997e-05 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723368+0000", 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044519829999999996 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.723439+0000", 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0063999999999999e-05 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:144 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'102, mlcod=18'98)", 2024-09-13T18:47:09.280 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 135.46840717399999, 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046446680000000002, 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726536+0000", 2024-09-13T18:47:09.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726534+0000", 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726588+0000", 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4021000000000003e-05 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726606+0000", 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7793999999999999e-05 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726617+0000", 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0458e-05 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726681+0000", 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.3991000000000004e-05 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.726701+0000", 2024-09-13T18:47:09.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0669000000000001e-05 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731089+0000", 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043875950000000002 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731181+0000", 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.1744999999999997e-05 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4198.0:145 1.0 e18/16 1:30306672:devicehealth::main.db.0000000000000000:head v 18'103, mlcod=18'98)", 2024-09-13T18:47:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 135.46763428599999, 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039188010000000004, 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:09.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727309+0000", 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727308+0000", 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727382+0000", 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.4549999999999996e-05 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727400+0000", 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7552000000000001e-05 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727408+0000", 2024-09-13T18:47:09.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8059999999999995e-06 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727503+0000", 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5555000000000002e-05 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.727534+0000", 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1163e-05 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731188+0000", 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003653566 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:44:53.731228+0000", 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9716999999999999e-05 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.293 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.869400294, 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081024679999999998, 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325543+0000", 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325540+0000", 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999967 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325559+0000", 2024-09-13T18:47:09.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9783e-05 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325658+0000", 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.8880000000000002e-05 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325688+0000", 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9297000000000001e-05 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000651379 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326519+0000", 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000180201 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 1", 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326691+0000", 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017136300000000001 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329640+0000", 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029493890000000002 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333556+0000", 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039158539999999999 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333610+0000", 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4678000000000001e-05 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333645+0000", 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4940000000000001e-05 2024-09-13T18:47:09.300 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.869375037, 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0081672380000000003, 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325568+0000", 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325567+0000", 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325591+0000", 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4334000000000001e-05 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325761+0000", 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000169851 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325793+0000", 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1730000000000003e-05 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327199+0000", 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014062409999999999 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327373+0000", 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00017387199999999999 2024-09-13T18:47:09.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333735+0000", 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0063624470000000002 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.869342894, 2024-09-13T18:47:09.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053494240000000002, 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325600+0000", 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325599+0000", 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325605+0000", 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.0569999999999998e-06 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325854+0000", 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024872199999999999 2024-09-13T18:47:09.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325869+0000", 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5186e-05 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326339+0000", 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047007599999999999 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326525+0000", 2024-09-13T18:47:09.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185859 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330950+0000", 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0044246270000000004 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:22 2.e e26/19 2:717a0223:::608.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.866582042, 2024-09-13T18:47:09.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0053787649999999998, 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328361+0000", 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328360+0000", 2024-09-13T18:47:09.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328372+0000", 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.163e-05 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328397+0000", 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5335999999999999e-05 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328412+0000", 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5099999999999999e-05 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328620+0000", 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00020808799999999999 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328663+0000", 2024-09-13T18:47:09.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2511e-05 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333657+0000", 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049943069999999999 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333740+0000", 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.2613000000000003e-05 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.314 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:23 2.e e26/19 2:717a0223:::608.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 122.863621271, 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0049461449999999999, 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.315 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331322+0000", 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331321+0000", 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331331+0000", 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0463e-05 2024-09-13T18:47:09.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331348+0000", 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6498e-05 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331356+0000", 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0620000000000001e-06 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331413+0000", 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6603e-05 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331455+0000", 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2104999999999998e-05 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:09.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336227+0000", 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047728129999999999 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336268+0000", 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.0598e-05 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDECSubOpWrite(4.12s2 62/52 ECSubWrite(tid=21, reqid=client.4834.0:3, at_version=0'0, trim_to=0'0, roll_forward_to=62'2))", 2024-09-13T18:47:09.322 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:47:06.303570+0000", 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 2.8913730060000002, 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0033415089999999999, 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303570+0000", 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303570+0000", 2024-09-13T18:47:09.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303569+0000", 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303589+0000", 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0616e-05 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303633+0000", 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3585999999999999e-05 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303646+0000", 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2559e-05 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303758+0000", 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000112621 2024-09-13T18:47:09.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_started", 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.303785+0000", 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6755e-05 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_committed", 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.306844+0000", 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030595589999999999 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:06.306912+0000", 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.7243000000000007e-05 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.327 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T18:47:09.330 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-13T18:47:09.322+0000 7fa488e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26416) UID: 0 2024-09-13T18:47:09.430 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-13T18:47:09.425+0000 7f439ff16700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27258) UID: 0 2024-09-13T18:47:09.449 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:09.449 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.460 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T18:47:09.470 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.462+0000 7f3f17400700 1 -- 172.21.15.32:0/1119852567 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v65) v1 ==== 101+0+0 (secure 0 0 0) 0x7f3f10015020 con 0x7f3f200c84d0 2024-09-13T18:47:09.474 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.466+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3efc066730 msgr2=0x7f3efc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.466+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3efc066730 0x7f3efc068bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3f20150c40 tx=0x7f3f08009040 comp rx=0 tx=0).stop 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.466+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 msgr2=0x7f3f2014bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.466+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 0x7f3f2014bd50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f10014040 tx=0x7f3f10004770 comp rx=0 tx=0).stop 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 shutdown_connections 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3efc066730 0x7f3efc068bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f201519b0 0x7f3f20146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f200c8ad0 0x7f3f200cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 --2- 172.21.15.32:0/1119852567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f200c84d0 0x7f3f2014bd50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 >> 172.21.15.32:0/1119852567 conn(0x7f3f2006b1f0 msgr2=0x7f3f2006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 shutdown_connections 2024-09-13T18:47:09.475 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:09.470+0000 7f3f25a00700 1 -- 172.21.15.32:0/1119852567 wait complete. 2024-09-13T18:47:09.476 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:47:09.539 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-13T18:47:09.534+0000 7f42e2e00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26413) UID: 0 2024-09-13T18:47:09.610 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.610 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:09.610 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:09.610 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:09.610 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.619 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T18:47:09.632 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:09.626+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:09.725 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.725 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:09.725 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:09.725 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1b epoch 25/19 rep_tid 2 entries 25'1 (0'0) error 2:ddb4e4d7:::200.00000002:head by mds.0.4:33 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.39597785799999, 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034736630000000001, 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:09.726 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328287+0000", 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328285+0000", 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.727 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328310+0000", 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5227000000000001e-05 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328363+0000", 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328403+0000", 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9977e-05 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.728 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328621+0000", 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000217834 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331760+0000", 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0031393139999999998 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "MOSDPGPull(2.7 e53/52 cost 1048576)", 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.370517602, 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033282299999999999, 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353747+0000", 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353761+0000", 2024-09-13T18:47:09.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4487999999999999e-05 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353769+0000", 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1629999999999996e-06 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353782+0000", 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2394e-05 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.353840+0000", 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7970000000000002e-05 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:46:41.354080+0000", 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00024017099999999999 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:66 3.32 3:4def72d4:::10000000003.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-09-13T18:47:09.733 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:47:09.031799+0000", 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.69246510900000002, 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016662280000000001, 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031799+0000", 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031799+0000", 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031798+0000", 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031805+0000", 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8770000000000004e-06 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031824+0000", 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9210000000000001e-05 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031837+0000", 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3038e-05 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.031924+0000", 2024-09-13T18:47:09.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.6960999999999996e-05 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.032042+0000", 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000118082 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033466+0000", 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0014234460000000001 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing_reply(3.32 epoch 64/41 rep_tid 0 lcod 64'1)", 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:47:09.033285+0000", 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 0.69097931199999996, 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000185057, 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033285+0000", 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033285+0000", 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033284+0000", 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033303+0000", 2024-09-13T18:47:09.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9131e-05 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033330+0000", 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.7117000000000001e-05 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033339+0000", 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8599999999999999e-06 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033389+0000", 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0317e-05 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:47:09.033470+0000", 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0814000000000002e-05 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:09.741 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.743 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T18:47:09.743 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-13T18:47:09.738+0000 7fd90aa00700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26420) UID: 0 2024-09-13T18:47:09.808 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:09.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:47:09.844 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-13T18:47:09.841+0000 7fdc5bc27700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27252) UID: 0 2024-09-13T18:47:09.847 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.847 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:09.847 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2024-09-13T18:47:09.847 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T18:47:09.896 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:47:09.896 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-13T18:47:09.906 INFO:tasks.thrashosds:joining thrashosds 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 180, 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:09.974 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T18:47:10.081 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-13T18:47:10.081 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2024-09-13T18:47:10.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2024-09-13T18:47:10.081 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2024-09-13T18:47:10.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.081 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.75685512699999, 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0065964650000000001, 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321876+0000", 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321873+0000", 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999971 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321893+0000", 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9817e-05 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321968+0000", 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5451000000000007e-05 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321993+0000", 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5023000000000001e-05 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:47:10.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00076747199999999995 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323096+0000", 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00033548200000000001 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323350+0000", 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025418499999999998 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326753+0000", 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003402792 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328331+0000", 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001577721 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328416+0000", 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4851999999999993e-05 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328472+0000", 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6406999999999997e-05 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.75683126, 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095775240000000005, 2024-09-13T18:47:10.087 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321900+0000", 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321899+0000", 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321907+0000", 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3110000000000006e-06 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322058+0000", 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015070400000000001 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322073+0000", 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5113000000000001e-05 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324015+0000", 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001942446 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324463+0000", 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044735 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324851+0000", 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00038862899999999998 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330326+0000", 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054749380000000004 2024-09-13T18:47:10.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331342+0000", 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001015553 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331405+0000", 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2824999999999996e-05 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331477+0000", 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2439000000000002e-05 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:30 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.75682075, 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0084089339999999999, 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.093 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321910+0000", 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321909+0000", 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321923+0000", 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3684e-05 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322158+0000", 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000235071 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322171+0000", 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3054000000000001e-05 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322761+0000", 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058967999999999998 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323078+0000", 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00031663600000000002 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.323339+0000", 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026142100000000002 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326035+0000", 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002696258 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330097+0000", 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040619460000000003 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330223+0000", 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00012625099999999999 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330319+0000", 2024-09-13T18:47:10.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.5619999999999996e-05 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.75680475, 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086316859999999995, 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321926+0000", 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321925+0000", 2024-09-13T18:47:10.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321930+0000", 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9130000000000002e-06 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322211+0000", 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028046499999999998 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322243+0000", 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.1921000000000002e-05 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324266+0000", 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020233819999999998 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324556+0000", 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00028953200000000001 2024-09-13T18:47:10.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.324815+0000", 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025906200000000001 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329997+0000", 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.005182613 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330417+0000", 2024-09-13T18:47:10.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00042013 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330498+0000", 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.0715000000000002e-05 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330558+0000", 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9605999999999998e-05 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.4:29 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.756797913, 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010369431, 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321933+0000", 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321932+0000", 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.321936+0000", 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9600000000000002e-06 2024-09-13T18:47:10.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322352+0000", 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00041583499999999998 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.322365+0000", 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3356999999999999e-05 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325433+0000", 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030676000000000002 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325709+0000", 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000275739 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 4", 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.326013+0000", 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00030424500000000003 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330341+0000", 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043278869999999999 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332173+0000", 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001832488 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332246+0000", 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2966000000000006e-05 2024-09-13T18:47:10.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332302+0000", 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5986999999999998e-05 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:10.110 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.753239787, 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0029934850000000002, 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325491+0000", 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325489+0000", 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325501+0000", 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2257e-05 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325517+0000", 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6004000000000001e-05 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.325528+0000", 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.101e-05 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328312+0000", 2024-09-13T18:47:10.113 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00278379 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328323+0000", 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0791000000000001e-05 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328485+0000", 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00016166299999999999 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.114 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.751428961, 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002975367, 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "reached pg", 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.115 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327302+0000", 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327301+0000", 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327317+0000", 2024-09-13T18:47:10.116 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.677e-05 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327351+0000", 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3646999999999998e-05 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327369+0000", 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8495000000000002e-05 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.117 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327884+0000", 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00051441400000000004 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330277+0000", 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023934210000000002 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.118 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:6 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'1, mlcod=0'0)", 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.75137526899999, 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0034198919999999999, 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.119 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327356+0000", 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327354+0000", 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999981 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327370+0000", 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6741000000000001e-05 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.120 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327395+0000", 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.4899999999999999e-05 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327413+0000", 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7487e-05 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327609+0000", 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000196264 2024-09-13T18:47:10.121 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.327652+0000", 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3334000000000002e-05 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330688+0000", 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.003035603 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330775+0000", 2024-09-13T18:47:10.122 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7462999999999999e-05 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:7 2.10 e26/19 2:0d82a743:::600.00000000:head v 26'2, mlcod=0'0)", 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.75033132199999, 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0025012530000000002, 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.123 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328400+0000", 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328398+0000", 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:10.124 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328411+0000", 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3386e-05 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328429+0000", 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7608000000000001e-05 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.125 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328454+0000", 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5346000000000001e-05 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328557+0000", 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000102398 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.328636+0000", 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.9140000000000005e-05 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.126 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330781+0000", 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021449569999999999 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330901+0000", 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000119978 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.127 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:30 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.748775634, 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000392958, 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:10.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329955+0000", 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329954+0000", 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999986 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329961+0000", 2024-09-13T18:47:10.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.3900000000000004e-06 2024-09-13T18:47:10.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329977+0000", 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5858999999999998e-05 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.329989+0000", 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1854e-05 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330066+0000", 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7201999999999997e-05 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330083+0000", 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.685e-05 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330348+0000", 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00026514799999999999 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.132 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:27 2.13 e25/19 ondisk, result = 0)", 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.748721887, 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00056097899999999997, 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330009+0000", 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330008+0000", 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330015+0000", 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330025+0000", 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.081e-05 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330033+0000", 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6680000000000001e-06 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330397+0000", 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000363431 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330409+0000", 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.219e-05 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.330570+0000", 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000161173 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.747482707, 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000239814, 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331248+0000", 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331247+0000", 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331255+0000", 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5440000000000001e-06 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331267+0000", 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2119e-05 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331275+0000", 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1659999999999994e-06 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331330+0000", 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4833999999999997e-05 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331337+0000", 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2699999999999999e-06 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331488+0000", 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015080599999999999 2024-09-13T18:47:10.141 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:8 2.10 e26/19 2:09401a81:::601.00000000:head v 26'3, mlcod=0'0)", 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.747437472, 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0048812810000000003, 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.142 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331293+0000", 2024-09-13T18:47:10.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331300+0000", 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.6769999999999998e-06 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331308+0000", 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.4910000000000005e-06 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331313+0000", 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3800000000000002e-06 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331511+0000", 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019738199999999999 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.145 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331564+0000", 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2986999999999999e-05 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336131+0000", 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0045669660000000004 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336175+0000", 2024-09-13T18:47:10.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3918000000000002e-05 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:9 2.10 e26/19 2:09401a81:::601.00000000:head v 26'4, mlcod=0'0)", 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.74740243799999, 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054929059999999997, 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331328+0000", 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331352+0000", 2024-09-13T18:47:10.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3654000000000001e-05 2024-09-13T18:47:10.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331359+0000", 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.9589999999999998e-06 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331363+0000", 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3810000000000001e-06 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332080+0000", 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000716864 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332133+0000", 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3186999999999997e-05 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336778+0000", 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0046445790000000002 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336821+0000", 2024-09-13T18:47:10.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3523000000000003e-05 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:10 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'5, mlcod=0'0)", 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.747362208, 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0054669080000000004, 2024-09-13T18:47:10.543 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331369+0000", 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331368+0000", 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331374+0000", 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2499999999999997e-06 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331380+0000", 2024-09-13T18:47:10.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.8909999999999998e-06 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.331385+0000", 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1570000000000002e-06 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332524+0000", 2024-09-13T18:47:10.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001139829 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332544+0000", 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9618000000000001e-05 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.550 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336824+0000", 2024-09-13T18:47:10.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0042795120000000001 2024-09-13T18:47:10.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336836+0000", 2024-09-13T18:47:10.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.204e-05 2024-09-13T18:47:10.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.553 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.553 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop_reply(mds.0.4:29 2.15 e26/19 ondisk, result = 0)", 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.746669786, 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00025027099999999999, 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332061+0000", 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332060+0000", 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332066+0000", 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.1160000000000004e-06 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332078+0000", 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1341e-05 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332094+0000", 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6697e-05 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332154+0000", 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.9596000000000003e-05 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332165+0000", 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1216000000000001e-05 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332311+0000", 2024-09-13T18:47:10.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014618699999999999 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:11 2.10 e26/19 2:0bd6d154:::602.00000000:head v 26'6, mlcod=0'0)", 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.746619098, 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047345640000000001, 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332112+0000", 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332111+0000", 2024-09-13T18:47:10.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332119+0000", 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7239999999999992e-06 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332127+0000", 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3459999999999994e-06 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332134+0000", 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2269999999999998e-06 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332722+0000", 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00058892199999999997 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332733+0000", 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0804e-05 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336838+0000", 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0041042889999999997 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336846+0000", 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7919999999999998e-06 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.562 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:12 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'7, mlcod=0'0)", 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.746225458, 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0043539470000000004, 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332505+0000", 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.9999995 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332522+0000", 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6929e-05 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332529+0000", 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6709999999999999e-06 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332538+0000", 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1030000000000002e-06 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332844+0000", 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000306209 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332863+0000", 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8969000000000001e-05 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336848+0000", 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039851440000000004 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336859+0000", 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1517e-05 2024-09-13T18:47:10.566 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(mds.0.4:13 2.10 e26/19 2:0d89b25e:::603.00000000:head v 26'8, mlcod=0'0)", 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 123.745828894, 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0039670740000000001, 2024-09-13T18:47:10.567 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332902+0000", 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2024-09-13T18:47:10.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332901+0000", 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4294967295.999999 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332908+0000", 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.2540000000000003e-06 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2024-09-13T18:47:10.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332918+0000", 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2189999999999993e-06 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.332923+0000", 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2769999999999996e-06 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333031+0000", 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000107803 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2024-09-13T18:47:10.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.333047+0000", 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6739e-05 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336860+0000", 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0038129010000000001 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2024-09-13T18:45:06.336869+0000", 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.7369999999999995e-06 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.571 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.572 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-13T18:47:10.572 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-13T18:47:10.572 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-13T18:47:11.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T18:47:11.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-13T18:47:11.679 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.674+0000 7f863be00700 1 Processor -- start 2024-09-13T18:47:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.674+0000 7f863be00700 1 -- start start 2024-09-13T18:47:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f863c150580 0x7f863c06e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c0c5720 0x7f863c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863be00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c06e140 con 0x7f863c066c20 2024-09-13T18:47:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863be00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c06de30 con 0x7f863c150580 2024-09-13T18:47:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0c8030 con 0x7f863c0c5720 2024-09-13T18:47:11.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863aa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f863c150580 0x7f863c06e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c0c5720 0x7f863c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863aa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f863c150580 0x7f863c06e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41168/0 (socket says 172.21.15.32:41168) 2024-09-13T18:47:11.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863aa00700 1 -- 172.21.15.32:0/2810373380 learned_addr learned my addr 172.21.15.32:0/2810373380 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:11.684 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863a000700 1 --1- 172.21.15.32:0/2810373380 >> v1:172.21.15.86:6789/0 conn(0x7f863c066c20 0x7f863c06d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45154/0 (socket says 172.21.15.32:45154) 2024-09-13T18:47:11.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863b400700 1 -- 172.21.15.32:0/2810373380 >> v2:172.21.15.32:3300/0 conn(0x7f863c150580 msgr2=0x7f863c06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:11.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863b400700 1 --2- 172.21.15.32:0/2810373380 >> v2:172.21.15.32:3300/0 conn(0x7f863c150580 0x7f863c06e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863b400700 1 -- 172.21.15.32:0/2810373380 >> v1:172.21.15.86:6789/0 conn(0x7f863c066c20 legacy=0x7f863c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863b400700 1 -- 172.21.15.32:0/2810373380 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0c8310 con 0x7f863c0c5720 2024-09-13T18:47:11.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f863b400700 1 --2- 172.21.15.32:0/2810373380 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c0c5720 0x7f863c160b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8634009d90 tx=0x7f863400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95b459ac9033b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.685 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f8639600700 1 -- 172.21.15.32:0/2810373380 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400e070 con 0x7f863c0c5720 2024-09-13T18:47:11.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f8639600700 1 -- 172.21.15.32:0/2810373380 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863400bb20 con 0x7f863c0c5720 2024-09-13T18:47:11.686 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.678+0000 7f8639600700 1 -- 172.21.15.32:0/2810373380 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634012430 con 0x7f863c0c5720 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 -- 172.21.15.32:0/2810373380 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c0c5720 msgr2=0x7f863c160b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 --2- 172.21.15.32:0/2810373380 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c0c5720 0x7f863c160b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8634009d90 tx=0x7f863400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 -- 172.21.15.32:0/2810373380 shutdown_connections 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 --2- 172.21.15.32:0/2810373380 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c0c5720 0x7f863c160b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 --2- 172.21.15.32:0/2810373380 >> v2:172.21.15.32:3300/0 conn(0x7f863c150580 0x7f863c06e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 -- 172.21.15.32:0/2810373380 >> 172.21.15.32:0/2810373380 conn(0x7f863c06f530 msgr2=0x7f863c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 -- 172.21.15.32:0/2810373380 shutdown_connections 2024-09-13T18:47:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.682+0000 7f863be00700 1 -- 172.21.15.32:0/2810373380 wait complete. 2024-09-13T18:47:11.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 Processor -- start 2024-09-13T18:47:11.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 -- start start 2024-09-13T18:47:11.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 0x7f863c1e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f863c0c5720 0x7f863c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f863c150580 0x7f863c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c151030 con 0x7f863c0c5720 2024-09-13T18:47:11.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c1efe50 con 0x7f863c150580 2024-09-13T18:47:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c1f0380 con 0x7f863c066c20 2024-09-13T18:47:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f863c0c5720 0x7f863c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 0x7f863c1e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 0x7f863c1e2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57548/0 (socket says 172.21.15.32:57548) 2024-09-13T18:47:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863aa00700 1 -- 172.21.15.32:0/2659447991 learned_addr learned my addr 172.21.15.32:0/2659447991 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:11.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863b400700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f863c150580 0x7f863c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 -- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 msgr2=0x7f863c1e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 0x7f863c1e2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 -- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f863c150580 msgr2=0x7f863c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f863c150580 0x7f863c151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 -- 172.21.15.32:0/2659447991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009a70 con 0x7f863c0c5720 2024-09-13T18:47:11.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863aa00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 0x7f863c1e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863a000700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f863c0c5720 0x7f863c152c90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f862800c460 tx=0x7f862800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628004a90 con 0x7f863c0c5720 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8628004bf0 con 0x7f863c0c5720 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c1f00a0 con 0x7f863c0c5720 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280070d0 con 0x7f863c0c5720 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.686+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c153b10 con 0x7f863c0c5720 2024-09-13T18:47:11.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.690+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c0c7170 con 0x7f863c0c5720 2024-09-13T18:47:11.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.690+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8628007230 con 0x7f863c0c5720 2024-09-13T18:47:11.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.694+0000 7f8632a00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f861c066730 0x7f861c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.694+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8628083b90 con 0x7f863c0c5720 2024-09-13T18:47:11.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.694+0000 7f863aa00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f861c066730 0x7f861c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.694+0000 7f863aa00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f861c066730 0x7f861c068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f862c006fd0 tx=0x7f862c0092e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.698+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8628050b80 con 0x7f863c0c5720 2024-09-13T18:47:11.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.710+0000 7fd63b000700 1 Processor -- start 2024-09-13T18:47:11.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63b000700 1 -- start start 2024-09-13T18:47:11.721 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63b000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd634157d30 0x7fd6340cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63b000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6340bfae0 0x7fd6340bff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63b000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6340c63d0 con 0x7fd63415e4d0 2024-09-13T18:47:11.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63b000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6340c7030 con 0x7fd634157d30 2024-09-13T18:47:11.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63b000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63415e960 con 0x7fd6340bfae0 2024-09-13T18:47:11.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd639c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd634157d30 0x7fd6340cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.722 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd639200700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd63415e4d0 0x7fd6340c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39070/0 (socket says 172.21.15.32:39070) 2024-09-13T18:47:11.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd639200700 1 -- 172.21.15.32:0/1992038594 learned_addr learned my addr 172.21.15.32:0/1992038594 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:11.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.714+0000 7fd63a600700 1 --2- 172.21.15.32:0/1992038594 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6340bfae0 0x7fd6340bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd633e00700 1 -- 172.21.15.32:0/1992038594 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838811954 0 0) 0x7fd6340c63d0 con 0x7fd63415e4d0 2024-09-13T18:47:11.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd633e00700 1 -- 172.21.15.32:0/1992038594 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd61c0035d0 con 0x7fd63415e4d0 2024-09-13T18:47:11.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd639c00700 1 -- 172.21.15.32:0/1992038594 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6340bfae0 msgr2=0x7fd6340bff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:11.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd639c00700 1 --2- 172.21.15.32:0/1992038594 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6340bfae0 0x7fd6340bff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd639c00700 1 -- 172.21.15.32:0/1992038594 >> v1:172.21.15.32:6789/0 conn(0x7fd63415e4d0 legacy=0x7fd6340c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd639c00700 1 -- 172.21.15.32:0/1992038594 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340c6690 con 0x7fd634157d30 2024-09-13T18:47:11.724 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd639c00700 1 --2- 172.21.15.32:0/1992038594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634157d30 0x7fd6340cb600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd628009850 tx=0x7fd628009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1829dd7e68721c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd633e00700 1 -- 172.21.15.32:0/1992038594 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628011830 con 0x7fd634157d30 2024-09-13T18:47:11.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd633e00700 1 -- 172.21.15.32:0/1992038594 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd628011990 con 0x7fd634157d30 2024-09-13T18:47:11.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd633e00700 1 -- 172.21.15.32:0/1992038594 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628011d40 con 0x7fd634157d30 2024-09-13T18:47:11.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 -- 172.21.15.32:0/1992038594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634157d30 msgr2=0x7fd6340cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 --2- 172.21.15.32:0/1992038594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634157d30 0x7fd6340cb600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd628009850 tx=0x7fd628009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:11.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 -- 172.21.15.32:0/1992038594 shutdown_connections 2024-09-13T18:47:11.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 --2- 172.21.15.32:0/1992038594 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6340bfae0 0x7fd6340bff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 --2- 172.21.15.32:0/1992038594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634157d30 0x7fd6340cb600 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 -- 172.21.15.32:0/1992038594 >> 172.21.15.32:0/1992038594 conn(0x7fd6340caae0 msgr2=0x7fd6340caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 -- 172.21.15.32:0/1992038594 shutdown_connections 2024-09-13T18:47:11.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.718+0000 7fd63b000700 1 -- 172.21.15.32:0/1992038594 wait complete. 2024-09-13T18:47:11.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 Processor -- start 2024-09-13T18:47:11.727 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 -- start start 2024-09-13T18:47:11.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340bfae0 0x7fd6341f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634157d30 0x7fd6341f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634161960 0x7fd6340ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.728 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63415b110 con 0x7fd634161960 2024-09-13T18:47:11.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341f7610 con 0x7fd6340bfae0 2024-09-13T18:47:11.729 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63b000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63415a2f0 con 0x7fd634157d30 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634161960 0x7fd6340ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634157d30 0x7fd6341f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340bfae0 0x7fd6341f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634161960 0x7fd6340ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41186/0 (socket says 172.21.15.32:41186) 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 learned_addr learned my addr 172.21.15.32:0/2909998683 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634157d30 msgr2=0x7fd6341f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634157d30 0x7fd6341f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634161960 msgr2=0x7fd6340ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634161960 0x7fd6340ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280094b0 con 0x7fd6340bfae0 2024-09-13T18:47:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd634161960 0x7fd6340ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.722+0000 7fd639c00700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340bfae0 0x7fd6341f6ab0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd628016000 tx=0x7fd628004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628004590 con 0x7fd6340bfae0 2024-09-13T18:47:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6280036c0 con 0x7fd6340bfae0 2024-09-13T18:47:11.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63415a5d0 con 0x7fd6340bfae0 2024-09-13T18:47:11.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628003a70 con 0x7fd6340bfae0 2024-09-13T18:47:11.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63415ada0 con 0x7fd6340bfae0 2024-09-13T18:47:11.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd6340aa550 con 0x7fd6340bfae0 2024-09-13T18:47:11.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.726+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd628003bd0 con 0x7fd6340bfae0 2024-09-13T18:47:11.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd614066730 0x7fd614068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fd628021030 con 0x7fd6340bfae0 2024-09-13T18:47:11.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd639200700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd614066730 0x7fd614068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fd628085b90 con 0x7fd6340bfae0 2024-09-13T18:47:11.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 0x7fd6340adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340afe80 con 0x7fd63415e4d0 2024-09-13T18:47:11.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd639200700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd614066730 0x7fd614068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6340ab720 tx=0x7fd620007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 0x7fd6340adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd634158110 con 0x7fd63415e4d0 2024-09-13T18:47:11.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 0x7fd6340adfa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009a40 tx=0x7fd62c007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.730+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c017870 con 0x7fd63415e4d0 2024-09-13T18:47:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.734+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.0 v2:172.21.15.32:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd62c00f040 con 0x7fd63415e4d0 2024-09-13T18:47:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.734+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 msgr2=0x7fd6340adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.734+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 0x7fd6340adfa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009a40 tx=0x7fd62c007960 comp rx=0 tx=0).stop 2024-09-13T18:47:11.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.734+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 msgr2=0x7fd6340adfa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:47:11.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.734+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd63415e4d0 0x7fd6340adfa0 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009a40 tx=0x7fd62c007960 comp rx=0 tx=0).stop 2024-09-13T18:47:11.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.742+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 0x7fd634158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.742+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63415b280 con 0x7fd6340b0320 2024-09-13T18:47:11.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.742+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 0x7fd634158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.742+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) v1 -- 0x7fd6340c6c50 con 0x7fd6340b0320 2024-09-13T18:47:11.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.742+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 0x7fd634158390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b60 tx=0x7fd62c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.742+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c022b50 con 0x7fd6340b0320 2024-09-13T18:47:11.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.0 v2:172.21.15.32:3300/0 2 ==== command_reply(tid 3: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) v1 ==== 82+0+3 (secure 0 0 0) 0x7fd62c022d70 con 0x7fd6340b0320 2024-09-13T18:47:11.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 msgr2=0x7fd634158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 0x7fd634158390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b60 tx=0x7fd62c004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 msgr2=0x7fd634158390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:47:11.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6340b0320 0x7fd634158390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.753 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-09-13T18:47:11.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 0x7fd634158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634067fc0 con 0x7fd6341588d0 2024-09-13T18:47:11.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 0x7fd634158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- command(tid 4: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6340c6080 con 0x7fd6341588d0 2024-09-13T18:47:11.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.746+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 0x7fd634158ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0079a0 tx=0x7fd62c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c034910 con 0x7fd6341588d0 2024-09-13T18:47:11.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 2 ==== command_reply(tid 4: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd62c034a70 con 0x7fd6341588d0 2024-09-13T18:47:11.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 msgr2=0x7fd634158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 0x7fd634158ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0079a0 tx=0x7fd62c00b040 comp rx=0 tx=0).stop 2024-09-13T18:47:11.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 msgr2=0x7fd634158ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:47:11.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 reap_dead start 2024-09-13T18:47:11.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.750+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6341588d0 0x7fd634158ce0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.762+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 0x7fd6341f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.762+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634159220 con 0x7fd6340ada40 2024-09-13T18:47:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.762+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 0x7fd6341f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.762+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- command(tid 5: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) v1 -- 0x7fd6340ade20 con 0x7fd6340ada40 2024-09-13T18:47:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.766+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 0x7fd6341f6ff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b01b0 tx=0x7fd62c022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.766+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c042040 con 0x7fd6340ada40 2024-09-13T18:47:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.1 v2:172.21.15.86:3300/0 2 ==== command_reply(tid 5: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) v1 ==== 82+0+3 (secure 0 0 0) 0x7fd62c020420 con 0x7fd6340ada40 2024-09-13T18:47:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 msgr2=0x7fd6341f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 0x7fd6341f6ff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b01b0 tx=0x7fd62c022000 comp rx=0 tx=0).stop 2024-09-13T18:47:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 msgr2=0x7fd6341f6ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:47:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340ada40 0x7fd6341f6ff0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.776 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-09-13T18:47:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 0x7fd634156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340cb600 con 0x7fd634156340 2024-09-13T18:47:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 0x7fd634156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- command(tid 6: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd63415b4c0 con 0x7fd634156340 2024-09-13T18:47:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 0x7fd634156720 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009790 tx=0x7fd62c02b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c020590 con 0x7fd634156340 2024-09-13T18:47:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.2 v2:172.21.15.86:3301/0 2 ==== command_reply(tid 6: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd62c0206f0 con 0x7fd634156340 2024-09-13T18:47:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 msgr2=0x7fd634156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 0x7fd634156720 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009790 tx=0x7fd62c02b000 comp rx=0 tx=0).stop 2024-09-13T18:47:11.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 msgr2=0x7fd634156720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:47:11.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.770+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156340 0x7fd634156720 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.782+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 0x7fd63415ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.782+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340c5120 con 0x7fd634156c60 2024-09-13T18:47:11.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.782+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 0x7fd63415ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.782+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- command(tid 7: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) v1 -- 0x7fd6340c5640 con 0x7fd634156c60 2024-09-13T18:47:11.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd63a600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 0x7fd63415ec60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b60 tx=0x7fd62c04b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c020c70 con 0x7fd634156c60 2024-09-13T18:47:11.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 <== mon.2 v2:172.21.15.86:3301/0 2 ==== command_reply(tid 7: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) v1 ==== 82+0+3 (secure 0 0 0) 0x7fd62c020a70 con 0x7fd634156c60 2024-09-13T18:47:11.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 msgr2=0x7fd63415ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 0x7fd63415ec60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b60 tx=0x7fd62c04b000 comp rx=0 tx=0).stop 2024-09-13T18:47:11.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd631600700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 msgr2=0x7fd63415ec60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:47:11.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.786+0000 7fd631600700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd634156c60 0x7fd63415ec60 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009b60 tx=0x7fd62c04b000 comp rx=0 tx=0).stop 2024-09-13T18:47:11.795 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd614066730 msgr2=0x7fd614068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd614066730 0x7fd614068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6340ab720 tx=0x7fd620007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340bfae0 msgr2=0x7fd6341f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 --2- 172.21.15.32:0/2909998683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6340bfae0 0x7fd6341f6ab0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd628016000 tx=0x7fd628004770 comp rx=0 tx=0).stop 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63a600700 1 -- 172.21.15.32:0/2909998683 reap_dead start 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 shutdown_connections 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 >> 172.21.15.32:0/2909998683 conn(0x7fd6340caae0 msgr2=0x7fd6340aa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 shutdown_connections 2024-09-13T18:47:11.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.790+0000 7fd63b000700 1 -- 172.21.15.32:0/2909998683 wait complete. 2024-09-13T18:47:11.798 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T18:47:11.798 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T18:47:11.798 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T18:47:11.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-13T18:47:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:11.914+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) v1 -- 0x7f863c153ca0 con 0x7f863c0c5720 2024-09-13T18:47:12.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 Processor -- start 2024-09-13T18:47:12.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 -- start start 2024-09-13T18:47:12.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb570153840 0x7fb5700c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5700c8f10 0x7fb5700ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5700c8370 con 0x7fb5700c8950 2024-09-13T18:47:12.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57006b810 con 0x7fb570153840 2024-09-13T18:47:12.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb576400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700c8650 con 0x7fb5700c8f10 2024-09-13T18:47:12.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb575000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb570153840 0x7fb5700c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb56fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5700c8f10 0x7fb5700ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb56fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5700c8f10 0x7fb5700ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:36764/0 (socket says 172.21.15.32:36764) 2024-09-13T18:47:12.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.006+0000 7fb56fe00700 1 -- 172.21.15.32:0/3712256472 learned_addr learned my addr 172.21.15.32:0/3712256472 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:12.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56fe00700 1 -- 172.21.15.32:0/3712256472 >> v2:172.21.15.32:3300/0 conn(0x7fb570153840 msgr2=0x7fb5700c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:12.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56fe00700 1 --2- 172.21.15.32:0/3712256472 >> v2:172.21.15.32:3300/0 conn(0x7fb570153840 0x7fb5700c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56fe00700 1 -- 172.21.15.32:0/3712256472 >> v1:172.21.15.32:6789/0 conn(0x7fb5700c8950 legacy=0x7fb57015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56fe00700 1 -- 172.21.15.32:0/3712256472 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57006ae70 con 0x7fb5700c8f10 2024-09-13T18:47:12.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56fe00700 1 --2- 172.21.15.32:0/3712256472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5700c8f10 0x7fb5700ccf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5700c4160 tx=0x7fb560009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43d077604759ede8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56f400700 1 -- 172.21.15.32:0/3712256472 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011830 con 0x7fb5700c8f10 2024-09-13T18:47:12.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56f400700 1 -- 172.21.15.32:0/3712256472 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560011990 con 0x7fb5700c8f10 2024-09-13T18:47:12.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb56f400700 1 -- 172.21.15.32:0/3712256472 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011d20 con 0x7fb5700c8f10 2024-09-13T18:47:12.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 -- 172.21.15.32:0/3712256472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5700c8f10 msgr2=0x7fb5700ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 --2- 172.21.15.32:0/3712256472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5700c8f10 0x7fb5700ccf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5700c4160 tx=0x7fb560009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 -- 172.21.15.32:0/3712256472 shutdown_connections 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 --2- 172.21.15.32:0/3712256472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5700c8f10 0x7fb5700ccf30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 --2- 172.21.15.32:0/3712256472 >> v2:172.21.15.32:3300/0 conn(0x7fb570153840 0x7fb5700c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 -- 172.21.15.32:0/3712256472 >> 172.21.15.32:0/3712256472 conn(0x7fb570071740 msgr2=0x7fb570071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 -- 172.21.15.32:0/3712256472 shutdown_connections 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.010+0000 7fb576400700 1 -- 172.21.15.32:0/3712256472 wait complete. 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 Processor -- start 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 -- start start 2024-09-13T18:47:12.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5700c8950 0x7fb570154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 0x7fb5700cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb570153840 0x7fb570143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570141180 con 0x7fb5700c8f10 2024-09-13T18:47:12.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570143800 con 0x7fb570153840 2024-09-13T18:47:12.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.014+0000 7fb576400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700cd570 con 0x7fb5700c8950 2024-09-13T18:47:12.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 0x7fb5700cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 0x7fb5700cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41234/0 (socket says 172.21.15.32:41234) 2024-09-13T18:47:12.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 -- 172.21.15.32:0/1232088807 learned_addr learned my addr 172.21.15.32:0/1232088807 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:12.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb575000700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5700c8950 0x7fb570154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb575a00700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb570153840 0x7fb570143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 -- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5700c8950 msgr2=0x7fb570154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5700c8950 0x7fb570154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 -- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb570153840 msgr2=0x7fb570143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb570153840 0x7fb570143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 -- 172.21.15.32:0/1232088807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560009570 con 0x7fb5700c8f10 2024-09-13T18:47:12.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56fe00700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 0x7fb5700cafd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb5700c8790 tx=0x7fb560004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560004590 con 0x7fb5700c8f10 2024-09-13T18:47:12.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5600036c0 con 0x7fb5700c8f10 2024-09-13T18:47:12.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560003a70 con 0x7fb5700c8f10 2024-09-13T18:47:12.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570142ed0 con 0x7fb5700c8f10 2024-09-13T18:47:12.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb570143a70 con 0x7fb5700c8f10 2024-09-13T18:47:12.026 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.018+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb570070240 con 0x7fb5700c8f10 2024-09-13T18:47:12.028 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.022+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb560003bd0 con 0x7fb5700c8f10 2024-09-13T18:47:12.030 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.026+0000 7fb56cc00700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb554066730 0x7fb554068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.026+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb560021030 con 0x7fb5700c8f10 2024-09-13T18:47:12.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.026+0000 7fb575000700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb554066730 0x7fb554068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.032 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.026+0000 7fb575000700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb554066730 0x7fb554068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb564009b50 tx=0x7fb564009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.030+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb560052a30 con 0x7fb5700c8f10 2024-09-13T18:47:12.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.222+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd reweight", "id": 0, "weight": 1.0} v 0) v1 -- 0x7fb5701e4950 con 0x7fb5700c8f10 2024-09-13T18:47:12.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.478+0000 7f8632a00700 1 -- 172.21.15.32:0/2659447991 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v66) v1 ==== 91+0+0 (secure 0 0 0) 0x7f86280541a0 con 0x7f863c0c5720 2024-09-13T18:47:12.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.478+0000 7fb56cc00700 1 -- 172.21.15.32:0/1232088807 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 0, "weight": 1.0}]=0 reweighted osd.0 to 1 (10000) v66) v1 ==== 113+0+0 (secure 0 0 0) 0x7fb56002b020 con 0x7fb5700c8f10 2024-09-13T18:47:12.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb554066730 msgr2=0x7fb554068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb554066730 0x7fb554068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb564009b50 tx=0x7fb564009240 comp rx=0 tx=0).stop 2024-09-13T18:47:12.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 msgr2=0x7fb5700cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 0x7fb5700cafd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb5700c8790 tx=0x7fb560004770 comp rx=0 tx=0).stop 2024-09-13T18:47:12.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 shutdown_connections 2024-09-13T18:47:12.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb554066730 0x7fb554068bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb570153840 0x7fb570143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5700c8f10 0x7fb5700cafd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 --2- 172.21.15.32:0/1232088807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5700c8950 0x7fb570154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 >> 172.21.15.32:0/1232088807 conn(0x7fb570071740 msgr2=0x7fb5700c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 shutdown_connections 2024-09-13T18:47:12.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.482+0000 7fb576400700 1 -- 172.21.15.32:0/1232088807 wait complete. 2024-09-13T18:47:12.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f861c066730 msgr2=0x7f861c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f861c066730 0x7f861c068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f862c006fd0 tx=0x7f862c0092e0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f863c0c5720 msgr2=0x7f863c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f863c0c5720 0x7f863c152c90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f862800c460 tx=0x7f862800c770 comp rx=0 tx=0).stop 2024-09-13T18:47:12.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 shutdown_connections 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f861c066730 0x7f861c068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f863c150580 0x7f863c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f863c0c5720 0x7f863c152c90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 --2- 172.21.15.32:0/2659447991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f863c066c20 0x7f863c1e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 >> 172.21.15.32:0/2659447991 conn(0x7f863c06f530 msgr2=0x7f863c14e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 shutdown_connections 2024-09-13T18:47:12.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.486+0000 7f863be00700 1 -- 172.21.15.32:0/2659447991 wait complete. 2024-09-13T18:47:12.496 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-09-13T18:47:12.496 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-13T18:47:12.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-13T18:47:12.518 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T18:47:12.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 Processor -- start 2024-09-13T18:47:12.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 -- start start 2024-09-13T18:47:12.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ff0156e30 0x7f9ff00c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9ff006f5a0 0x7f9ff00cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff0071570 con 0x7f9ff006f9c0 2024-09-13T18:47:12.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff0070920 con 0x7f9ff006f5a0 2024-09-13T18:47:12.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.694+0000 7f9ff5000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff015dad0 con 0x7f9ff0156e30 2024-09-13T18:47:12.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fede00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9ff0156e30 0x7f9ff00c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fee800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9ff006f9c0 0x7f9ff0159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45162/0 (socket says 172.21.15.32:45162) 2024-09-13T18:47:12.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fee800700 1 -- 172.21.15.32:0/2033262909 learned_addr learned my addr 172.21.15.32:0/2033262909 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:12.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fed400700 1 --2- 172.21.15.32:0/2033262909 >> v2:172.21.15.32:3300/0 conn(0x7f9ff006f5a0 0x7f9ff00cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9feca00700 1 -- 172.21.15.32:0/2033262909 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023068563 0 0) 0x7f9ff0071570 con 0x7f9ff006f9c0 2024-09-13T18:47:12.703 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9feca00700 1 -- 172.21.15.32:0/2033262909 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd40035d0 con 0x7f9ff006f9c0 2024-09-13T18:47:12.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fede00700 1 -- 172.21.15.32:0/2033262909 >> v2:172.21.15.32:3300/0 conn(0x7f9ff006f5a0 msgr2=0x7f9ff00cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:12.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fede00700 1 --2- 172.21.15.32:0/2033262909 >> v2:172.21.15.32:3300/0 conn(0x7f9ff006f5a0 0x7f9ff00cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fede00700 1 -- 172.21.15.32:0/2033262909 >> v1:172.21.15.86:6789/0 conn(0x7f9ff006f9c0 legacy=0x7f9ff0159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fede00700 1 -- 172.21.15.32:0/2033262909 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff015ce90 con 0x7f9ff0156e30 2024-09-13T18:47:12.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9fede00700 1 --2- 172.21.15.32:0/2033262909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff0156e30 0x7f9ff00c80a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ff006abb0 tx=0x7f9fe0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11db8435fe1c2d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9feca00700 1 -- 172.21.15.32:0/2033262909 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0011830 con 0x7f9ff0156e30 2024-09-13T18:47:12.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9feca00700 1 -- 172.21.15.32:0/2033262909 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0011990 con 0x7f9ff0156e30 2024-09-13T18:47:12.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9feca00700 1 -- 172.21.15.32:0/2033262909 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0011d00 con 0x7f9ff0156e30 2024-09-13T18:47:12.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 -- 172.21.15.32:0/2033262909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff0156e30 msgr2=0x7f9ff00c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 --2- 172.21.15.32:0/2033262909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff0156e30 0x7f9ff00c80a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ff006abb0 tx=0x7f9fe0009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:12.706 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 -- 172.21.15.32:0/2033262909 shutdown_connections 2024-09-13T18:47:12.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 --2- 172.21.15.32:0/2033262909 >> v2:172.21.15.32:3300/0 conn(0x7f9ff006f5a0 0x7f9ff00cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 --2- 172.21.15.32:0/2033262909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff0156e30 0x7f9ff00c80a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 -- 172.21.15.32:0/2033262909 >> 172.21.15.32:0/2033262909 conn(0x7f9ff006eae0 msgr2=0x7f9ff006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 -- 172.21.15.32:0/2033262909 shutdown_connections 2024-09-13T18:47:12.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.698+0000 7f9ff5000700 1 -- 172.21.15.32:0/2033262909 wait complete. 2024-09-13T18:47:12.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.702+0000 7f9ff5000700 1 Processor -- start 2024-09-13T18:47:12.709 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.702+0000 7f9ff5000700 1 -- start start 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 0x7f9ff01ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff006f9c0 0x7f9ff014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ff0156e30 0x7f9ff014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00ad8a0 con 0x7f9ff006f5a0 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff01efcc0 con 0x7f9ff006f9c0 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00ae650 con 0x7f9ff0156e30 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 0x7f9ff01ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 0x7f9ff01ef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41252/0 (socket says 172.21.15.32:41252) 2024-09-13T18:47:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 -- 172.21.15.32:0/1945839891 learned_addr learned my addr 172.21.15.32:0/1945839891 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fed400700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff006f9c0 0x7f9ff014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fee800700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ff0156e30 0x7f9ff014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 -- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ff0156e30 msgr2=0x7f9ff014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ff0156e30 0x7f9ff014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 -- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff006f9c0 msgr2=0x7f9ff014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff006f9c0 0x7f9ff014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.713 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 -- 172.21.15.32:0/1945839891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00094b0 con 0x7f9ff006f5a0 2024-09-13T18:47:12.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fede00700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 0x7f9ff01ef780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0014040 tx=0x7f9fe0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0004510 con 0x7f9ff006f5a0 2024-09-13T18:47:12.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe001e070 con 0x7f9ff006f5a0 2024-09-13T18:47:12.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff00adad0 con 0x7f9ff006f5a0 2024-09-13T18:47:12.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00038c0 con 0x7f9ff006f5a0 2024-09-13T18:47:12.714 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff00ae090 con 0x7f9ff006f5a0 2024-09-13T18:47:12.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.706+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0067a00 con 0x7f9ff006f5a0 2024-09-13T18:47:12.715 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.710+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9fe0003a20 con 0x7f9ff006f5a0 2024-09-13T18:47:12.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.710+0000 7f9fe6000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fd0066730 0x7f9fd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.710+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9fe0085350 con 0x7f9ff006f5a0 2024-09-13T18:47:12.717 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.710+0000 7f9fed400700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fd0066730 0x7f9fd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.718 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.710+0000 7f9fed400700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fd0066730 0x7f9fd0068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00c3e70 tx=0x7f9fdc009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.718+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9fe0052220 con 0x7f9ff006f5a0 2024-09-13T18:47:12.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 Processor -- start 2024-09-13T18:47:12.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 -- start start 2024-09-13T18:47:12.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba88151680 0x7fba8806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fba880cd640 0x7fba8806b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8815aa50 con 0x7fba88151a60 2024-09-13T18:47:12.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8815aca0 con 0x7fba880cd640 2024-09-13T18:47:12.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.742+0000 7fba8ea00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8815af80 con 0x7fba88151680 2024-09-13T18:47:12.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8cc00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fba88151a60 0x7fba880ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45166/0 (socket says 172.21.15.32:45166) 2024-09-13T18:47:12.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8d600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fba88151680 0x7fba8806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8cc00700 1 -- 172.21.15.32:0/2179067471 learned_addr learned my addr 172.21.15.32:0/2179067471 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:12.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8e000700 1 --2- 172.21.15.32:0/2179067471 >> v2:172.21.15.32:3300/0 conn(0x7fba880cd640 0x7fba8806b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba87e00700 1 -- 172.21.15.32:0/2179067471 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53321871 0 0) 0x7fba8815aa50 con 0x7fba88151a60 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba87e00700 1 -- 172.21.15.32:0/2179067471 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba700035d0 con 0x7fba88151a60 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8d600700 1 -- 172.21.15.32:0/2179067471 >> v2:172.21.15.32:3300/0 conn(0x7fba880cd640 msgr2=0x7fba8806b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8d600700 1 --2- 172.21.15.32:0/2179067471 >> v2:172.21.15.32:3300/0 conn(0x7fba880cd640 0x7fba8806b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8d600700 1 -- 172.21.15.32:0/2179067471 >> v1:172.21.15.86:6789/0 conn(0x7fba88151a60 legacy=0x7fba880ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8d600700 1 -- 172.21.15.32:0/2179067471 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8815b260 con 0x7fba88151680 2024-09-13T18:47:12.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8e000700 1 --2- 172.21.15.32:0/2179067471 >> v2:172.21.15.32:3300/0 conn(0x7fba880cd640 0x7fba8806b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8d600700 1 --2- 172.21.15.32:0/2179067471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88151680 0x7fba8806b260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba8806d7b0 tx=0x7fba7c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446b46a6ac2aaad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba87e00700 1 -- 172.21.15.32:0/2179067471 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011830 con 0x7fba88151680 2024-09-13T18:47:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba87e00700 1 -- 172.21.15.32:0/2179067471 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c011990 con 0x7fba88151680 2024-09-13T18:47:12.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba87e00700 1 -- 172.21.15.32:0/2179067471 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011d20 con 0x7fba88151680 2024-09-13T18:47:12.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8ea00700 1 -- 172.21.15.32:0/2179067471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88151680 msgr2=0x7fba8806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.746+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2179067471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88151680 0x7fba8806b260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba8806d7b0 tx=0x7fba7c009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- 172.21.15.32:0/2179067471 shutdown_connections 2024-09-13T18:47:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2179067471 >> v2:172.21.15.32:3300/0 conn(0x7fba880cd640 0x7fba8806b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2179067471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba88151680 0x7fba8806b260 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- 172.21.15.32:0/2179067471 >> 172.21.15.32:0/2179067471 conn(0x7fba88071740 msgr2=0x7fba88071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- 172.21.15.32:0/2179067471 shutdown_connections 2024-09-13T18:47:12.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- 172.21.15.32:0/2179067471 wait complete. 2024-09-13T18:47:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 Processor -- start 2024-09-13T18:47:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- start start 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba880cd640 0x7fba881f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 0x7fba88070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba8814e9f0 0x7fba88158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8815a260 con 0x7fba88151680 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880c7bd0 con 0x7fba8814e9f0 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8ea00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba881f3240 con 0x7fba880cd640 2024-09-13T18:47:12.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8cc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 0x7fba88070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.750+0000 7fba8cc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 0x7fba88070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41266/0 (socket says 172.21.15.32:41266) 2024-09-13T18:47:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba8814e9f0 0x7fba88158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 -- 172.21.15.32:0/2524563292 learned_addr learned my addr 172.21.15.32:0/2524563292 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:12.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8d600700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba880cd640 0x7fba881f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 -- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba880cd640 msgr2=0x7fba881f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba880cd640 0x7fba881f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 -- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba8814e9f0 msgr2=0x7fba88158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba8814e9f0 0x7fba88158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 -- 172.21.15.32:0/2524563292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80009a70 con 0x7fba88151680 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8e000700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba8814e9f0 0x7fba88158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8cc00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 0x7fba88070d10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c500 tx=0x7fba7400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74005d90 con 0x7fba88151680 2024-09-13T18:47:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400ce60 con 0x7fba88151680 2024-09-13T18:47:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0094b0 con 0x7fba88151680 2024-09-13T18:47:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74007310 con 0x7fba88151680 2024-09-13T18:47:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8814f540 con 0x7fba88151680 2024-09-13T18:47:12.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.754+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba880ccf30 con 0x7fba88151680 2024-09-13T18:47:12.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.758+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba74007470 con 0x7fba88151680 2024-09-13T18:47:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.758+0000 7fba85600700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fba68066760 0x7fba68068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.758+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fba74083900 con 0x7fba88151680 2024-09-13T18:47:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.758+0000 7fba8d600700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fba68066760 0x7fba68068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.758+0000 7fba8d600700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fba68066760 0x7fba68068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.766+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba74050860 con 0x7fba88151680 2024-09-13T18:47:12.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.910+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 0, "weight": 1.0} v 0) v1 -- 0x7f9ff00c8800 con 0x7f9ff006f5a0 2024-09-13T18:47:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:12.954+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) v1 -- 0x7fba8806f530 con 0x7fba88151680 2024-09-13T18:47:13.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.482+0000 7f9fe6000700 1 -- 172.21.15.32:0/1945839891 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]=0 set osd.0 primary-affinity to 1 (8655362) v67) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9fe00200a0 con 0x7f9ff006f5a0 2024-09-13T18:47:13.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.486+0000 7fba85600700 1 -- 172.21.15.32:0/2524563292 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v67) v1 ==== 101+0+0 (secure 0 0 0) 0x7fba74053e80 con 0x7fba88151680 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fd0066730 msgr2=0x7f9fd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fd0066730 0x7f9fd0068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00c3e70 tx=0x7f9fdc009240 comp rx=0 tx=0).stop 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 msgr2=0x7f9ff01ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 0x7f9ff01ef780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0014040 tx=0x7f9fe0004770 comp rx=0 tx=0).stop 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 shutdown_connections 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9fd0066730 0x7f9fd0068bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ff0156e30 0x7f9ff014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ff006f9c0 0x7f9ff014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 --2- 172.21.15.32:0/1945839891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ff006f5a0 0x7f9ff01ef780 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 >> 172.21.15.32:0/1945839891 conn(0x7f9ff006eae0 msgr2=0x7f9ff006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:13.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 shutdown_connections 2024-09-13T18:47:13.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fba68066760 msgr2=0x7fba68068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fba68066760 0x7fba68068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:13.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 msgr2=0x7fba88070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 0x7fba88070d10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c500 tx=0x7fba7400c810 comp rx=0 tx=0).stop 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 shutdown_connections 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fba68066760 0x7fba68068c20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba8814e9f0 0x7fba88158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba88151680 0x7fba88070d10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 --2- 172.21.15.32:0/2524563292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba880cd640 0x7fba881f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 >> 172.21.15.32:0/2524563292 conn(0x7fba88071740 msgr2=0x7fba8806b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 shutdown_connections 2024-09-13T18:47:13.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.490+0000 7fba8ea00700 1 -- 172.21.15.32:0/2524563292 wait complete. 2024-09-13T18:47:13.500 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-13T18:47:13.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.494+0000 7f9ff5000700 1 -- 172.21.15.32:0/1945839891 wait complete. 2024-09-13T18:47:13.506 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-13T18:47:13.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-13T18:47:13.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.746+0000 7fd60b000700 1 Processor -- start 2024-09-13T18:47:13.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd60b000700 1 -- start start 2024-09-13T18:47:13.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd60b000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6040c9e90 0x7fd6040ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd60b000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040c9440 con 0x7fd6040ca840 2024-09-13T18:47:13.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd60b000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040c7aa0 con 0x7fd60406ea50 2024-09-13T18:47:13.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd60b000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040c9a70 con 0x7fd6040c9e90 2024-09-13T18:47:13.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd609200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6040c9e90 0x7fd6040ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd609200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6040c9e90 0x7fd6040ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41278/0 (socket says 172.21.15.32:41278) 2024-09-13T18:47:13.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.750+0000 7fd609200700 1 -- 172.21.15.32:0/1330956500 learned_addr learned my addr 172.21.15.32:0/1330956500 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd609200700 1 -- 172.21.15.32:0/1330956500 >> v1:172.21.15.86:6789/0 conn(0x7fd60406ea50 legacy=0x7fd60415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd609200700 1 -- 172.21.15.32:0/1330956500 >> v1:172.21.15.32:6789/0 conn(0x7fd6040ca840 legacy=0x7fd60406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd609200700 1 -- 172.21.15.32:0/1330956500 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040c7d60 con 0x7fd6040c9e90 2024-09-13T18:47:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd609200700 1 --2- 172.21.15.32:0/1330956500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6040c9e90 0x7fd6040ca300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009910 tx=0x7fd5f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78a4984919b7b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd603e00700 1 -- 172.21.15.32:0/1330956500 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000ba60 con 0x7fd6040c9e90 2024-09-13T18:47:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd603e00700 1 -- 172.21.15.32:0/1330956500 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f000bbc0 con 0x7fd6040c9e90 2024-09-13T18:47:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd603e00700 1 -- 172.21.15.32:0/1330956500 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0009e60 con 0x7fd6040c9e90 2024-09-13T18:47:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 -- 172.21.15.32:0/1330956500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6040c9e90 msgr2=0x7fd6040ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 --2- 172.21.15.32:0/1330956500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6040c9e90 0x7fd6040ca300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009910 tx=0x7fd5f0009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 -- 172.21.15.32:0/1330956500 shutdown_connections 2024-09-13T18:47:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 --2- 172.21.15.32:0/1330956500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6040c9e90 0x7fd6040ca300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 -- 172.21.15.32:0/1330956500 >> 172.21.15.32:0/1330956500 conn(0x7fd6040cac60 msgr2=0x7fd6040cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 -- 172.21.15.32:0/1330956500 shutdown_connections 2024-09-13T18:47:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.754+0000 7fd60b000700 1 -- 172.21.15.32:0/1330956500 wait complete. 2024-09-13T18:47:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 Processor -- start 2024-09-13T18:47:13.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 -- start start 2024-09-13T18:47:13.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60406ea50 0x7fd6040aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6040c9e90 0x7fd6041f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6040ca840 0x7fd6041ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041f3480 con 0x7fd60406ea50 2024-09-13T18:47:13.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040a9f50 con 0x7fd6040ca840 2024-09-13T18:47:13.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60b000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041f2be0 con 0x7fd6040c9e90 2024-09-13T18:47:13.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd609c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60406ea50 0x7fd6040aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd609200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6040c9e90 0x7fd6041f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd609c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60406ea50 0x7fd6040aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41280/0 (socket says 172.21.15.32:41280) 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609c00700 1 -- 172.21.15.32:0/402018726 learned_addr learned my addr 172.21.15.32:0/402018726 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.758+0000 7fd60a600700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6040ca840 0x7fd6041ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609200700 1 -- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6040ca840 msgr2=0x7fd6041ef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609200700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6040ca840 0x7fd6041ef9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609200700 1 -- 172.21.15.32:0/402018726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60406ea50 msgr2=0x7fd6040aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609200700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60406ea50 0x7fd6040aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609200700 1 -- 172.21.15.32:0/402018726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0009570 con 0x7fd6040c9e90 2024-09-13T18:47:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd609200700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6040c9e90 0x7fd6041f2550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0016000 tx=0x7fd5f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0004610 con 0x7fd6040c9e90 2024-09-13T18:47:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6041f2ec0 con 0x7fd6040c9e90 2024-09-13T18:47:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f001f070 con 0x7fd6040c9e90 2024-09-13T18:47:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0003900 con 0x7fd6040c9e90 2024-09-13T18:47:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.762+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6041ef1d0 con 0x7fd6040c9e90 2024-09-13T18:47:13.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.766+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6041ef030 con 0x7fd6040c9e90 2024-09-13T18:47:13.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.766+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5f0003a60 con 0x7fd6040c9e90 2024-09-13T18:47:13.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.766+0000 7fd601600700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd5e4066760 0x7fd5e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.766+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fd5f0021070 con 0x7fd6040c9e90 2024-09-13T18:47:13.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.770+0000 7fd609c00700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd5e4066760 0x7fd5e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.770+0000 7fd609c00700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd5e4066760 0x7fd5e4068c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001940 tx=0x7fd5f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:13.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.778+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6041ef030 con 0x7fd6040c9e90 2024-09-13T18:47:13.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:13.978+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd reweight", "id": 1, "weight": 1.0} v 0) v1 -- 0x7fd6041ef030 con 0x7fd6040c9e90 2024-09-13T18:47:14.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.506+0000 7fd601600700 1 -- 172.21.15.32:0/402018726 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 1, "weight": 1.0}]=0 reweighted osd.1 to 1 (10000) v68) v1 ==== 113+0+0 (secure 0 0 0) 0x7fd6041ef030 con 0x7fd6040c9e90 2024-09-13T18:47:14.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd5e4066760 msgr2=0x7fd5e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd5e4066760 0x7fd5e4068c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001940 tx=0x7fd5f8009040 comp rx=0 tx=0).stop 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6040c9e90 msgr2=0x7fd6041f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6040c9e90 0x7fd6041f2550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0016000 tx=0x7fd5f0004770 comp rx=0 tx=0).stop 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 shutdown_connections 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fd5e4066760 0x7fd5e4068c20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6040ca840 0x7fd6041ef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6040c9e90 0x7fd6041f2550 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 --2- 172.21.15.32:0/402018726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60406ea50 0x7fd6040aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 >> 172.21.15.32:0/402018726 conn(0x7fd6040cac60 msgr2=0x7fd60406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:14.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 shutdown_connections 2024-09-13T18:47:14.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.514+0000 7fd60b000700 1 -- 172.21.15.32:0/402018726 wait complete. 2024-09-13T18:47:14.525 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-09-13T18:47:14.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-13T18:47:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.738+0000 7f9745a00700 1 Processor -- start 2024-09-13T18:47:14.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.738+0000 7f9745a00700 1 -- start start 2024-09-13T18:47:14.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.738+0000 7f9745a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97400721b0 0x7f974015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.738+0000 7f9745a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9740153450 0x7f9740153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974015a620 con 0x7f9740072590 2024-09-13T18:47:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97400716a0 con 0x7f9740153450 2024-09-13T18:47:14.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9740153e40 con 0x7f97400721b0 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9740153450 0x7f9740153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9740153450 0x7f9740153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41286/0 (socket says 172.21.15.32:41286) 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 -- 172.21.15.32:0/817044194 learned_addr learned my addr 172.21.15.32:0/817044194 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973f400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9740072590 0x7f97400c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45180/0 (socket says 172.21.15.32:45180) 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973fe00700 1 --2- 172.21.15.32:0/817044194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97400721b0 0x7f974015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973ea00700 1 -- 172.21.15.32:0/817044194 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932178048 0 0) 0x7f974015a620 con 0x7f9740072590 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973ea00700 1 -- 172.21.15.32:0/817044194 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97240035d0 con 0x7f9740072590 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 -- 172.21.15.32:0/817044194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97400721b0 msgr2=0x7f974015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:14.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 --2- 172.21.15.32:0/817044194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97400721b0 0x7f974015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 -- 172.21.15.32:0/817044194 >> v1:172.21.15.86:6789/0 conn(0x7f9740072590 legacy=0x7f97400c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 -- 172.21.15.32:0/817044194 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974015db50 con 0x7f9740153450 2024-09-13T18:47:14.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745000700 1 --2- 172.21.15.32:0/817044194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9740153450 0x7f9740153900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9738009e50 tx=0x7f973800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50435757a955b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:14.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973ea00700 1 -- 172.21.15.32:0/817044194 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800e070 con 0x7f9740153450 2024-09-13T18:47:14.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973ea00700 1 -- 172.21.15.32:0/817044194 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800b910 con 0x7f9740153450 2024-09-13T18:47:14.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f973ea00700 1 -- 172.21.15.32:0/817044194 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800bc80 con 0x7f9740153450 2024-09-13T18:47:14.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- 172.21.15.32:0/817044194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9740153450 msgr2=0x7f9740153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 --2- 172.21.15.32:0/817044194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9740153450 0x7f9740153900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9738009e50 tx=0x7f973800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:14.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- 172.21.15.32:0/817044194 shutdown_connections 2024-09-13T18:47:14.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 --2- 172.21.15.32:0/817044194 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9740153450 0x7f9740153900 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 --2- 172.21.15.32:0/817044194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97400721b0 0x7f974015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- 172.21.15.32:0/817044194 >> 172.21.15.32:0/817044194 conn(0x7f97400cbfe0 msgr2=0x7f97400cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:14.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- 172.21.15.32:0/817044194 shutdown_connections 2024-09-13T18:47:14.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.742+0000 7f9745a00700 1 -- 172.21.15.32:0/817044194 wait complete. 2024-09-13T18:47:14.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 Processor -- start 2024-09-13T18:47:14.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 -- start start 2024-09-13T18:47:14.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 0x7f97401519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9740072590 0x7f97401eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9740153450 0x7f97401489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97400c7ed0 con 0x7f97400721b0 2024-09-13T18:47:14.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974015c380 con 0x7f9740153450 2024-09-13T18:47:14.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974015c650 con 0x7f9740072590 2024-09-13T18:47:14.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f973fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 0x7f97401519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f973f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9740072590 0x7f97401eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f9745000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9740153450 0x7f97401489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f973fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 0x7f97401519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41298/0 (socket says 172.21.15.32:41298) 2024-09-13T18:47:14.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.746+0000 7f973fe00700 1 -- 172.21.15.32:0/1336360011 learned_addr learned my addr 172.21.15.32:0/1336360011 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:14.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745000700 1 -- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9740072590 msgr2=0x7f97401eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745000700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9740072590 0x7f97401eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745000700 1 -- 172.21.15.32:0/1336360011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 msgr2=0x7f97401519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745000700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 0x7f97401519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745000700 1 -- 172.21.15.32:0/1336360011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9738009b30 con 0x7f9740153450 2024-09-13T18:47:14.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f973fe00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 0x7f97401519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:14.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745000700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9740153450 0x7f97401489a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9738015000 tx=0x7f9738004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:14.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738004800 con 0x7f9740153450 2024-09-13T18:47:14.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97380092e0 con 0x7f9740153450 2024-09-13T18:47:14.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974015c930 con 0x7f9740153450 2024-09-13T18:47:14.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973801b650 con 0x7f9740153450 2024-09-13T18:47:14.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974015b410 con 0x7f9740153450 2024-09-13T18:47:14.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.750+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9740067a00 con 0x7f9740153450 2024-09-13T18:47:14.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.754+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f973801b7b0 con 0x7f9740153450 2024-09-13T18:47:14.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.754+0000 7f9737e00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.754+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9738085de0 con 0x7f9740153450 2024-09-13T18:47:14.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.754+0000 7f973fe00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.758+0000 7f973fe00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97300113d0 tx=0x7f9730009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:14.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.762+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9738052e70 con 0x7f9740153450 2024-09-13T18:47:14.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:14.962+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 1, "weight": 1.0} v 0) v1 -- 0x7f974015d870 con 0x7f9740153450 2024-09-13T18:47:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.510+0000 7f9737e00700 1 -- 172.21.15.32:0/1336360011 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]=0 set osd.1 primary-affinity to 1 (8655362) v69) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9738056490 con 0x7f9740153450 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 msgr2=0x7f9720068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97300113d0 tx=0x7f9730009240 comp rx=0 tx=0).stop 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9740153450 msgr2=0x7f97401489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9740153450 0x7f97401489a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9738015000 tx=0x7f9738004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 shutdown_connections 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9720066730 0x7f9720068bf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9740153450 0x7f97401489a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9740072590 0x7f97401eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 --2- 172.21.15.32:0/1336360011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97400721b0 0x7f97401519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 >> 172.21.15.32:0/1336360011 conn(0x7f97400cbfe0 msgr2=0x7f9740159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 shutdown_connections 2024-09-13T18:47:15.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.514+0000 7f9745a00700 1 -- 172.21.15.32:0/1336360011 wait complete. 2024-09-13T18:47:15.525 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-13T18:47:15.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T18:47:15.730 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.722+0000 7f9d5a600700 1 Processor -- start 2024-09-13T18:47:15.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.726+0000 7f9d5a600700 1 -- start start 2024-09-13T18:47:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.726+0000 7f9d5a600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9d54151680 0x7f9d5406b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.726+0000 7f9d5a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d54151a60 0x7f9d5406b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.726+0000 7f9d5a600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5415aa50 con 0x7f9d540ccf30 2024-09-13T18:47:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.726+0000 7f9d5a600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5415aca0 con 0x7f9d54151680 2024-09-13T18:47:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.726+0000 7f9d5a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5415af80 con 0x7f9d54151a60 2024-09-13T18:47:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59c00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9d540ccf30 0x7f9d54157a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39092/0 (socket says 172.21.15.32:39092) 2024-09-13T18:47:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59c00700 1 -- 172.21.15.32:0/2606005500 learned_addr learned my addr 172.21.15.32:0/2606005500 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59200700 1 --2- 172.21.15.32:0/2606005500 >> v2:172.21.15.32:3300/0 conn(0x7f9d54151680 0x7f9d5406b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d53e00700 1 --2- 172.21.15.32:0/2606005500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d54151a60 0x7f9d5406b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59200700 1 -- 172.21.15.32:0/2606005500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d54151a60 msgr2=0x7f9d5406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59200700 1 --2- 172.21.15.32:0/2606005500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d54151a60 0x7f9d5406b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59200700 1 -- 172.21.15.32:0/2606005500 >> v1:172.21.15.32:6789/0 conn(0x7f9d540ccf30 legacy=0x7f9d54157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59200700 1 -- 172.21.15.32:0/2606005500 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5415b260 con 0x7f9d54151680 2024-09-13T18:47:15.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d59200700 1 --2- 172.21.15.32:0/2606005500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d5406b260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009850 tx=0x7f9d48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace08dfae1933a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d53400700 1 -- 172.21.15.32:0/2606005500 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011830 con 0x7f9d54151680 2024-09-13T18:47:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d53400700 1 -- 172.21.15.32:0/2606005500 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48011990 con 0x7f9d54151680 2024-09-13T18:47:15.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d53400700 1 -- 172.21.15.32:0/2606005500 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011d40 con 0x7f9d54151680 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 -- 172.21.15.32:0/2606005500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 msgr2=0x7f9d5406b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 --2- 172.21.15.32:0/2606005500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d5406b260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009850 tx=0x7f9d48009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 -- 172.21.15.32:0/2606005500 shutdown_connections 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 --2- 172.21.15.32:0/2606005500 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d54151a60 0x7f9d5406b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 --2- 172.21.15.32:0/2606005500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d5406b260 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 -- 172.21.15.32:0/2606005500 >> 172.21.15.32:0/2606005500 conn(0x7f9d54071740 msgr2=0x7f9d54071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 -- 172.21.15.32:0/2606005500 shutdown_connections 2024-09-13T18:47:15.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.730+0000 7f9d5a600700 1 -- 172.21.15.32:0/2606005500 wait complete. 2024-09-13T18:47:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.734+0000 7f9d5a600700 1 Processor -- start 2024-09-13T18:47:15.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.734+0000 7f9d5a600700 1 -- start start 2024-09-13T18:47:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.734+0000 7f9d5a600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d540ccf30 0x7f9d540c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.734+0000 7f9d5a600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d540c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d5a600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d5414e830 0x7f9d541f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d5a600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5414c5f0 con 0x7f9d54151680 2024-09-13T18:47:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d5a600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c5930 con 0x7f9d5414e830 2024-09-13T18:47:15.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d5a600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540c5600 con 0x7f9d540ccf30 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d540c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d540c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:41320/0 (socket says 172.21.15.32:41320) 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 -- 172.21.15.32:0/290874149 learned_addr learned my addr 172.21.15.32:0/290874149 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d59200700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d540ccf30 0x7f9d540c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d59c00700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d5414e830 0x7f9d541f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 -- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d540ccf30 msgr2=0x7f9d540c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d540ccf30 0x7f9d540c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 -- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d5414e830 msgr2=0x7f9d541f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d5414e830 0x7f9d541f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 -- 172.21.15.32:0/290874149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480094b0 con 0x7f9d54151680 2024-09-13T18:47:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d59200700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d540ccf30 0x7f9d540c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d53e00700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d540c5dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000e840 tx=0x7f9d4000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d400095a0 con 0x7f9d54151680 2024-09-13T18:47:15.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40013680 con 0x7f9d54151680 2024-09-13T18:47:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5414eff0 con 0x7f9d54151680 2024-09-13T18:47:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d400139f0 con 0x7f9d54151680 2024-09-13T18:47:15.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.738+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5414f5b0 con 0x7f9d54151680 2024-09-13T18:47:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.742+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5406d070 con 0x7f9d54151680 2024-09-13T18:47:15.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.742+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d40013b50 con 0x7f9d54151680 2024-09-13T18:47:15.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.742+0000 7f9d50c00700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9d34066760 0x7f9d34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.742+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9d40084860 con 0x7f9d54151680 2024-09-13T18:47:15.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.746+0000 7f9d59200700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9d34066760 0x7f9d34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.746+0000 7f9d59200700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9d34066760 0x7f9d34068c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d480090b0 tx=0x7f9d48008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.750+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d400517c0 con 0x7f9d54151680 2024-09-13T18:47:15.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:15.954+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd reweight", "id": 2, "weight": 1.0} v 0) v1 -- 0x7f9d540cd3a0 con 0x7f9d54151680 2024-09-13T18:47:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.530+0000 7f9d50c00700 1 -- 172.21.15.32:0/290874149 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 2, "weight": 1.0}]=0 reweighted osd.2 to 1 (10000) v70) v1 ==== 113+0+0 (secure 0 0 0) 0x7f9d40054de0 con 0x7f9d54151680 2024-09-13T18:47:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9d34066760 msgr2=0x7f9d34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9d34066760 0x7f9d34068c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d480090b0 tx=0x7f9d48008030 comp rx=0 tx=0).stop 2024-09-13T18:47:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 msgr2=0x7f9d540c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d540c5dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000e840 tx=0x7f9d4000ec00 comp rx=0 tx=0).stop 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 shutdown_connections 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9d34066760 0x7f9d34068c20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d5414e830 0x7f9d541f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d54151680 0x7f9d540c5dc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 --2- 172.21.15.32:0/290874149 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d540ccf30 0x7f9d540c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 >> 172.21.15.32:0/290874149 conn(0x7f9d54071740 msgr2=0x7f9d540c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 shutdown_connections 2024-09-13T18:47:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.534+0000 7f9d5a600700 1 -- 172.21.15.32:0/290874149 wait complete. 2024-09-13T18:47:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T18:47:16.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-13T18:47:16.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.734+0000 7f7c33200700 1 Processor -- start 2024-09-13T18:47:16.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.734+0000 7f7c33200700 1 -- start start 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c33200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c159880 0x7f7c2c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c33200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c071570 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c33200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c06fcb0 con 0x7f7c2c156e30 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c33200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c070920 con 0x7f7c2c159880 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c2be00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f7c2c156e30 0x7f7c2c06f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45188/0 (socket says 172.21.15.32:45188) 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c2be00700 1 -- 172.21.15.32:0/785228334 learned_addr learned my addr 172.21.15.32:0/785228334 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c31200700 1 --2- 172.21.15.32:0/785228334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c159880 0x7f7c2c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.738+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492675432 0 0) 0x7f7c2c071570 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c100035d0 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297319717 0 0) 0x7f7c2c06fcb0 con 0x7f7c2c156e30 2024-09-13T18:47:16.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c2c071570 con 0x7f7c2c156e30 2024-09-13T18:47:16.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c31200700 1 -- 172.21.15.32:0/785228334 >> v1:172.21.15.86:6789/0 conn(0x7f7c2c156e30 legacy=0x7f7c2c06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c31200700 1 -- 172.21.15.32:0/785228334 >> v1:172.21.15.32:6789/0 conn(0x7f7c2c0c80a0 legacy=0x7f7c2c0cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c31200700 1 -- 172.21.15.32:0/785228334 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c15ce90 con 0x7f7c2c159880 2024-09-13T18:47:16.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c31200700 1 --2- 172.21.15.32:0/785228334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c159880 0x7f7c2c159d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009dc0 tx=0x7f7c2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78fa5b98153f0646 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400e070 con 0x7f7c2c159880 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400bb20 con 0x7f7c2c159880 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c2aa00700 1 -- 172.21.15.32:0/785228334 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24012430 con 0x7f7c2c159880 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 -- 172.21.15.32:0/785228334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c159880 msgr2=0x7f7c2c159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 --2- 172.21.15.32:0/785228334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c159880 0x7f7c2c159d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009dc0 tx=0x7f7c2400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 -- 172.21.15.32:0/785228334 shutdown_connections 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 --2- 172.21.15.32:0/785228334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c159880 0x7f7c2c159d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 -- 172.21.15.32:0/785228334 >> 172.21.15.32:0/785228334 conn(0x7f7c2c06eae0 msgr2=0x7f7c2c06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 -- 172.21.15.32:0/785228334 shutdown_connections 2024-09-13T18:47:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.742+0000 7f7c33200700 1 -- 172.21.15.32:0/785228334 wait complete. 2024-09-13T18:47:16.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 Processor -- start 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 -- start start 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 0x7f7c2c1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 0x7f7c2c1ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c2c159880 0x7f7c2c1efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c15dad0 con 0x7f7c2c159880 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c1ef300 con 0x7f7c2c156e30 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c33200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c15afa0 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2b400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 0x7f7c2c1ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 0x7f7c2c1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 0x7f7c2c1556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:57662/0 (socket says 172.21.15.32:57662) 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 -- 172.21.15.32:0/3109631429 learned_addr learned my addr 172.21.15.32:0/3109631429 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2b400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 0x7f7c2c1ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:36856/0 (socket says 172.21.15.32:36856) 2024-09-13T18:47:16.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c31200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c2c159880 0x7f7c2c1efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 -- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 msgr2=0x7f7c2c1ef720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 0x7f7c2c1ef720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 -- 172.21.15.32:0/3109631429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c2c159880 msgr2=0x7f7c2c1efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c2c159880 0x7f7c2c1efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 -- 172.21.15.32:0/3109631429 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009a70 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2b400700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 0x7f7c2c1ef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.746+0000 7f7c2be00700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 0x7f7c2c1556c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c730 tx=0x7f7c1c00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c005d90 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0070d0 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c15aa50 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c007460 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c0b2000 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c1ef440 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.750+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c1c0075c0 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.754+0000 7f7c23e00700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7c0c066730 0x7f7c0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.754+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f7c1c083d50 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.754+0000 7f7c2b400700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7c0c066730 0x7f7c0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.754+0000 7f7c2b400700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7c0c066730 0x7f7c0c068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c06ce60 tx=0x7f7c18009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.762+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c1c050ec0 con 0x7f7c2c0c80a0 2024-09-13T18:47:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:16.954+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd primary-affinity", "id": 2, "weight": 1.0} v 0) v1 -- 0x7f7c2c067a00 con 0x7f7c2c0c80a0 2024-09-13T18:47:17.552 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.546+0000 7f7c23e00700 1 -- 172.21.15.32:0/3109631429 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]=0 set osd.2 primary-affinity to 1 (8655362) v71) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7c1c017020 con 0x7f7c2c0c80a0 2024-09-13T18:47:17.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7c0c066730 msgr2=0x7f7c0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7c0c066730 0x7f7c0c068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c06ce60 tx=0x7f7c18009040 comp rx=0 tx=0).stop 2024-09-13T18:47:17.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 msgr2=0x7f7c2c1556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 0x7f7c2c1556c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c730 tx=0x7f7c1c00ca40 comp rx=0 tx=0).stop 2024-09-13T18:47:17.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 shutdown_connections 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7c0c066730 0x7f7c0c068bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c2c159880 0x7f7c2c1efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c2c156e30 0x7f7c2c1ef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 --2- 172.21.15.32:0/3109631429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7c2c0c80a0 0x7f7c2c1556c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 >> 172.21.15.32:0/3109631429 conn(0x7f7c2c06eae0 msgr2=0x7f7c2c0cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 shutdown_connections 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.550+0000 7f7c33200700 1 -- 172.21.15.32:0/3109631429 wait complete. 2024-09-13T18:47:17.558 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-13T18:47:17.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T18:47:17.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.750+0000 7f4ad2400700 1 Processor -- start 2024-09-13T18:47:17.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.750+0000 7f4ad2400700 1 -- start start 2024-09-13T18:47:17.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad2400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4acc15a240 0x7f4acc164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad2400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc1599b0 con 0x7f4acc0724c0 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad2400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc0728a0 con 0x7f4acc159e40 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad2400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc0c9090 con 0x7f4acc15a240 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad1a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4acc15a240 0x7f4acc164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4acbe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4acc159e40 0x7f4acc0c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45190/0 (socket says 172.21.15.32:45190) 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4acbe00700 1 -- 172.21.15.32:0/558768732 learned_addr learned my addr 172.21.15.32:0/558768732 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad1a00700 1 -- 172.21.15.32:0/558768732 >> v1:172.21.15.86:6789/0 conn(0x7f4acc159e40 legacy=0x7f4acc0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad1a00700 1 -- 172.21.15.32:0/558768732 >> v1:172.21.15.32:6789/0 conn(0x7f4acc0724c0 legacy=0x7f4acc06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.754+0000 7f4ad1a00700 1 -- 172.21.15.32:0/558768732 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc15a690 con 0x7f4acc15a240 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad1a00700 1 --2- 172.21.15.32:0/558768732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc15a240 0x7f4acc164fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5fc8e0357d71d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4acb400700 1 -- 172.21.15.32:0/558768732 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400e070 con 0x7f4acc15a240 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4acb400700 1 -- 172.21.15.32:0/558768732 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac400bbd0 con 0x7f4acc15a240 2024-09-13T18:47:17.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4acb400700 1 -- 172.21.15.32:0/558768732 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4012430 con 0x7f4acc15a240 2024-09-13T18:47:17.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 -- 172.21.15.32:0/558768732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc15a240 msgr2=0x7f4acc164fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 --2- 172.21.15.32:0/558768732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc15a240 0x7f4acc164fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d90 tx=0x7f4ac400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:17.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 -- 172.21.15.32:0/558768732 shutdown_connections 2024-09-13T18:47:17.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 --2- 172.21.15.32:0/558768732 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc15a240 0x7f4acc164fc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 -- 172.21.15.32:0/558768732 >> 172.21.15.32:0/558768732 conn(0x7f4acc0cac60 msgr2=0x7f4acc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:17.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 -- 172.21.15.32:0/558768732 shutdown_connections 2024-09-13T18:47:17.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.758+0000 7f4ad2400700 1 -- 172.21.15.32:0/558768732 wait complete. 2024-09-13T18:47:17.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 Processor -- start 2024-09-13T18:47:17.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 -- start start 2024-09-13T18:47:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc0724c0 0x7f4acc155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 0x7f4acc1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4acc15a240 0x7f4acc0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc158990 con 0x7f4acc0724c0 2024-09-13T18:47:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc1f3440 con 0x7f4acc159e40 2024-09-13T18:47:17.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad2400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc1586b0 con 0x7f4acc15a240 2024-09-13T18:47:17.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4acbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 0x7f4acc1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc0724c0 0x7f4acc155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4acc15a240 0x7f4acc0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4acbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 0x7f4acc1f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:36868/0 (socket says 172.21.15.32:36868) 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4acbe00700 1 -- 172.21.15.32:0/2045480303 learned_addr learned my addr 172.21.15.32:0/2045480303 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 -- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4acc15a240 msgr2=0x7f4acc0acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4acc15a240 0x7f4acc0acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 -- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 msgr2=0x7f4acc1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 0x7f4acc1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 -- 172.21.15.32:0/2045480303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009a70 con 0x7f4acc0724c0 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1a00700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4acc15a240 0x7f4acc0acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:17.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4acbe00700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 0x7f4acc1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:17.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ad1000700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc0724c0 0x7f4acc155c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000c410 tx=0x7f4ac0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.762+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00052d0 con 0x7f4acc0724c0 2024-09-13T18:47:17.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.766+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0005430 con 0x7f4acc0724c0 2024-09-13T18:47:17.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.766+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00055a0 con 0x7f4acc0724c0 2024-09-13T18:47:17.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.766+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc1f3160 con 0x7f4acc0724c0 2024-09-13T18:47:17.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.766+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc1f1250 con 0x7f4acc0724c0 2024-09-13T18:47:17.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.766+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc1f1470 con 0x7f4acc0724c0 2024-09-13T18:47:17.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.766+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ac00038e0 con 0x7f4acc0724c0 2024-09-13T18:47:17.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.770+0000 7f4ac8c00700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4aac066760 0x7f4aac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.770+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4ac0083720 con 0x7f4acc0724c0 2024-09-13T18:47:17.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.770+0000 7f4acbe00700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4aac066760 0x7f4aac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.770+0000 7f4acbe00700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4aac066760 0x7f4aac068c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0c8390 tx=0x7f4ab8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.778+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ac0050710 con 0x7f4acc0724c0 2024-09-13T18:47:17.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:17.970+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd reweight", "id": 3, "weight": 1.0} v 0) v1 -- 0x7f4acc15d940 con 0x7f4acc0724c0 2024-09-13T18:47:18.555 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.546+0000 7f4ac8c00700 1 -- 172.21.15.32:0/2045480303 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 3, "weight": 1.0}]=0 reweighted osd.3 to 1 (10000) v72) v1 ==== 113+0+0 (secure 0 0 0) 0x7f4ac0053d30 con 0x7f4acc0724c0 2024-09-13T18:47:18.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4aac066760 msgr2=0x7f4aac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4aac066760 0x7f4aac068c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0c8390 tx=0x7f4ab8009040 comp rx=0 tx=0).stop 2024-09-13T18:47:18.559 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc0724c0 msgr2=0x7f4acc155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc0724c0 0x7f4acc155c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000c410 tx=0x7f4ac0001e70 comp rx=0 tx=0).stop 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 shutdown_connections 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4aac066760 0x7f4aac068c20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4acc15a240 0x7f4acc0acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4acc159e40 0x7f4acc1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 --2- 172.21.15.32:0/2045480303 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4acc0724c0 0x7f4acc155c30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 >> 172.21.15.32:0/2045480303 conn(0x7f4acc0cac60 msgr2=0x7f4acc159120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 shutdown_connections 2024-09-13T18:47:18.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.554+0000 7f4ad2400700 1 -- 172.21.15.32:0/2045480303 wait complete. 2024-09-13T18:47:18.561 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T18:47:18.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-13T18:47:18.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.762+0000 7f2361e00700 1 Processor -- start 2024-09-13T18:47:18.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.762+0000 7f2361e00700 1 -- start start 2024-09-13T18:47:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f235c072210 0x7f235c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f235c0c6d90 0x7f235c0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c161ff0 con 0x7f235c0c7c30 2024-09-13T18:47:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0c8040 con 0x7f235c0c6d90 2024-09-13T18:47:18.771 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0c6540 con 0x7f235c072210 2024-09-13T18:47:18.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f235c0c6d90 0x7f235c0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2360a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f235c072210 0x7f235c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f235c0c7c30 0x7f235c070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56918/0 (socket says 172.21.15.32:56918) 2024-09-13T18:47:18.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f2361400700 1 -- 172.21.15.32:0/2242621339 learned_addr learned my addr 172.21.15.32:0/2242621339 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:18.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235be00700 1 -- 172.21.15.32:0/2242621339 >> v2:172.21.15.86:3300/0 conn(0x7f235c072210 msgr2=0x7f235c06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235b400700 1 -- 172.21.15.32:0/2242621339 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304566560 0 0) 0x7f235c161ff0 con 0x7f235c0c7c30 2024-09-13T18:47:18.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235be00700 1 --2- 172.21.15.32:0/2242621339 >> v2:172.21.15.86:3300/0 conn(0x7f235c072210 0x7f235c06fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235be00700 1 -- 172.21.15.32:0/2242621339 >> v1:172.21.15.86:6789/0 conn(0x7f235c0c7c30 legacy=0x7f235c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235be00700 1 -- 172.21.15.32:0/2242621339 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c161190 con 0x7f235c0c6d90 2024-09-13T18:47:18.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235be00700 1 --2- 172.21.15.32:0/2242621339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c0c6d90 0x7f235c0c76f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f235c0cbcf0 tx=0x7f2348009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aae7df8e0e92ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235b400700 1 -- 172.21.15.32:0/2242621339 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348011830 con 0x7f235c0c6d90 2024-09-13T18:47:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235b400700 1 -- 172.21.15.32:0/2242621339 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348011990 con 0x7f235c0c6d90 2024-09-13T18:47:18.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.766+0000 7f235b400700 1 -- 172.21.15.32:0/2242621339 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348011d20 con 0x7f235c0c6d90 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 -- 172.21.15.32:0/2242621339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c0c6d90 msgr2=0x7f235c0c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 --2- 172.21.15.32:0/2242621339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c0c6d90 0x7f235c0c76f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f235c0cbcf0 tx=0x7f2348009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 -- 172.21.15.32:0/2242621339 shutdown_connections 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 --2- 172.21.15.32:0/2242621339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c0c6d90 0x7f235c0c76f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 --2- 172.21.15.32:0/2242621339 >> v2:172.21.15.86:3300/0 conn(0x7f235c072210 0x7f235c06fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 -- 172.21.15.32:0/2242621339 >> 172.21.15.32:0/2242621339 conn(0x7f235c0cac60 msgr2=0x7f235c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 -- 172.21.15.32:0/2242621339 shutdown_connections 2024-09-13T18:47:18.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 -- 172.21.15.32:0/2242621339 wait complete. 2024-09-13T18:47:18.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 Processor -- start 2024-09-13T18:47:18.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.770+0000 7f2361e00700 1 -- start start 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c072210 0x7f235c1f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 0x7f235c123f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f235c0c7c30 0x7f235c1f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0c27b0 con 0x7f235c072210 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1f6ce0 con 0x7f235c0c6d90 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0c29e0 con 0x7f235c0c7c30 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2360a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c072210 0x7f235c1f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 0x7f235c123f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f235c0c7c30 0x7f235c1f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 0x7f235c123f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53274/0 (socket says 172.21.15.32:53274) 2024-09-13T18:47:18.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2360a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c072210 0x7f235c1f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56434/0 (socket says 172.21.15.32:56434) 2024-09-13T18:47:18.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 -- 172.21.15.32:0/2324590934 learned_addr learned my addr 172.21.15.32:0/2324590934 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:18.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 -- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f235c0c7c30 msgr2=0x7f235c1f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f235c0c7c30 0x7f235c1f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 -- 172.21.15.32:0/2324590934 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c072210 msgr2=0x7f235c1f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c072210 0x7f235c1f7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 -- 172.21.15.32:0/2324590934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480094b0 con 0x7f235c0c6d90 2024-09-13T18:47:18.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f235be00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 0x7f235c123f90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2348009fd0 tx=0x7f2348004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348004480 con 0x7f235c0c6d90 2024-09-13T18:47:18.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234801f070 con 0x7f235c0c6d90 2024-09-13T18:47:18.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c06deb0 con 0x7f235c0c6d90 2024-09-13T18:47:18.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348003900 con 0x7f235c0c6d90 2024-09-13T18:47:18.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.774+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c1f6690 con 0x7f235c0c6d90 2024-09-13T18:47:18.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.778+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c0b0160 con 0x7f235c0c6d90 2024-09-13T18:47:18.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.778+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2348021030 con 0x7f235c0c6d90 2024-09-13T18:47:18.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.782+0000 7f2358c00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f233c066730 0x7f233c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.782+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f23480857c0 con 0x7f235c0c6d90 2024-09-13T18:47:18.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.782+0000 7f2360a00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f233c066730 0x7f233c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.782+0000 7f2360a00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f233c066730 0x7f233c068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2350009bf0 tx=0x7f2350009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.790+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f23480528d0 con 0x7f235c0c6d90 2024-09-13T18:47:18.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:18.990+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 3, "weight": 1.0} v 0) v1 -- 0x7f235c1f6e20 con 0x7f235c0c6d90 2024-09-13T18:47:19.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.562+0000 7f2358c00700 1 -- 172.21.15.32:0/2324590934 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]=0 set osd.3 primary-affinity to 1 (8655362) v73) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2348055ef0 con 0x7f235c0c6d90 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.566+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f233c066730 msgr2=0x7f233c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.566+0000 7f2361e00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f233c066730 0x7f233c068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2350009bf0 tx=0x7f2350009240 comp rx=0 tx=0).stop 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.566+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 msgr2=0x7f235c123f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.566+0000 7f2361e00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 0x7f235c123f90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2348009fd0 tx=0x7f2348004770 comp rx=0 tx=0).stop 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 shutdown_connections 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f233c066730 0x7f233c068bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f235c0c7c30 0x7f235c1f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f235c0c6d90 0x7f235c123f90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 --2- 172.21.15.32:0/2324590934 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f235c072210 0x7f235c1f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 >> 172.21.15.32:0/2324590934 conn(0x7f235c0cac60 msgr2=0x7f235c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 shutdown_connections 2024-09-13T18:47:19.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.570+0000 7f2361e00700 1 -- 172.21.15.32:0/2324590934 wait complete. 2024-09-13T18:47:19.577 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-13T18:47:19.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-13T18:47:19.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 Processor -- start 2024-09-13T18:47:19.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 -- start start 2024-09-13T18:47:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66a4153770 0x7f66a415d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f66a4066b00 0x7f66a4159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a415d9d0 con 0x7f66a40c7fd0 2024-09-13T18:47:19.794 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40c77b0 con 0x7f66a4153770 2024-09-13T18:47:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a3200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a40c54b0 con 0x7f66a4066b00 2024-09-13T18:47:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.786+0000 7f66a1e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66a4153770 0x7f66a415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f66a4153770 0x7f66a415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56444/0 (socket says 172.21.15.32:56444) 2024-09-13T18:47:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 -- 172.21.15.32:0/2817508473 learned_addr learned my addr 172.21.15.32:0/2817508473 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:19.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a2800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f66a40c7fd0 0x7f66a406a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56934/0 (socket says 172.21.15.32:56934) 2024-09-13T18:47:19.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f669be00700 1 --2- 172.21.15.32:0/2817508473 >> v2:172.21.15.86:3300/0 conn(0x7f66a4066b00 0x7f66a4159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 -- 172.21.15.32:0/2817508473 >> v2:172.21.15.86:3300/0 conn(0x7f66a4066b00 msgr2=0x7f66a4159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:19.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 --2- 172.21.15.32:0/2817508473 >> v2:172.21.15.86:3300/0 conn(0x7f66a4066b00 0x7f66a4159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 -- 172.21.15.32:0/2817508473 >> v1:172.21.15.86:6789/0 conn(0x7f66a40c7fd0 legacy=0x7f66a406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 -- 172.21.15.32:0/2817508473 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40c59e0 con 0x7f66a4153770 2024-09-13T18:47:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1400700 1 -- 172.21.15.32:0/2817508473 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302474418 0 0) 0x7f669c001490 con 0x7f66a40c7fd0 2024-09-13T18:47:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f669be00700 1 --2- 172.21.15.32:0/2817508473 >> v2:172.21.15.86:3300/0 conn(0x7f66a4066b00 0x7f66a4159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:19.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1e00700 1 --2- 172.21.15.32:0/2817508473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a4153770 0x7f66a415d490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f66a4157140 tx=0x7f6694009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db33596d239e537d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1400700 1 -- 172.21.15.32:0/2817508473 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400b8a0 con 0x7f66a4153770 2024-09-13T18:47:19.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1400700 1 -- 172.21.15.32:0/2817508473 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400ba00 con 0x7f66a4153770 2024-09-13T18:47:19.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a1400700 1 -- 172.21.15.32:0/2817508473 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bd90 con 0x7f66a4153770 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a3200700 1 -- 172.21.15.32:0/2817508473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a4153770 msgr2=0x7f66a415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a3200700 1 --2- 172.21.15.32:0/2817508473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a4153770 0x7f66a415d490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f66a4157140 tx=0x7f6694009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a3200700 1 -- 172.21.15.32:0/2817508473 shutdown_connections 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a3200700 1 --2- 172.21.15.32:0/2817508473 >> v2:172.21.15.86:3300/0 conn(0x7f66a4066b00 0x7f66a4159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a3200700 1 --2- 172.21.15.32:0/2817508473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a4153770 0x7f66a415d490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.790+0000 7f66a3200700 1 -- 172.21.15.32:0/2817508473 >> 172.21.15.32:0/2817508473 conn(0x7f66a406f530 msgr2=0x7f66a406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.794+0000 7f66a3200700 1 -- 172.21.15.32:0/2817508473 shutdown_connections 2024-09-13T18:47:19.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.794+0000 7f66a3200700 1 -- 172.21.15.32:0/2817508473 wait complete. 2024-09-13T18:47:19.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.794+0000 7f66a3200700 1 Processor -- start 2024-09-13T18:47:19.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.794+0000 7f66a3200700 1 -- start start 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a4066b00 0x7f66a415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 0x7f66a4146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a4153770 0x7f66a41471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4147720 con 0x7f66a40c7fd0 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41f31c0 con 0x7f66a4153770 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4149f90 con 0x7f66a4066b00 2024-09-13T18:47:19.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 0x7f66a4146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a2800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a4153770 0x7f66a41471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a4066b00 0x7f66a415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a2800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a4153770 0x7f66a41471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53292/0 (socket says 172.21.15.32:53292) 2024-09-13T18:47:19.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 0x7f66a4146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56452/0 (socket says 172.21.15.32:56452) 2024-09-13T18:47:19.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a2800700 1 -- 172.21.15.32:0/513600404 learned_addr learned my addr 172.21.15.32:0/513600404 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 -- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a4066b00 msgr2=0x7f66a415ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a4066b00 0x7f66a415ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 -- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a4153770 msgr2=0x7f66a41471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a4153770 0x7f66a41471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 -- 172.21.15.32:0/513600404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009570 con 0x7f66a40c7fd0 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669be00700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 0x7f66a4146ca0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f668c00e810 tx=0x7f668c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c004230 con 0x7f66a40c7fd0 2024-09-13T18:47:19.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c004390 con 0x7f66a40c7fd0 2024-09-13T18:47:19.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a414a250 con 0x7f66a40c7fd0 2024-09-13T18:47:19.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0036c0 con 0x7f66a40c7fd0 2024-09-13T18:47:19.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.798+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a41f26e0 con 0x7f66a40c7fd0 2024-09-13T18:47:19.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.802+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a40c5fb0 con 0x7f66a40c7fd0 2024-09-13T18:47:19.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.802+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f668c003820 con 0x7f66a40c7fd0 2024-09-13T18:47:19.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.806+0000 7f669a000700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6680066730 0x7f6680068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.806+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f668c083da0 con 0x7f66a40c7fd0 2024-09-13T18:47:19.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.806+0000 7f66a1e00700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6680066730 0x7f6680068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.806+0000 7f66a1e00700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6680066730 0x7f6680068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6694014040 tx=0x7f6694008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:19.810+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f668c050d00 con 0x7f66a40c7fd0 2024-09-13T18:47:20.013 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.002+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd reweight", "id": 4, "weight": 1.0} v 0) v1 -- 0x7f66a406d740 con 0x7f66a40c7fd0 2024-09-13T18:47:20.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.578+0000 7f669a000700 1 -- 172.21.15.32:0/513600404 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 4, "weight": 1.0}]=0 reweighted osd.4 to 1 (10000) v74) v1 ==== 113+0+0 (secure 0 0 0) 0x7f668c020090 con 0x7f66a40c7fd0 2024-09-13T18:47:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6680066730 msgr2=0x7f6680068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6680066730 0x7f6680068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6694014040 tx=0x7f6694008030 comp rx=0 tx=0).stop 2024-09-13T18:47:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 msgr2=0x7f66a4146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 0x7f66a4146ca0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f668c00e810 tx=0x7f668c00eb20 comp rx=0 tx=0).stop 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 shutdown_connections 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6680066730 0x7f6680068bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66a4153770 0x7f66a41471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f66a40c7fd0 0x7f66a4146ca0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 --2- 172.21.15.32:0/513600404 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66a4066b00 0x7f66a415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 >> 172.21.15.32:0/513600404 conn(0x7f66a406f530 msgr2=0x7f66a41519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 shutdown_connections 2024-09-13T18:47:20.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.582+0000 7f66a3200700 1 -- 172.21.15.32:0/513600404 wait complete. 2024-09-13T18:47:20.592 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.4 to 1 (10000) 2024-09-13T18:47:20.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-13T18:47:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.794+0000 7fe6a3200700 1 Processor -- start 2024-09-13T18:47:20.800 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.794+0000 7fe6a3200700 1 -- start start 2024-09-13T18:47:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.794+0000 7fe6a3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a415a240 0x7fe6a4164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.794+0000 7fe6a3200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a415a6d0 con 0x7fe6a4159e40 2024-09-13T18:47:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.794+0000 7fe6a3200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a41599b0 con 0x7fe6a40724c0 2024-09-13T18:47:20.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.794+0000 7fe6a3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c9090 con 0x7fe6a415a240 2024-09-13T18:47:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a1400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe6a4159e40 0x7fe6a40c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42110/0 (socket says 172.21.15.32:42110) 2024-09-13T18:47:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a1e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fe6a40724c0 0x7fe6a406fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56940/0 (socket says 172.21.15.32:56940) 2024-09-13T18:47:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a1400700 1 -- 172.21.15.32:0/3391370015 learned_addr learned my addr 172.21.15.32:0/3391370015 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:20.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a2800700 1 --2- 172.21.15.32:0/3391370015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a415a240 0x7fe6a4164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257282738 0 0) 0x7fe690001110 con 0x7fe6a4159e40 2024-09-13T18:47:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6880035d0 con 0x7fe6a4159e40 2024-09-13T18:47:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490865965 0 0) 0x7fe6a41599b0 con 0x7fe6a40724c0 2024-09-13T18:47:20.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe690001110 con 0x7fe6a40724c0 2024-09-13T18:47:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158892751 0 0) 0x7fe6880035d0 con 0x7fe6a4159e40 2024-09-13T18:47:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a2800700 1 -- 172.21.15.32:0/3391370015 >> v1:172.21.15.86:6789/0 conn(0x7fe6a40724c0 legacy=0x7fe6a406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a2800700 1 -- 172.21.15.32:0/3391370015 >> v1:172.21.15.32:6789/0 conn(0x7fe6a4159e40 legacy=0x7fe6a40c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a2800700 1 -- 172.21.15.32:0/3391370015 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40728a0 con 0x7fe6a415a240 2024-09-13T18:47:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a2800700 1 --2- 172.21.15.32:0/3391370015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a415a240 0x7fe6a4164fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009dc0 tx=0x7fe69c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e39c9c5aef4b3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00e070 con 0x7fe6a415a240 2024-09-13T18:47:20.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c003a40 con 0x7fe6a415a240 2024-09-13T18:47:20.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.798+0000 7fe6a0a00700 1 -- 172.21.15.32:0/3391370015 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690001800 con 0x7fe6a415a240 2024-09-13T18:47:20.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 -- 172.21.15.32:0/3391370015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a415a240 msgr2=0x7fe6a4164fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 --2- 172.21.15.32:0/3391370015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a415a240 0x7fe6a4164fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009dc0 tx=0x7fe69c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:20.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 -- 172.21.15.32:0/3391370015 shutdown_connections 2024-09-13T18:47:20.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 --2- 172.21.15.32:0/3391370015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a415a240 0x7fe6a4164fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 -- 172.21.15.32:0/3391370015 >> 172.21.15.32:0/3391370015 conn(0x7fe6a40cac60 msgr2=0x7fe6a40cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 -- 172.21.15.32:0/3391370015 shutdown_connections 2024-09-13T18:47:20.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 -- 172.21.15.32:0/3391370015 wait complete. 2024-09-13T18:47:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 Processor -- start 2024-09-13T18:47:20.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.802+0000 7fe6a3200700 1 -- start start 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 0x7fe6a4155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6a4159e40 0x7fe6a406c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a415a240 0x7fe6a406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41581d0 con 0x7fe6a4159e40 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a415c210 con 0x7fe6a415a240 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a415bf50 con 0x7fe6a40724c0 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 0x7fe6a4155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6a4159e40 0x7fe6a406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 0x7fe6a4155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:56500/0 (socket says 172.21.15.32:56500) 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 -- 172.21.15.32:0/1812966650 learned_addr learned my addr 172.21.15.32:0/1812966650 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:20.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a2800700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a415a240 0x7fe6a406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 -- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a415a240 msgr2=0x7fe6a406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a415a240 0x7fe6a406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 -- 172.21.15.32:0/1812966650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6a4159e40 msgr2=0x7fe6a406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6a4159e40 0x7fe6a406c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 -- 172.21.15.32:0/1812966650 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c009a70 con 0x7fe6a40724c0 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a1e00700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 0x7fe6a4155940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c4d0 tx=0x7fe69400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694005cd0 con 0x7fe6a40724c0 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694005e30 con 0x7fe6a40724c0 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940072f0 con 0x7fe6a40724c0 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a40c0bf0 con 0x7fe6a40724c0 2024-09-13T18:47:20.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.806+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a406dc50 con 0x7fe6a40724c0 2024-09-13T18:47:20.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.810+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4061fa0 con 0x7fe6a40724c0 2024-09-13T18:47:20.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.810+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe694007450 con 0x7fe6a40724c0 2024-09-13T18:47:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.814+0000 7fe69a000700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe684066730 0x7fe684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.814+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fe694083e60 con 0x7fe6a40724c0 2024-09-13T18:47:20.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.814+0000 7fe6a1400700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe684066730 0x7fe684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.814+0000 7fe6a1400700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe684066730 0x7fe684068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40c10e0 tx=0x7fe690001470 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:20.818+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe694050e50 con 0x7fe6a40724c0 2024-09-13T18:47:21.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.018+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd primary-affinity", "id": 4, "weight": 1.0} v 0) v1 -- 0x7fe6a40c1130 con 0x7fe6a40724c0 2024-09-13T18:47:21.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.586+0000 7fe69a000700 1 -- 172.21.15.32:0/1812966650 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]=0 set osd.4 primary-affinity to 1 (8655362) v75) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe694017020 con 0x7fe6a40724c0 2024-09-13T18:47:21.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.590+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe684066730 msgr2=0x7fe684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe684066730 0x7fe684068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40c10e0 tx=0x7fe690001470 comp rx=0 tx=0).stop 2024-09-13T18:47:21.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 msgr2=0x7fe6a4155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 0x7fe6a4155940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c4d0 tx=0x7fe69400c7e0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 shutdown_connections 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe684066730 0x7fe684068bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a415a240 0x7fe6a406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6a4159e40 0x7fe6a406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 --2- 172.21.15.32:0/1812966650 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6a40724c0 0x7fe6a4155940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 >> 172.21.15.32:0/1812966650 conn(0x7fe6a40cac60 msgr2=0x7fe6a4156850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 shutdown_connections 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.594+0000 7fe6a3200700 1 -- 172.21.15.32:0/1812966650 wait complete. 2024-09-13T18:47:21.642 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-13T18:47:21.642 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T18:47:21.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.834+0000 7f18c1e00700 1 Processor -- start 2024-09-13T18:47:21.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.834+0000 7f18c1e00700 1 -- start start 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18c1e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18bc066b00 0x7f18bc15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18c1e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc15d9d0 con 0x7f18bc0c7fd0 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18c1e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0c54b0 con 0x7f18bc153770 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18c1e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc0c77b0 con 0x7f18bc066b00 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18bbe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18bc066b00 0x7f18bc15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18bbe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f18bc066b00 0x7f18bc15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53320/0 (socket says 172.21.15.32:53320) 2024-09-13T18:47:21.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18bbe00700 1 -- 172.21.15.32:0/2613890523 learned_addr learned my addr 172.21.15.32:0/2613890523 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:21.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18bbe00700 1 -- 172.21.15.32:0/2613890523 >> v1:172.21.15.86:6789/0 conn(0x7f18bc153770 legacy=0x7f18bc159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18bbe00700 1 -- 172.21.15.32:0/2613890523 >> v1:172.21.15.32:6789/0 conn(0x7f18bc0c7fd0 legacy=0x7f18bc163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.838+0000 7f18bbe00700 1 -- 172.21.15.32:0/2613890523 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0c59e0 con 0x7f18bc066b00 2024-09-13T18:47:21.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18bbe00700 1 --2- 172.21.15.32:0/2613890523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc066b00 0x7f18bc15d490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009910 tx=0x7f18a8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c47fa05b1bf6455a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18bb400700 1 -- 172.21.15.32:0/2613890523 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800ba60 con 0x7f18bc066b00 2024-09-13T18:47:21.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18bb400700 1 -- 172.21.15.32:0/2613890523 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800bbc0 con 0x7f18bc066b00 2024-09-13T18:47:21.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18bb400700 1 -- 172.21.15.32:0/2613890523 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8009e60 con 0x7f18bc066b00 2024-09-13T18:47:21.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 -- 172.21.15.32:0/2613890523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc066b00 msgr2=0x7f18bc15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2613890523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc066b00 0x7f18bc15d490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009910 tx=0x7f18a8009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:21.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 -- 172.21.15.32:0/2613890523 shutdown_connections 2024-09-13T18:47:21.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2613890523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc066b00 0x7f18bc15d490 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 -- 172.21.15.32:0/2613890523 >> 172.21.15.32:0/2613890523 conn(0x7f18bc06f530 msgr2=0x7f18bc06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 -- 172.21.15.32:0/2613890523 shutdown_connections 2024-09-13T18:47:21.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.842+0000 7f18c1e00700 1 -- 172.21.15.32:0/2613890523 wait complete. 2024-09-13T18:47:21.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 Processor -- start 2024-09-13T18:47:21.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 -- start start 2024-09-13T18:47:21.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18bc066b00 0x7f18bc1efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18bc0c7fd0 0x7f18bc14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 0x7f18bc15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc158f10 con 0x7f18bc066b00 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc0ca9d0 con 0x7f18bc153770 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc1570d0 con 0x7f18bc0c7fd0 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 0x7f18bc15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18bc066b00 0x7f18bc1efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18bbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18bc0c7fd0 0x7f18bc14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 0x7f18bc15b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53330/0 (socket says 172.21.15.32:53330) 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 -- 172.21.15.32:0/2653182551 learned_addr learned my addr 172.21.15.32:0/2653182551 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 -- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18bc0c7fd0 msgr2=0x7f18bc14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18bc0c7fd0 0x7f18bc14fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 -- 172.21.15.32:0/2653182551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18bc066b00 msgr2=0x7f18bc1efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18bc066b00 0x7f18bc1efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.846+0000 7f18c1400700 1 -- 172.21.15.32:0/2653182551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009570 con 0x7f18bc153770 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18c1400700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 0x7f18bc15b4d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18b400cb80 tx=0x7f18b400ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4003c20 con 0x7f18bc153770 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4003d80 con 0x7f18bc153770 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400aaa0 con 0x7f18bc153770 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc0cb1e0 con 0x7f18bc153770 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc0caf00 con 0x7f18bc153770 2024-09-13T18:47:21.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc0c5fb0 con 0x7f18bc153770 2024-09-13T18:47:21.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.850+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18b400ac00 con 0x7f18bc153770 2024-09-13T18:47:21.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.854+0000 7f18b8c00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f189c066730 0x7f189c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.854+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f18b40842a0 con 0x7f18bc153770 2024-09-13T18:47:21.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.854+0000 7f18c0a00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f189c066730 0x7f189c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.854+0000 7f18c0a00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f189c066730 0x7f189c068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000f60 tx=0x7f18b0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:21.866+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18b4051290 con 0x7f18bc153770 2024-09-13T18:47:22.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.062+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd reweight", "id": 5, "weight": 1.0} v 0) v1 -- 0x7f18bc152240 con 0x7f18bc153770 2024-09-13T18:47:22.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.598+0000 7f18b8c00700 1 -- 172.21.15.32:0/2653182551 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 5, "weight": 1.0}]=0 reweighted osd.5 to 1 (10000) v76) v1 ==== 113+0+0 (secure 0 0 0) 0x7f18b40548b0 con 0x7f18bc153770 2024-09-13T18:47:22.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f189c066730 msgr2=0x7f189c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f189c066730 0x7f189c068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000f60 tx=0x7f18b0009040 comp rx=0 tx=0).stop 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 msgr2=0x7f18bc15b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 0x7f18bc15b4d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18b400cb80 tx=0x7f18b400ce90 comp rx=0 tx=0).stop 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 shutdown_connections 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f189c066730 0x7f189c068bf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18bc153770 0x7f18bc15b4d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18bc0c7fd0 0x7f18bc14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 --2- 172.21.15.32:0/2653182551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18bc066b00 0x7f18bc1efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 >> 172.21.15.32:0/2653182551 conn(0x7f18bc06f530 msgr2=0x7f18bc0cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 shutdown_connections 2024-09-13T18:47:22.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.602+0000 7f18c1e00700 1 -- 172.21.15.32:0/2653182551 wait complete. 2024-09-13T18:47:22.612 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T18:47:22.631 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-13T18:47:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.802+0000 7f9cb3e00700 1 Processor -- start 2024-09-13T18:47:22.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3e00700 1 -- start start 2024-09-13T18:47:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9cb4151a60 0x7f9cb40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9cb40cd470 0x7f9cb4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb415aa50 con 0x7f9cb4151680 2024-09-13T18:47:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb40cd880 con 0x7f9cb40cd470 2024-09-13T18:47:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb415aca0 con 0x7f9cb4151a60 2024-09-13T18:47:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb3400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9cb40cd470 0x7f9cb4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb2a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9cb4151680 0x7f9cb406b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42124/0 (socket says 172.21.15.32:42124) 2024-09-13T18:47:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.806+0000 7f9cb2a00700 1 -- 172.21.15.32:0/2405602892 learned_addr learned my addr 172.21.15.32:0/2405602892 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb2000700 1 --2- 172.21.15.32:0/2405602892 >> v2:172.21.15.86:3300/0 conn(0x7f9cb4151a60 0x7f9cb40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3400700 1 -- 172.21.15.32:0/2405602892 >> v2:172.21.15.86:3300/0 conn(0x7f9cb4151a60 msgr2=0x7f9cb40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3400700 1 --2- 172.21.15.32:0/2405602892 >> v2:172.21.15.86:3300/0 conn(0x7f9cb4151a60 0x7f9cb40ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3400700 1 -- 172.21.15.32:0/2405602892 >> v1:172.21.15.32:6789/0 conn(0x7f9cb4151680 legacy=0x7f9cb406b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3400700 1 -- 172.21.15.32:0/2405602892 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb415af80 con 0x7f9cb40cd470 2024-09-13T18:47:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3400700 1 --2- 172.21.15.32:0/2405602892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb40cd470 0x7f9cb4157a30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9cb406e4d0 tx=0x7f9cac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6352785ce96fce5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb1600700 1 -- 172.21.15.32:0/2405602892 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00e070 con 0x7f9cb40cd470 2024-09-13T18:47:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb1600700 1 -- 172.21.15.32:0/2405602892 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00bb20 con 0x7f9cb40cd470 2024-09-13T18:47:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb1600700 1 -- 172.21.15.32:0/2405602892 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac012430 con 0x7f9cb40cd470 2024-09-13T18:47:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 -- 172.21.15.32:0/2405602892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb40cd470 msgr2=0x7f9cb4157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/2405602892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb40cd470 0x7f9cb4157a30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9cb406e4d0 tx=0x7f9cac00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 -- 172.21.15.32:0/2405602892 shutdown_connections 2024-09-13T18:47:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/2405602892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb40cd470 0x7f9cb4157a30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/2405602892 >> v2:172.21.15.86:3300/0 conn(0x7f9cb4151a60 0x7f9cb40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 -- 172.21.15.32:0/2405602892 >> 172.21.15.32:0/2405602892 conn(0x7f9cb4071740 msgr2=0x7f9cb4071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 -- 172.21.15.32:0/2405602892 shutdown_connections 2024-09-13T18:47:22.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.810+0000 7f9cb3e00700 1 -- 172.21.15.32:0/2405602892 wait complete. 2024-09-13T18:47:22.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 Processor -- start 2024-09-13T18:47:22.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 -- start start 2024-09-13T18:47:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb40cd470 0x7f9cb41ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cb4151680 0x7f9cb414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 0x7f9cb414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb414ddb0 con 0x7f9cb41506e0 2024-09-13T18:47:22.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb414da00 con 0x7f9cb40cd470 2024-09-13T18:47:22.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb414d720 con 0x7f9cb4151680 2024-09-13T18:47:22.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 0x7f9cb414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 0x7f9cb414bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56484/0 (socket says 172.21.15.32:56484) 2024-09-13T18:47:22.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb2000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cb4151680 0x7f9cb414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 -- 172.21.15.32:0/4233345630 learned_addr learned my addr 172.21.15.32:0/4233345630 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:22.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb2a00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb40cd470 0x7f9cb41ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 -- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cb4151680 msgr2=0x7f9cb414b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cb4151680 0x7f9cb414b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 -- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb40cd470 msgr2=0x7f9cb41ecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb40cd470 0x7f9cb41ecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 -- 172.21.15.32:0/4233345630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009a70 con 0x7f9cb41506e0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.814+0000 7f9cb3400700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 0x7f9cb414bc60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9cac014040 tx=0x7f9cac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac012430 con 0x7f9cb41506e0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac020070 con 0x7f9cb41506e0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb4151ef0 con 0x7f9cb41506e0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0098f0 con 0x7f9cb41506e0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb41524b0 con 0x7f9cb41506e0 2024-09-13T18:47:22.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb414df60 con 0x7f9cb41506e0 2024-09-13T18:47:22.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.818+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9cac004040 con 0x7f9cb41506e0 2024-09-13T18:47:22.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.822+0000 7f9cab400700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9c94066730 0x7f9c94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.822+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9cac022070 con 0x7f9cb41506e0 2024-09-13T18:47:22.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.822+0000 7f9cb2a00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9c94066730 0x7f9c94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.822+0000 7f9cb2a00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9c94066730 0x7f9c94068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4005930 tx=0x7f9ca4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:22.826+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9cb414df60 con 0x7f9cb41506e0 2024-09-13T18:47:23.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.022+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 5, "weight": 1.0} v 0) v1 -- 0x7f9cb414df60 con 0x7f9cb41506e0 2024-09-13T18:47:23.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:23.502 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:23.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.614+0000 7f9cab400700 1 -- 172.21.15.32:0/4233345630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]=0 set osd.5 primary-affinity to 1 (8655362) v77) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9cb414df60 con 0x7f9cb41506e0 2024-09-13T18:47:23.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9c94066730 msgr2=0x7f9c94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9c94066730 0x7f9c94068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4005930 tx=0x7f9ca4009040 comp rx=0 tx=0).stop 2024-09-13T18:47:23.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 msgr2=0x7f9cb414bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.623 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 0x7f9cb414bc60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9cac014040 tx=0x7f9cac004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 shutdown_connections 2024-09-13T18:47:23.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9c94066730 0x7f9c94068bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9cb41506e0 0x7f9cb414bc60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.624 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cb4151680 0x7f9cb414b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 --2- 172.21.15.32:0/4233345630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cb40cd470 0x7f9cb41ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 >> 172.21.15.32:0/4233345630 conn(0x7f9cb4071740 msgr2=0x7f9cb41565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 shutdown_connections 2024-09-13T18:47:23.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.618+0000 7f9cb3e00700 1 -- 172.21.15.32:0/4233345630 wait complete. 2024-09-13T18:47:23.626 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-13T18:47:23.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T18:47:23.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff56400700 1 Processor -- start 2024-09-13T18:47:23.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff56400700 1 -- start start 2024-09-13T18:47:23.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff56400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff56400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff501597e0 con 0x7eff50153800 2024-09-13T18:47:23.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff56400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff50159ac0 con 0x7eff500cb620 2024-09-13T18:47:23.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff56400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff501595f0 con 0x7eff5015cf60 2024-09-13T18:47:23.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff4fe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7eff500cb620 0x7eff500cba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56956/0 (socket says 172.21.15.32:56956) 2024-09-13T18:47:23.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff4f400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7eff50153800 0x7eff500c75e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42132/0 (socket says 172.21.15.32:42132) 2024-09-13T18:47:23.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff4fe00700 1 -- 172.21.15.32:0/2851151562 learned_addr learned my addr 172.21.15.32:0/2851151562 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:23.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.826+0000 7eff4ea00700 1 --2- 172.21.15.32:0/2851151562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374556719 0 0) 0x7eff50159ac0 con 0x7eff500cb620 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff340035d0 con 0x7eff500cb620 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56827898 0 0) 0x7eff501597e0 con 0x7eff50153800 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff50159ac0 con 0x7eff50153800 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4ea00700 1 -- 172.21.15.32:0/2851151562 >> v1:172.21.15.86:6789/0 conn(0x7eff500cb620 legacy=0x7eff500cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4ea00700 1 -- 172.21.15.32:0/2851151562 >> v1:172.21.15.32:6789/0 conn(0x7eff50153800 legacy=0x7eff500c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4ea00700 1 -- 172.21.15.32:0/2851151562 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50159da0 con 0x7eff5015cf60 2024-09-13T18:47:23.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4ea00700 1 --2- 172.21.15.32:0/2851151562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015d360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009880 tx=0x7eff3c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c991362a92b4c708 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c011830 con 0x7eff5015cf60 2024-09-13T18:47:23.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c011990 con 0x7eff5015cf60 2024-09-13T18:47:23.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff4e000700 1 -- 172.21.15.32:0/2851151562 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c011d20 con 0x7eff5015cf60 2024-09-13T18:47:23.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 -- 172.21.15.32:0/2851151562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 msgr2=0x7eff5015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 --2- 172.21.15.32:0/2851151562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015d360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009880 tx=0x7eff3c009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:23.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 -- 172.21.15.32:0/2851151562 shutdown_connections 2024-09-13T18:47:23.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 --2- 172.21.15.32:0/2851151562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015d360 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 -- 172.21.15.32:0/2851151562 >> 172.21.15.32:0/2851151562 conn(0x7eff5006ada0 msgr2=0x7eff5006b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 -- 172.21.15.32:0/2851151562 shutdown_connections 2024-09-13T18:47:23.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.830+0000 7eff56400700 1 -- 172.21.15.32:0/2851151562 wait complete. 2024-09-13T18:47:23.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.834+0000 7eff56400700 1 Processor -- start 2024-09-13T18:47:23.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.834+0000 7eff56400700 1 -- start start 2024-09-13T18:47:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 0x7eff500c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 0x7eff5015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5015bcd0 con 0x7eff500cb620 2024-09-13T18:47:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5015c190 con 0x7eff50153800 2024-09-13T18:47:23.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5015bef0 con 0x7eff5015cf60 2024-09-13T18:47:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 0x7eff500c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4ea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 0x7eff5015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4ea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 0x7eff5015b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53352/0 (socket says 172.21.15.32:53352) 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4ea00700 1 -- 172.21.15.32:0/1260658116 learned_addr learned my addr 172.21.15.32:0/1260658116 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 0x7eff500c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56488/0 (socket says 172.21.15.32:56488) 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4fe00700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 -- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 msgr2=0x7eff5015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 -- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 msgr2=0x7eff5015b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 0x7eff5015b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 -- 172.21.15.32:0/1260658116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0094b0 con 0x7eff500cb620 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4ea00700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 0x7eff5015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:23.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff4f400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 0x7eff500c4c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c530 tx=0x7eff4000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40005cd0 con 0x7eff500cb620 2024-09-13T18:47:23.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40005e30 con 0x7eff500cb620 2024-09-13T18:47:23.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40007310 con 0x7eff500cb620 2024-09-13T18:47:23.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff501ef9f0 con 0x7eff500cb620 2024-09-13T18:47:23.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.838+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5015a770 con 0x7eff500cb620 2024-09-13T18:47:23.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.842+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff50153be0 con 0x7eff500cb620 2024-09-13T18:47:23.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.842+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff40007470 con 0x7eff500cb620 2024-09-13T18:47:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.846+0000 7eff47400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7eff30066730 0x7eff30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.846+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6624+0+0 (secure 0 0 0) 0x7eff400839a0 con 0x7eff500cb620 2024-09-13T18:47:23.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.846+0000 7eff4ea00700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7eff30066730 0x7eff30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.846+0000 7eff4ea00700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7eff30066730 0x7eff30068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0097d0 tx=0x7eff3c01c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:23.850+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff400509b0 con 0x7eff500cb620 2024-09-13T18:47:24.061 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.054+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd reweight", "id": 6, "weight": 1.0} v 0) v1 -- 0x7eff500cbda0 con 0x7eff500cb620 2024-09-13T18:47:24.625 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.618+0000 7eff47400700 1 -- 172.21.15.32:0/1260658116 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 6, "weight": 1.0}]=0 reweighted osd.6 to 1 (10000) v78) v1 ==== 113+0+0 (secure 0 0 0) 0x7eff40017020 con 0x7eff500cb620 2024-09-13T18:47:24.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7eff30066730 msgr2=0x7eff30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7eff30066730 0x7eff30068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0097d0 tx=0x7eff3c01c040 comp rx=0 tx=0).stop 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 msgr2=0x7eff500c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 0x7eff500c4c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c530 tx=0x7eff4000c840 comp rx=0 tx=0).stop 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 shutdown_connections 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7eff30066730 0x7eff30068bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff5015cf60 0x7eff5015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff50153800 0x7eff5015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 --2- 172.21.15.32:0/1260658116 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7eff500cb620 0x7eff500c4c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 >> 172.21.15.32:0/1260658116 conn(0x7eff5006ada0 msgr2=0x7eff50158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 shutdown_connections 2024-09-13T18:47:24.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.626+0000 7eff56400700 1 -- 172.21.15.32:0/1260658116 wait complete. 2024-09-13T18:47:24.634 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T18:47:24.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-13T18:47:24.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.838+0000 7f8d2b200700 1 Processor -- start 2024-09-13T18:47:24.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.838+0000 7f8d2b200700 1 -- start start 2024-09-13T18:47:24.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7d40 0x7f8d2c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2b200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d2c0c5870 0x7f8d2c153620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2b200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c15a840 con 0x7f8d2c0c7960 2024-09-13T18:47:24.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2b200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c156e30 con 0x7f8d2c0c5870 2024-09-13T18:47:24.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c072410 con 0x7f8d2c0c7d40 2024-09-13T18:47:24.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2a800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d2c0c5870 0x7f8d2c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2a800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8d2c0c5870 0x7f8d2c153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53356/0 (socket says 172.21.15.32:53356) 2024-09-13T18:47:24.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2a800700 1 -- 172.21.15.32:0/2601560304 learned_addr learned my addr 172.21.15.32:0/2601560304 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:24.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d29e00700 1 --1- 172.21.15.32:0/2601560304 >> v1:172.21.15.86:6789/0 conn(0x7f8d2c0c7960 0x7f8d2c071b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56962/0 (socket says 172.21.15.32:56962) 2024-09-13T18:47:24.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d21400700 1 --2- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7d40 0x7f8d2c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2a800700 1 -- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7d40 msgr2=0x7f8d2c15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:24.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2a800700 1 --2- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7d40 0x7f8d2c15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.842+0000 7f8d2a800700 1 -- 172.21.15.32:0/2601560304 >> v1:172.21.15.86:6789/0 conn(0x7f8d2c0c7960 legacy=0x7f8d2c071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:24.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2a800700 1 -- 172.21.15.32:0/2601560304 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0726f0 con 0x7f8d2c0c5870 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2a800700 1 --2- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c153620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400d150 tx=0x7f8d2400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54d68a184eeb0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d29400700 1 -- 172.21.15.32:0/2601560304 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24010070 con 0x7f8d2c0c5870 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d29400700 1 -- 172.21.15.32:0/2601560304 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2400ddc0 con 0x7f8d2c0c5870 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d29400700 1 -- 172.21.15.32:0/2601560304 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400b310 con 0x7f8d2c0c5870 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 -- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c5870 msgr2=0x7f8d2c153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c153620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400d150 tx=0x7f8d2400d460 comp rx=0 tx=0).stop 2024-09-13T18:47:24.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 -- 172.21.15.32:0/2601560304 shutdown_connections 2024-09-13T18:47:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c153620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2601560304 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7d40 0x7f8d2c15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 -- 172.21.15.32:0/2601560304 >> 172.21.15.32:0/2601560304 conn(0x7f8d2c0cac60 msgr2=0x7f8d2c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 -- 172.21.15.32:0/2601560304 shutdown_connections 2024-09-13T18:47:24.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.846+0000 7f8d2b200700 1 -- 172.21.15.32:0/2601560304 wait complete. 2024-09-13T18:47:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 Processor -- start 2024-09-13T18:47:24.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 -- start start 2024-09-13T18:47:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 0x7f8d2c1ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c7d40 0x7f8d2c14fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1ee9c0 con 0x7f8d2c0c5870 2024-09-13T18:47:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1f2ee0 con 0x7f8d2c0c7d40 2024-09-13T18:47:24.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.850+0000 7f8d2b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1574e0 con 0x7f8d2c0c7960 2024-09-13T18:47:24.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d29e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 0x7f8d2c1ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d2a800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c7d40 0x7f8d2c14fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 0x7f8d2c1ef0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:56536/0 (socket says 172.21.15.32:56536) 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 -- 172.21.15.32:0/2271412044 learned_addr learned my addr 172.21.15.32:0/2271412044 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 -- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c7d40 msgr2=0x7f8d2c14fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c7d40 0x7f8d2c14fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 -- 172.21.15.32:0/2271412044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d2c0c5870 msgr2=0x7f8d2c06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 -- 172.21.15.32:0/2271412044 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2400bd40 con 0x7f8d2c0c7960 2024-09-13T18:47:24.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d2a800700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c7d40 0x7f8d2c14fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:24.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d21400700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 0x7f8d2c1ef0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400d800 tx=0x7f8d1400db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:24.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14004240 con 0x7f8d2c0c7960 2024-09-13T18:47:24.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d140043a0 con 0x7f8d2c0c7960 2024-09-13T18:47:24.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c1eec60 con 0x7f8d2c0c7960 2024-09-13T18:47:24.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d140036c0 con 0x7f8d2c0c7960 2024-09-13T18:47:24.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.854+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c1f2360 con 0x7f8d2c0c7960 2024-09-13T18:47:24.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.858+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c1eedf0 con 0x7f8d2c0c7960 2024-09-13T18:47:24.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.858+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d14003820 con 0x7f8d2c0c7960 2024-09-13T18:47:24.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.858+0000 7f8d22a00700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d08066760 0x7f8d08068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.862+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8d14084080 con 0x7f8d2c0c7960 2024-09-13T18:47:24.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.862+0000 7f8d29e00700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d08066760 0x7f8d08068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.862+0000 7f8d29e00700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d08066760 0x7f8d08068c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c000f60 tx=0x7f8d1c007ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:24.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:24.870+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d140b5db0 con 0x7f8d2c0c7960 2024-09-13T18:47:25.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.074+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd primary-affinity", "id": 6, "weight": 1.0} v 0) v1 -- 0x7f8d2c0c5d00 con 0x7f8d2c0c7960 2024-09-13T18:47:25.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.642+0000 7f8d22a00700 1 -- 172.21.15.32:0/2271412044 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]=0 set osd.6 primary-affinity to 1 (8655362) v79) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8d14051070 con 0x7f8d2c0c7960 2024-09-13T18:47:25.653 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d08066760 msgr2=0x7f8d08068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d08066760 0x7f8d08068c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c000f60 tx=0x7f8d1c007ef0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 msgr2=0x7f8d2c1ef0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 0x7f8d2c1ef0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400d800 tx=0x7f8d1400db10 comp rx=0 tx=0).stop 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 shutdown_connections 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d08066760 0x7f8d08068c20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d2c0c7d40 0x7f8d2c14fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8d2c0c7960 0x7f8d2c1ef0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 --2- 172.21.15.32:0/2271412044 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8d2c0c5870 0x7f8d2c06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 >> 172.21.15.32:0/2271412044 conn(0x7f8d2c0cac60 msgr2=0x7f8d2c152180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 shutdown_connections 2024-09-13T18:47:25.654 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.646+0000 7f8d2b200700 1 -- 172.21.15.32:0/2271412044 wait complete. 2024-09-13T18:47:25.656 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-13T18:47:25.679 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T18:47:25.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.858+0000 7f4377200700 1 Processor -- start 2024-09-13T18:47:25.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.858+0000 7f4377200700 1 -- start start 2024-09-13T18:47:25.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43780c7d40 0x7f437815a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437815a840 con 0x7f43780c7960 2024-09-13T18:47:25.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4378072410 con 0x7f43780c5870 2024-09-13T18:47:25.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4378156e30 con 0x7f43780c7d40 2024-09-13T18:47:25.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43780c7d40 0x7f437815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43780c7d40 0x7f437815a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56504/0 (socket says 172.21.15.32:56504) 2024-09-13T18:47:25.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 -- 172.21.15.32:0/348663651 learned_addr learned my addr 172.21.15.32:0/348663651 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:25.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4375e00700 1 --1- 172.21.15.32:0/348663651 >> v1:172.21.15.32:6789/0 conn(0x7f43780c7960 0x7f4378071b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42136/0 (socket says 172.21.15.32:42136) 2024-09-13T18:47:25.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 -- 172.21.15.32:0/348663651 >> v1:172.21.15.86:6789/0 conn(0x7f43780c5870 legacy=0x7f4378153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 -- 172.21.15.32:0/348663651 >> v1:172.21.15.32:6789/0 conn(0x7f43780c7960 legacy=0x7f4378071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 -- 172.21.15.32:0/348663651 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43780726f0 con 0x7f43780c7d40 2024-09-13T18:47:25.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f436fe00700 1 --2- 172.21.15.32:0/348663651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7d40 0x7f437815a300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f436000bbb0 tx=0x7f436000bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce1861e00d2e06b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:25.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4375400700 1 -- 172.21.15.32:0/348663651 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000dd90 con 0x7f43780c7d40 2024-09-13T18:47:25.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4375400700 1 -- 172.21.15.32:0/348663651 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360010470 con 0x7f43780c7d40 2024-09-13T18:47:25.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4375400700 1 -- 172.21.15.32:0/348663651 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360010820 con 0x7f43780c7d40 2024-09-13T18:47:25.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 -- 172.21.15.32:0/348663651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7d40 msgr2=0x7f437815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 --2- 172.21.15.32:0/348663651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7d40 0x7f437815a300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f436000bbb0 tx=0x7f436000bec0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 -- 172.21.15.32:0/348663651 shutdown_connections 2024-09-13T18:47:25.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 --2- 172.21.15.32:0/348663651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7d40 0x7f437815a300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.862+0000 7f4377200700 1 -- 172.21.15.32:0/348663651 >> 172.21.15.32:0/348663651 conn(0x7f43780cac60 msgr2=0x7f43780cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:25.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.866+0000 7f4377200700 1 -- 172.21.15.32:0/348663651 shutdown_connections 2024-09-13T18:47:25.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.866+0000 7f4377200700 1 -- 172.21.15.32:0/348663651 wait complete. 2024-09-13T18:47:25.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.866+0000 7f4377200700 1 Processor -- start 2024-09-13T18:47:25.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.866+0000 7f4377200700 1 -- start start 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43780c5870 0x7f4378158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 0x7f437806e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43780c7d40 0x7f43781ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437806cd30 con 0x7f43780c7960 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437806d640 con 0x7f43780c7d40 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437806d920 con 0x7f43780c5870 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 0x7f437806e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 0x7f437806e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56506/0 (socket says 172.21.15.32:56506) 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 -- 172.21.15.32:0/1756469156 learned_addr learned my addr 172.21.15.32:0/1756469156 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:25.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4375e00700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43780c5870 0x7f4378158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4376800700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43780c7d40 0x7f43781ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 -- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43780c5870 msgr2=0x7f4378158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43780c5870 0x7f4378158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 -- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43780c7d40 msgr2=0x7f43781ef230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43780c7d40 0x7f43781ef230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 -- 172.21.15.32:0/1756469156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436000b810 con 0x7f43780c7960 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436fe00700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 0x7f437806e1e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4378071aa0 tx=0x7f4360004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:25.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360003d50 con 0x7f43780c7960 2024-09-13T18:47:25.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43600105e0 con 0x7f43780c7960 2024-09-13T18:47:25.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437806cf80 con 0x7f43780c7960 2024-09-13T18:47:25.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360010990 con 0x7f43780c7960 2024-09-13T18:47:25.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.870+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437806d2f0 con 0x7f43780c7960 2024-09-13T18:47:25.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.874+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437806df00 con 0x7f43780c7960 2024-09-13T18:47:25.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.874+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4360019400 con 0x7f43780c7960 2024-09-13T18:47:25.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.874+0000 7f436e000700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4354066730 0x7f4354068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.874+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f43600865c0 con 0x7f43780c7960 2024-09-13T18:47:25.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.874+0000 7f4375e00700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4354066730 0x7f4354068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.874+0000 7f4375e00700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4354066730 0x7f4354068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4368000f60 tx=0x7f4368007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:25.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:25.878+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f437806df00 con 0x7f43780c7960 2024-09-13T18:47:26.079 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.074+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd reweight", "id": 7, "weight": 1.0} v 0) v1 -- 0x7f437806df00 con 0x7f43780c7960 2024-09-13T18:47:26.652 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.646+0000 7f436e000700 1 -- 172.21.15.32:0/1756469156 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 7, "weight": 1.0}]=0 reweighted osd.7 to 1 (10000) v80) v1 ==== 113+0+0 (secure 0 0 0) 0x7f437806df00 con 0x7f43780c7960 2024-09-13T18:47:26.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4354066730 msgr2=0x7f4354068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4354066730 0x7f4354068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4368000f60 tx=0x7f4368007d30 comp rx=0 tx=0).stop 2024-09-13T18:47:26.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 msgr2=0x7f437806e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 0x7f437806e1e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4378071aa0 tx=0x7f4360004770 comp rx=0 tx=0).stop 2024-09-13T18:47:26.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 shutdown_connections 2024-09-13T18:47:26.658 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4354066730 0x7f4354068bf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43780c7d40 0x7f43781ef230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43780c7960 0x7f437806e1e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 --2- 172.21.15.32:0/1756469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43780c5870 0x7f4378158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 >> 172.21.15.32:0/1756469156 conn(0x7f43780cac60 msgr2=0x7f4378151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:26.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 shutdown_connections 2024-09-13T18:47:26.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.650+0000 7f4377200700 1 -- 172.21.15.32:0/1756469156 wait complete. 2024-09-13T18:47:26.660 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T18:47:26.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-13T18:47:26.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.874+0000 7f4af4e00700 1 Processor -- start 2024-09-13T18:47:26.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.874+0000 7f4af4e00700 1 -- start start 2024-09-13T18:47:26.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4af4e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4af0073990 0x7f4af0159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4af4e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af006fd20 con 0x7f4af00701b0 2024-09-13T18:47:26.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4af4e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00c7380 con 0x7f4af0073d70 2024-09-13T18:47:26.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4af4e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00c7940 con 0x7f4af0073990 2024-09-13T18:47:26.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aef400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4af0073990 0x7f4af0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aeea00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4af0073d70 0x7f4af00c6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56980/0 (socket says 172.21.15.32:56980) 2024-09-13T18:47:26.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aeea00700 1 -- 172.21.15.32:0/3925145358 learned_addr learned my addr 172.21.15.32:0/3925145358 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:26.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aef400700 1 -- 172.21.15.32:0/3925145358 >> v1:172.21.15.86:6789/0 conn(0x7f4af0073d70 legacy=0x7f4af00c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aef400700 1 -- 172.21.15.32:0/3925145358 >> v1:172.21.15.32:6789/0 conn(0x7f4af00701b0 legacy=0x7f4af0070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aef400700 1 -- 172.21.15.32:0/3925145358 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00c7660 con 0x7f4af0073990 2024-09-13T18:47:26.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aef400700 1 --2- 172.21.15.32:0/3925145358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af0159600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009850 tx=0x7f4ae0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f8c59adf08786d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:26.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aee000700 1 -- 172.21.15.32:0/3925145358 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0011830 con 0x7f4af0073990 2024-09-13T18:47:26.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aee000700 1 -- 172.21.15.32:0/3925145358 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0011990 con 0x7f4af0073990 2024-09-13T18:47:26.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.878+0000 7f4aee000700 1 -- 172.21.15.32:0/3925145358 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0011d20 con 0x7f4af0073990 2024-09-13T18:47:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- 172.21.15.32:0/3925145358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 msgr2=0x7f4af0159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3925145358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af0159600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009850 tx=0x7f4ae0009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- 172.21.15.32:0/3925145358 shutdown_connections 2024-09-13T18:47:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3925145358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af0159600 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- 172.21.15.32:0/3925145358 >> 172.21.15.32:0/3925145358 conn(0x7f4af00c8a60 msgr2=0x7f4af00c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:26.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- 172.21.15.32:0/3925145358 shutdown_connections 2024-09-13T18:47:26.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- 172.21.15.32:0/3925145358 wait complete. 2024-09-13T18:47:26.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 Processor -- start 2024-09-13T18:47:26.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- start start 2024-09-13T18:47:26.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 0x7f4af00c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4af0073d70 0x7f4af01ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af015a7c0 con 0x7f4af0073d70 2024-09-13T18:47:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c1160 con 0x7f4af0073990 2024-09-13T18:47:26.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.882+0000 7f4af4e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c1440 con 0x7f4af00701b0 2024-09-13T18:47:26.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aeea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 0x7f4af00c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aefe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4af0073d70 0x7f4af01ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 0x7f4af00c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:56562/0 (socket says 172.21.15.32:56562) 2024-09-13T18:47:26.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 -- 172.21.15.32:0/3874584247 learned_addr learned my addr 172.21.15.32:0/3874584247 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:26.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 -- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 msgr2=0x7f4af015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 -- 172.21.15.32:0/3874584247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4af0073d70 msgr2=0x7f4af01ef260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4af0073d70 0x7f4af01ef260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 -- 172.21.15.32:0/3874584247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00094b0 con 0x7f4af00701b0 2024-09-13T18:47:26.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aefe00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4af0073d70 0x7f4af01ef260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:26.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aeea00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4aef400700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 0x7f4af00c27c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4af0072640 tx=0x7f4ae0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00036c0 con 0x7f4af00701b0 2024-09-13T18:47:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0003820 con 0x7f4af00701b0 2024-09-13T18:47:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0003bd0 con 0x7f4af00701b0 2024-09-13T18:47:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af00c1720 con 0x7f4af00701b0 2024-09-13T18:47:26.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.886+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af015aa10 con 0x7f4af00701b0 2024-09-13T18:47:26.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.890+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af0159600 con 0x7f4af00701b0 2024-09-13T18:47:26.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.890+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ae0003d30 con 0x7f4af00701b0 2024-09-13T18:47:26.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.890+0000 7f4ae7400700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ad0066730 0x7f4ad0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.894+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4ae0021030 con 0x7f4af00701b0 2024-09-13T18:47:26.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.894+0000 7f4aeea00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ad0066730 0x7f4ad0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.894+0000 7f4aeea00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ad0066730 0x7f4ad0068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4af0158e30 tx=0x7f4adc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:26.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:26.902+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ae0052cd0 con 0x7f4af00701b0 2024-09-13T18:47:27.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.098+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd primary-affinity", "id": 7, "weight": 1.0} v 0) v1 -- 0x7f4af00c40c0 con 0x7f4af00701b0 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.654+0000 7f4ae7400700 1 -- 172.21.15.32:0/3874584247 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]=0 set osd.7 primary-affinity to 1 (8655362) v81) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4ae002b0a0 con 0x7f4af00701b0 2024-09-13T18:47:27.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ad0066730 msgr2=0x7f4ad0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ad0066730 0x7f4ad0068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4af0158e30 tx=0x7f4adc009040 comp rx=0 tx=0).stop 2024-09-13T18:47:27.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 msgr2=0x7f4af00c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 0x7f4af00c27c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4af0072640 tx=0x7f4ae0004770 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 shutdown_connections 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ad0066730 0x7f4ad0068bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4af0073d70 0x7f4af01ef260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4af0073990 0x7f4af015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 --2- 172.21.15.32:0/3874584247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4af00701b0 0x7f4af00c27c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 >> 172.21.15.32:0/3874584247 conn(0x7f4af00c8a60 msgr2=0x7f4af0159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 shutdown_connections 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.658+0000 7f4af4e00700 1 -- 172.21.15.32:0/3874584247 wait complete. 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-13T18:47:27.686 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-13T18:47:27.687 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-13T18:47:27.687 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-13T18:47:27.687 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-13T18:47:27.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:47:27.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:27.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 Processor -- start 2024-09-13T18:47:27.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 -- start start 2024-09-13T18:47:27.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f16080cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f16080cb920 0x7f16080cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160815d7f0 con 0x7f16080ca700 2024-09-13T18:47:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16080cb770 con 0x7f16080cb920 2024-09-13T18:47:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f1610000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160815dc80 con 0x7f1608153960 2024-09-13T18:47:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f160e000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f16080cb920 0x7f16080cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f160cc00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f16080ca700 0x7f1608159730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:42152/0 (socket says 172.21.15.32:42152) 2024-09-13T18:47:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f160cc00700 1 -- 172.21.15.32:0/1227813791 learned_addr learned my addr 172.21.15.32:0/1227813791 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:27.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.858+0000 7f160d600700 1 --2- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f16080cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f160e000700 1 -- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 msgr2=0x7f16080cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f160e000700 1 --2- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f16080cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f160e000700 1 -- 172.21.15.32:0/1227813791 >> v1:172.21.15.32:6789/0 conn(0x7f16080ca700 legacy=0x7f1608159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f160e000700 1 -- 172.21.15.32:0/1227813791 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080cb490 con 0x7f16080cb920 2024-09-13T18:47:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f160e000700 1 --2- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080cb920 0x7f16080cbd90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1600009d90 tx=0x7f160000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83e1ce24abfaf46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1607e00700 1 -- 172.21.15.32:0/1227813791 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000e070 con 0x7f16080cb920 2024-09-13T18:47:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1607e00700 1 -- 172.21.15.32:0/1227813791 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000bb20 con 0x7f16080cb920 2024-09-13T18:47:27.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1607e00700 1 -- 172.21.15.32:0/1227813791 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600012430 con 0x7f16080cb920 2024-09-13T18:47:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 -- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080cb920 msgr2=0x7f16080cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 --2- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080cb920 0x7f16080cbd90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1600009d90 tx=0x7f160000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 -- 172.21.15.32:0/1227813791 shutdown_connections 2024-09-13T18:47:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 --2- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080cb920 0x7f16080cbd90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 --2- 172.21.15.32:0/1227813791 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f16080cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 -- 172.21.15.32:0/1227813791 >> 172.21.15.32:0/1227813791 conn(0x7f16080725a0 msgr2=0x7f1608073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 -- 172.21.15.32:0/1227813791 shutdown_connections 2024-09-13T18:47:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.862+0000 7f1610000700 1 -- 172.21.15.32:0/1227813791 wait complete. 2024-09-13T18:47:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 Processor -- start 2024-09-13T18:47:27.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 -- start start 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 0x7f1608146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16080cb920 0x7f16081e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f160815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160815c710 con 0x7f16080cb920 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608147970 con 0x7f16080ca700 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f1610000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16081473b0 con 0x7f1608153960 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f160d600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 0x7f1608146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f160e000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f160815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f160cc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16080cb920 0x7f16081e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f160d600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 0x7f1608146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53428/0 (socket says 172.21.15.32:53428) 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.866+0000 7f160d600700 1 -- 172.21.15.32:0/2772463882 learned_addr learned my addr 172.21.15.32:0/2772463882 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160d600700 1 -- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 msgr2=0x7f160815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160d600700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f160815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160d600700 1 -- 172.21.15.32:0/2772463882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16080cb920 msgr2=0x7f16081e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160d600700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16080cb920 0x7f16081e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160d600700 1 -- 172.21.15.32:0/2772463882 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009a70 con 0x7f16080ca700 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160cc00700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16080cb920 0x7f16081e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160e000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f160815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f160d600700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 0x7f1608146de0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e870 tx=0x7f15fc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0095a0 con 0x7f16080ca700 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc013680 con 0x7f16080ca700 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16081f31a0 con 0x7f16080ca700 2024-09-13T18:47:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0139f0 con 0x7f16080ca700 2024-09-13T18:47:27.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1608147600 con 0x7f16080ca700 2024-09-13T18:47:27.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.870+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1608153d40 con 0x7f16080ca700 2024-09-13T18:47:27.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.874+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15fc013bb0 con 0x7f16080ca700 2024-09-13T18:47:27.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.874+0000 7f1605600700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f15e8066730 0x7f15e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.874+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f15fc084730 con 0x7f16080ca700 2024-09-13T18:47:27.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.874+0000 7f160cc00700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f15e8066730 0x7f15e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.878+0000 7f160cc00700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f15e8066730 0x7f15e8068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f160814d510 tx=0x7f15f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:27.886+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15fc051690 con 0x7f16080ca700 2024-09-13T18:47:28.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.090+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16080cc440 con 0x7f16080ca700 2024-09-13T18:47:28.100 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.094+0000 7f1605600700 1 -- 172.21.15.32:0/2772463882 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18451 (secure 0 0 0) 0x7f15fc013e60 con 0x7f16080ca700 2024-09-13T18:47:28.101 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:28.101 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":81,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:47:27.647237+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:46:40.269675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.17","osds":[6,4,7,5]},{"pgid":"4.19","osds":[1,4,3,6]}],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f15e8066730 msgr2=0x7f15e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f15e8066730 0x7f15e8068bf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f160814d510 tx=0x7f15f4009040 comp rx=0 tx=0).stop 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 msgr2=0x7f1608146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 0x7f1608146de0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e870 tx=0x7f15fc00eb80 comp rx=0 tx=0).stop 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 shutdown_connections 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f15e8066730 0x7f15e8068bf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1608153960 0x7f160815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f16080cb920 0x7f16081e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 --2- 172.21.15.32:0/2772463882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16080ca700 0x7f1608146de0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 >> 172.21.15.32:0/2772463882 conn(0x7f16080725a0 msgr2=0x7f16081525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 shutdown_connections 2024-09-13T18:47:28.107 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.098+0000 7f1610000700 1 -- 172.21.15.32:0/2772463882 wait complete. 2024-09-13T18:47:28.128 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:47:28.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:28.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.294+0000 7f5e93200700 1 Processor -- start 2024-09-13T18:47:28.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.294+0000 7f5e93200700 1 -- start start 2024-09-13T18:47:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e93200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e940c7890 0x7f5e940c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e93200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e940cb860 0x7f5e940c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e93200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e940c5d90 con 0x7f5e940c6b30 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e93200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e940c5a00 con 0x7f5e940c7890 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e93200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e940c6110 con 0x7f5e940cb860 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e940c7890 0x7f5e940c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e92800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5e940c6b30 0x7f5e9415e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:56986/0 (socket says 172.21.15.32:56986) 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f5e940cb860 0x7f5e940c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5e940c7890 0x7f5e940c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56534/0 (socket says 172.21.15.32:56534) 2024-09-13T18:47:28.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e92800700 1 -- 172.21.15.32:0/4223071122 learned_addr learned my addr 172.21.15.32:0/4223071122 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91400700 1 -- 172.21.15.32:0/4223071122 >> v2:172.21.15.32:3300/0 conn(0x7f5e940c7890 msgr2=0x7f5e940c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91400700 1 --2- 172.21.15.32:0/4223071122 >> v2:172.21.15.32:3300/0 conn(0x7f5e940c7890 0x7f5e940c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91400700 1 -- 172.21.15.32:0/4223071122 >> v1:172.21.15.86:6789/0 conn(0x7f5e940c6b30 legacy=0x7f5e9415e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91400700 1 -- 172.21.15.32:0/4223071122 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e940c81b0 con 0x7f5e940cb860 2024-09-13T18:47:28.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e90a00700 1 -- 172.21.15.32:0/4223071122 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556079197 0 0) 0x7f5e8c001490 con 0x7f5e940c6b30 2024-09-13T18:47:28.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e91400700 1 --2- 172.21.15.32:0/4223071122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940cb860 0x7f5e940c65f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5e9406eb00 tx=0x7f5e80009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab2a3da617c480bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e90a00700 1 -- 172.21.15.32:0/4223071122 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011830 con 0x7f5e940cb860 2024-09-13T18:47:28.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.298+0000 7f5e90a00700 1 -- 172.21.15.32:0/4223071122 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80011990 con 0x7f5e940cb860 2024-09-13T18:47:28.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e90a00700 1 -- 172.21.15.32:0/4223071122 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011d20 con 0x7f5e940cb860 2024-09-13T18:47:28.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 -- 172.21.15.32:0/4223071122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940cb860 msgr2=0x7f5e940c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 --2- 172.21.15.32:0/4223071122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940cb860 0x7f5e940c65f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5e9406eb00 tx=0x7f5e80009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 -- 172.21.15.32:0/4223071122 shutdown_connections 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 --2- 172.21.15.32:0/4223071122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940cb860 0x7f5e940c65f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 --2- 172.21.15.32:0/4223071122 >> v2:172.21.15.32:3300/0 conn(0x7f5e940c7890 0x7f5e940c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 -- 172.21.15.32:0/4223071122 >> 172.21.15.32:0/4223071122 conn(0x7f5e940cad40 msgr2=0x7f5e940cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 -- 172.21.15.32:0/4223071122 shutdown_connections 2024-09-13T18:47:28.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 -- 172.21.15.32:0/4223071122 wait complete. 2024-09-13T18:47:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 Processor -- start 2024-09-13T18:47:28.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.302+0000 7f5e93200700 1 -- start start 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 0x7f5e94127860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e940c7890 0x7f5e940c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e940cb860 0x7f5e940c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c0db0 con 0x7f5e940cb860 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c1370 con 0x7f5e940c6b30 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e941f39f0 con 0x7f5e940c7890 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 0x7f5e94127860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 0x7f5e94127860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:53448/0 (socket says 172.21.15.32:53448) 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e940c7890 0x7f5e940c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 -- 172.21.15.32:0/1506814812 learned_addr learned my addr 172.21.15.32:0/1506814812 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e92800700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e940cb860 0x7f5e940c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 -- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e940c7890 msgr2=0x7f5e940c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e940c7890 0x7f5e940c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 -- 172.21.15.32:0/1506814812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e940cb860 msgr2=0x7f5e940c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e940cb860 0x7f5e940c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 -- 172.21.15.32:0/1506814812 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800094b0 con 0x7f5e940c6b30 2024-09-13T18:47:28.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e92800700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e940cb860 0x7f5e940c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e91e00700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 0x7f5e94127860 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400e9d0 tx=0x7f5e8400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84009720 con 0x7f5e940c6b30 2024-09-13T18:47:28.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400ee70 con 0x7f5e940c6b30 2024-09-13T18:47:28.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e941f3c90 con 0x7f5e940c6b30 2024-09-13T18:47:28.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400ca50 con 0x7f5e940c6b30 2024-09-13T18:47:28.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.306+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e940b0da0 con 0x7f5e940c6b30 2024-09-13T18:47:28.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.310+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e940aa220 con 0x7f5e940c6b30 2024-09-13T18:47:28.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.310+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e8400cbb0 con 0x7f5e940c6b30 2024-09-13T18:47:28.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.314+0000 7f5e8a000700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5e74066730 0x7f5e74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.314+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f5e840848c0 con 0x7f5e940c6b30 2024-09-13T18:47:28.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.314+0000 7f5e91400700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5e74066730 0x7f5e74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.314+0000 7f5e91400700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5e74066730 0x7f5e74068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009fd0 tx=0x7f5e80008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.322+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e84051820 con 0x7f5e940c6b30 2024-09-13T18:47:28.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.514+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e940c8410 con 0x7f5e940c6b30 2024-09-13T18:47:28.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.518+0000 7f5e8a000700 1 -- 172.21.15.32:0/1506814812 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18451 (secure 0 0 0) 0x7f5e8400ce60 con 0x7f5e940c6b30 2024-09-13T18:47:28.526 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:28.526 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":81,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:47:27.647237+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:46:40.269675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.17","osds":[6,4,7,5]},{"pgid":"4.19","osds":[1,4,3,6]}],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.522+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5e74066730 msgr2=0x7f5e74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.522+0000 7f5e93200700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5e74066730 0x7f5e74068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009fd0 tx=0x7f5e80008030 comp rx=0 tx=0).stop 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.522+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 msgr2=0x7f5e94127860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.522+0000 7f5e93200700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 0x7f5e94127860 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400e9d0 tx=0x7f5e8400ece0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 shutdown_connections 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5e74066730 0x7f5e74068bf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e940cb860 0x7f5e940c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e940c7890 0x7f5e940c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 --2- 172.21.15.32:0/1506814812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e940c6b30 0x7f5e94127860 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 >> 172.21.15.32:0/1506814812 conn(0x7f5e940cad40 msgr2=0x7f5e9415e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 shutdown_connections 2024-09-13T18:47:28.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.526+0000 7f5e93200700 1 -- 172.21.15.32:0/1506814812 wait complete. 2024-09-13T18:47:28.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:47:28.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:47:28.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:47:28.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:47:28.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:47:28.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:47:28.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:47:28.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:47:28.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 Processor -- start 2024-09-13T18:47:28.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 -- start start 2024-09-13T18:47:28.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f1029c00700 1 Processor -- start 2024-09-13T18:47:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f1029c00700 1 -- start start 2024-09-13T18:47:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 0x7f3818006eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3818044be0 0x7f38180e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f381fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 0x7f3818006eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f381fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 0x7f3818006eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57574/0 (socket says 172.21.15.32:57574) 2024-09-13T18:47:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f381f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3818044be0 0x7f38180e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3824a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f381804ad40 0x7f381804bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39744/0 (socket says 172.21.15.32:39744) 2024-09-13T18:47:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f381f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3818044be0 0x7f38180e6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39598/0 (socket says 172.21.15.32:39598) 2024-09-13T18:47:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3818006a20 con 0x7f381804ad40 2024-09-13T18:47:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f8b8e800700 1 Processor -- start 2024-09-13T18:47:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f8b8e800700 1 -- start start 2024-09-13T18:47:28.807 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180073f0 con 0x7f38180dcd90 2024-09-13T18:47:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f3825400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180e6fb0 con 0x7f3818044be0 2024-09-13T18:47:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.798+0000 7f381fe00700 1 -- 172.21.15.32:0/2746788729 learned_addr learned my addr 172.21.15.32:0/2746788729 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1029c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10240aa3d0 0x7f102415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1029c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240c92a0 con 0x7f10240a9ff0 2024-09-13T18:47:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1029c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102415e050 con 0x7f10240a9490 2024-09-13T18:47:28.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1029c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240c9cf0 con 0x7f10240aa3d0 2024-09-13T18:47:28.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7faaa8a00700 1 Processor -- start 2024-09-13T18:47:28.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1022000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f10240a9490 0x7f102415d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44852/0 (socket says 172.21.15.32:44852) 2024-09-13T18:47:28.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1022000700 1 -- 172.21.15.32:0/2883665539 learned_addr learned my addr 172.21.15.32:0/2883665539 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:28.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381f400700 1 -- 172.21.15.32:0/2746788729 >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 msgr2=0x7f3818006eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381f400700 1 --2- 172.21.15.32:0/2746788729 >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 0x7f3818006eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381f400700 1 -- 172.21.15.32:0/2746788729 >> v1:172.21.15.32:6789/0 conn(0x7f381804ad40 legacy=0x7f381804bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381f400700 1 -- 172.21.15.32:0/2746788729 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818005ba0 con 0x7f3818044be0 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381fe00700 1 --2- 172.21.15.32:0/2746788729 >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 0x7f3818006eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381f400700 1 --2- 172.21.15.32:0/2746788729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f38180e6a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3818032f30 tx=0x7f3814009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deae4fb2912f17a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b8e800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b800dcb70 0x7f8b800e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b8e800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80050010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b8e800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8b8004f060 0x7f8b8004f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b8e800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b80005d70 con 0x7f8b800dcb70 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b8e800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b800e38d0 con 0x7f8b8004f060 2024-09-13T18:47:28.810 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b8e800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b80005f80 con 0x7f8b80007020 2024-09-13T18:47:28.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1023400700 1 --2- 172.21.15.32:0/2883665539 >> v2:172.21.15.32:3300/0 conn(0x7f10240aa3d0 0x7f102415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7faaa8a00700 1 -- start start 2024-09-13T18:47:28.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381ea00700 1 -- 172.21.15.32:0/2746788729 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814011830 con 0x7f3818044be0 2024-09-13T18:47:28.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80050010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80050010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52456/0 (socket says 172.21.15.32:52456) 2024-09-13T18:47:28.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 -- 172.21.15.32:0/2747187180 learned_addr learned my addr 172.21.15.32:0/2747187180 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1023400700 1 -- 172.21.15.32:0/2883665539 >> v1:172.21.15.86:6789/0 conn(0x7f10240a9490 legacy=0x7f102415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b87e00700 1 --2- 172.21.15.32:0/2747187180 >> v2:172.21.15.86:3300/0 conn(0x7f8b8004f060 0x7f8b8004f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1023400700 1 -- 172.21.15.32:0/2883665539 >> v1:172.21.15.32:6789/0 conn(0x7f10240a9ff0 legacy=0x7f102415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1023400700 1 -- 172.21.15.32:0/2883665539 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240a9940 con 0x7f10240aa3d0 2024-09-13T18:47:28.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 -- 172.21.15.32:0/2747187180 >> v2:172.21.15.86:3300/0 conn(0x7f8b8004f060 msgr2=0x7f8b8004f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 --2- 172.21.15.32:0/2747187180 >> v2:172.21.15.86:3300/0 conn(0x7f8b8004f060 0x7f8b8004f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 -- 172.21.15.32:0/2747187180 >> v2:172.21.15.32:3300/0 conn(0x7f8b800dcb70 msgr2=0x7f8b800e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 --2- 172.21.15.32:0/2747187180 >> v2:172.21.15.32:3300/0 conn(0x7f8b800dcb70 0x7f8b800e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 -- 172.21.15.32:0/2747187180 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80006260 con 0x7f8b80007020 2024-09-13T18:47:28.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381ea00700 1 -- 172.21.15.32:0/2746788729 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814011990 con 0x7f3818044be0 2024-09-13T18:47:28.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f381ea00700 1 -- 172.21.15.32:0/2746788729 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814011d20 con 0x7f3818044be0 2024-09-13T18:47:28.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7fb548a00700 1 Processor -- start 2024-09-13T18:47:28.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f1023400700 1 --2- 172.21.15.32:0/2883665539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240aa3d0 0x7f102415d900 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f101c009d90 tx=0x7f101c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cc2428658488bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7f8b86a00700 1 --2- 172.21.15.32:0/2747187180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80050010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b80036f90 tx=0x7f8b74009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598856e9a5e44014 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7fb548a00700 1 -- start start 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b86000700 1 -- 172.21.15.32:0/2747187180 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011830 con 0x7f8b80007020 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7faaa8a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faaa40721b0 0x7faaa415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.802+0000 7faaa8a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa40c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa8a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 0x7faaa4153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa8a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa40716a0 con 0x7faaa40721b0 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa8a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa4153e40 con 0x7faaa4153450 2024-09-13T18:47:28.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa8a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415a620 con 0x7faaa4072590 2024-09-13T18:47:28.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b86000700 1 -- 172.21.15.32:0/2747187180 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74011990 con 0x7f8b80007020 2024-09-13T18:47:28.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b86000700 1 -- 172.21.15.32:0/2747187180 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011d20 con 0x7f8b80007020 2024-09-13T18:47:28.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f1021600700 1 -- 172.21.15.32:0/2883665539 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00e070 con 0x7f10240aa3d0 2024-09-13T18:47:28.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f1021600700 1 -- 172.21.15.32:0/2883665539 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c00bad0 con 0x7f10240aa3d0 2024-09-13T18:47:28.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f1021600700 1 -- 172.21.15.32:0/2883665539 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00e070 con 0x7f10240aa3d0 2024-09-13T18:47:28.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 -- 172.21.15.32:0/2746788729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 msgr2=0x7f38180e6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 --2- 172.21.15.32:0/2746788729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f38180e6a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3818032f30 tx=0x7f3814009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:28.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 -- 172.21.15.32:0/2746788729 shutdown_connections 2024-09-13T18:47:28.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 --2- 172.21.15.32:0/2746788729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f38180e6a70 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3818032f30 tx=0x7f3814009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:28.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 --2- 172.21.15.32:0/2746788729 >> v2:172.21.15.32:3300/0 conn(0x7f38180dcd90 0x7f3818006eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 -- 172.21.15.32:0/2746788729 >> 172.21.15.32:0/2746788729 conn(0x7f381804fd00 msgr2=0x7f3818050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 -- 172.21.15.32:0/2747187180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 msgr2=0x7f8b80050010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 --2- 172.21.15.32:0/2747187180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80050010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b80036f90 tx=0x7f8b74009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa40c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa3200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 0x7faaa4153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa40c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52468/0 (socket says 172.21.15.32:52468) 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 -- 172.21.15.32:0/3555319934 learned_addr learned my addr 172.21.15.32:0/3555319934 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 -- 172.21.15.32:0/2747187180 shutdown_connections 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 --2- 172.21.15.32:0/2747187180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80050010 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 --2- 172.21.15.32:0/2747187180 >> v2:172.21.15.86:3300/0 conn(0x7f8b8004f060 0x7f8b8004f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 --2- 172.21.15.32:0/2747187180 >> v2:172.21.15.32:3300/0 conn(0x7f8b800dcb70 0x7f8b800e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 -- 172.21.15.32:0/2747187180 >> 172.21.15.32:0/2747187180 conn(0x7f8b80054070 msgr2=0x7f8b80054480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa3200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 0x7faaa4153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39626/0 (socket says 172.21.15.32:39626) 2024-09-13T18:47:28.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 -- 172.21.15.32:0/2746788729 shutdown_connections 2024-09-13T18:47:28.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb548a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb54406ea50 0x7fb54415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa2800700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.32:3300/0 conn(0x7faaa40721b0 0x7faaa415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb548a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5440c9e90 0x7fb5440ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb548a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440c9440 con 0x7fb5440ca840 2024-09-13T18:47:28.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb548a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5440c9a70 con 0x7fb5440c9e90 2024-09-13T18:47:28.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb548a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440c7aa0 con 0x7fb54406ea50 2024-09-13T18:47:28.822 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f3825400700 1 -- 172.21.15.32:0/2746788729 wait complete. 2024-09-13T18:47:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 -- 172.21.15.32:0/2747187180 shutdown_connections 2024-09-13T18:47:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f8b8e800700 1 -- 172.21.15.32:0/2747187180 wait complete. 2024-09-13T18:47:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fa565400700 1 Processor -- start 2024-09-13T18:47:28.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fa565400700 1 -- start start 2024-09-13T18:47:28.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 -- 172.21.15.32:0/3555319934 >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 msgr2=0x7faaa4153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 0x7faaa4153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 -- 172.21.15.32:0/3555319934 >> v2:172.21.15.32:3300/0 conn(0x7faaa40721b0 msgr2=0x7faaa415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.32:3300/0 conn(0x7faaa40721b0 0x7faaa415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 -- 172.21.15.32:0/3555319934 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa415db50 con 0x7faaa4072590 2024-09-13T18:47:28.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa2800700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.32:3300/0 conn(0x7faaa40721b0 0x7faaa415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:28.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb542a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5440c9e90 0x7fb5440ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa3200700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 0x7faaa4153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:28.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f4301a00700 1 Processor -- start 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb542a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb5440c9e90 0x7fb5440ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39638/0 (socket says 172.21.15.32:39638) 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb542a00700 1 -- 172.21.15.32:0/706254906 learned_addr learned my addr 172.21.15.32:0/706254906 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb543400700 1 --2- 172.21.15.32:0/706254906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb54406ea50 0x7fb54415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7fb543e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb5440ca840 0x7fb54406fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44854/0 (socket says 172.21.15.32:44854) 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f1029c00700 1 -- 172.21.15.32:0/2883665539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240aa3d0 msgr2=0x7f102415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f1029c00700 1 --2- 172.21.15.32:0/2883665539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240aa3d0 0x7f102415d900 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f101c009d90 tx=0x7f101c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:28.826 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7f4301a00700 1 -- start start 2024-09-13T18:47:28.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faa99e00700 1 --2- 172.21.15.32:0/3555319934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa40c9ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faaa4072af0 tx=0x7faa8c009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b088230331476a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.806+0000 7faaa1e00700 1 -- 172.21.15.32:0/3555319934 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00b8a0 con 0x7faaa4072590 2024-09-13T18:47:28.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa1e00700 1 -- 172.21.15.32:0/3555319934 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c00ba00 con 0x7faaa4072590 2024-09-13T18:47:28.827 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa1e00700 1 -- 172.21.15.32:0/3555319934 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00bd90 con 0x7faaa4072590 2024-09-13T18:47:28.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f1029c00700 1 -- 172.21.15.32:0/2883665539 shutdown_connections 2024-09-13T18:47:28.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f1029c00700 1 --2- 172.21.15.32:0/2883665539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240aa3d0 0x7f102415d900 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f1029c00700 1 -- 172.21.15.32:0/2883665539 >> 172.21.15.32:0/2883665539 conn(0x7f10240cad40 msgr2=0x7f10240cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.828 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f1029c00700 1 -- 172.21.15.32:0/2883665539 shutdown_connections 2024-09-13T18:47:28.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb543400700 1 -- 172.21.15.32:0/706254906 >> v2:172.21.15.86:3300/0 conn(0x7fb5440c9e90 msgr2=0x7fb5440ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb543400700 1 --2- 172.21.15.32:0/706254906 >> v2:172.21.15.86:3300/0 conn(0x7fb5440c9e90 0x7fb5440ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb543400700 1 -- 172.21.15.32:0/706254906 >> v1:172.21.15.86:6789/0 conn(0x7fb5440ca840 legacy=0x7fb54406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb543400700 1 -- 172.21.15.32:0/706254906 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440c7d60 con 0x7fb54406ea50 2024-09-13T18:47:28.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb542000700 1 -- 172.21.15.32:0/706254906 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775132948 0 0) 0x7fb5440c9440 con 0x7fb5440ca840 2024-09-13T18:47:28.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f1029c00700 1 -- 172.21.15.32:0/2883665539 wait complete. 2024-09-13T18:47:28.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa565400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa560070450 0x7fa560164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa565400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa560070860 con 0x7fa56006e720 2024-09-13T18:47:28.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa565400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56015db70 con 0x7fa560072290 2024-09-13T18:47:28.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa565400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5600c67c0 con 0x7fa560070450 2024-09-13T18:47:28.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 Processor -- start 2024-09-13T18:47:28.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 -- 172.21.15.32:0/3555319934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 msgr2=0x7faaa40c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 --2- 172.21.15.32:0/3555319934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa40c9ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faaa4072af0 tx=0x7faa8c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.831 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 -- start start 2024-09-13T18:47:28.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb543400700 1 --2- 172.21.15.32:0/706254906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb54406ea50 0x7fb54415aa70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb530009850 tx=0x7fb530009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e70aff796a978f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55f400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa56006e720 0x7fa5600c7b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39758/0 (socket says 172.21.15.32:39758) 2024-09-13T18:47:28.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55f400700 1 -- 172.21.15.32:0/4247810109 learned_addr learned my addr 172.21.15.32:0/4247810109 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:28.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f4301a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42fc071ca0 0x7f42fc0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f4301a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc15a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 -- 172.21.15.32:0/3555319934 shutdown_connections 2024-09-13T18:47:28.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 --2- 172.21.15.32:0/3555319934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa40c9ac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa564a00700 1 --2- 172.21.15.32:0/4247810109 >> v2:172.21.15.86:3300/0 conn(0x7fa560070450 0x7fa560164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.86:3300/0 conn(0x7faaa4153450 0x7faaa4153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 --2- 172.21.15.32:0/3555319934 >> v2:172.21.15.32:3300/0 conn(0x7faaa40721b0 0x7faaa415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 -- 172.21.15.32:0/3555319934 >> 172.21.15.32:0/3555319934 conn(0x7faaa40cbfe0 msgr2=0x7faaa40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f4301a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f42fc072080 0x7f42fc0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f4301a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42fc0c8b40 con 0x7f42fc072080 2024-09-13T18:47:28.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f4301a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42fc0a9e90 con 0x7f42fc071ca0 2024-09-13T18:47:28.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f4301a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc15a990 con 0x7f42fc0c75c0 2024-09-13T18:47:28.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 -- 172.21.15.32:0/3555319934 shutdown_connections 2024-09-13T18:47:28.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7faaa8a00700 1 -- 172.21.15.32:0/3555319934 wait complete. 2024-09-13T18:47:28.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42fc071ca0 0x7f42fc0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f42fc071ca0 0x7f42fc0aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39664/0 (socket says 172.21.15.32:39664) 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 -- 172.21.15.32:0/3445077884 learned_addr learned my addr 172.21.15.32:0/3445077884 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269948086 0 0) 0x7fa56015db70 con 0x7fa560072290 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5440035d0 con 0x7fa560072290 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137837139 0 0) 0x7fa560070860 con 0x7fa56006e720 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa56015db70 con 0x7fa56006e720 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42fa000700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42fb400700 1 --2- 172.21.15.32:0/3445077884 >> v2:172.21.15.32:3300/0 conn(0x7f42fc072080 0x7f42fc0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80179260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f3825400700 1 Processor -- start 2024-09-13T18:47:28.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f3825400700 1 -- start start 2024-09-13T18:47:28.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa564a00700 1 -- 172.21.15.32:0/4247810109 >> v1:172.21.15.86:6789/0 conn(0x7fa560072290 legacy=0x7fa560159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa564a00700 1 -- 172.21.15.32:0/4247810109 >> v1:172.21.15.32:6789/0 conn(0x7fa56006e720 legacy=0x7fa5600c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa564a00700 1 -- 172.21.15.32:0/4247810109 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56006ffe0 con 0x7fa560070450 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b8004f060 0x7f8b8004c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b800dcb70 0x7f8b8017c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8004e430 con 0x7f8b8004f060 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8017cae0 con 0x7f8b800dcb70 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b8e800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8004bdf0 con 0x7f8b80007020 2024-09-13T18:47:28.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 -- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 msgr2=0x7f42fc15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 -- 172.21.15.32:0/3445077884 >> v2:172.21.15.32:3300/0 conn(0x7f42fc072080 msgr2=0x7f42fc0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 --2- 172.21.15.32:0/3445077884 >> v2:172.21.15.32:3300/0 conn(0x7f42fc072080 0x7f42fc0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa564a00700 1 --2- 172.21.15.32:0/4247810109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa560164fc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009850 tx=0x7fa54c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3275b1b6cff6baf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42faa00700 1 -- 172.21.15.32:0/3445077884 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc0c9330 con 0x7f42fc071ca0 2024-09-13T18:47:28.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b86a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b8004f060 0x7f8b8004c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f42fa000700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b86a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b8004f060 0x7f8b8004c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57626/0 (socket says 172.21.15.32:57626) 2024-09-13T18:47:28.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7f8b86a00700 1 -- 172.21.15.32:0/395737399 learned_addr learned my addr 172.21.15.32:0/395737399 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c004230 con 0x7fa560070450 2024-09-13T18:47:28.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c004390 con 0x7fa560070450 2024-09-13T18:47:28.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb542000700 1 -- 172.21.15.32:0/706254906 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530011830 con 0x7fb54406ea50 2024-09-13T18:47:28.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb542000700 1 -- 172.21.15.32:0/706254906 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530011990 con 0x7fb54406ea50 2024-09-13T18:47:28.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.810+0000 7fb542000700 1 -- 172.21.15.32:0/706254906 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530011d40 con 0x7fb54406ea50 2024-09-13T18:47:28.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 Processor -- start 2024-09-13T18:47:28.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f42faa00700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc071ca0 0x7f42fc0aa320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f42fc062150 tx=0x7f42ec009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e271e4a33cef3a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa55ea00700 1 -- 172.21.15.32:0/4247810109 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c004230 con 0x7fa560070450 2024-09-13T18:47:28.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f97ff400700 1 Processor -- start 2024-09-13T18:47:28.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b86a00700 1 -- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 msgr2=0x7f8b80179260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:47:28.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b86a00700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b80007020 0x7f8b80179260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b86a00700 1 -- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b800dcb70 msgr2=0x7f8b8017c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b86a00700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b800dcb70 0x7f8b8017c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b86a00700 1 -- 172.21.15.32:0/395737399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74009570 con 0x7f8b8004f060 2024-09-13T18:47:28.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3825400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f381804eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3825400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f381804ad40 0x7f38180cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3825400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38180dcd90 0x7f38180cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 -- start start 2024-09-13T18:47:28.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f42f9600700 1 -- 172.21.15.32:0/3445077884 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec011830 con 0x7f42fc071ca0 2024-09-13T18:47:28.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f42f9600700 1 -- 172.21.15.32:0/3445077884 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec011990 con 0x7f42fc071ca0 2024-09-13T18:47:28.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f42f9600700 1 -- 172.21.15.32:0/3445077884 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec011d20 con 0x7f42fc071ca0 2024-09-13T18:47:28.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f381804eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f381804eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39680/0 (socket says 172.21.15.32:39680) 2024-09-13T18:47:28.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f381804ad40 0x7f38180cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381f400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f381804ad40 0x7f38180cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52510/0 (socket says 172.21.15.32:52510) 2024-09-13T18:47:28.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 -- 172.21.15.32:0/706254906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb54406ea50 msgr2=0x7fb54415aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 --2- 172.21.15.32:0/706254906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb54406ea50 0x7fb54415aa70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb530009850 tx=0x7fb530009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:28.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 Processor -- start 2024-09-13T18:47:28.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b86a00700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b8004f060 0x7f8b8004c720 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8b800060c0 tx=0x7f8b74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3824a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38180dcd90 0x7f38180cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3824a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38180dcd90 0x7f38180cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57630/0 (socket says 172.21.15.32:57630) 2024-09-13T18:47:28.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f97ff400700 1 -- start start 2024-09-13T18:47:28.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 -- 172.21.15.32:0/706254906 shutdown_connections 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 --2- 172.21.15.32:0/706254906 >> v2:172.21.15.86:3300/0 conn(0x7fb5440c9e90 0x7fb5440ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 --2- 172.21.15.32:0/706254906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb54406ea50 0x7fb54415aa70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 -- 172.21.15.32:0/706254906 >> 172.21.15.32:0/706254906 conn(0x7fb5440cac60 msgr2=0x7fb5440cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa565400700 1 -- 172.21.15.32:0/4247810109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 msgr2=0x7fa560164fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa565400700 1 --2- 172.21.15.32:0/4247810109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa560164fc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009850 tx=0x7fa54c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 -- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc071ca0 msgr2=0x7f42fc0aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc071ca0 0x7f42fc0aa320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f42fc062150 tx=0x7f42ec009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381fe00700 1 -- 172.21.15.32:0/619535198 learned_addr learned my addr 172.21.15.32:0/619535198 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240a9490 0x7f102415fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10240a9ff0 0x7f1024160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10240aa3d0 0x7f10240ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 -- 172.21.15.32:0/3445077884 shutdown_connections 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 --2- 172.21.15.32:0/3445077884 >> v2:172.21.15.32:3300/0 conn(0x7f42fc072080 0x7f42fc0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 --2- 172.21.15.32:0/3445077884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc071ca0 0x7f42fc0aa320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 -- 172.21.15.32:0/3445077884 >> 172.21.15.32:0/3445077884 conn(0x7f42fc0cad40 msgr2=0x7f42fc0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 -- 172.21.15.32:0/706254906 shutdown_connections 2024-09-13T18:47:28.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa565400700 1 -- 172.21.15.32:0/4247810109 shutdown_connections 2024-09-13T18:47:28.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa565400700 1 --2- 172.21.15.32:0/4247810109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa560164fc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa565400700 1 -- 172.21.15.32:0/4247810109 >> 172.21.15.32:0/4247810109 conn(0x7fa5600cac60 msgr2=0x7fa5600cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74004510 con 0x7f8b8004f060 2024-09-13T18:47:28.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b740036c0 con 0x7f8b8004f060 2024-09-13T18:47:28.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74003a70 con 0x7f8b8004f060 2024-09-13T18:47:28.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240ad6b0 con 0x7f10240a9490 2024-09-13T18:47:28.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8004c0d0 con 0x7f8b8004f060 2024-09-13T18:47:28.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241f3d40 con 0x7f10240a9ff0 2024-09-13T18:47:28.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 -- 172.21.15.32:0/3445077884 shutdown_connections 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fb548a00700 1 -- 172.21.15.32:0/706254906 wait complete. 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3825400700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ce210 con 0x7f38180dcd90 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3825400700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ce690 con 0x7f3818044be0 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f3825400700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ce970 con 0x7f381804ad40 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381f400700 1 -- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 msgr2=0x7f381804eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381f400700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f381804eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f381f400700 1 -- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38180dcd90 msgr2=0x7f38180cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f381f400700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38180dcd90 0x7f38180cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f381f400700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200758d0 con 0x7f381804ad40 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b80178a60 con 0x7f8b8004f060 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 -- start start 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40721b0 0x7faaa415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faaa4153450 0x7faaa415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa41fffe0 con 0x7faaa4153450 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40ca220 con 0x7faaa40721b0 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa8a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa41ffa60 con 0x7faaa4072590 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa2800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40721b0 0x7faaa415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa2800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40721b0 0x7faaa415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39690/0 (socket says 172.21.15.32:39690) 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7faaa2800700 1 -- 172.21.15.32:0/459718233 learned_addr learned my addr 172.21.15.32:0/459718233 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1023400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10240aa3d0 0x7f10240ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1023400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10240aa3d0 0x7f10240ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52526/0 (socket says 172.21.15.32:52526) 2024-09-13T18:47:28.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1023400700 1 -- 172.21.15.32:0/831399614 learned_addr learned my addr 172.21.15.32:0/831399614 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10241f4270 con 0x7f10240aa3d0 2024-09-13T18:47:28.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1022000700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10240a9ff0 0x7f1024160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7fa565400700 1 -- 172.21.15.32:0/4247810109 shutdown_connections 2024-09-13T18:47:28.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f4301a00700 1 -- 172.21.15.32:0/3445077884 wait complete. 2024-09-13T18:47:28.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.814+0000 7f97ff400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f97f806f530 0x7f97f8150710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f381fe00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3818044be0 0x7f381804eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f3824a00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f38180dcd90 0x7f38180cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1022a00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240a9490 0x7f102415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7fa565400700 1 -- 172.21.15.32:0/4247810109 wait complete. 2024-09-13T18:47:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97ff400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f8072840 con 0x7f97f8070b40 2024-09-13T18:47:28.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97ff400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f8156fc0 con 0x7f97f80c69d0 2024-09-13T18:47:28.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97ff400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f806fcd0 con 0x7f97f806f530 2024-09-13T18:47:28.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97fca00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f97f80c69d0 0x7f97f80c1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44872/0 (socket says 172.21.15.32:44872) 2024-09-13T18:47:28.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97fca00700 1 -- 172.21.15.32:0/3630006516 learned_addr learned my addr 172.21.15.32:0/3630006516 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:28.859 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1023400700 1 -- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10240a9ff0 msgr2=0x7f1024160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f381f400700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f381804ad40 0x7f38180cf730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3814016000 tx=0x7f3814004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b80006b00 con 0x7f8b8004f060 2024-09-13T18:47:28.860 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faa99e00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1023400700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10240a9ff0 0x7f1024160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1023400700 1 -- 172.21.15.32:0/831399614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240a9490 msgr2=0x7f102415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1023400700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10240a9490 0x7f102415fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1023400700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c009a70 con 0x7f10240aa3d0 2024-09-13T18:47:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa2800700 1 -- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 msgr2=0x7faaa414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa2800700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa2800700 1 -- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faaa4153450 msgr2=0x7faaa415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa2800700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faaa4153450 0x7faaa415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa2800700 1 -- 172.21.15.32:0/459718233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c009570 con 0x7faaa40721b0 2024-09-13T18:47:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faa99e00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaa4072590 0x7faaa414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286440292 0 0) 0x7f97f8156fc0 con 0x7f97f80c69d0 2024-09-13T18:47:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97dc0035d0 con 0x7f97f80c69d0 2024-09-13T18:47:28.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7fb548a00700 1 Processor -- start 2024-09-13T18:47:28.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140045d0 con 0x7f381804ad40 2024-09-13T18:47:28.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140036c0 con 0x7f381804ad40 2024-09-13T18:47:28.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814003a70 con 0x7f381804ad40 2024-09-13T18:47:28.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f3825400700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38140094b0 con 0x7f381804ad40 2024-09-13T18:47:28.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f3825400700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180cef30 con 0x7f381804ad40 2024-09-13T18:47:28.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa2800700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40721b0 0x7faaa415baa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c7f0 tx=0x7faa9400cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94011800 con 0x7faaa40721b0 2024-09-13T18:47:28.865 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94011960 con 0x7faaa40721b0 2024-09-13T18:47:28.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94011d10 con 0x7faaa40721b0 2024-09-13T18:47:28.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa41ffd00 con 0x7faaa40721b0 2024-09-13T18:47:28.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa415c6d0 con 0x7faaa40721b0 2024-09-13T18:47:28.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1023400700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10240aa3d0 0x7f10240ac2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f101c004000 tx=0x7f101c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.866 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1022000700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10240a9ff0 0x7f1024160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:28.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c012660 con 0x7f10240aa3d0 2024-09-13T18:47:28.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0127c0 con 0x7f10240aa3d0 2024-09-13T18:47:28.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c012b30 con 0x7f10240aa3d0 2024-09-13T18:47:28.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102415dab0 con 0x7f10240aa3d0 2024-09-13T18:47:28.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10240ad060 con 0x7f10240aa3d0 2024-09-13T18:47:28.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7fa565400700 1 Processor -- start 2024-09-13T18:47:28.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7fa565400700 1 -- start start 2024-09-13T18:47:28.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f4301a00700 1 Processor -- start 2024-09-13T18:47:28.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97efe00700 1 --2- 172.21.15.32:0/3630006516 >> v2:172.21.15.32:3300/0 conn(0x7f97f806f530 0x7f97f8150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1161328649 0 0) 0x7f97dc0035d0 con 0x7f97f80c69d0 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 >> v2:172.21.15.32:3300/0 conn(0x7f97f806f530 msgr2=0x7f97f8150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 --2- 172.21.15.32:0/3630006516 >> v2:172.21.15.32:3300/0 conn(0x7f97f806f530 0x7f97f8150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 >> v1:172.21.15.32:6789/0 conn(0x7f97f8070b40 legacy=0x7f97f80c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 --> v1:172.21.15.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8157260 con 0x7f97f80c69d0 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 <== mon.1 v1:172.21.15.86:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7f97e8001670 con 0x7f97f80c69d0 2024-09-13T18:47:28.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 >> v1:172.21.15.86:6789/0 conn(0x7f97f80c69d0 legacy=0x7f97f80c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97dc003a20 0x7f97dc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97dc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc005230 0x7f97dc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f806fcd0 con 0x7f97dc004870 2024-09-13T18:47:28.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0104f0 con 0x7f97dc005230 2024-09-13T18:47:28.870 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0106b0 con 0x7f97dc003a20 2024-09-13T18:47:28.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10240c8fc0 con 0x7f10240aa3d0 2024-09-13T18:47:28.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97fca00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97dc003a20 0x7f97dc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97dc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97fd400700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc005230 0x7f97dc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 -- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97dc003a20 msgr2=0x7f97dc003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b74003bd0 con 0x7f8b8004f060 2024-09-13T18:47:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97dc003a20 0x7f97dc003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 -- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc005230 msgr2=0x7f97dc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97dc005230 0x7f97dc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 -- 172.21.15.32:0/3630006516 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8157260 con 0x7f97dc004870 2024-09-13T18:47:28.873 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97fd400700 1 -- 172.21.15.32:0/3630006516 reap_dead start 2024-09-13T18:47:28.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.818+0000 7fb548a00700 1 -- start start 2024-09-13T18:47:28.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb548a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb54406ea50 0x7fb544070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb548a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5440c9e90 0x7fb544158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb548a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5440ca840 0x7fb5441594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb548a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb544152fe0 con 0x7fb54406ea50 2024-09-13T18:47:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb548a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54415a9a0 con 0x7fb5440ca840 2024-09-13T18:47:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faaa415d2b0 con 0x7faaa40721b0 2024-09-13T18:47:28.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb548a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5441521d0 con 0x7fb5440c9e90 2024-09-13T18:47:28.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 -- start start 2024-09-13T18:47:28.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97efe00700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97dc004cf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009b50 tx=0x7f97dc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dd741c26713c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb543e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5440ca840 0x7fb5441594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb543e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5440ca840 0x7fb5441594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39696/0 (socket says 172.21.15.32:39696) 2024-09-13T18:47:28.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb543e00700 1 -- 172.21.15.32:0/823573130 learned_addr learned my addr 172.21.15.32:0/823573130 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38180063d0 con 0x7f381804ad40 2024-09-13T18:47:28.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f101c012c90 con 0x7f10240aa3d0 2024-09-13T18:47:28.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000e6c0 con 0x7f97dc004870 2024-09-13T18:47:28.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000e820 con 0x7f97dc004870 2024-09-13T18:47:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97f7e00700 1 -- 172.21.15.32:0/3630006516 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000ebd0 con 0x7f97dc004870 2024-09-13T18:47:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb543400700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb54406ea50 0x7fb544070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f8b7b400700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8b68066800 0x7f8b68068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa565400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56006e720 0x7fa560154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa565400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa5601fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa565400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa560072290 0x7fa5601fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97ff400700 1 -- 172.21.15.32:0/3630006516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 msgr2=0x7f97dc004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97ff400700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97dc004cf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009b50 tx=0x7f97dc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb542a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5440c9e90 0x7fb544158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa565400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600702c0 con 0x7fa56006e720 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa565400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600c6f10 con 0x7fa560070450 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa565400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600ab800 con 0x7fa560072290 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa55f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa5601fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa55f400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa5601fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39704/0 (socket says 172.21.15.32:39704) 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa55f400700 1 -- 172.21.15.32:0/2552897714 learned_addr learned my addr 172.21.15.32:0/2552897714 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fa564a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa560072290 0x7fa5601fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97ff400700 1 -- 172.21.15.32:0/3630006516 shutdown_connections 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97ff400700 1 --2- 172.21.15.32:0/3630006516 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97dc004cf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f97ff400700 1 -- 172.21.15.32:0/3630006516 >> 172.21.15.32:0/3630006516 conn(0x7f97f80c8ad0 msgr2=0x7f97f80c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb542a00700 1 -- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5440ca840 msgr2=0x7fb5441594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f101aa00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1004066780 0x7f1004068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f101c057460 con 0x7f10240aa3d0 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb542a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5440ca840 0x7fb5441594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb542a00700 1 -- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb54406ea50 msgr2=0x7fb544070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb542a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb54406ea50 0x7fb544070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7fb542a00700 1 -- 172.21.15.32:0/823573130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300094b0 con 0x7fb5440c9e90 2024-09-13T18:47:28.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f97ff400700 1 -- 172.21.15.32:0/3630006516 shutdown_connections 2024-09-13T18:47:28.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f101aa00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1004070c90 0x7f1004073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1004073800 con 0x7f1004070c90 2024-09-13T18:47:28.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42fc071ca0 0x7f42fc0bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc072080 0x7f42fc0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc124560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc126000 con 0x7f42fc071ca0 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc1262e0 con 0x7f42fc072080 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f4301a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc1265c0 con 0x7f42fc0c75c0 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.822+0000 7f8b87400700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8b68066800 0x7f8b68068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f1022a00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1004066780 0x7f1004068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f101c056b30 con 0x7f10240aa3d0 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa564a00700 1 -- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 msgr2=0x7fa5601fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa564a00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa560070450 0x7fa5601fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa564a00700 1 -- 172.21.15.32:0/2552897714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56006e720 msgr2=0x7fa560154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa564a00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56006e720 0x7fa560154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa564a00700 1 -- 172.21.15.32:0/2552897714 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0094b0 con 0x7fa560072290 2024-09-13T18:47:28.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc124560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc124560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52562/0 (socket says 172.21.15.32:52562) 2024-09-13T18:47:28.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 -- 172.21.15.32:0/2561354155 learned_addr learned my addr 172.21.15.32:0/2561354155 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fa000700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc072080 0x7f42fc0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8b740862d0 con 0x7f8b8004f060 2024-09-13T18:47:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f97ff400700 1 -- 172.21.15.32:0/3630006516 wait complete. 2024-09-13T18:47:28.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b7b400700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f8b68070060 0x7f8b68072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b68072bd0 con 0x7f8b68070060 2024-09-13T18:47:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b74086680 con 0x7f8b8004f060 2024-09-13T18:47:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fb542a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5440c9e90 0x7fb544158f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5440c9390 tx=0x7fb53400eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f1022000700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1004070c90 0x7f1004073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa564a00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa560072290 0x7fa5601fdca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa54c015000 tx=0x7fa54c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 -- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc072080 msgr2=0x7f42fc0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc072080 0x7f42fc0c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 -- 172.21.15.32:0/2561354155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42fc071ca0 msgr2=0x7f42fc0bfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f42fc071ca0 0x7f42fc0bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 -- 172.21.15.32:0/2561354155 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80094b0 con 0x7f42fc0c75c0 2024-09-13T18:47:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42fb400700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc124560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42f400eed0 tx=0x7f42f400ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b87400700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8b68066800 0x7f8b68068cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0096b0 tx=0x7f8b7c006c30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa940233e0 con 0x7faaa40721b0 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa9b400700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7faa80066780 0x7faa80068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3814003bd0 con 0x7f381804ad40 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f3813e00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3800066780 0x7f3800068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f3814021030 con 0x7f381804ad40 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f3813e00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3800070d60 0x7f3800073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38000738d0 con 0x7f3800070d60 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3814003e80 con 0x7f381804ad40 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b87e00700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f8b68070060 0x7f8b68072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f8b87e00700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f8b68070060 0x7f8b68072500 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534004020 con 0x7fb5440c9e90 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534004180 con 0x7fb5440c9e90 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534004510 con 0x7fb5440c9e90 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5441524b0 con 0x7fb5440c9e90 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb544152c70 con 0x7fb5440c9e90 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5440c9690 con 0x7fb5440c9e90 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7faa94055df0 con 0x7faaa40721b0 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa9b400700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7faa80070d60 0x7faa80073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa800738d0 con 0x7faa80070d60 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa940554c0 con 0x7faaa40721b0 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faa99e00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7faa80066780 0x7faa80068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7faaa3200700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7faa80070d60 0x7faa80073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7faa99e00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7faa80066780 0x7faa80068c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faaa4072af0 tx=0x7faa8c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f1022000700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1004070c90 0x7f1004073130 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f1022a00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1004066780 0x7f1004068c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1014004f70 tx=0x7f1014009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4010040 con 0x7f42fc0c75c0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f400baa0 con 0x7f42fc0c75c0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec009570 con 0x7f42fc0c75c0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc124040 con 0x7f42fc0c75c0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f400be30 con 0x7f42fc0c75c0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42fc123ec0 con 0x7f42fc0c75c0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f97ff400700 1 Processor -- start 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7f97ff400700 1 -- start start 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97ff400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97f81f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97ff400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97f80cb950 0x7f97f81dc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97ff400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97f80c5230 0x7f97f8148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97ff400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f81e0d90 con 0x7f97dc004870 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97ff400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c4da0 con 0x7f97f80c5230 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97ff400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f81e07d0 con 0x7f97f80cb950 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f3824a00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3800070d60 0x7f3800073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f381fe00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3800066780 0x7f3800068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f381fe00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3800066780 0x7f3800068c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3820068c30 tx=0x7f382008e040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f3824a00700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3800070d60 0x7f3800073200 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8b68072bd0 con 0x7f8b68070060 2024-09-13T18:47:28.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7faaa3200700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7faa80070d60 0x7faa80073200 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1004073800 con 0x7f1004070c90 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c006ea0 con 0x7fa560072290 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c01f070 con 0x7fa560072290 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.826+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c011630 con 0x7fa560072290 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600aaa20 con 0x7fa560072290 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5601fcf60 con 0x7fa560072290 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42f4026430 con 0x7f42fc0c75c0 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42f2a00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f42dc066760 0x7f42dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f42f4085050 con 0x7f42fc0c75c0 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97efe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97f80cb950 0x7f97f81dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fd400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97f80c5230 0x7f97f8148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97efe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97f80cb950 0x7f97f81dc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52570/0 (socket says 172.21.15.32:52570) 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97efe00700 1 -- 172.21.15.32:0/3920089820 learned_addr learned my addr 172.21.15.32:0/3920089820 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fca00700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97f81f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fca00700 1 -- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97f80cb950 msgr2=0x7f97f81dc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fca00700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97f80cb950 0x7f97f81dc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fca00700 1 -- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97f80c5230 msgr2=0x7f97f8148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fca00700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97f80c5230 0x7f97f8148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f97fca00700 1 -- 172.21.15.32:0/3920089820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f81e0ab0 con 0x7f97dc004870 2024-09-13T18:47:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5340036c0 con 0x7fb5440c9e90 2024-09-13T18:47:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42f2a00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f42dc06ff40 0x7f42dc0723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42dc072ab0 con 0x7f42dc06ff40 2024-09-13T18:47:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42f40853c0 con 0x7f42fc0c75c0 2024-09-13T18:47:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7f42faa00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f42dc066760 0x7f42dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f42fa000700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f42dc06ff40 0x7f42dc0723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f42faa00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f42dc066760 0x7f42dc068c20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009c30 tx=0x7f42ec010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97fca00700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97f81f3d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97e8001050 tx=0x7f97e8007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8011580 con 0x7f97dc004870 2024-09-13T18:47:28.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8011720 con 0x7f97dc004870 2024-09-13T18:47:28.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8011ad0 con 0x7f97dc004870 2024-09-13T18:47:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb53b400700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5240667b0 0x7fb524068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f42fa000700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f42dc06ff40 0x7f42dc0723e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f80c4750 con 0x7f97dc004870 2024-09-13T18:47:28.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f81dd020 con 0x7f97dc004870 2024-09-13T18:47:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb534084190 con 0x7fb5440c9e90 2024-09-13T18:47:28.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb543400700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5240667b0 0x7fb524068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7faa800738d0 con 0x7faa80070d60 2024-09-13T18:47:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.830+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa56015d370 con 0x7fa560072290 2024-09-13T18:47:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f42dc072ab0 con 0x7f42dc06ff40 2024-09-13T18:47:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97f8072500 con 0x7f97dc004870 2024-09-13T18:47:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb53b400700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb524070010 0x7fb5240724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb524072b80 con 0x7fb524070010 2024-09-13T18:47:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb534084500 con 0x7fb5440c9e90 2024-09-13T18:47:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb543e00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb524070010 0x7fb5240724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb543400700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5240667b0 0x7fb524068c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb5300090b0 tx=0x7fb530008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa54c021030 con 0x7fa560072290 2024-09-13T18:47:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.834+0000 7fb543e00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb524070010 0x7fb5240724b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97e8011c30 con 0x7f97dc004870 2024-09-13T18:47:28.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb524072b80 con 0x7fb524070010 2024-09-13T18:47:28.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f38000738d0 con 0x7f3800070d60 2024-09-13T18:47:28.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa557e00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa540066780 0x7fa540068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fa54c085f40 con 0x7fa560072290 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa557e00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa54006ffe0 0x7fa540072480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa540072b50 con 0x7fa54006ffe0 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa54c0862b0 con 0x7fa560072290 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa55fe00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa540066780 0x7fa540068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7fa55fe00700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa540066780 0x7fa540068c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5580012e0 tx=0x7fa558001660 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97f5600700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f97d40667b0 0x7f97d4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.842+0000 7fa55f400700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa54006ffe0 0x7fa540072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f97e8084d50 con 0x7f97dc004870 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97f5600700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f97d4070010 0x7f97d40724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97d4072b80 con 0x7f97d4070010 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97e80851f0 con 0x7f97dc004870 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97efe00700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f97d40667b0 0x7f97d4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97fd400700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f97d4070010 0x7f97d40724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97fd400700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f97d4070010 0x7f97d40724b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.838+0000 7f97efe00700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f97d40667b0 0x7f97d4068c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f97f80c14b0 tx=0x7f97e0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.842+0000 7fa55f400700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa54006ffe0 0x7fa540072480 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.842+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f97d4072b80 con 0x7f97d4070010 2024-09-13T18:47:28.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.842+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa540072b50 con 0x7fa54006ffe0 2024-09-13T18:47:28.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faaa415cfd0 con 0x7faa80070d60 2024-09-13T18:47:28.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faa9b400700 1 -- 172.21.15.32:0/459718233 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa9c00f040 con 0x7faa80070d60 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7faa80070d60 msgr2=0x7faa80073200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7faa80070d60 0x7faa80073200 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7faa80066780 msgr2=0x7faa80068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7faa80066780 0x7faa80068c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faaa4072af0 tx=0x7faa8c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40721b0 msgr2=0x7faaa415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 --2- 172.21.15.32:0/459718233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40721b0 0x7faaa415baa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c7f0 tx=0x7faa9400cbb0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa3200700 1 -- 172.21.15.32:0/459718233 reap_dead start 2024-09-13T18:47:28.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 shutdown_connections 2024-09-13T18:47:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 >> 172.21.15.32:0/459718233 conn(0x7faaa40cbfe0 msgr2=0x7faaa40b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 shutdown_connections 2024-09-13T18:47:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.858+0000 7faaa8a00700 1 -- 172.21.15.32:0/459718233 wait complete. 2024-09-13T18:47:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.862+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1024066970 con 0x7f1004070c90 2024-09-13T18:47:28.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.862+0000 7f101aa00700 1 -- 172.21.15.32:0/831399614 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1024066970 con 0x7f1004070c90 2024-09-13T18:47:28.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.862+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b80006820 con 0x7f8b68070060 2024-09-13T18:47:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.862+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1004070c90 msgr2=0x7f1004073130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.862+0000 7f1029c00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7f1004070c90 0x7f1004073130 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.862+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1004066780 msgr2=0x7f1004068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1004066780 0x7f1004068c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1014004f70 tx=0x7f1014009040 comp rx=0 tx=0).stop 2024-09-13T18:47:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10240aa3d0 msgr2=0x7f10240ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 --2- 172.21.15.32:0/831399614 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10240aa3d0 0x7f10240ac2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f101c004000 tx=0x7f101c004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1023400700 1 -- 172.21.15.32:0/831399614 reap_dead start 2024-09-13T18:47:28.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 shutdown_connections 2024-09-13T18:47:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 >> 172.21.15.32:0/831399614 conn(0x7f10240cad40 msgr2=0x7f10240cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 shutdown_connections 2024-09-13T18:47:28.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f1029c00700 1 -- 172.21.15.32:0/831399614 wait complete. 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f8b7b400700 1 -- 172.21.15.32:0/395737399 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b8804ec20 con 0x7f8b68070060 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f8b68070060 msgr2=0x7f8b68072500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.866+0000 7f8b8e800700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f8b68070060 0x7f8b68072500 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8b68066800 msgr2=0x7f8b68068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8b68066800 0x7f8b68068cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0096b0 tx=0x7f8b7c006c30 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b8004f060 msgr2=0x7f8b8004c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 --2- 172.21.15.32:0/395737399 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b8004f060 0x7f8b8004c720 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8b800060c0 tx=0x7f8b74004770 comp rx=0 tx=0).stop 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b87e00700 1 -- 172.21.15.32:0/395737399 reap_dead start 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 shutdown_connections 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 >> 172.21.15.32:0/395737399 conn(0x7f8b80054070 msgr2=0x7f8b800512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 shutdown_connections 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f8b8e800700 1 -- 172.21.15.32:0/395737399 wait complete. 2024-09-13T18:47:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97f8070300 con 0x7f97d4070010 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97f5600700 1 -- 172.21.15.32:0/3920089820 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f97f0004a30 con 0x7f97d4070010 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f97d4070010 msgr2=0x7f97d40724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f97d4070010 0x7f97d40724b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f97d40667b0 msgr2=0x7f97d4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f97d40667b0 0x7f97d4068c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f97f80c14b0 tx=0x7f97e0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 msgr2=0x7f97f81f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 --2- 172.21.15.32:0/3920089820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97dc004870 0x7f97f81f3d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97e8001050 tx=0x7f97e8007570 comp rx=0 tx=0).stop 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97fd400700 1 -- 172.21.15.32:0/3920089820 reap_dead start 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 shutdown_connections 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 >> 172.21.15.32:0/3920089820 conn(0x7f97f80c8ad0 msgr2=0x7f97f80c6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 shutdown_connections 2024-09-13T18:47:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.870+0000 7f97ff400700 1 -- 172.21.15.32:0/3920089820 wait complete. 2024-09-13T18:47:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb54406ee30 con 0x7fb524070010 2024-09-13T18:47:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7fb53b400700 1 -- 172.21.15.32:0/823573130 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb53c001ff0 con 0x7fb524070010 2024-09-13T18:47:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb524070010 msgr2=0x7fb5240724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42fc0a9840 con 0x7f42dc06ff40 2024-09-13T18:47:28.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7fb548a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7fb524070010 0x7fb5240724b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.927 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38180060f0 con 0x7f3800070d60 2024-09-13T18:47:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5240667b0 msgr2=0x7fb524068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.874+0000 7fb548a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb5240667b0 0x7fb524068c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb5300090b0 tx=0x7fb530008030 comp rx=0 tx=0).stop 2024-09-13T18:47:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5440c9e90 msgr2=0x7fb544158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb548a00700 1 --2- 172.21.15.32:0/823573130 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5440c9e90 0x7fb544158f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5440c9390 tx=0x7fb53400eb00 comp rx=0 tx=0).stop 2024-09-13T18:47:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb543e00700 1 -- 172.21.15.32:0/823573130 reap_dead start 2024-09-13T18:47:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa56015d090 con 0x7fa54006ffe0 2024-09-13T18:47:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 shutdown_connections 2024-09-13T18:47:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 >> 172.21.15.32:0/823573130 conn(0x7fb5440cac60 msgr2=0x7fb5440c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 shutdown_connections 2024-09-13T18:47:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f42f2a00700 1 -- 172.21.15.32:0/2561354155 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42e8009330 con 0x7f42dc06ff40 2024-09-13T18:47:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fb548a00700 1 -- 172.21.15.32:0/823573130 wait complete. 2024-09-13T18:47:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa557e00700 1 -- 172.21.15.32:0/2552897714 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa550004b70 con 0x7fa54006ffe0 2024-09-13T18:47:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3813e00700 1 -- 172.21.15.32:0/619535198 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f380c004b70 con 0x7f3800070d60 2024-09-13T18:47:28.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f42dc06ff40 msgr2=0x7f42dc0723e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f42dc06ff40 0x7f42dc0723e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3800070d60 msgr2=0x7f3800073200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.931 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f3800070d60 0x7f3800073200 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa54006ffe0 msgr2=0x7fa540072480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa54006ffe0 0x7fa540072480 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f42dc066760 msgr2=0x7f42dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f42dc066760 0x7f42dc068c20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009c30 tx=0x7f42ec010000 comp rx=0 tx=0).stop 2024-09-13T18:47:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 msgr2=0x7f42fc124560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 --2- 172.21.15.32:0/2561354155 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc0c75c0 0x7f42fc124560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42f400eed0 tx=0x7f42f400ef00 comp rx=0 tx=0).stop 2024-09-13T18:47:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3800066780 msgr2=0x7f3800068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3800066780 0x7f3800068c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3820068c30 tx=0x7f382008e040 comp rx=0 tx=0).stop 2024-09-13T18:47:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa540066780 msgr2=0x7fa540068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa540066780 0x7fa540068c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5580012e0 tx=0x7fa558001660 comp rx=0 tx=0).stop 2024-09-13T18:47:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa560072290 msgr2=0x7fa5601fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 --2- 172.21.15.32:0/2552897714 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa560072290 0x7fa5601fdca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa54c015000 tx=0x7fa54c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f381804ad40 msgr2=0x7f38180cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 --2- 172.21.15.32:0/619535198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f381804ad40 0x7f38180cf730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3814016000 tx=0x7f3814004770 comp rx=0 tx=0).stop 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3824a00700 1 -- 172.21.15.32:0/619535198 reap_dead start 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 shutdown_connections 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 >> 172.21.15.32:0/619535198 conn(0x7f381804fd00 msgr2=0x7f38180d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa564a00700 1 -- 172.21.15.32:0/2552897714 reap_dead start 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 shutdown_connections 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 >> 172.21.15.32:0/2552897714 conn(0x7fa5600cac60 msgr2=0x7fa5601300b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 shutdown_connections 2024-09-13T18:47:28.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f42fb400700 1 -- 172.21.15.32:0/2561354155 reap_dead start 2024-09-13T18:47:28.935 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7fa565400700 1 -- 172.21.15.32:0/2552897714 wait complete. 2024-09-13T18:47:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 shutdown_connections 2024-09-13T18:47:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 >> 172.21.15.32:0/2561354155 conn(0x7f42fc0cad40 msgr2=0x7f42fc06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 shutdown_connections 2024-09-13T18:47:28.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 shutdown_connections 2024-09-13T18:47:28.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f3811600700 1 -- 172.21.15.32:0/619535198 wait complete. 2024-09-13T18:47:28.937 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:28.878+0000 7f4301a00700 1 -- 172.21.15.32:0/2561354155 wait complete. 2024-09-13T18:47:28.937 INFO:teuthology.orchestra.run.smithi032.stdout:64424509474 2024-09-13T18:47:28.938 INFO:teuthology.orchestra.run.smithi032.stdout:60129542180 2024-09-13T18:47:28.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:47:28.939 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:47:28.940 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-13T18:47:28.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:47:28.941 INFO:teuthology.orchestra.run.smithi032.stdout:64424509477 2024-09-13T18:47:28.941 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:47:28.942 INFO:teuthology.orchestra.run.smithi032.stdout:64424509476 2024-09-13T18:47:28.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:47:28.943 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-13T18:47:28.943 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:47:28.944 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-13T18:47:28.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:47:28.945 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-13T18:47:28.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:47:29.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.210+0000 7f5510c00700 1 Processor -- start 2024-09-13T18:47:29.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.210+0000 7f5510c00700 1 -- start start 2024-09-13T18:47:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f5510c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f5510c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c15a560 con 0x7f550c073990 2024-09-13T18:47:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f5510c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c06d5e0 con 0x7f550c159ac0 2024-09-13T18:47:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f5510c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c159fa0 con 0x7f550c06f530 2024-09-13T18:47:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550aa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.221 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550be00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f550c159ac0 0x7f550c1533c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44880/0 (socket says 172.21.15.32:44880) 2024-09-13T18:47:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550be00700 1 -- 172.21.15.32:0/191926085 learned_addr learned my addr 172.21.15.32:0/191926085 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550a000700 1 -- 172.21.15.32:0/191926085 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568954530 0 0) 0x7f550c06d5e0 con 0x7f550c159ac0 2024-09-13T18:47:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550a000700 1 -- 172.21.15.32:0/191926085 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f00035d0 con 0x7f550c159ac0 2024-09-13T18:47:29.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550aa00700 1 -- 172.21.15.32:0/191926085 >> v1:172.21.15.86:6789/0 conn(0x7f550c159ac0 legacy=0x7f550c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550aa00700 1 -- 172.21.15.32:0/191926085 >> v1:172.21.15.32:6789/0 conn(0x7f550c073990 legacy=0x7f550c06ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f550aa00700 1 -- 172.21.15.32:0/191926085 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c15a280 con 0x7f550c06f530 2024-09-13T18:47:29.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.214+0000 7f4e40e00700 1 Processor -- start 2024-09-13T18:47:29.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 Processor -- start 2024-09-13T18:47:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e40e00700 1 -- start start 2024-09-13T18:47:29.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 -- start start 2024-09-13T18:47:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f550aa00700 1 --2- 172.21.15.32:0/191926085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c159580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009880 tx=0x7f54f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4129823f13d1be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f6f77200700 1 Processor -- start 2024-09-13T18:47:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e40e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c151ab0 0x7f4e3c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e40e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e3c06ae20 0x7f4e3c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e40e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0c28d0 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e40e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c4150 con 0x7f4e3c06ae20 2024-09-13T18:47:29.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e40e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c2310 con 0x7f4e3c151ab0 2024-09-13T18:47:29.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e39e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c151ab0 0x7f4e3c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e39400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e3c06ae20 0x7f4e3c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e39400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4e3c06ae20 0x7f4e3c0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39732/0 (socket says 172.21.15.32:39732) 2024-09-13T18:47:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f4e39400700 1 -- 172.21.15.32:0/2041576949 learned_addr learned my addr 172.21.15.32:0/2041576949 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd08067520 0x7fcd08156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd0806da30 0x7fcd0814f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 0x7fcd0806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080c2cf0 con 0x7fcd0806da30 2024-09-13T18:47:29.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080c50b0 con 0x7fcd080c62d0 2024-09-13T18:47:29.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd07200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081565b0 con 0x7fcd08067520 2024-09-13T18:47:29.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd05e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd08067520 0x7fcd08156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd06800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 0x7fcd0806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd05400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcd0806da30 0x7fcd0814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd06800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 0x7fcd0806cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39738/0 (socket says 172.21.15.32:39738) 2024-09-13T18:47:29.228 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7fcd06800700 1 -- 172.21.15.32:0/3908653264 learned_addr learned my addr 172.21.15.32:0/3908653264 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.218+0000 7f6f77200700 1 -- start start 2024-09-13T18:47:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 Processor -- start 2024-09-13T18:47:29.229 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f550a000700 1 -- 172.21.15.32:0/191926085 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011830 con 0x7f550c06f530 2024-09-13T18:47:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f550a000700 1 -- 172.21.15.32:0/191926085 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8011990 con 0x7f550c06f530 2024-09-13T18:47:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f550a000700 1 -- 172.21.15.32:0/191926085 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011d20 con 0x7f550c06f530 2024-09-13T18:47:29.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 -- start start 2024-09-13T18:47:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e39400700 1 -- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c151ab0 msgr2=0x7f4e3c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e39400700 1 --2- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c151ab0 0x7f4e3c06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e39400700 1 -- 172.21.15.32:0/2041576949 >> v1:172.21.15.86:6789/0 conn(0x7f4e3c0ca7e0 legacy=0x7f4e3c0cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd05400700 1 -- 172.21.15.32:0/3908653264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd08067520 msgr2=0x7fcd08156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd05400700 1 --2- 172.21.15.32:0/3908653264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd08067520 0x7fcd08156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd05400700 1 -- 172.21.15.32:0/3908653264 >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 msgr2=0x7fcd0806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd05400700 1 --2- 172.21.15.32:0/3908653264 >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 0x7fcd0806cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd05400700 1 -- 172.21.15.32:0/3908653264 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0814fd80 con 0x7fcd0806da30 2024-09-13T18:47:29.232 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e39400700 1 -- 172.21.15.32:0/2041576949 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0c25f0 con 0x7f4e3c06ae20 2024-09-13T18:47:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f77200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6f7815e670 0x7f6f78070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd06800700 1 --2- 172.21.15.32:0/3908653264 >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 0x7fcd0806cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f77200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f780cbe00 0x7f6f780cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f77200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780701e0 con 0x7f6f780caf00 2024-09-13T18:47:29.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f77200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f780b2fd0 con 0x7f6f7815e670 2024-09-13T18:47:29.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f77200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780b3290 con 0x7f6f780cbe00 2024-09-13T18:47:29.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7fcd05400700 1 --2- 172.21.15.32:0/3908653264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0806da30 0x7fcd0814f840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd080c9090 tx=0x7fcd0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27680f4f23ea858e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f76800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6f780caf00 0x7f6f780cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44906/0 (socket says 172.21.15.32:44906) 2024-09-13T18:47:29.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e39400700 1 --2- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c0ca2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009910 tx=0x7f4e2c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c77e13612e65c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f76800700 1 -- 172.21.15.32:0/4134661548 learned_addr learned my addr 172.21.15.32:0/4134661548 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:29.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e38a00700 1 -- 172.21.15.32:0/2041576949 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c004230 con 0x7f4e3c06ae20 2024-09-13T18:47:29.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e38a00700 1 -- 172.21.15.32:0/2041576949 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c004390 con 0x7f4e3c06ae20 2024-09-13T18:47:29.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e38a00700 1 -- 172.21.15.32:0/2041576949 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0036c0 con 0x7f4e3c06ae20 2024-09-13T18:47:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 -- 172.21.15.32:0/191926085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 msgr2=0x7f550c159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 --2- 172.21.15.32:0/191926085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c159580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009880 tx=0x7f54f8009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f74a00700 1 -- 172.21.15.32:0/4134661548 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690101285 0 0) 0x7f6f780701e0 con 0x7f6f780caf00 2024-09-13T18:47:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f74a00700 1 -- 172.21.15.32:0/4134661548 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5c0035d0 con 0x7f6f780caf00 2024-09-13T18:47:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f75e00700 1 --2- 172.21.15.32:0/4134661548 >> v2:172.21.15.86:3300/0 conn(0x7f6f7815e670 0x7f6f78070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f75400700 1 --2- 172.21.15.32:0/4134661548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f780cbe00 0x7f6f780cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 -- 172.21.15.32:0/191926085 shutdown_connections 2024-09-13T18:47:29.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406ea50 0x7f02c415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.237 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 --2- 172.21.15.32:0/191926085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c159580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f02c406fac0 0x7f02c406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 -- 172.21.15.32:0/191926085 >> 172.21.15.32:0/191926085 conn(0x7f550c0c8a60 msgr2=0x7f550c0c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40c9440 con 0x7f02c40c9e90 2024-09-13T18:47:29.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c40c9a70 con 0x7f02c406fac0 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02ca400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c40c7aa0 con 0x7f02c406ea50 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02c9000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406ea50 0x7f02c415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02c3e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f02c40c9e90 0x7f02c40ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44918/0 (socket says 172.21.15.32:44918) 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02c3e00700 1 -- 172.21.15.32:0/746110543 learned_addr learned my addr 172.21.15.32:0/746110543 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f02c9a00700 1 --2- 172.21.15.32:0/746110543 >> v2:172.21.15.86:3300/0 conn(0x7f02c406fac0 0x7f02c406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 -- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c06ae20 msgr2=0x7f4e3c0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 --2- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c0ca2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009910 tx=0x7f4e2c009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 -- 172.21.15.32:0/2041576949 shutdown_connections 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 --2- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c0ca2a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 --2- 172.21.15.32:0/2041576949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c151ab0 0x7f4e3c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 -- 172.21.15.32:0/2041576949 >> 172.21.15.32:0/2041576949 conn(0x7f4e3c06eae0 msgr2=0x7f4e3c06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 -- 172.21.15.32:0/2041576949 shutdown_connections 2024-09-13T18:47:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f4e40e00700 1 -- 172.21.15.32:0/2041576949 wait complete. 2024-09-13T18:47:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd04a00700 1 -- 172.21.15.32:0/3908653264 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000e070 con 0x7fcd0806da30 2024-09-13T18:47:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd04a00700 1 -- 172.21.15.32:0/3908653264 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000bb20 con 0x7fcd0806da30 2024-09-13T18:47:29.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd04a00700 1 -- 172.21.15.32:0/3908653264 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00012430 con 0x7fcd0806da30 2024-09-13T18:47:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f75400700 1 -- 172.21.15.32:0/4134661548 >> v2:172.21.15.86:3300/0 conn(0x7f6f7815e670 msgr2=0x7f6f78070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f75400700 1 --2- 172.21.15.32:0/4134661548 >> v2:172.21.15.86:3300/0 conn(0x7f6f7815e670 0x7f6f78070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f75400700 1 -- 172.21.15.32:0/4134661548 >> v1:172.21.15.86:6789/0 conn(0x7f6f780caf00 legacy=0x7f6f780cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f6f74a00700 1 -- 172.21.15.32:0/4134661548 <== mon.1 v1:172.21.15.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2380966075 0 0) 0x7f6f5c0035d0 con 0x7f6f780caf00 2024-09-13T18:47:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f75400700 1 -- 172.21.15.32:0/4134661548 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780b3550 con 0x7f6f780cbe00 2024-09-13T18:47:29.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f75e00700 1 --2- 172.21.15.32:0/4134661548 >> v2:172.21.15.86:3300/0 conn(0x7f6f7815e670 0x7f6f78070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c9000700 1 -- 172.21.15.32:0/746110543 >> v2:172.21.15.86:3300/0 conn(0x7f02c406fac0 msgr2=0x7f02c406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c9000700 1 --2- 172.21.15.32:0/746110543 >> v2:172.21.15.86:3300/0 conn(0x7f02c406fac0 0x7f02c406ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c9000700 1 -- 172.21.15.32:0/746110543 >> v1:172.21.15.86:6789/0 conn(0x7f02c40c9e90 legacy=0x7f02c40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c3400700 1 -- 172.21.15.32:0/746110543 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196700292 0 0) 0x7f02c40c9440 con 0x7f02c40c9e90 2024-09-13T18:47:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c9000700 1 -- 172.21.15.32:0/746110543 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40c7d60 con 0x7f02c406ea50 2024-09-13T18:47:29.242 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f75400700 1 --2- 172.21.15.32:0/4134661548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f780cbe00 0x7f6f780cc250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009850 tx=0x7f6f64009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf74678a88a532d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 -- 172.21.15.32:0/191926085 shutdown_connections 2024-09-13T18:47:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.222+0000 7f5510c00700 1 -- 172.21.15.32:0/191926085 wait complete. 2024-09-13T18:47:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f5510c00700 1 Processor -- start 2024-09-13T18:47:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f74a00700 1 -- 172.21.15.32:0/4134661548 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68001650 con 0x7f6f780cbe00 2024-09-13T18:47:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f74a00700 1 -- 172.21.15.32:0/4134661548 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64004030 con 0x7f6f780cbe00 2024-09-13T18:47:29.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f74a00700 1 -- 172.21.15.32:0/4134661548 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640043a0 con 0x7f6f780cbe00 2024-09-13T18:47:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 Processor -- start 2024-09-13T18:47:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 -- 172.21.15.32:0/3908653264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0806da30 msgr2=0x7fcd0814f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 --2- 172.21.15.32:0/3908653264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0806da30 0x7fcd0814f840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd080c9090 tx=0x7fcd0000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 -- start start 2024-09-13T18:47:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c9000700 1 --2- 172.21.15.32:0/746110543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406ea50 0x7f02c415aa70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009850 tx=0x7f02b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4c7d46663abe64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c3400700 1 -- 172.21.15.32:0/746110543 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4011830 con 0x7f02c406ea50 2024-09-13T18:47:29.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c3400700 1 -- 172.21.15.32:0/746110543 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4011990 con 0x7f02c406ea50 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02c3400700 1 -- 172.21.15.32:0/746110543 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4011d40 con 0x7f02c406ea50 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02ca400700 1 -- 172.21.15.32:0/746110543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406ea50 msgr2=0x7f02c415aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f02ca400700 1 --2- 172.21.15.32:0/746110543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406ea50 0x7f02c415aa70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009850 tx=0x7f02b4009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f02ca400700 1 -- 172.21.15.32:0/746110543 shutdown_connections 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f02ca400700 1 --2- 172.21.15.32:0/746110543 >> v2:172.21.15.86:3300/0 conn(0x7f02c406fac0 0x7f02c406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f02ca400700 1 --2- 172.21.15.32:0/746110543 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406ea50 0x7f02c415aa70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f02ca400700 1 -- 172.21.15.32:0/746110543 >> 172.21.15.32:0/746110543 conn(0x7f02c40cac60 msgr2=0x7f02c40cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 -- 172.21.15.32:0/4134661548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f780cbe00 msgr2=0x7f6f780cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.246 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 --2- 172.21.15.32:0/4134661548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f780cbe00 0x7f6f780cc250 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009850 tx=0x7f6f64009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 -- 172.21.15.32:0/4134661548 shutdown_connections 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 --2- 172.21.15.32:0/4134661548 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f780cbe00 0x7f6f780cc250 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 --2- 172.21.15.32:0/4134661548 >> v2:172.21.15.86:3300/0 conn(0x7f6f7815e670 0x7f6f78070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 -- 172.21.15.32:0/4134661548 >> 172.21.15.32:0/4134661548 conn(0x7f6f78071d30 msgr2=0x7f6f78072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 -- 172.21.15.32:0/4134661548 shutdown_connections 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f6f77200700 1 -- 172.21.15.32:0/4134661548 wait complete. 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fc56d200700 1 Processor -- start 2024-09-13T18:47:29.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 -- 172.21.15.32:0/3908653264 shutdown_connections 2024-09-13T18:47:29.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 --2- 172.21.15.32:0/3908653264 >> v2:172.21.15.86:3300/0 conn(0x7fcd080c62d0 0x7fcd0806cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 --2- 172.21.15.32:0/3908653264 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd0806da30 0x7fcd0814f840 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 --2- 172.21.15.32:0/3908653264 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd08067520 0x7fcd08156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 -- 172.21.15.32:0/3908653264 >> 172.21.15.32:0/3908653264 conn(0x7fcd0806a390 msgr2=0x7fcd0806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 -- 172.21.15.32:0/3908653264 shutdown_connections 2024-09-13T18:47:29.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7fcd07200700 1 -- 172.21.15.32:0/3908653264 wait complete. 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 0x7f4e3c13fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c151ab0 0x7f4e3c13ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c141bc0 con 0x7f4e3c06ae20 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1430c0 con 0x7f4e3c151ab0 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e40e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c1f3200 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e39400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 0x7f4e3c13fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e39400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 0x7f4e3c13fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52638/0 (socket says 172.21.15.32:52638) 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f4e39400700 1 -- 172.21.15.32:0/3916768103 learned_addr learned my addr 172.21.15.32:0/3916768103 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e3a800700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c151ab0 0x7f4e3c13ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39400700 1 -- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c151ab0 msgr2=0x7f4e3c13ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39400700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c151ab0 0x7f4e3c13ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39400700 1 -- 172.21.15.32:0/3916768103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e3c06ae20 msgr2=0x7f4e3c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39400700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39400700 1 -- 172.21.15.32:0/3916768103 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c009570 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f5510c00700 1 -- start start 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f5510c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f5510c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f550c073990 0x7f550c0c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f5510c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f550c159ac0 0x7f550c151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f550b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f550b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52622/0 (socket says 172.21.15.32:52622) 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f550aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f550c073990 0x7f550c0c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f550b400700 1 -- 172.21.15.32:0/1060016050 learned_addr learned my addr 172.21.15.32:0/1060016050 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c15cad0 con 0x7f550c159ac0 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.226+0000 7f550be00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f550c159ac0 0x7f550c151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c156d00 con 0x7f550c073990 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c15c7f0 con 0x7f550c06f530 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f550aa00700 1 -- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 msgr2=0x7f550c070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f550aa00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f550aa00700 1 -- 172.21.15.32:0/1060016050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f550c159ac0 msgr2=0x7f550c151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f550aa00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f550c159ac0 0x7f550c151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fc56d200700 1 -- start start 2024-09-13T18:47:29.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f550aa00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80094b0 con 0x7f550c073990 2024-09-13T18:47:29.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 Processor -- start 2024-09-13T18:47:29.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f02ca400700 1 -- 172.21.15.32:0/746110543 shutdown_connections 2024-09-13T18:47:29.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 -- start start 2024-09-13T18:47:29.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f02ca400700 1 -- 172.21.15.32:0/746110543 wait complete. 2024-09-13T18:47:29.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e39400700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 0x7f4e3c13fa50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0cacf0 tx=0x7f4e2c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f550aa00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f550c073990 0x7f550c0c3d20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f550c06bfc0 tx=0x7f54f8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c003e30 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c011840 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c011bf0 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80036c0 con 0x7f550c073990 2024-09-13T18:47:29.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f801e070 con 0x7f550c073990 2024-09-13T18:47:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f6f77200700 1 Processor -- start 2024-09-13T18:47:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fc56d200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc568157e30 0x7fc56806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 0x7fcd081501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0806da30 0x7fcd081ee330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd080c62d0 0x7fcd08147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08151470 con 0x7fcd08067520 2024-09-13T18:47:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08154af0 con 0x7fcd0806da30 2024-09-13T18:47:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7fcd07200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081edea0 con 0x7fcd080c62d0 2024-09-13T18:47:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c156a20 con 0x7f550c073990 2024-09-13T18:47:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c1fc330 con 0x7f550c073990 2024-09-13T18:47:29.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8003a60 con 0x7f550c073990 2024-09-13T18:47:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 -- start start 2024-09-13T18:47:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f780caf00 0x7f6f780c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f780cbe00 0x7f6f781f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 0x7f6f7806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806b070 con 0x7f6f780caf00 2024-09-13T18:47:29.258 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7806b310 con 0x7f6f780cbe00 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f77200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780cece0 con 0x7f6f7815e670 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f8db2200700 1 Processor -- start 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc56d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc568070c40 0x7fc56806e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc56d200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680c2e30 con 0x7fc56806e940 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc56d200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680c6a40 con 0x7fc568157e30 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc56d200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568070010 con 0x7fc568070c40 2024-09-13T18:47:29.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc56806e940 0x7fc568070530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39786/0 (socket says 172.21.15.32:39786) 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565400700 1 -- 172.21.15.32:0/694685050 learned_addr learned my addr 172.21.15.32:0/694685050 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 0x7fcd081501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 0x7fcd081501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57754/0 (socket says 172.21.15.32:57754) 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 -- 172.21.15.32:0/1345553778 learned_addr learned my addr 172.21.15.32:0/1345553778 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd06800700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd080c62d0 0x7fcd08147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 -- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd080c62d0 msgr2=0x7fcd08147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd080c62d0 0x7fcd08147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 -- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0806da30 msgr2=0x7fcd081ee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0806da30 0x7fcd081ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 -- 172.21.15.32:0/1345553778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009570 con 0x7fcd08067520 2024-09-13T18:47:29.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd06800700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd080c62d0 0x7fcd08147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:29.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fcd05e00700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 0x7fcd081501b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fccf401f650 tx=0x7fccf401fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 Processor -- start 2024-09-13T18:47:29.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 -- start start 2024-09-13T18:47:29.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f02ca400700 1 Processor -- start 2024-09-13T18:47:29.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.230+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c0c44d0 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c141e10 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e4005310 con 0x7f550c073990 2024-09-13T18:47:29.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565e00700 1 --2- 172.21.15.32:0/694685050 >> v2:172.21.15.32:3300/0 conn(0x7fc568157e30 0x7fc56806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc566800700 1 --2- 172.21.15.32:0/694685050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc568070c40 0x7fc56806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f02ca400700 1 -- start start 2024-09-13T18:47:29.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c067a00 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 0x7f6f7806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f75e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f780caf00 0x7f6f780c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 0x7f6f7806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52658/0 (socket says 172.21.15.32:52658) 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f75e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f780caf00 0x7f6f780c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57760/0 (socket says 172.21.15.32:57760) 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f75e00700 1 -- 172.21.15.32:0/3934826342 learned_addr learned my addr 172.21.15.32:0/3934826342 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f75400700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f780cbe00 0x7f6f781f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565e00700 1 -- 172.21.15.32:0/694685050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc568070c40 msgr2=0x7fc56806e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565e00700 1 --2- 172.21.15.32:0/694685050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc568070c40 0x7fc56806e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565e00700 1 -- 172.21.15.32:0/694685050 >> v1:172.21.15.32:6789/0 conn(0x7fc56806e940 legacy=0x7fc568070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7fc565e00700 1 -- 172.21.15.32:0/694685050 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680c8820 con 0x7fc568157e30 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4904153850 0x7f49041596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49040c4160 0x7f49040c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49040c5110 con 0x7f4904153c30 2024-09-13T18:47:29.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490415a6d0 con 0x7f4904153850 2024-09-13T18:47:29.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f02ca400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 0x7f02c41f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4909000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4904159c20 con 0x7f49040c4160 2024-09-13T18:47:29.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4901400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4904153c30 0x7f49040ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44934/0 (socket says 172.21.15.32:44934) 2024-09-13T18:47:29.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f4901400700 1 -- 172.21.15.32:0/400357892 learned_addr learned my addr 172.21.15.32:0/400357892 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:29.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4024890 con 0x7fcd08067520 2024-09-13T18:47:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c9000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 0x7f02c41f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf40249f0 con 0x7fcd08067520 2024-09-13T18:47:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4024d80 con 0x7fcd08067520 2024-09-13T18:47:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd00009a70 con 0x7fcd08067520 2024-09-13T18:47:29.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c9000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 0x7f02c41f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57768/0 (socket says 172.21.15.32:57768) 2024-09-13T18:47:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 -- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f780cbe00 msgr2=0x7f6f781f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f780cbe00 0x7f6f781f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 -- 172.21.15.32:0/3934826342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f780caf00 msgr2=0x7f6f780c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f780caf00 0x7f6f780c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f6f76800700 1 -- 172.21.15.32:0/3934826342 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70009a70 con 0x7f6f7815e670 2024-09-13T18:47:29.269 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c9000700 1 -- 172.21.15.32:0/2717503674 learned_addr learned my addr 172.21.15.32:0/2717503674 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0814d4f0 con 0x7fcd08067520 2024-09-13T18:47:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406fac0 0x7f02c41f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4901e00700 1 --2- 172.21.15.32:0/400357892 >> v2:172.21.15.86:3300/0 conn(0x7f4904153850 0x7f49041596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.270 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4902800700 1 --2- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49040c4160 0x7f49040c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02c40c9e90 0x7f02c4157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c3e00700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406fac0 0x7f02c41f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4124aa0 con 0x7f02c406ea50 2024-09-13T18:47:29.271 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e2c021070 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4157260 con 0x7f02c40c9e90 2024-09-13T18:47:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fc565e00700 1 --2- 172.21.15.32:0/694685050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc56806dbe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc558009850 tx=0x7fc558009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efae2fd56aebdcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f6f76800700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 0x7f6f7806b6c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c4a0 tx=0x7f6f6800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c41f71d0 con 0x7f02c406fac0 2024-09-13T18:47:29.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4901e00700 1 -- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49040c4160 msgr2=0x7f49040c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.234+0000 7f8db2200700 1 -- start start 2024-09-13T18:47:29.273 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8db2200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 0x7f8dac0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4901e00700 1 --2- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49040c4160 0x7f49040c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4901e00700 1 -- 172.21.15.32:0/400357892 >> v1:172.21.15.86:6789/0 conn(0x7f4904153c30 legacy=0x7f49040ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.274 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4901e00700 1 -- 172.21.15.32:0/400357892 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904159e90 con 0x7f4904153850 2024-09-13T18:47:29.275 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8db2200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8dac161810 0x7f8dac168490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8db2200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0b4390 con 0x7f8dac071450 2024-09-13T18:47:29.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8db2200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac0b2120 con 0x7f8dac161810 2024-09-13T18:47:29.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8db2200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac15e590 con 0x7f8dac158080 2024-09-13T18:47:29.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 0x7f8dac0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 0x7f8dac0cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52682/0 (socket says 172.21.15.32:52682) 2024-09-13T18:47:29.276 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 -- 172.21.15.32:0/1075560216 learned_addr learned my addr 172.21.15.32:0/1075560216 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8daaa00700 1 --1- 172.21.15.32:0/1075560216 >> v1:172.21.15.86:6789/0 conn(0x7f8dac071450 0x7f8dac161100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44940/0 (socket says 172.21.15.32:44940) 2024-09-13T18:47:29.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fc564a00700 1 -- 172.21.15.32:0/694685050 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011830 con 0x7fc568157e30 2024-09-13T18:47:29.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c9a00700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02c40c9e90 0x7f02c4157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fc564a00700 1 -- 172.21.15.32:0/694685050 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558011990 con 0x7fc568157e30 2024-09-13T18:47:29.278 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fc564a00700 1 -- 172.21.15.32:0/694685050 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011d20 con 0x7fc568157e30 2024-09-13T18:47:29.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c3e00700 1 -- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02c40c9e90 msgr2=0x7f02c4157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4e32000700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4e1c066800 0x7f4e1c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.279 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4e2c086340 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f54f8003bc0 con 0x7f550c073990 2024-09-13T18:47:29.280 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 -- 172.21.15.32:0/1075560216 >> v2:172.21.15.32:3300/0 conn(0x7f8dac161810 msgr2=0x7f8dac168490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 --2- 172.21.15.32:0/1075560216 >> v2:172.21.15.32:3300/0 conn(0x7f8dac161810 0x7f8dac168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 -- 172.21.15.32:0/1075560216 >> v1:172.21.15.86:6789/0 conn(0x7f8dac071450 legacy=0x7f8dac161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 -- 172.21.15.32:0/1075560216 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac070770 con 0x7f8dac158080 2024-09-13T18:47:29.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c3e00700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02c40c9e90 0x7f02c4157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c3e00700 1 -- 172.21.15.32:0/2717503674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 msgr2=0x7f02c41f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4e39e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4e1c066800 0x7f4e1c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f8dab400700 1 --2- 172.21.15.32:0/1075560216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 0x7f8dac0cb480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009910 tx=0x7f8d9c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac5aff986334063 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f4901e00700 1 --2- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4904153850 0x7f49041596e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009850 tx=0x7f48f4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0cb80e71dcd307e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c3e00700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 0x7f02c41f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fc56d200700 1 -- 172.21.15.32:0/694685050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 msgr2=0x7fc56806dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fc56d200700 1 --2- 172.21.15.32:0/694685050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc56806dbe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc558009850 tx=0x7fc558009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd08159480 con 0x7fcd08067520 2024-09-13T18:47:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c3e00700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40094b0 con 0x7f02c406fac0 2024-09-13T18:47:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.238+0000 7f02c9000700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 0x7f02c41f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 -- 172.21.15.32:0/694685050 shutdown_connections 2024-09-13T18:47:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 --2- 172.21.15.32:0/694685050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc568070c40 0x7fc56806e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 --2- 172.21.15.32:0/694685050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc56806dbe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 -- 172.21.15.32:0/694685050 >> 172.21.15.32:0/694685050 conn(0x7fc56806b1f0 msgr2=0x7fc56806b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7f02c3e00700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406fac0 0x7f02c41f6b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f02c40c9390 tx=0x7f02b000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 -- 172.21.15.32:0/694685050 shutdown_connections 2024-09-13T18:47:29.285 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 -- 172.21.15.32:0/694685050 wait complete. 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7f4e39e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4e1c066800 0x7f4e1c068cc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e34011340 tx=0x7f4e3400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7f5503400700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f54ec066760 0x7f54ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f54f8085b10 con 0x7f550c073990 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7f550b400700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f54ec066760 0x7f54ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 Processor -- start 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccf40233e0 con 0x7fcd08067520 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fccfe000700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcce8066830 0x7fcce8068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fccf4095230 con 0x7fcd08067520 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7f550b400700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f54ec066760 0x7f54ec068c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0017a0 tx=0x7f54fc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fc56d200700 1 -- start start 2024-09-13T18:47:29.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.242+0000 7fcd05400700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcce8066830 0x7fcce8068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc56d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc56806e940 0x7fc5681f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fcd05400700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcce8066830 0x7fcce8068cf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd0814e220 tx=0x7fcd00010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc56d200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc568070c40 0x7fc5681e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc56d200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc5681e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc56d200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c3aa0 con 0x7fc568157e30 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc56d200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c5010 con 0x7fc568070c40 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc56d200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681f3a20 con 0x7fc56806e940 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc565e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc56806e940 0x7fc5681f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc5681e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc565e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc56806e940 0x7fc5681f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52696/0 (socket says 172.21.15.32:52696) 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc565e00700 1 -- 172.21.15.32:0/587803747 learned_addr learned my addr 172.21.15.32:0/587803747 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc565400700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc568070c40 0x7fc5681e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f8daa000700 1 -- 172.21.15.32:0/1075560216 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c00ba60 con 0x7f8dac158080 2024-09-13T18:47:29.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f8daa000700 1 -- 172.21.15.32:0/1075560216 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c00bbc0 con 0x7f8dac158080 2024-09-13T18:47:29.291 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f8daa000700 1 -- 172.21.15.32:0/1075560216 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c009e60 con 0x7f8dac158080 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 -- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc56806e940 msgr2=0x7fc5681f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc56806e940 0x7fc5681f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 -- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc568070c40 msgr2=0x7fc5681e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc568070c40 0x7fc5681e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 -- 172.21.15.32:0/587803747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580094b0 con 0x7fc568157e30 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc565400700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc568070c40 0x7fc5681e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:29.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0004ca0 con 0x7f02c406fac0 2024-09-13T18:47:29.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c4155860 con 0x7f02c406fac0 2024-09-13T18:47:29.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c4155e00 con 0x7f02c406fac0 2024-09-13T18:47:29.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e2c0533b0 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b0004e00 con 0x7f02c406fac0 2024-09-13T18:47:29.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00072f0 con 0x7f02c406fac0 2024-09-13T18:47:29.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7fc566800700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc5681e5b80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc560007d90 tx=0x7fc56000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68004ca0 con 0x7f6f7815e670 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68004e20 con 0x7f6f7815e670 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68007310 con 0x7f6f7815e670 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f640094b0 con 0x7f6f7815e670 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f780ce230 con 0x7f6f7815e670 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f4900a00700 1 -- 172.21.15.32:0/400357892 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011830 con 0x7f4904153850 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f4900a00700 1 -- 172.21.15.32:0/400357892 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4011990 con 0x7f4904153850 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f4900a00700 1 -- 172.21.15.32:0/400357892 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4011d40 con 0x7f4904153850 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f54f8052b80 con 0x7f550c073990 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f8db2200700 1 -- 172.21.15.32:0/1075560216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 msgr2=0x7f8dac0cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f8db2200700 1 --2- 172.21.15.32:0/1075560216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 0x7f8dac0cb480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009910 tx=0x7f8d9c009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f8db2200700 1 -- 172.21.15.32:0/1075560216 shutdown_connections 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f8db2200700 1 --2- 172.21.15.32:0/1075560216 >> v2:172.21.15.32:3300/0 conn(0x7f8dac161810 0x7f8dac168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f8db2200700 1 --2- 172.21.15.32:0/1075560216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac158080 0x7f8dac0cb480 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f8db2200700 1 -- 172.21.15.32:0/1075560216 >> 172.21.15.32:0/1075560216 conn(0x7f8dac0725f0 msgr2=0x7f8dac073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.246+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c005310 con 0x7f02c406fac0 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f780ca9c0 con 0x7f6f7815e670 2024-09-13T18:47:29.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 -- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4904153850 msgr2=0x7f49041596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 --2- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4904153850 0x7f49041596e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009850 tx=0x7f48f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:29.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560018070 con 0x7fc568157e30 2024-09-13T18:47:29.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000ebe0 con 0x7fc568157e30 2024-09-13T18:47:29.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560003a40 con 0x7fc568157e30 2024-09-13T18:47:29.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fccf4062210 con 0x7fcd08067520 2024-09-13T18:47:29.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f8db2200700 1 -- 172.21.15.32:0/1075560216 shutdown_connections 2024-09-13T18:47:29.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f8db2200700 1 -- 172.21.15.32:0/1075560216 wait complete. 2024-09-13T18:47:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5681e45c0 con 0x7fc568157e30 2024-09-13T18:47:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680c37c0 con 0x7fc568157e30 2024-09-13T18:47:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 -- 172.21.15.32:0/400357892 shutdown_connections 2024-09-13T18:47:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 --2- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f49040c4160 0x7f49040c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 --2- 172.21.15.32:0/400357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4904153850 0x7f49041596e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 -- 172.21.15.32:0/400357892 >> 172.21.15.32:0/400357892 conn(0x7f4904073b40 msgr2=0x7f4904073f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 -- 172.21.15.32:0/400357892 shutdown_connections 2024-09-13T18:47:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f4909000700 1 -- 172.21.15.32:0/400357892 wait complete. 2024-09-13T18:47:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.250+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02b0007450 con 0x7f02c406fac0 2024-09-13T18:47:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f68007470 con 0x7f6f7815e670 2024-09-13T18:47:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f02c0c00700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f02a4066760 0x7f02a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f6f6e000700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6f58066780 0x7f6f58068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56806f530 con 0x7fc568157e30 2024-09-13T18:47:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f02c9000700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f02a4066760 0x7f02a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f6f68084750 con 0x7f6f7815e670 2024-09-13T18:47:29.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f02b0084640 con 0x7f02c406fac0 2024-09-13T18:47:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f4909000700 1 Processor -- start 2024-09-13T18:47:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f4909000700 1 -- start start 2024-09-13T18:47:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02b0054d40 con 0x7f02c406fac0 2024-09-13T18:47:29.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f6f75e00700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6f58066780 0x7f6f58068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f8db2200700 1 Processor -- start 2024-09-13T18:47:29.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.254+0000 7f8db2200700 1 -- start start 2024-09-13T18:47:29.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4909000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 0x7f4904142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4909000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4904153850 0x7f49041585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f6f75e00700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6f58066780 0x7f6f58068c40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f700115a0 tx=0x7f6f7000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4909000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4904153c30 0x7f4904158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4909000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49040c6aa0 con 0x7f4904153850 2024-09-13T18:47:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4909000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49041f08e0 con 0x7f49040c4160 2024-09-13T18:47:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4909000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49041f28b0 con 0x7f4904153c30 2024-09-13T18:47:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc560014420 con 0x7fc568157e30 2024-09-13T18:47:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8db2200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac071450 0x7f8dac0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8db2200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 0x7f8dac157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8db2200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dac161810 0x7f8dac15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8db2200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0c7470 con 0x7f8dac161810 2024-09-13T18:47:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8db2200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0c8c00 con 0x7f8dac158080 2024-09-13T18:47:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8db2200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1f38f0 con 0x7f8dac071450 2024-09-13T18:47:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f02c9000700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f02a4066760 0x7f02a4068c20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f02b4014040 tx=0x7f02b401c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 0x7f8dac157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 0x7f8dac157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39810/0 (socket says 172.21.15.32:39810) 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 -- 172.21.15.32:0/36953038 learned_addr learned my addr 172.21.15.32:0/36953038 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8dab400700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac071450 0x7f8dac0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8dabe00700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dac161810 0x7f8dac15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 -- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac071450 msgr2=0x7f8dac0c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac071450 0x7f8dac0c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 -- 172.21.15.32:0/36953038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dac161810 msgr2=0x7f8dac15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dac161810 0x7f8dac15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 -- 172.21.15.32:0/36953038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c009570 con 0x7f8dac158080 2024-09-13T18:47:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4901e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 0x7f4904142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4901e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 0x7f4904142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39826/0 (socket says 172.21.15.32:39826) 2024-09-13T18:47:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4901e00700 1 -- 172.21.15.32:0/3101723133 learned_addr learned my addr 172.21.15.32:0/3101723133 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8dabe00700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dac161810 0x7f8dac15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8daaa00700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 0x7f8dac157530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c6b0 tx=0x7f8d9800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7fc55e000700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc548066780 0x7fc548068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fc560083cb0 con 0x7fc568157e30 2024-09-13T18:47:29.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4902800700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4904153c30 0x7f4904158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f4901400700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4904153850 0x7f49041585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.258+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98005cd0 con 0x7f8dac158080 2024-09-13T18:47:29.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f680518c0 con 0x7f6f7815e670 2024-09-13T18:47:29.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac1f3bd0 con 0x7f8dac158080 2024-09-13T18:47:29.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98005e30 con 0x7f8dac158080 2024-09-13T18:47:29.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d980072d0 con 0x7f8dac158080 2024-09-13T18:47:29.315 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7fc565e00700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc548066780 0x7fc548068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901e00700 1 -- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4904153c30 msgr2=0x7f4904158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901e00700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4904153c30 0x7f4904158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901e00700 1 -- 172.21.15.32:0/3101723133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4904153850 msgr2=0x7f49041585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901e00700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4904153850 0x7f49041585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901e00700 1 -- 172.21.15.32:0/3101723133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40094b0 con 0x7f49040c4160 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4902800700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4904153c30 0x7f4904158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901400700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4904153850 0x7f49041585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:29.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac1f4190 con 0x7f8dac158080 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7fc565e00700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc548066780 0x7fc548068c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc558009ba0 tx=0x7fc558008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4901e00700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 0x7f4904142580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f48f40090b0 tx=0x7f48f4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4004480 con 0x7f49040c4160 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49041f2b50 con 0x7f49040c4160 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49041f3110 con 0x7f49040c4160 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f401f070 con 0x7f49040c4160 2024-09-13T18:47:29.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4004480 con 0x7f49040c4160 2024-09-13T18:47:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.262+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac0679e0 con 0x7f8dac158080 2024-09-13T18:47:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.266+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc560050c80 con 0x7fc568157e30 2024-09-13T18:47:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.266+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48f4021030 con 0x7f49040c4160 2024-09-13T18:47:29.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.266+0000 7f48fa000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f48e4066750 0x7f48e4068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.266+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f48f40850c0 con 0x7f49040c4160 2024-09-13T18:47:29.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d98007430 con 0x7f8dac158080 2024-09-13T18:47:29.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc005310 con 0x7f49040c4160 2024-09-13T18:47:29.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f4901400700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f48e4066750 0x7f48e4068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.319 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f4901400700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f48e4066750 0x7f48e4068c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48f0007fd0 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f8da3400700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d8c066730 0x7f8d8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8d98083940 con 0x7f8dac158080 2024-09-13T18:47:29.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f8dab400700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d8c066730 0x7f8d8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.320 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.270+0000 7f8dab400700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d8c066730 0x7f8d8c068bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c000c00 tx=0x7f8d9c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.274+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d980508d0 con 0x7f8dac158080 2024-09-13T18:47:29.321 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.282+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48f40520b0 con 0x7f49040c4160 2024-09-13T18:47:29.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.566+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f54e4005890 con 0x7f550c073990 2024-09-13T18:47:29.575 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.570+0000 7f5503400700 1 -- 172.21.15.32:0/1060016050 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54f8020020 con 0x7f550c073990 2024-09-13T18:47:29.575 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-13T18:47:29.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f54ec066760 msgr2=0x7f54ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f54ec066760 0x7f54ec068c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0017a0 tx=0x7f54fc009040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f550c073990 msgr2=0x7f550c0c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f550c073990 0x7f550c0c3d20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f550c06bfc0 tx=0x7f54f8004770 comp rx=0 tx=0).stop 2024-09-13T18:47:29.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 shutdown_connections 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f54ec066760 0x7f54ec068c20 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0017a0 tx=0x7f54fc009040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f550c159ac0 0x7f550c151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f550c073990 0x7f550c0c3d20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 --2- 172.21.15.32:0/1060016050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f550c06f530 0x7f550c070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 >> 172.21.15.32:0/1060016050 conn(0x7f550c0c8a60 msgr2=0x7f550c0c1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 shutdown_connections 2024-09-13T18:47:29.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.578+0000 7f5510c00700 1 -- 172.21.15.32:0/1060016050 wait complete. 2024-09-13T18:47:29.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.6 2024-09-13T18:47:29.617 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.610+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd0814f950 con 0x7fcd08067520 2024-09-13T18:47:29.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.614+0000 7fccfe000700 1 -- 172.21.15.32:0/1345553778 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccf4065830 con 0x7fcd08067520 2024-09-13T18:47:29.621 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.614+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f029c005890 con 0x7f02c406fac0 2024-09-13T18:47:29.621 INFO:teuthology.orchestra.run.smithi032.stdout:64424509476 2024-09-13T18:47:29.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.614+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5680c2a00 con 0x7fc568157e30 2024-09-13T18:47:29.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.614+0000 7fc55e000700 1 -- 172.21.15.32:0/587803747 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5600542a0 con 0x7fc568157e30 2024-09-13T18:47:29.622 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.614+0000 7f02c0c00700 1 -- 172.21.15.32:0/2717503674 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02b0054f20 con 0x7f02c406fac0 2024-09-13T18:47:29.624 INFO:teuthology.orchestra.run.smithi032.stdout:64424509474 2024-09-13T18:47:29.624 INFO:teuthology.orchestra.run.smithi032.stdout:60129542177 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcce8066830 msgr2=0x7fcce8068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcce8066830 0x7fcce8068cf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd0814e220 tx=0x7fcd00010000 comp rx=0 tx=0).stop 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 msgr2=0x7fcd081501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 0x7fcd081501b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fccf401f650 tx=0x7fccf401fa10 comp rx=0 tx=0).stop 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 shutdown_connections 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fcce8066830 0x7fcce8068cf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.626 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f02a4066760 msgr2=0x7f02a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f02a4066760 0x7f02a4068c20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f02b4014040 tx=0x7f02b401c040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406fac0 msgr2=0x7f02c41f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406fac0 0x7f02c41f6b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f02c40c9390 tx=0x7f02b000c8b0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcd080c62d0 0x7fcd08147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd0806da30 0x7fcd081ee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 --2- 172.21.15.32:0/1345553778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd08067520 0x7fcd081501b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 >> 172.21.15.32:0/1345553778 conn(0x7fcd0806a390 msgr2=0x7fcd0814d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 shutdown_connections 2024-09-13T18:47:29.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fcd07200700 1 -- 172.21.15.32:0/1345553778 wait complete. 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc548066780 msgr2=0x7fc548068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 shutdown_connections 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f02a4066760 0x7f02a4068c20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02c40c9e90 0x7f02c4157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02c406fac0 0x7f02c41f6b40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 --2- 172.21.15.32:0/2717503674 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f02c406ea50 0x7f02c41f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 >> 172.21.15.32:0/2717503674 conn(0x7f02c40cac60 msgr2=0x7f02c40bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.618+0000 7fc56d200700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc548066780 0x7fc548068c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc558009ba0 tx=0x7fc558008030 comp rx=0 tx=0).stop 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 msgr2=0x7fc5681e5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc5681e5b80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc560007d90 tx=0x7fc56000e3c0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 shutdown_connections 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc548066780 0x7fc548068c40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc568157e30 0x7fc5681e5b80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc568070c40 0x7fc5681e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 --2- 172.21.15.32:0/587803747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc56806e940 0x7fc5681f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 >> 172.21.15.32:0/587803747 conn(0x7fc56806b1f0 msgr2=0x7fc5680c1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 shutdown_connections 2024-09-13T18:47:29.630 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7f02ca400700 1 -- 172.21.15.32:0/2717503674 wait complete. 2024-09-13T18:47:29.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 shutdown_connections 2024-09-13T18:47:29.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7fc56d200700 1 -- 172.21.15.32:0/587803747 wait complete. 2024-09-13T18:47:29.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f780c8850 con 0x7f6f7815e670 2024-09-13T18:47:29.631 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.622+0000 7f6f6e000700 1 -- 172.21.15.32:0/3934826342 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f68007720 con 0x7f6f7815e670 2024-09-13T18:47:29.631 INFO:teuthology.orchestra.run.smithi032.stdout:64424509473 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6f58066780 msgr2=0x7f6f58068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6f58066780 0x7f6f58068c40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f700115a0 tx=0x7f6f7000b040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 msgr2=0x7f6f7806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 0x7f6f7806b6c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c4a0 tx=0x7f6f6800c7b0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 shutdown_connections 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6f58066780 0x7f6f58068c40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f7815e670 0x7f6f7806b6c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f780cbe00 0x7f6f781f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 --2- 172.21.15.32:0/3934826342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f780caf00 0x7f6f780c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 >> 172.21.15.32:0/3934826342 conn(0x7f6f78071d30 msgr2=0x7f6f78070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 shutdown_connections 2024-09-13T18:47:29.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.626+0000 7f6f77200700 1 -- 172.21.15.32:0/3934826342 wait complete. 2024-09-13T18:47:29.638 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.630+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4e3c067a00 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.641 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.634+0000 7f4e32000700 1 -- 172.21.15.32:0/3916768103 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e2c0569d0 con 0x7f4e3c0ca7e0 2024-09-13T18:47:29.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.634+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8dac070400 con 0x7f8dac158080 2024-09-13T18:47:29.642 INFO:teuthology.orchestra.run.smithi032.stdout:60129542177 2024-09-13T18:47:29.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.634+0000 7f8da3400700 1 -- 172.21.15.32:0/36953038 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d98017020 con 0x7f8dac158080 2024-09-13T18:47:29.643 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d8c066730 msgr2=0x7f8d8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d8c066730 0x7f8d8c068bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c000c00 tx=0x7f8d9c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 msgr2=0x7f8dac157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 0x7f8dac157530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c6b0 tx=0x7f8d9800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4e1c066800 msgr2=0x7f4e1c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4e1c066800 0x7f4e1c068cc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e34011340 tx=0x7f4e3400b040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.647 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 msgr2=0x7f4e3c13fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 0x7f4e3c13fa50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0cacf0 tx=0x7f4e2c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:29.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 shutdown_connections 2024-09-13T18:47:29.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 shutdown_connections 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4e1c066800 0x7f4e1c068cc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e3c151ab0 0x7f4e3c13ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e3c0ca7e0 0x7f4e3c13fa50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 --2- 172.21.15.32:0/3916768103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e3c06ae20 0x7f4e3c142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 >> 172.21.15.32:0/3916768103 conn(0x7f4e3c06eae0 msgr2=0x7f4e3c140710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8d8c066730 0x7f8d8c068bf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.649 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dac161810 0x7f8dac15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dac158080 0x7f8dac157530 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 --2- 172.21.15.32:0/36953038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dac071450 0x7f8dac0c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 >> 172.21.15.32:0/36953038 conn(0x7f8dac0725f0 msgr2=0x7f8dac15ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 shutdown_connections 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f8db2200700 1 -- 172.21.15.32:0/36953038 wait complete. 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 shutdown_connections 2024-09-13T18:47:29.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.642+0000 7f4e40e00700 1 -- 172.21.15.32:0/3916768103 wait complete. 2024-09-13T18:47:29.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509477 got 64424509476 for osd.2 2024-09-13T18:47:29.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.7 2024-09-13T18:47:29.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509474 for osd.1 2024-09-13T18:47:29.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509474 got 64424509473 for osd.3 2024-09-13T18:47:29.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.5 2024-09-13T18:47:29.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.662+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48dc0055c0 con 0x7f49040c4160 2024-09-13T18:47:29.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.662+0000 7f48fa000700 1 -- 172.21.15.32:0/3101723133 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48f4015070 con 0x7f49040c4160 2024-09-13T18:47:29.668 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f48e4066750 msgr2=0x7f48e4068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f48e4066750 0x7f48e4068c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48f0007fd0 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 msgr2=0x7f4904142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 0x7f4904142580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f48f40090b0 tx=0x7f48f4004770 comp rx=0 tx=0).stop 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 shutdown_connections 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f48e4066750 0x7f48e4068c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4904153c30 0x7f4904158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4904153850 0x7f49041585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 --2- 172.21.15.32:0/3101723133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49040c4160 0x7f4904142580 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 >> 172.21.15.32:0/3101723133 conn(0x7f4904073b40 msgr2=0x7f4904149be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 shutdown_connections 2024-09-13T18:47:29.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:29.666+0000 7f4909000700 1 -- 172.21.15.32:0/3101723133 wait complete. 2024-09-13T18:47:29.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542179 for osd.4 2024-09-13T18:47:29.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509476 got 64424509475 for osd.0 2024-09-13T18:47:30.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:47:30.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:47:30.658 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:47:30.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:47:30.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:47:30.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:47:30.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:47:30.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:47:30.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.826+0000 7f8222e00700 1 Processor -- start 2024-09-13T18:47:30.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.826+0000 7f8222e00700 1 -- start start 2024-09-13T18:47:30.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.826+0000 7f8222e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f821c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.826+0000 7f8222e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f821c0c8110 0x7f821c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f821c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f821c0c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52714/0 (socket says 172.21.15.32:52714) 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221a00700 1 -- 172.21.15.32:0/730436778 learned_addr learned my addr 172.21.15.32:0/730436778 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c15cb70 con 0x7f821c070150 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c070600 con 0x7f821c0c8110 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15cda0 con 0x7f821c156e50 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268183890 0 0) 0x7f821c15cb70 con 0x7f821c070150 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82040035d0 con 0x7f821c070150 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221000700 1 --2- 172.21.15.32:0/730436778 >> v2:172.21.15.32:3300/0 conn(0x7f821c0c8110 0x7f821c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1044236060 0 0) 0x7f82040035d0 con 0x7f821c070150 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 msgr2=0x7f821c0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f821c0c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 >> v2:172.21.15.32:3300/0 conn(0x7f821c0c8110 msgr2=0x7f821c06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 --2- 172.21.15.32:0/730436778 >> v2:172.21.15.32:3300/0 conn(0x7f821c0c8110 0x7f821c06fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c159600 con 0x7f821c070150 2024-09-13T18:47:30.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404464803 0 0) 0x7f8208001670 con 0x7f821c070150 2024-09-13T18:47:30.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 >> v1:172.21.15.32:6789/0 conn(0x7f821c070150 legacy=0x7f821c159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8204003a20 0x7f8204003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8204004870 0x7f8204004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f8204005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c070600 con 0x7f8204003a20 2024-09-13T18:47:30.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15cda0 con 0x7f8204004870 2024-09-13T18:47:30.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040142f0 con 0x7f821c156e50 2024-09-13T18:47:30.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221000700 1 --2- 172.21.15.32:0/730436778 >> v2:172.21.15.32:3300/0 conn(0x7f821c0c8110 0x7f821c06fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:30.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221a00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8204003a20 0x7f8204003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8221000700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8204004870 0x7f8204004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.830+0000 7f8222400700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f8204005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221000700 1 -- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 msgr2=0x7f8204005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221000700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f821c156e50 0x7f8204005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221000700 1 -- 172.21.15.32:0/730436778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8204003a20 msgr2=0x7f8204003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221000700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8204003a20 0x7f8204003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221000700 1 -- 172.21.15.32:0/730436778 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c159600 con 0x7f8204004870 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221a00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8204003a20 0x7f8204003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8221000700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8204004870 0x7f8204004cf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82140073b0 tx=0x7f82040058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778f299351aa4205 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214003a40 con 0x7f8204004870 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f821be00700 1 -- 172.21.15.32:0/730436778 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214003ba0 con 0x7f8204004870 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8204004870 msgr2=0x7f8204004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222e00700 1 --2- 172.21.15.32:0/730436778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8204004870 0x7f8204004cf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82140073b0 tx=0x7f82040058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222400700 1 -- 172.21.15.32:0/730436778 reap_dead start 2024-09-13T18:47:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 shutdown_connections 2024-09-13T18:47:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 >> 172.21.15.32:0/730436778 conn(0x7f821c0cac60 msgr2=0x7f821c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 shutdown_connections 2024-09-13T18:47:30.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.834+0000 7f8222e00700 1 -- 172.21.15.32:0/730436778 wait complete. 2024-09-13T18:47:30.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.842+0000 7f8222e00700 1 Processor -- start 2024-09-13T18:47:30.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.842+0000 7f8222e00700 1 -- start start 2024-09-13T18:47:30.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 0x7f821c0ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f821c15b350 0x7f821c2108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f821c15a550 0x7f821c06d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 0x7f821c0ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c155860 con 0x7f821c15a550 2024-09-13T18:47:30.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c210410 con 0x7f821c15b350 2024-09-13T18:47:30.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c210de0 con 0x7f8204004870 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 0x7f821c0ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52720/0 (socket says 172.21.15.32:52720) 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 -- 172.21.15.32:0/2637510726 learned_addr learned my addr 172.21.15.32:0/2637510726 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221000700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f821c15b350 0x7f821c2108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8222400700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f821c15a550 0x7f821c06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 -- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f821c15b350 msgr2=0x7f821c2108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f821c15b350 0x7f821c2108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 -- 172.21.15.32:0/2637510726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f821c15a550 msgr2=0x7f821c06d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f821c15a550 0x7f821c06d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.854 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 -- 172.21.15.32:0/2637510726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0ac740 con 0x7f8204004870 2024-09-13T18:47:30.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8221a00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 0x7f821c0ab220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f821001f900 tx=0x7f821001fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210004020 con 0x7f8204004870 2024-09-13T18:47:30.855 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210004180 con 0x7f8204004870 2024-09-13T18:47:30.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.846+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100042f0 con 0x7f8204004870 2024-09-13T18:47:30.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.850+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0cb450 con 0x7f8204004870 2024-09-13T18:47:30.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.850+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c155d70 con 0x7f8204004870 2024-09-13T18:47:30.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.854+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8210004450 con 0x7f8204004870 2024-09-13T18:47:30.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.854+0000 7f8219600700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f81fc066730 0x7f81fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.854+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8210084990 con 0x7f8204004870 2024-09-13T18:47:30.861 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.854+0000 7f8221000700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f81fc066730 0x7f81fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.858+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c157230 con 0x7f8204004870 2024-09-13T18:47:30.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.858+0000 7f8221000700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f81fc066730 0x7f81fc068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8214017040 tx=0x7f821400b070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.870+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82100518f0 con 0x7f8204004870 2024-09-13T18:47:30.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.870+0000 7ffbcee00700 1 Processor -- start 2024-09-13T18:47:30.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.870+0000 7ffbcee00700 1 -- start start 2024-09-13T18:47:30.878 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbcee00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ffbc80cb020 0x7ffbc8071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbcee00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffbc80ca9c0 0x7ffbc80ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbcee00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc815d620 con 0x7ffbc80c9f00 2024-09-13T18:47:30.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbcee00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80c9d00 con 0x7ffbc80ca9c0 2024-09-13T18:47:30.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbcee00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80cbc40 con 0x7ffbc80cb020 2024-09-13T18:47:30.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ffbc80c9f00 0x7ffbc80cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39798/0 (socket says 172.21.15.32:39798) 2024-09-13T18:47:30.879 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7e00700 1 -- 172.21.15.32:0/213714239 learned_addr learned my addr 172.21.15.32:0/213714239 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:30.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7400700 1 --2- 172.21.15.32:0/213714239 >> v2:172.21.15.86:3300/0 conn(0x7ffbc80cb020 0x7ffbc8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbcce00700 1 --2- 172.21.15.32:0/213714239 >> v2:172.21.15.32:3300/0 conn(0x7ffbc80ca9c0 0x7ffbc80ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7400700 1 -- 172.21.15.32:0/213714239 >> v2:172.21.15.32:3300/0 conn(0x7ffbc80ca9c0 msgr2=0x7ffbc80ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.880 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7400700 1 --2- 172.21.15.32:0/213714239 >> v2:172.21.15.32:3300/0 conn(0x7ffbc80ca9c0 0x7ffbc80ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7400700 1 -- 172.21.15.32:0/213714239 >> v1:172.21.15.32:6789/0 conn(0x7ffbc80c9f00 legacy=0x7ffbc80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7400700 1 -- 172.21.15.32:0/213714239 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80b4610 con 0x7ffbc80cb020 2024-09-13T18:47:30.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7ffbc7400700 1 --2- 172.21.15.32:0/213714239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc80cb020 0x7ffbc8071490 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8074510 tx=0x7ffbb8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93849b0b7ff24e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.881 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7fe581c00700 1 Processor -- start 2024-09-13T18:47:30.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7f874a000700 1 Processor -- start 2024-09-13T18:47:30.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7f874a000700 1 -- start start 2024-09-13T18:47:30.882 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.874+0000 7fe581c00700 1 -- start start 2024-09-13T18:47:30.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbc6a00700 1 -- 172.21.15.32:0/213714239 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004230 con 0x7ffbc80cb020 2024-09-13T18:47:30.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbc6a00700 1 -- 172.21.15.32:0/213714239 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb8004390 con 0x7ffbc80cb020 2024-09-13T18:47:30.883 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbc6a00700 1 -- 172.21.15.32:0/213714239 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80036c0 con 0x7ffbc80cb020 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 -- 172.21.15.32:0/213714239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc80cb020 msgr2=0x7ffbc8071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 --2- 172.21.15.32:0/213714239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc80cb020 0x7ffbc8071490 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8074510 tx=0x7ffbb8009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 0x7fe57c155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe57c0c7fa0 0x7fe57c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe57c0c8420 0x7fe57c0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c159a10 con 0x7fe57c0c7fa0 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c158a80 con 0x7fe57c0c8420 2024-09-13T18:47:30.884 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c159040 con 0x7fe57c155e80 2024-09-13T18:47:30.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f874a000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8744071ca0 0x7f87440aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f874a000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f874415a450 0x7f87440c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f874a000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87440c8b40 con 0x7f87440c75c0 2024-09-13T18:47:30.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f874a000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440c9330 con 0x7f874415a450 2024-09-13T18:47:30.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f874a000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8744072790 con 0x7f8744071ca0 2024-09-13T18:47:30.885 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 -- 172.21.15.32:0/213714239 shutdown_connections 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 --2- 172.21.15.32:0/213714239 >> v2:172.21.15.32:3300/0 conn(0x7ffbc80ca9c0 0x7ffbc80ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 --2- 172.21.15.32:0/213714239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc80cb020 0x7ffbc8071490 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8074510 tx=0x7ffbb8009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 -- 172.21.15.32:0/213714239 >> 172.21.15.32:0/213714239 conn(0x7ffbc80725f0 msgr2=0x7ffbc8073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 -- 172.21.15.32:0/213714239 shutdown_connections 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 0x7fe57c155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 0x7fe57c155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52726/0 (socket says 172.21.15.32:52726) 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe581200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe57c0c8420 0x7fe57c0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.886 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 -- 172.21.15.32:0/271631966 learned_addr learned my addr 172.21.15.32:0/271631966 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f8743400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8744071ca0 0x7f87440aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f8743400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8744071ca0 0x7f87440aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39882/0 (socket says 172.21.15.32:39882) 2024-09-13T18:47:30.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 -- 172.21.15.32:0/271631966 >> v2:172.21.15.86:3300/0 conn(0x7fe57c0c8420 msgr2=0x7fe57c0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 --2- 172.21.15.32:0/271631966 >> v2:172.21.15.86:3300/0 conn(0x7fe57c0c8420 0x7fe57c0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 -- 172.21.15.32:0/271631966 >> v2:172.21.15.32:3300/0 conn(0x7fe57c0c7fa0 msgr2=0x7fe57c1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.887 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 --2- 172.21.15.32:0/271631966 >> v2:172.21.15.32:3300/0 conn(0x7fe57c0c7fa0 0x7fe57c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 -- 172.21.15.32:0/271631966 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c06eac0 con 0x7fe57c155e80 2024-09-13T18:47:30.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7ffbcee00700 1 -- 172.21.15.32:0/213714239 wait complete. 2024-09-13T18:47:30.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7f8743400700 1 -- 172.21.15.32:0/1833680347 learned_addr learned my addr 172.21.15.32:0/1833680347 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.878+0000 7fe57be00700 1 --2- 172.21.15.32:0/271631966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 0x7fe57c155490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06f310 tx=0x7fe56c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0403ec332b3a587 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe57aa00700 1 -- 172.21.15.32:0/271631966 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c013c90 con 0x7fe57c155e80 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe57aa00700 1 -- 172.21.15.32:0/271631966 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c013df0 con 0x7fe57c155e80 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe57aa00700 1 -- 172.21.15.32:0/271631966 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c01b620 con 0x7fe57c155e80 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743e00700 1 --2- 172.21.15.32:0/1833680347 >> v2:172.21.15.32:3300/0 conn(0x7f874415a450 0x7f87440c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743400700 1 -- 172.21.15.32:0/1833680347 >> v2:172.21.15.32:3300/0 conn(0x7f874415a450 msgr2=0x7f87440c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.889 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743400700 1 --2- 172.21.15.32:0/1833680347 >> v2:172.21.15.32:3300/0 conn(0x7f874415a450 0x7f87440c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8742000700 1 -- 172.21.15.32:0/1833680347 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287333359 0 0) 0x7f87440c8b40 con 0x7f87440c75c0 2024-09-13T18:47:30.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 -- 172.21.15.32:0/271631966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 msgr2=0x7fe57c155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 --2- 172.21.15.32:0/271631966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 0x7fe57c155490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06f310 tx=0x7fe56c009f90 comp rx=0 tx=0).stop 2024-09-13T18:47:30.890 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 Processor -- start 2024-09-13T18:47:30.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743400700 1 -- 172.21.15.32:0/1833680347 >> v1:172.21.15.86:6789/0 conn(0x7f87440c75c0 legacy=0x7f8744072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743400700 1 -- 172.21.15.32:0/1833680347 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440a9e90 con 0x7f8744071ca0 2024-09-13T18:47:30.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 -- 172.21.15.32:0/271631966 shutdown_connections 2024-09-13T18:47:30.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 --2- 172.21.15.32:0/271631966 >> v2:172.21.15.86:3300/0 conn(0x7fe57c0c8420 0x7fe57c0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 --2- 172.21.15.32:0/271631966 >> v2:172.21.15.32:3300/0 conn(0x7fe57c0c7fa0 0x7fe57c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.891 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 --2- 172.21.15.32:0/271631966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c155e80 0x7fe57c155490 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 -- 172.21.15.32:0/271631966 >> 172.21.15.32:0/271631966 conn(0x7fe57c0cac60 msgr2=0x7fe57c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 -- start start 2024-09-13T18:47:30.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743e00700 1 --2- 172.21.15.32:0/1833680347 >> v2:172.21.15.32:3300/0 conn(0x7f874415a450 0x7f87440c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:30.892 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 -- 172.21.15.32:0/271631966 shutdown_connections 2024-09-13T18:47:30.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7fe581c00700 1 -- 172.21.15.32:0/271631966 wait complete. 2024-09-13T18:47:30.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8743400700 1 --2- 172.21.15.32:0/1833680347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8744071ca0 0x7f87440aa320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8744062150 tx=0x7f873c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd7ffade847bba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 0x7ffbc80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffbc80ca9c0 0x7ffbc814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 0x7ffbc814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.893 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81f3580 con 0x7ffbc80ca9c0 2024-09-13T18:47:30.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8157c80 con 0x7ffbc81512d0 2024-09-13T18:47:30.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7ffbcee00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81518f0 con 0x7ffbc80c9f00 2024-09-13T18:47:30.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8742000700 1 -- 172.21.15.32:0/1833680347 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00e070 con 0x7f8744071ca0 2024-09-13T18:47:30.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8742000700 1 -- 172.21.15.32:0/1833680347 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b9c0 con 0x7f8744071ca0 2024-09-13T18:47:30.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.882+0000 7f8742000700 1 -- 172.21.15.32:0/1833680347 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00bd70 con 0x7f8744071ca0 2024-09-13T18:47:30.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 Processor -- start 2024-09-13T18:47:30.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 0x7ffbc814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.895 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbc7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 0x7ffbc80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f874a000700 1 -- 172.21.15.32:0/1833680347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8744071ca0 msgr2=0x7f87440aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f874a000700 1 --2- 172.21.15.32:0/1833680347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8744071ca0 0x7f87440aa320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8744062150 tx=0x7f873c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:30.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 -- start start 2024-09-13T18:47:30.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbc7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 0x7ffbc80b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52730/0 (socket says 172.21.15.32:52730) 2024-09-13T18:47:30.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 0x7ffbc814d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39890/0 (socket says 172.21.15.32:39890) 2024-09-13T18:47:30.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 -- 172.21.15.32:0/3472080417 learned_addr learned my addr 172.21.15.32:0/3472080417 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f874a000700 1 -- 172.21.15.32:0/1833680347 shutdown_connections 2024-09-13T18:47:30.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f874a000700 1 --2- 172.21.15.32:0/1833680347 >> v2:172.21.15.32:3300/0 conn(0x7f874415a450 0x7f87440c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f874a000700 1 --2- 172.21.15.32:0/1833680347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8744071ca0 0x7f87440aa320 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8744062150 tx=0x7f873c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:30.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f874a000700 1 -- 172.21.15.32:0/1833680347 >> 172.21.15.32:0/1833680347 conn(0x7f87440cad40 msgr2=0x7f87440cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbc7400700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffbc80ca9c0 0x7ffbc814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f8eb4a00700 1 Processor -- start 2024-09-13T18:47:30.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7f8eb4a00700 1 -- start start 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 0x7fe57c0aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe57c155e80 0x7fe57c0ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c0ad010 0x7fe57c0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c1eb510 con 0x7fe57c0c8420 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c1ea920 con 0x7fe57c155e80 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06e690 con 0x7fe57c0ad010 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 0x7fe57c0aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 0x7fe57c0aa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57888/0 (socket says 172.21.15.32:57888) 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 -- 172.21.15.32:0/880197073 learned_addr learned my addr 172.21.15.32:0/880197073 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.899 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57b400700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe57c155e80 0x7fe57c0ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe581200700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c0ad010 0x7fe57c0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 -- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c0ad010 msgr2=0x7fe57c0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c0ad010 0x7fe57c0aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 -- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe57c155e80 msgr2=0x7fe57c0ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe57c155e80 0x7fe57c0ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7fe57be00700 1 -- 172.21.15.32:0/880197073 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c009e00 con 0x7fe57c0c8420 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 -- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 msgr2=0x7ffbc80b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 0x7ffbc80b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 -- 172.21.15.32:0/3472080417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffbc80ca9c0 msgr2=0x7ffbc814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffbc80ca9c0 0x7ffbc814cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 -- 172.21.15.32:0/3472080417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80094b0 con 0x7ffbc81512d0 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbc7e00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 0x7ffbc80b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbc7400700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffbc80ca9c0 0x7ffbc814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:30.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.886+0000 7ffbcce00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 0x7ffbc814d290 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0007e90 tx=0x7ffbc000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f874a000700 1 -- 172.21.15.32:0/1833680347 shutdown_connections 2024-09-13T18:47:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7fe57be00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 0x7fe57c0aa830 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe56c000c00 tx=0x7fe56c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000ecd0 con 0x7ffbc81512d0 2024-09-13T18:47:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000ee30 con 0x7ffbc81512d0 2024-09-13T18:47:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0014660 con 0x7ffbc81512d0 2024-09-13T18:47:30.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8151eb0 con 0x7ffbc81512d0 2024-09-13T18:47:30.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f874a000700 1 -- 172.21.15.32:0/1833680347 wait complete. 2024-09-13T18:47:30.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eb4a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb00c27a0 0x7f8eb0156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eb4a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8eb00c2b80 0x7f8eb006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c020070 con 0x7fe57c0c8420 2024-09-13T18:47:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eafe00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f8eb00b1e00 0x7f8eb0150200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44958/0 (socket says 172.21.15.32:44958) 2024-09-13T18:47:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaf400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb00c27a0 0x7f8eb0156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaf400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f8eb00c27a0 0x7f8eb0156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39908/0 (socket says 172.21.15.32:39908) 2024-09-13T18:47:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaf400700 1 -- 172.21.15.32:0/1028510417 learned_addr learned my addr 172.21.15.32:0/1028510417 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb0157420 con 0x7f8eb00b1e00 2024-09-13T18:47:30.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c1eabe0 con 0x7fe57c0c8420 2024-09-13T18:47:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc80c90e0 con 0x7ffbc81512d0 2024-09-13T18:47:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006edc0 con 0x7f8eb00c2b80 2024-09-13T18:47:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006ded0 con 0x7f8eb00c27a0 2024-09-13T18:47:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaea00700 1 --2- 172.21.15.32:0/1028510417 >> v2:172.21.15.32:3300/0 conn(0x7f8eb00c2b80 0x7f8eb006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.905 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eae000700 1 -- 172.21.15.32:0/1028510417 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090112371 0 0) 0x7f8ea8001490 con 0x7f8eb00b1e00 2024-09-13T18:47:30.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c1eb1a0 con 0x7fe57c0c8420 2024-09-13T18:47:30.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eae000700 1 -- 172.21.15.32:0/1028510417 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e940035d0 con 0x7f8eb00b1e00 2024-09-13T18:47:30.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaf400700 1 -- 172.21.15.32:0/1028510417 >> v2:172.21.15.32:3300/0 conn(0x7f8eb00c2b80 msgr2=0x7f8eb006f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaf400700 1 --2- 172.21.15.32:0/1028510417 >> v2:172.21.15.32:3300/0 conn(0x7f8eb00c2b80 0x7f8eb006f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f8eaf400700 1 -- 172.21.15.32:0/1028510417 >> v1:172.21.15.86:6789/0 conn(0x7f8eb00b1e00 legacy=0x7f8eb0150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f874a000700 1 Processor -- start 2024-09-13T18:47:30.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7f874a000700 1 -- start start 2024-09-13T18:47:30.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c0038d0 con 0x7fe57c0c8420 2024-09-13T18:47:30.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.890+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003c40 con 0x7fe57c0c8420 2024-09-13T18:47:30.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f874a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87440c75c0 0x7f87440ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f874a000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 0x7f87441f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c1eb360 con 0x7fe57c0c8420 2024-09-13T18:47:30.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc8152040 con 0x7ffbc81512d0 2024-09-13T18:47:30.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8eaf400700 1 -- 172.21.15.32:0/1028510417 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb006e1b0 con 0x7f8eb00c27a0 2024-09-13T18:47:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f874a000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87440aa420 0x7f87441f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f874a000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440aceb0 con 0x7f87440c75c0 2024-09-13T18:47:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f874a000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87441f5130 con 0x7f874415a450 2024-09-13T18:47:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f874a000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874406db00 con 0x7f87440aa420 2024-09-13T18:47:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8eaf400700 1 --2- 172.21.15.32:0/1028510417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb0156ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006d070 tx=0x7f8ea0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c89439afd85504 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 0x7f87441f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 0x7f87441f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39912/0 (socket says 172.21.15.32:39912) 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 -- 172.21.15.32:0/3954767468 learned_addr learned my addr 172.21.15.32:0/3954767468 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8743e00700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87440aa420 0x7f87441f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8743400700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87440c75c0 0x7f87440ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 -- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87440aa420 msgr2=0x7f87441f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87440aa420 0x7f87441f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 -- 172.21.15.32:0/3954767468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87440c75c0 msgr2=0x7f87440ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87440c75c0 0x7f87440ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 -- 172.21.15.32:0/3954767468 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c009b30 con 0x7f874415a450 2024-09-13T18:47:30.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7f8742a00700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 0x7f87441f55c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f873400c780 tx=0x7f873400ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.894+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffbc00147c0 con 0x7ffbc81512d0 2024-09-13T18:47:30.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7ffbbfe00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffba80667b0 0x7ffba8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7ffbc0085360 con 0x7ffbc81512d0 2024-09-13T18:47:30.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7ffbc7e00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffba80667b0 0x7ffba8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe56c025470 con 0x7fe57c0c8420 2024-09-13T18:47:30.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7ffbc7e00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffba80667b0 0x7ffba8068c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4007c40 tx=0x7ffbb4007b90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7fe573e00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe55c066730 0x7fe55c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fe56c08a070 con 0x7fe57c0c8420 2024-09-13T18:47:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7fe57b400700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe55c066730 0x7fe55c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.898+0000 7fe57b400700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe55c066730 0x7fe55c068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06e480 tx=0x7fe5680091c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.902+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe56c057150 con 0x7fe57c0c8420 2024-09-13T18:47:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.902+0000 7f8eae000700 1 -- 172.21.15.32:0/1028510417 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011830 con 0x7f8eb00c27a0 2024-09-13T18:47:30.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.902+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340054e0 con 0x7f874415a450 2024-09-13T18:47:30.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.902+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340036a0 con 0x7f874415a450 2024-09-13T18:47:30.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.902+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734003a30 con 0x7f874415a450 2024-09-13T18:47:30.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.902+0000 7f8eae000700 1 -- 172.21.15.32:0/1028510417 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea0011990 con 0x7f8eb00c27a0 2024-09-13T18:47:30.914 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eae000700 1 -- 172.21.15.32:0/1028510417 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011d20 con 0x7f8eb00c27a0 2024-09-13T18:47:30.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 msgr2=0x7f8eb0156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/1028510417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb0156ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006d070 tx=0x7f8ea0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874415e9b0 con 0x7f874415a450 2024-09-13T18:47:30.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874415ec50 con 0x7f874415a450 2024-09-13T18:47:30.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 shutdown_connections 2024-09-13T18:47:30.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/1028510417 >> v2:172.21.15.32:3300/0 conn(0x7f8eb00c2b80 0x7f8eb006f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/1028510417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb0156ee0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 >> 172.21.15.32:0/1028510417 conn(0x7f8eb00c8a60 msgr2=0x7f8eb00c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 shutdown_connections 2024-09-13T18:47:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f8eb4a00700 1 -- 172.21.15.32:0/1028510417 wait complete. 2024-09-13T18:47:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffbc0052440 con 0x7ffbc81512d0 2024-09-13T18:47:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.906+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87441f52e0 con 0x7f874415a450 2024-09-13T18:47:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eb4a00700 1 Processor -- start 2024-09-13T18:47:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eb4a00700 1 -- start start 2024-09-13T18:47:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8734003b90 con 0x7f874415a450 2024-09-13T18:47:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f873b400700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8724066830 0x7f8724068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8734083d00 con 0x7f874415a450 2024-09-13T18:47:30.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eb4a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 0x7f8eb01f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eb4a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eb4a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 0x7f8eb0143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.918 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8743400700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8724066830 0x7f8724068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eaf400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 0x7f8eb01f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eaf400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 0x7f8eb01f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52750/0 (socket says 172.21.15.32:52750) 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eaea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.910+0000 7f8eaea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb00c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39926/0 (socket says 172.21.15.32:39926) 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 0x7f8eb0143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 0x7f8eb0143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57912/0 (socket says 172.21.15.32:57912) 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eaf400700 1 -- 172.21.15.32:0/3140007126 learned_addr learned my addr 172.21.15.32:0/3140007126 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.919 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8734050d70 con 0x7f874415a450 2024-09-13T18:47:30.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00c5b10 con 0x7f8eb00c2b80 2024-09-13T18:47:30.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01ed490 con 0x7f8eb00c27a0 2024-09-13T18:47:30.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00c62a0 con 0x7f8eb00b1e00 2024-09-13T18:47:30.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8743400700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8724066830 0x7f8724068cf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8744072a40 tx=0x7f873c009000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 -- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 msgr2=0x7f8eb01f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 0x7f8eb01f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 -- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 msgr2=0x7f8eb00c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb00c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.921 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009570 con 0x7f8eb00c2b80 2024-09-13T18:47:30.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eaea00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb00c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:30.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eafe00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 0x7f8eb0143780 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800caf0 tx=0x7f8ea800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eaf400700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 0x7f8eb01f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:30.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea800aa90 con 0x7f8eb00c2b80 2024-09-13T18:47:30.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb00c58e0 con 0x7f8eb00c2b80 2024-09-13T18:47:30.922 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.914+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb00c4770 con 0x7f8eb00c2b80 2024-09-13T18:47:30.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.918+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea800abf0 con 0x7f8eb00c2b80 2024-09-13T18:47:30.925 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.918+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea801c440 con 0x7f8eb00c2b80 2024-09-13T18:47:30.926 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.918+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e88005310 con 0x7f8eb00c2b80 2024-09-13T18:47:30.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.922+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ea8007070 con 0x7f8eb00c2b80 2024-09-13T18:47:30.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.922+0000 7f8ea7400700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8e90066730 0x7f8e90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.930 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.922+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f8ea80840f0 con 0x7f8eb00c2b80 2024-09-13T18:47:30.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.926+0000 7f8eaf400700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8e90066730 0x7f8e90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.926+0000 7f8eaf400700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8e90066730 0x7f8e90068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000a010 tx=0x7f8ea0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.939 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.934+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ea8050ff0 con 0x7f8eb00c2b80 2024-09-13T18:47:30.942 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.934+0000 7f5160c00700 1 Processor -- start 2024-09-13T18:47:30.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5160c00700 1 -- start start 2024-09-13T18:47:30.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7fa78f200700 1 Processor -- start 2024-09-13T18:47:30.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7fa78f200700 1 -- start start 2024-09-13T18:47:30.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5160c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f515c06ae20 0x7f515c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5160c00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c0c28d0 con 0x7f515c151ab0 2024-09-13T18:47:30.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5160c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c0c4150 con 0x7f515c0cd0e0 2024-09-13T18:47:30.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5160c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c0c2310 con 0x7f515c06ae20 2024-09-13T18:47:30.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5159e00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f515c151ab0 0x7f515c0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39802/0 (socket says 172.21.15.32:39802) 2024-09-13T18:47:30.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.938+0000 7f5159e00700 1 -- 172.21.15.32:0/1807787540 learned_addr learned my addr 172.21.15.32:0/1807787540 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:30.947 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5159400700 1 --2- 172.21.15.32:0/1807787540 >> v2:172.21.15.86:3300/0 conn(0x7f515c06ae20 0x7f515c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5159400700 1 -- 172.21.15.32:0/1807787540 >> v1:172.21.15.86:6789/0 conn(0x7f515c0cd0e0 legacy=0x7f515c161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5159400700 1 -- 172.21.15.32:0/1807787540 >> v1:172.21.15.32:6789/0 conn(0x7f515c151ab0 legacy=0x7f515c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5159400700 1 -- 172.21.15.32:0/1807787540 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0c25f0 con 0x7f515c06ae20 2024-09-13T18:47:30.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5158a00700 1 -- 172.21.15.32:0/1807787540 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338152046 0 0) 0x7f515c0c28d0 con 0x7f515c151ab0 2024-09-13T18:47:30.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78f200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa790155e80 0x7fa790155490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78f200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fa7900c8420 0x7fa7901594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78f200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa790158a80 con 0x7fa7900c7fa0 2024-09-13T18:47:30.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78f200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790159a10 con 0x7fa790155e80 2024-09-13T18:47:30.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78f200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790159040 con 0x7fa7900c8420 2024-09-13T18:47:30.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5159400700 1 --2- 172.21.15.32:0/1807787540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c06ae20 0x7f515c06b980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f514c009850 tx=0x7f514c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab5d1e402f7176d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5158a00700 1 -- 172.21.15.32:0/1807787540 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c011830 con 0x7f515c06ae20 2024-09-13T18:47:30.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5158a00700 1 -- 172.21.15.32:0/1807787540 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c011990 con 0x7f515c06ae20 2024-09-13T18:47:30.950 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7f5158a00700 1 -- 172.21.15.32:0/1807787540 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c011d20 con 0x7f515c06ae20 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78d400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa7900c7fa0 0x7fa7900a9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39812/0 (socket says 172.21.15.32:39812) 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78d400700 1 -- 172.21.15.32:0/1337585651 learned_addr learned my addr 172.21.15.32:0/1337585651 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78de00700 1 --2- 172.21.15.32:0/1337585651 >> v2:172.21.15.32:3300/0 conn(0x7fa790155e80 0x7fa790155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78de00700 1 -- 172.21.15.32:0/1337585651 >> v2:172.21.15.86:3300/0 conn(0x7fa7900c8420 msgr2=0x7fa7901594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78de00700 1 --2- 172.21.15.32:0/1337585651 >> v2:172.21.15.86:3300/0 conn(0x7fa7900c8420 0x7fa7901594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78de00700 1 -- 172.21.15.32:0/1337585651 >> v1:172.21.15.32:6789/0 conn(0x7fa7900c7fa0 legacy=0x7fa7900a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78de00700 1 -- 172.21.15.32:0/1337585651 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79006eac0 con 0x7fa790155e80 2024-09-13T18:47:30.951 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.942+0000 7fa78de00700 1 --2- 172.21.15.32:0/1337585651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa790155e80 0x7fa790155490 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa780010ba0 tx=0x7fa780010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cc312902324d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 -- 172.21.15.32:0/1807787540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c06ae20 msgr2=0x7f515c06b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.952 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 --2- 172.21.15.32:0/1807787540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c06ae20 0x7f515c06b980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f514c009850 tx=0x7f514c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:30.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 -- 172.21.15.32:0/1807787540 shutdown_connections 2024-09-13T18:47:30.953 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78ca00700 1 -- 172.21.15.32:0/1337585651 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78000be80 con 0x7fa790155e80 2024-09-13T18:47:30.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78ca00700 1 -- 172.21.15.32:0/1337585651 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780006b30 con 0x7fa790155e80 2024-09-13T18:47:30.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78ca00700 1 -- 172.21.15.32:0/1337585651 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780010070 con 0x7fa790155e80 2024-09-13T18:47:30.954 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 --2- 172.21.15.32:0/1807787540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c06ae20 0x7f515c06b980 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 -- 172.21.15.32:0/1337585651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa790155e80 msgr2=0x7fa790155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 --2- 172.21.15.32:0/1337585651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa790155e80 0x7fa790155490 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa780010ba0 tx=0x7fa780010eb0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 -- 172.21.15.32:0/1807787540 >> 172.21.15.32:0/1807787540 conn(0x7f515c06eae0 msgr2=0x7f515c06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 -- 172.21.15.32:0/1337585651 shutdown_connections 2024-09-13T18:47:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 --2- 172.21.15.32:0/1337585651 >> v2:172.21.15.86:3300/0 conn(0x7fa7900c8420 0x7fa7901594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 --2- 172.21.15.32:0/1337585651 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa790155e80 0x7fa790155490 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 -- 172.21.15.32:0/1337585651 >> 172.21.15.32:0/1337585651 conn(0x7fa7900cac60 msgr2=0x7fa7900cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 -- 172.21.15.32:0/1807787540 shutdown_connections 2024-09-13T18:47:30.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7f5160c00700 1 -- 172.21.15.32:0/1807787540 wait complete. 2024-09-13T18:47:30.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 -- 172.21.15.32:0/1337585651 shutdown_connections 2024-09-13T18:47:30.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.946+0000 7fa78f200700 1 -- 172.21.15.32:0/1337585651 wait complete. 2024-09-13T18:47:30.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 Processor -- start 2024-09-13T18:47:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 -- start start 2024-09-13T18:47:30.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 Processor -- start 2024-09-13T18:47:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f515c06ae20 0x7f515c0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c0cd0e0 0x7f515c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 0x7f515c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1446d0 con 0x7f515c06ae20 2024-09-13T18:47:30.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1513f0 con 0x7f515c0cd0e0 2024-09-13T18:47:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5160c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0cbf90 con 0x7f515c151ab0 2024-09-13T18:47:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5159400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c0cd0e0 0x7f515c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 0x7f515c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 0x7f515c0c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52758/0 (socket says 172.21.15.32:52758) 2024-09-13T18:47:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 -- 172.21.15.32:0/762465254 learned_addr learned my addr 172.21.15.32:0/762465254 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 -- start start 2024-09-13T18:47:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5159e00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f515c06ae20 0x7f515c0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 -- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c0cd0e0 msgr2=0x7f515c0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c0cd0e0 0x7f515c0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 -- 172.21.15.32:0/762465254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f515c06ae20 msgr2=0x7f515c0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f515c06ae20 0x7f515c0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 -- 172.21.15.32:0/762465254 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0094b0 con 0x7f515c151ab0 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 0x7fa79006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa790155e80 0x7fa7901ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7901eebf0 0x7fa79014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900ad120 con 0x7fa7901eebf0 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900ad540 con 0x7fa7900c8420 2024-09-13T18:47:30.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79014ba60 con 0x7fa790155e80 2024-09-13T18:47:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f5159e00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f515c06ae20 0x7f515c0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7f515a800700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 0x7f515c0c6d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f515400cc80 tx=0x7f515400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 0x7fa79006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.950+0000 7fa78d400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa790155e80 0x7fa7901ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400ad40 con 0x7f515c151ab0 2024-09-13T18:47:30.964 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7ff1bfa00700 1 Processor -- start 2024-09-13T18:47:30.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400ce80 con 0x7f515c151ab0 2024-09-13T18:47:30.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400aea0 con 0x7f515c151ab0 2024-09-13T18:47:30.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c151110 con 0x7f515c151ab0 2024-09-13T18:47:30.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c070900 con 0x7f515c151ab0 2024-09-13T18:47:30.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 0x7fa79006e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39962/0 (socket says 172.21.15.32:39962) 2024-09-13T18:47:30.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 -- 172.21.15.32:0/2740398786 learned_addr learned my addr 172.21.15.32:0/2740398786 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78e800700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7901eebf0 0x7fa79014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 -- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa790155e80 msgr2=0x7fa7901ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa790155e80 0x7fa7901ee6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 -- 172.21.15.32:0/2740398786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7901eebf0 msgr2=0x7fa79014ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7901eebf0 0x7fa79014ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 -- 172.21.15.32:0/2740398786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780010800 con 0x7fa7900c8420 2024-09-13T18:47:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7ff1bfa00700 1 -- start start 2024-09-13T18:47:30.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c067a00 con 0x7f515c151ab0 2024-09-13T18:47:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78de00700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 0x7fa79006e1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa7900aa0b0 tx=0x7fa780004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780005c40 con 0x7fa7900c8420 2024-09-13T18:47:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7900afdb0 con 0x7fa7900c8420 2024-09-13T18:47:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7900acd20 con 0x7fa7900c8420 2024-09-13T18:47:30.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5154003c40 con 0x7f515c151ab0 2024-09-13T18:47:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780005da0 con 0x7fa7900c8420 2024-09-13T18:47:30.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.954+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780004270 con 0x7fa7900c8420 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bfa00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1b806ec60 0x7ff1b80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bfa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b80c8430 0x7ff1b814f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bd000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff1b8071ca0 0x7ff1b8072080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44978/0 (socket says 172.21.15.32:44978) 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1b806ec60 0x7ff1b80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff1b806ec60 0x7ff1b80c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:39968/0 (socket says 172.21.15.32:39968) 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 -- 172.21.15.32:0/2011989878 learned_addr learned my addr 172.21.15.32:0/2011989878 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bda00700 1 --2- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b80c8430 0x7ff1b814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b8070520 con 0x7ff1b8071ca0 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80c9fc0 con 0x7ff1b806ec60 2024-09-13T18:47:30.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80c92a0 con 0x7ff1b80c8430 2024-09-13T18:47:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 -- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b80c8430 msgr2=0x7ff1b814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 --2- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b80c8430 0x7ff1b814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 -- 172.21.15.32:0/2011989878 >> v1:172.21.15.86:6789/0 conn(0x7ff1b8071ca0 legacy=0x7ff1b8072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 -- 172.21.15.32:0/2011989878 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80c7a60 con 0x7ff1b806ec60 2024-09-13T18:47:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7400700 1 -- 172.21.15.32:0/2011989878 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244400166 0 0) 0x7ff1b8070520 con 0x7ff1b8071ca0 2024-09-13T18:47:30.971 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7f5152000700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f513c066730 0x7f513c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f5154084e50 con 0x7f515c151ab0 2024-09-13T18:47:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7e00700 1 --2- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b806ec60 0x7ff1b80c7ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400aab0 tx=0x7ff1a400adc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e12f26d038993a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7400700 1 -- 172.21.15.32:0/2011989878 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400cb70 con 0x7ff1b806ec60 2024-09-13T18:47:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7400700 1 -- 172.21.15.32:0/2011989878 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a400ccd0 con 0x7ff1b806ec60 2024-09-13T18:47:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.958+0000 7ff1b7400700 1 -- 172.21.15.32:0/2011989878 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4010620 con 0x7ff1b806ec60 2024-09-13T18:47:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7f5159e00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f513c066730 0x7f513c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768005310 con 0x7fa7900c8420 2024-09-13T18:47:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b806ec60 msgr2=0x7ff1b80c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7800043d0 con 0x7fa7900c8420 2024-09-13T18:47:30.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b806ec60 0x7ff1b80c7ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400aab0 tx=0x7ff1a400adc0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7f5159e00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f513c066730 0x7f513c068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5148000f60 tx=0x7f5148009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 shutdown_connections 2024-09-13T18:47:30.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b80c8430 0x7ff1b814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/2011989878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b806ec60 0x7ff1b80c7ef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 >> 172.21.15.32:0/2011989878 conn(0x7ff1b80cad40 msgr2=0x7ff1b80cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 shutdown_connections 2024-09-13T18:47:30.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7fa786000700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa76c066760 0x7fa76c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fa78008e0a0 con 0x7fa7900c8420 2024-09-13T18:47:30.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7fa78d400700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa76c066760 0x7fa76c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.962+0000 7ff1bfa00700 1 -- 172.21.15.32:0/2011989878 wait complete. 2024-09-13T18:47:30.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7fa78d400700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa76c066760 0x7fa76c068c20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa7901ef770 tx=0x7fa778005d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5154051e30 con 0x7f515c151ab0 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bfa00700 1 Processor -- start 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bfa00700 1 -- start start 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bfa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 0x7ff1b814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bfa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1b8071ca0 0x7ff1b81dc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bd000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 0x7ff1b814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bd000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 0x7ff1b814ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52782/0 (socket says 172.21.15.32:52782) 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.966+0000 7ff1bfa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b80c8430 0x7ff1b81dc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 -- 172.21.15.32:0/3238673671 learned_addr learned my addr 172.21.15.32:0/3238673671 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1b7e00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1b8071ca0 0x7ff1b81dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bda00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b80c8430 0x7ff1b81dc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81ddc60 con 0x7ff1b8071ca0 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81dcf10 con 0x7ff1b80c8430 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81ddf20 con 0x7ff1b806ec60 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 -- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b80c8430 msgr2=0x7ff1b81dc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b80c8430 0x7ff1b81dc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 -- 172.21.15.32:0/3238673671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1b8071ca0 msgr2=0x7ff1b81dc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1b8071ca0 0x7ff1b81dc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a400a710 con 0x7ff1b806ec60 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa78005b090 con 0x7fa7900c8420 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bd000700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 0x7ff1b814ba10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c580 tx=0x7ff1ac00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004ca0 con 0x7ff1b806ec60 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac004e20 con 0x7ff1b806ec60 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac007310 con 0x7ff1b806ec60 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b81de200 con 0x7ff1b806ec60 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.970+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b81de7c0 con 0x7ff1b806ec60 2024-09-13T18:47:30.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.974+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b814bf50 con 0x7ff1b806ec60 2024-09-13T18:47:30.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.974+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1ac007470 con 0x7ff1b806ec60 2024-09-13T18:47:30.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.978+0000 7ff1b4c00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff198066800 0x7ff198068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.978+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7ff1ac0848a0 con 0x7ff1b806ec60 2024-09-13T18:47:30.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.978+0000 7ff1b7e00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff198066800 0x7ff198068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.982+0000 7ff1b7e00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff198066800 0x7ff198068cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4000c00 tx=0x7ff1a4010000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:30.982+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1ac051910 con 0x7ff1b806ec60 2024-09-13T18:47:31.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.222+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f821c0c6340 con 0x7f8204004870 2024-09-13T18:47:31.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.226+0000 7f8219600700 1 -- 172.21.15.32:0/2637510726 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8210017070 con 0x7f8204004870 2024-09-13T18:47:31.231 INFO:teuthology.orchestra.run.smithi032.stdout:60129542180 2024-09-13T18:47:31.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.226+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f81fc066730 msgr2=0x7f81fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.226+0000 7f8222e00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f81fc066730 0x7f81fc068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8214017040 tx=0x7f821400b070 comp rx=0 tx=0).stop 2024-09-13T18:47:31.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.226+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 msgr2=0x7f821c0ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.234 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.226+0000 7f8222e00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 0x7f821c0ab220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f821001f900 tx=0x7f821001fcc0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 shutdown_connections 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f81fc066730 0x7f81fc068bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f821c15a550 0x7f821c06d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f821c15b350 0x7f821c2108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 --2- 172.21.15.32:0/2637510726 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8204004870 0x7f821c0ab220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 >> 172.21.15.32:0/2637510726 conn(0x7f821c0cac60 msgr2=0x7f821c14c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 shutdown_connections 2024-09-13T18:47:31.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.230+0000 7f8222e00700 1 -- 172.21.15.32:0/2637510726 wait complete. 2024-09-13T18:47:31.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe57c0c9010 con 0x7fe57c0c8420 2024-09-13T18:47:31.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87440a9800 con 0x7f874415a450 2024-09-13T18:47:31.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542180 for osd.6 2024-09-13T18:47:31.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe573e00700 1 -- 172.21.15.32:0/880197073 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe56c02a090 con 0x7fe57c0c8420 2024-09-13T18:47:31.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ffbc815cfd0 con 0x7ffbc81512d0 2024-09-13T18:47:31.261 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.261 INFO:teuthology.orchestra.run.smithi032.stdout:64424509477 2024-09-13T18:47:31.261 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7f873b400700 1 -- 172.21.15.32:0/3954767468 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8734054390 con 0x7f874415a450 2024-09-13T18:47:31.261 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-13T18:47:31.262 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7ffbbfe00700 1 -- 172.21.15.32:0/3472080417 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffbc0055a60 con 0x7ffbc81512d0 2024-09-13T18:47:31.262 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe55c066730 msgr2=0x7fe55c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe55c066730 0x7fe55c068bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe57c06e480 tx=0x7fe5680091c0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 msgr2=0x7fe57c0aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 0x7fe57c0aa830 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe56c000c00 tx=0x7fe56c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 shutdown_connections 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe55c066730 0x7fe55c068bf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe57c0ad010 0x7fe57c0aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe57c155e80 0x7fe57c0ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 --2- 172.21.15.32:0/880197073 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe57c0c8420 0x7fe57c0aa830 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.263 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.254+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 >> 172.21.15.32:0/880197073 conn(0x7fe57c0cac60 msgr2=0x7fe57c157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 shutdown_connections 2024-09-13T18:47:31.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffba80667b0 msgr2=0x7ffba8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.264 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffba80667b0 0x7ffba8068c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4007c40 tx=0x7ffbb4007b90 comp rx=0 tx=0).stop 2024-09-13T18:47:31.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8724066830 msgr2=0x7f8724068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8724066830 0x7f8724068cf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8744072a40 tx=0x7f873c009000 comp rx=0 tx=0).stop 2024-09-13T18:47:31.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 msgr2=0x7f87441f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 0x7f87441f55c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f873400c780 tx=0x7f873400ca90 comp rx=0 tx=0).stop 2024-09-13T18:47:31.265 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7fe581c00700 1 -- 172.21.15.32:0/880197073 wait complete. 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 msgr2=0x7ffbc814d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 0x7ffbc814d290 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0007e90 tx=0x7ffbc000e3c0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 shutdown_connections 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ffba80667b0 0x7ffba8068c70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbc81512d0 0x7ffbc814d290 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffbc80ca9c0 0x7ffbc814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 --2- 172.21.15.32:0/3472080417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbc80c9f00 0x7ffbc80b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 >> 172.21.15.32:0/3472080417 conn(0x7ffbc80725f0 msgr2=0x7ffbc80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 shutdown_connections 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8724066830 0x7f8724068cf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87440aa420 0x7f87441f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f874415a450 0x7f87441f55c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 --2- 172.21.15.32:0/3954767468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87440c75c0 0x7f87440ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 >> 172.21.15.32:0/3954767468 conn(0x7f87440cad40 msgr2=0x7f8744157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 shutdown_connections 2024-09-13T18:47:31.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 shutdown_connections 2024-09-13T18:47:31.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7ffbcee00700 1 -- 172.21.15.32:0/3472080417 wait complete. 2024-09-13T18:47:31.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.258+0000 7f874a000700 1 -- 172.21.15.32:0/3954767468 wait complete. 2024-09-13T18:47:31.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.278+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e880055c0 con 0x7f8eb00c2b80 2024-09-13T18:47:31.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.278+0000 7f8ea7400700 1 -- 172.21.15.32:0/3140007126 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ea8017020 con 0x7f8eb00c2b80 2024-09-13T18:47:31.286 INFO:teuthology.orchestra.run.smithi032.stdout:64424509474 2024-09-13T18:47:31.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8e90066730 msgr2=0x7f8e90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8e90066730 0x7f8e90068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000a010 tx=0x7f8ea0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:31.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 msgr2=0x7f8eb0143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 0x7f8eb0143780 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800caf0 tx=0x7f8ea800ceb0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 shutdown_connections 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f8e90066730 0x7f8e90068bf0 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000a010 tx=0x7f8ea0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8eb00c2b80 0x7f8eb0143780 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8eb00c27a0 0x7f8eb00c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 --2- 172.21.15.32:0/3140007126 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8eb00b1e00 0x7f8eb01f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 >> 172.21.15.32:0/3140007126 conn(0x7f8eb00c8a60 msgr2=0x7f8eb014ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 shutdown_connections 2024-09-13T18:47:31.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.282+0000 7f8eb4a00700 1 -- 172.21.15.32:0/3140007126 wait complete. 2024-09-13T18:47:31.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542179 for osd.7 2024-09-13T18:47:31.291 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.1 2024-09-13T18:47:31.292 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509477 got 64424509477 for osd.2 2024-09-13T18:47:31.294 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.298+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f515c0c9530 con 0x7f515c151ab0 2024-09-13T18:47:31.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.298+0000 7f5152000700 1 -- 172.21.15.32:0/762465254 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5154055450 con 0x7f515c151ab0 2024-09-13T18:47:31.306 INFO:teuthology.orchestra.run.smithi032.stdout:64424509476 2024-09-13T18:47:31.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509474 got 64424509474 for osd.3 2024-09-13T18:47:31.308 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f513c066730 msgr2=0x7f513c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f513c066730 0x7f513c068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5148000f60 tx=0x7f5148009040 comp rx=0 tx=0).stop 2024-09-13T18:47:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 msgr2=0x7f515c0c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 0x7f515c0c6d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f515400cc80 tx=0x7f515400a340 comp rx=0 tx=0).stop 2024-09-13T18:47:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 shutdown_connections 2024-09-13T18:47:31.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f513c066730 0x7f513c068bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f515c151ab0 0x7f515c0c6d30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f515c0cd0e0 0x7f515c0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 --2- 172.21.15.32:0/762465254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f515c06ae20 0x7f515c0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 >> 172.21.15.32:0/762465254 conn(0x7f515c06eae0 msgr2=0x7f515c0ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 shutdown_connections 2024-09-13T18:47:31.310 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.302+0000 7f5160c00700 1 -- 172.21.15.32:0/762465254 wait complete. 2024-09-13T18:47:31.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509476 got 64424509476 for osd.0 2024-09-13T18:47:31.330 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.336 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.330+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa7680055c0 con 0x7fa7900c8420 2024-09-13T18:47:31.337 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.330+0000 7fa786000700 1 -- 172.21.15.32:0/2740398786 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa78001d020 con 0x7fa7900c8420 2024-09-13T18:47:31.337 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-13T18:47:31.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa76c066760 msgr2=0x7fa76c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.341 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa76c066760 0x7fa76c068c20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa7901ef770 tx=0x7fa778005d50 comp rx=0 tx=0).stop 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 msgr2=0x7fa79006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 0x7fa79006e1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa7900aa0b0 tx=0x7fa780004770 comp rx=0 tx=0).stop 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 shutdown_connections 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa76c066760 0x7fa76c068c20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7901eebf0 0x7fa79014ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa790155e80 0x7fa7901ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 --2- 172.21.15.32:0/2740398786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7900c8420 0x7fa79006e1a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 >> 172.21.15.32:0/2740398786 conn(0x7fa7900cac60 msgr2=0x7fa790156260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 shutdown_connections 2024-09-13T18:47:31.342 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.334+0000 7fa78f200700 1 -- 172.21.15.32:0/2740398786 wait complete. 2024-09-13T18:47:31.347 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.342+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff1b8067740 con 0x7ff1b806ec60 2024-09-13T18:47:31.348 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.342+0000 7ff1b4c00700 1 -- 172.21.15.32:0/3238673671 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1ac007720 con 0x7ff1b806ec60 2024-09-13T18:47:31.348 INFO:teuthology.orchestra.run.smithi032.stdout:60129542181 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff198066800 msgr2=0x7ff198068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff198066800 0x7ff198068cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4000c00 tx=0x7ff1a4010000 comp rx=0 tx=0).stop 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 msgr2=0x7ff1b814ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 0x7ff1b814ba10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c580 tx=0x7ff1ac00c890 comp rx=0 tx=0).stop 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 shutdown_connections 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff198066800 0x7ff198068cc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1b80c8430 0x7ff1b81dc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.353 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1b8071ca0 0x7ff1b81dc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 --2- 172.21.15.32:0/3238673671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1b806ec60 0x7ff1b814ba10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 >> 172.21.15.32:0/3238673671 conn(0x7ff1b80cad40 msgr2=0x7ff1b8072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 shutdown_connections 2024-09-13T18:47:31.354 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.346+0000 7ff1bfa00700 1 -- 172.21.15.32:0/3238673671 wait complete. 2024-09-13T18:47:31.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542179 for osd.5 2024-09-13T18:47:31.362 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542180 got 60129542181 for osd.4 2024-09-13T18:47:31.381 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T18:47:31.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:31.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.586+0000 7f45bbe00700 1 Processor -- start 2024-09-13T18:47:31.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.586+0000 7f45bbe00700 1 -- start start 2024-09-13T18:47:31.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bbe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45bc0ca550 0x7f45bc157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc06c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bbe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc15b8f0 con 0x7f45bc151680 2024-09-13T18:47:31.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bbe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc15a940 con 0x7f45bc0ca550 2024-09-13T18:47:31.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1573d0 con 0x7f45bc158040 2024-09-13T18:47:31.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45baa00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f45bc151680 0x7f45bc0c9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44986/0 (socket says 172.21.15.32:44986) 2024-09-13T18:47:31.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45baa00700 1 -- 172.21.15.32:0/1836246992 learned_addr learned my addr 172.21.15.32:0/1836246992 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bb400700 1 --2- 172.21.15.32:0/1836246992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45ba000700 1 --2- 172.21.15.32:0/1836246992 >> v2:172.21.15.32:3300/0 conn(0x7f45bc0ca550 0x7f45bc157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45b9600700 1 -- 172.21.15.32:0/1836246992 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539611720 0 0) 0x7f45ac001110 con 0x7f45bc151680 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45b9600700 1 -- 172.21.15.32:0/1836246992 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a00035d0 con 0x7f45bc151680 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bb400700 1 -- 172.21.15.32:0/1836246992 >> v2:172.21.15.32:3300/0 conn(0x7f45bc0ca550 msgr2=0x7f45bc157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bb400700 1 --2- 172.21.15.32:0/1836246992 >> v2:172.21.15.32:3300/0 conn(0x7f45bc0ca550 0x7f45bc157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bb400700 1 -- 172.21.15.32:0/1836246992 >> v1:172.21.15.86:6789/0 conn(0x7f45bc151680 legacy=0x7f45bc0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bb400700 1 -- 172.21.15.32:0/1836246992 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0cd370 con 0x7f45bc158040 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.590+0000 7f45bb400700 1 --2- 172.21.15.32:0/1836246992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc06c050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009d90 tx=0x7f45b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a8265a163ddf3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45b9600700 1 -- 172.21.15.32:0/1836246992 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400e070 con 0x7f45bc158040 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45b9600700 1 -- 172.21.15.32:0/1836246992 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400bb20 con 0x7f45bc158040 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45b9600700 1 -- 172.21.15.32:0/1836246992 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4012430 con 0x7f45bc158040 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 -- 172.21.15.32:0/1836246992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 msgr2=0x7f45bc06c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1836246992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc06c050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009d90 tx=0x7f45b400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 -- 172.21.15.32:0/1836246992 shutdown_connections 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1836246992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc06c050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1836246992 >> v2:172.21.15.32:3300/0 conn(0x7f45bc0ca550 0x7f45bc157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 -- 172.21.15.32:0/1836246992 >> 172.21.15.32:0/1836246992 conn(0x7f45bc06a390 msgr2=0x7f45bc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 -- 172.21.15.32:0/1836246992 shutdown_connections 2024-09-13T18:47:31.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.594+0000 7f45bbe00700 1 -- 172.21.15.32:0/1836246992 wait complete. 2024-09-13T18:47:31.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 Processor -- start 2024-09-13T18:47:31.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 -- start start 2024-09-13T18:47:31.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 0x7f45bc0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45bc151680 0x7f45bc0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc0c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c4b40 con 0x7f45bc0ca550 2024-09-13T18:47:31.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c6830 con 0x7f45bc151680 2024-09-13T18:47:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc14dd90 con 0x7f45bc158040 2024-09-13T18:47:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 0x7f45bc0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 0x7f45bc0c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57962/0 (socket says 172.21.15.32:57962) 2024-09-13T18:47:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 -- 172.21.15.32:0/1150930728 learned_addr learned my addr 172.21.15.32:0/1150930728 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45ba000700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45bc151680 0x7f45bc0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45bb400700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc0c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 -- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 msgr2=0x7f45bc0c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc0c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 -- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45bc151680 msgr2=0x7f45bc0cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45bc151680 0x7f45bc0cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 -- 172.21.15.32:0/1150930728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009a70 con 0x7f45bc0ca550 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.598+0000 7f45baa00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 0x7f45bc0c62f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f45ac001270 tx=0x7f45ac00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac005d90 con 0x7f45bc0ca550 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc0c5d70 con 0x7f45bc0ca550 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac0070d0 con 0x7f45bc0ca550 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac007480 con 0x7f45bc0ca550 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0c6010 con 0x7f45bc0ca550 2024-09-13T18:47:31.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc074dd0 con 0x7f45bc0ca550 2024-09-13T18:47:31.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.602+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45ac0075e0 con 0x7f45bc0ca550 2024-09-13T18:47:31.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.606+0000 7f45b2a00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f459c066730 0x7f459c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.606+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f45ac083810 con 0x7f45bc0ca550 2024-09-13T18:47:31.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.606+0000 7f45ba000700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f459c066730 0x7f459c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.606+0000 7f45ba000700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f459c066730 0x7f459c068bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0c7c60 tx=0x7f45a8009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.614+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45ac0506e0 con 0x7f45bc0ca550 2024-09-13T18:47:31.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.790+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45bc0c3010 con 0x7f459c066730 2024-09-13T18:47:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.810+0000 7f45b2a00700 1 -- 172.21.15.32:0/1150930728 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367880 (secure 0 0 0) 0x7f45bc0c3010 con 0x7f459c066730 2024-09-13T18:47:31.828 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:31.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f459c066730 msgr2=0x7f459c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f459c066730 0x7f459c068bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0c7c60 tx=0x7f45a8009240 comp rx=0 tx=0).stop 2024-09-13T18:47:31.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 msgr2=0x7f45bc0c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 0x7f45bc0c62f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f45ac001270 tx=0x7f45ac00c7d0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 shutdown_connections 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f459c066730 0x7f459c068bf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f45bc158040 0x7f45bc0c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45bc151680 0x7f45bc0cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 --2- 172.21.15.32:0/1150930728 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45bc0ca550 0x7f45bc0c62f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 >> 172.21.15.32:0/1150930728 conn(0x7f45bc06a390 msgr2=0x7f45bc06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 shutdown_connections 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:31.822+0000 7f45bbe00700 1 -- 172.21.15.32:0/1150930728 wait complete. 2024-09-13T18:47:31.833 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:47:31.849 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-13T18:47:30.114079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629029,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":243,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249468,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725252,"statfs":{"total":773094113280,"available":772838658048,"internally_reserved":0,"allocated":8904704,"data_stored":5130154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.492388"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658843+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:26.658843+0000","last_peered":"2024-09-13T18:47:26.658843+0000","last_clean":"2024-09-13T18:47:26.658843+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:26.658843+0000","last_undegraded":"2024-09-13T18:47:26.658843+0000","last_fullsized":"2024-09-13T18:47:26.658843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268110+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:47:27.268110+0000","last_peered":"2024-09-13T18:47:27.268110+0000","last_clean":"2024-09-13T18:47:27.268110+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:27.268110+0000","last_undegraded":"2024-09-13T18:47:27.268110+0000","last_fullsized":"2024-09-13T18:47:27.268110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261007+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.261007+0000","last_peered":"2024-09-13T18:47:27.261007+0000","last_clean":"2024-09-13T18:47:27.261007+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.261007+0000","last_undegraded":"2024-09-13T18:47:27.261007+0000","last_fullsized":"2024-09-13T18:47:27.261007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:46.084608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268242+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:47:27.268242+0000","last_peered":"2024-09-13T18:47:27.268242+0000","last_clean":"2024-09-13T18:47:27.268242+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:27.268242+0000","last_undegraded":"2024-09-13T18:47:27.268242+0000","last_fullsized":"2024-09-13T18:47:27.268242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268231+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:47:27.268231+0000","last_peered":"2024-09-13T18:47:27.268231+0000","last_clean":"2024-09-13T18:47:27.268231+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:27.268231+0000","last_undegraded":"2024-09-13T18:47:27.268231+0000","last_fullsized":"2024-09-13T18:47:27.268231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":95,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655504+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:26.655504+0000","last_peered":"2024-09-13T18:47:26.655504+0000","last_clean":"2024-09-13T18:47:26.655504+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:26.655504+0000","last_undegraded":"2024-09-13T18:47:26.655504+0000","last_fullsized":"2024-09-13T18:47:26.655504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"64'3","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265399+0000","last_change":"2024-09-13T18:47:14.525177+0000","last_active":"2024-09-13T18:47:27.265399+0000","last_peered":"2024-09-13T18:47:27.265399+0000","last_clean":"2024-09-13T18:47:27.265399+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:27.265399+0000","last_undegraded":"2024-09-13T18:47:27.265399+0000","last_fullsized":"2024-09-13T18:47:27.265399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:30.537891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261691+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:27.261691+0000","last_peered":"2024-09-13T18:47:27.261691+0000","last_clean":"2024-09-13T18:47:27.261691+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:27.261691+0000","last_undegraded":"2024-09-13T18:47:27.261691+0000","last_fullsized":"2024-09-13T18:47:27.261691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655757+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:26.655757+0000","last_peered":"2024-09-13T18:47:26.655757+0000","last_clean":"2024-09-13T18:47:26.655757+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:26.655757+0000","last_undegraded":"2024-09-13T18:47:26.655757+0000","last_fullsized":"2024-09-13T18:47:26.655757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901044+0000","last_change":"2024-09-13T18:47:14.525584+0000","last_active":"2024-09-13T18:47:27.901044+0000","last_peered":"2024-09-13T18:47:27.901044+0000","last_clean":"2024-09-13T18:47:27.901044+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:27.901044+0000","last_undegraded":"2024-09-13T18:47:27.901044+0000","last_fullsized":"2024-09-13T18:47:27.901044+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:18.465119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266553+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:27.266553+0000","last_peered":"2024-09-13T18:47:27.266553+0000","last_clean":"2024-09-13T18:47:27.266553+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:27.266553+0000","last_undegraded":"2024-09-13T18:47:27.266553+0000","last_fullsized":"2024-09-13T18:47:27.266553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655470+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:26.655470+0000","last_peered":"2024-09-13T18:47:26.655470+0000","last_clean":"2024-09-13T18:47:26.655470+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:26.655470+0000","last_undegraded":"2024-09-13T18:47:26.655470+0000","last_fullsized":"2024-09-13T18:47:26.655470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266005+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:47:27.266005+0000","last_peered":"2024-09-13T18:47:27.266005+0000","last_clean":"2024-09-13T18:47:27.266005+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:27.266005+0000","last_undegraded":"2024-09-13T18:47:27.266005+0000","last_fullsized":"2024-09-13T18:47:27.266005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"64'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266144+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:47:27.266144+0000","last_peered":"2024-09-13T18:47:27.266144+0000","last_clean":"2024-09-13T18:47:27.266144+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:27.266144+0000","last_undegraded":"2024-09-13T18:47:27.266144+0000","last_fullsized":"2024-09-13T18:47:27.266144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266891+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.266891+0000","last_peered":"2024-09-13T18:47:27.266891+0000","last_clean":"2024-09-13T18:47:27.266891+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.266891+0000","last_undegraded":"2024-09-13T18:47:27.266891+0000","last_fullsized":"2024-09-13T18:47:27.266891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264104+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:27.264104+0000","last_peered":"2024-09-13T18:47:27.264104+0000","last_clean":"2024-09-13T18:47:27.264104+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:27.264104+0000","last_undegraded":"2024-09-13T18:47:27.264104+0000","last_fullsized":"2024-09-13T18:47:27.264104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263324+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.263324+0000","last_peered":"2024-09-13T18:47:27.263324+0000","last_clean":"2024-09-13T18:47:27.263324+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.263324+0000","last_undegraded":"2024-09-13T18:47:27.263324+0000","last_fullsized":"2024-09-13T18:47:27.263324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265099+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.265099+0000","last_peered":"2024-09-13T18:47:27.265099+0000","last_clean":"2024-09-13T18:47:27.265099+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.265099+0000","last_undegraded":"2024-09-13T18:47:27.265099+0000","last_fullsized":"2024-09-13T18:47:27.265099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.954234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656833+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:26.656833+0000","last_peered":"2024-09-13T18:47:26.656833+0000","last_clean":"2024-09-13T18:47:26.656833+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:26.656833+0000","last_undegraded":"2024-09-13T18:47:26.656833+0000","last_fullsized":"2024-09-13T18:47:26.656833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657838+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:26.657838+0000","last_peered":"2024-09-13T18:47:26.657838+0000","last_clean":"2024-09-13T18:47:26.657838+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:26.657838+0000","last_undegraded":"2024-09-13T18:47:26.657838+0000","last_fullsized":"2024-09-13T18:47:26.657838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266878+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.266878+0000","last_peered":"2024-09-13T18:47:27.266878+0000","last_clean":"2024-09-13T18:47:27.266878+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.266878+0000","last_undegraded":"2024-09-13T18:47:27.266878+0000","last_fullsized":"2024-09-13T18:47:27.266878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265730+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:27.265730+0000","last_peered":"2024-09-13T18:47:27.265730+0000","last_clean":"2024-09-13T18:47:27.265730+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:27.265730+0000","last_undegraded":"2024-09-13T18:47:27.265730+0000","last_fullsized":"2024-09-13T18:47:27.265730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263552+0000","last_change":"2024-09-13T18:47:14.520002+0000","last_active":"2024-09-13T18:47:27.263552+0000","last_peered":"2024-09-13T18:47:27.263552+0000","last_clean":"2024-09-13T18:47:27.263552+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:27.263552+0000","last_undegraded":"2024-09-13T18:47:27.263552+0000","last_fullsized":"2024-09-13T18:47:27.263552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:01.778129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656294+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:26.656294+0000","last_peered":"2024-09-13T18:47:26.656294+0000","last_clean":"2024-09-13T18:47:26.656294+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:26.656294+0000","last_undegraded":"2024-09-13T18:47:26.656294+0000","last_fullsized":"2024-09-13T18:47:26.656294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657925+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:26.657925+0000","last_peered":"2024-09-13T18:47:26.657925+0000","last_clean":"2024-09-13T18:47:26.657925+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:26.657925+0000","last_undegraded":"2024-09-13T18:47:26.657925+0000","last_fullsized":"2024-09-13T18:47:26.657925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266890+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.266890+0000","last_peered":"2024-09-13T18:47:27.266890+0000","last_clean":"2024-09-13T18:47:27.266890+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.266890+0000","last_undegraded":"2024-09-13T18:47:27.266890+0000","last_fullsized":"2024-09-13T18:47:27.266890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655511+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:26.655511+0000","last_peered":"2024-09-13T18:47:26.655511+0000","last_clean":"2024-09-13T18:47:26.655511+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:26.655511+0000","last_undegraded":"2024-09-13T18:47:26.655511+0000","last_fullsized":"2024-09-13T18:47:26.655511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658909+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:26.658909+0000","last_peered":"2024-09-13T18:47:26.658909+0000","last_clean":"2024-09-13T18:47:26.658909+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:26.658909+0000","last_undegraded":"2024-09-13T18:47:26.658909+0000","last_fullsized":"2024-09-13T18:47:26.658909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"70'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658459+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:47:26.658459+0000","last_peered":"2024-09-13T18:47:26.658459+0000","last_clean":"2024-09-13T18:47:26.658459+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:26.658459+0000","last_undegraded":"2024-09-13T18:47:26.658459+0000","last_fullsized":"2024-09-13T18:47:26.658459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656651+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:26.656651+0000","last_peered":"2024-09-13T18:47:26.656651+0000","last_clean":"2024-09-13T18:47:26.656651+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:26.656651+0000","last_undegraded":"2024-09-13T18:47:26.656651+0000","last_fullsized":"2024-09-13T18:47:26.656651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263802+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:27.263802+0000","last_peered":"2024-09-13T18:47:27.263802+0000","last_clean":"2024-09-13T18:47:27.263802+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:27.263802+0000","last_undegraded":"2024-09-13T18:47:27.263802+0000","last_fullsized":"2024-09-13T18:47:27.263802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266744+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:47:27.266744+0000","last_peered":"2024-09-13T18:47:27.266744+0000","last_clean":"2024-09-13T18:47:27.266744+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:27.266744+0000","last_undegraded":"2024-09-13T18:47:27.266744+0000","last_fullsized":"2024-09-13T18:47:27.266744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264165+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.264165+0000","last_peered":"2024-09-13T18:47:27.264165+0000","last_clean":"2024-09-13T18:47:27.264165+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.264165+0000","last_undegraded":"2024-09-13T18:47:27.264165+0000","last_fullsized":"2024-09-13T18:47:27.264165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656088+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:47:26.656088+0000","last_peered":"2024-09-13T18:47:26.656088+0000","last_clean":"2024-09-13T18:47:26.656088+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:26.656088+0000","last_undegraded":"2024-09-13T18:47:26.656088+0000","last_fullsized":"2024-09-13T18:47:26.656088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266528+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:47:27.266528+0000","last_peered":"2024-09-13T18:47:27.266528+0000","last_clean":"2024-09-13T18:47:27.266528+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:27.266528+0000","last_undegraded":"2024-09-13T18:47:27.266528+0000","last_fullsized":"2024-09-13T18:47:27.266528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263593+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:47:27.263593+0000","last_peered":"2024-09-13T18:47:27.263593+0000","last_clean":"2024-09-13T18:47:27.263593+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:27.263593+0000","last_undegraded":"2024-09-13T18:47:27.263593+0000","last_fullsized":"2024-09-13T18:47:27.263593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264264+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:27.264264+0000","last_peered":"2024-09-13T18:47:27.264264+0000","last_clean":"2024-09-13T18:47:27.264264+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:27.264264+0000","last_undegraded":"2024-09-13T18:47:27.264264+0000","last_fullsized":"2024-09-13T18:47:27.264264+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:58.188762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265891+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.265891+0000","last_peered":"2024-09-13T18:47:27.265891+0000","last_clean":"2024-09-13T18:47:27.265891+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.265891+0000","last_undegraded":"2024-09-13T18:47:27.265891+0000","last_fullsized":"2024-09-13T18:47:27.265891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263927+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:47:27.263927+0000","last_peered":"2024-09-13T18:47:27.263927+0000","last_clean":"2024-09-13T18:47:27.263927+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:27.263927+0000","last_undegraded":"2024-09-13T18:47:27.263927+0000","last_fullsized":"2024-09-13T18:47:27.263927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264936+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:47:27.264936+0000","last_peered":"2024-09-13T18:47:27.264936+0000","last_clean":"2024-09-13T18:47:27.264936+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:27.264936+0000","last_undegraded":"2024-09-13T18:47:27.264936+0000","last_fullsized":"2024-09-13T18:47:27.264936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"67'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266493+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:47:27.266493+0000","last_peered":"2024-09-13T18:47:27.266493+0000","last_clean":"2024-09-13T18:47:27.266493+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:27.266493+0000","last_undegraded":"2024-09-13T18:47:27.266493+0000","last_fullsized":"2024-09-13T18:47:27.266493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264888+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:47:27.264888+0000","last_peered":"2024-09-13T18:47:27.264888+0000","last_clean":"2024-09-13T18:47:27.264888+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:27.264888+0000","last_undegraded":"2024-09-13T18:47:27.264888+0000","last_fullsized":"2024-09-13T18:47:27.264888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263663+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:47:27.263663+0000","last_peered":"2024-09-13T18:47:27.263663+0000","last_clean":"2024-09-13T18:47:27.263663+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:27.263663+0000","last_undegraded":"2024-09-13T18:47:27.263663+0000","last_fullsized":"2024-09-13T18:47:27.263663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265583+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.265583+0000","last_peered":"2024-09-13T18:47:27.265583+0000","last_clean":"2024-09-13T18:47:27.265583+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.265583+0000","last_undegraded":"2024-09-13T18:47:27.265583+0000","last_fullsized":"2024-09-13T18:47:27.265583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267795+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.267795+0000","last_peered":"2024-09-13T18:47:27.267795+0000","last_clean":"2024-09-13T18:47:27.267795+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.267795+0000","last_undegraded":"2024-09-13T18:47:27.267795+0000","last_fullsized":"2024-09-13T18:47:27.267795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657527+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:26.657527+0000","last_peered":"2024-09-13T18:47:26.657527+0000","last_clean":"2024-09-13T18:47:26.657527+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:26.657527+0000","last_undegraded":"2024-09-13T18:47:26.657527+0000","last_fullsized":"2024-09-13T18:47:26.657527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266055+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.266055+0000","last_peered":"2024-09-13T18:47:27.266055+0000","last_clean":"2024-09-13T18:47:27.266055+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.266055+0000","last_undegraded":"2024-09-13T18:47:27.266055+0000","last_fullsized":"2024-09-13T18:47:27.266055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261221+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:47:27.261221+0000","last_peered":"2024-09-13T18:47:27.261221+0000","last_clean":"2024-09-13T18:47:27.261221+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:27.261221+0000","last_undegraded":"2024-09-13T18:47:27.261221+0000","last_fullsized":"2024-09-13T18:47:27.261221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266732+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.266732+0000","last_peered":"2024-09-13T18:47:27.266732+0000","last_clean":"2024-09-13T18:47:27.266732+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.266732+0000","last_undegraded":"2024-09-13T18:47:27.266732+0000","last_fullsized":"2024-09-13T18:47:27.266732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266415+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:27.266415+0000","last_peered":"2024-09-13T18:47:27.266415+0000","last_clean":"2024-09-13T18:47:27.266415+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:27.266415+0000","last_undegraded":"2024-09-13T18:47:27.266415+0000","last_fullsized":"2024-09-13T18:47:27.266415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263597+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.263597+0000","last_peered":"2024-09-13T18:47:27.263597+0000","last_clean":"2024-09-13T18:47:27.263597+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.263597+0000","last_undegraded":"2024-09-13T18:47:27.263597+0000","last_fullsized":"2024-09-13T18:47:27.263597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655686+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:26.655686+0000","last_peered":"2024-09-13T18:47:26.655686+0000","last_clean":"2024-09-13T18:47:26.655686+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:26.655686+0000","last_undegraded":"2024-09-13T18:47:26.655686+0000","last_fullsized":"2024-09-13T18:47:26.655686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265175+0000","last_change":"2024-09-13T18:47:14.709999+0000","last_active":"2024-09-13T18:47:27.265175+0000","last_peered":"2024-09-13T18:47:27.265175+0000","last_clean":"2024-09-13T18:47:27.265175+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:27.265175+0000","last_undegraded":"2024-09-13T18:47:27.265175+0000","last_fullsized":"2024-09-13T18:47:27.265175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:43.817137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267884+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:47:27.267884+0000","last_peered":"2024-09-13T18:47:27.267884+0000","last_clean":"2024-09-13T18:47:27.267884+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:27.267884+0000","last_undegraded":"2024-09-13T18:47:27.267884+0000","last_fullsized":"2024-09-13T18:47:27.267884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267160+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.267160+0000","last_peered":"2024-09-13T18:47:27.267160+0000","last_clean":"2024-09-13T18:47:27.267160+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.267160+0000","last_undegraded":"2024-09-13T18:47:27.267160+0000","last_fullsized":"2024-09-13T18:47:27.267160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265710+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:27.265710+0000","last_peered":"2024-09-13T18:47:27.265710+0000","last_clean":"2024-09-13T18:47:27.265710+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:27.265710+0000","last_undegraded":"2024-09-13T18:47:27.265710+0000","last_fullsized":"2024-09-13T18:47:27.265710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:41.204767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658197+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:26.658197+0000","last_peered":"2024-09-13T18:47:26.658197+0000","last_clean":"2024-09-13T18:47:26.658197+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:26.658197+0000","last_undegraded":"2024-09-13T18:47:26.658197+0000","last_fullsized":"2024-09-13T18:47:26.658197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265409+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.265409+0000","last_peered":"2024-09-13T18:47:27.265409+0000","last_clean":"2024-09-13T18:47:27.265409+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.265409+0000","last_undegraded":"2024-09-13T18:47:27.265409+0000","last_fullsized":"2024-09-13T18:47:27.265409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656499+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:47:26.656499+0000","last_peered":"2024-09-13T18:47:26.656499+0000","last_clean":"2024-09-13T18:47:26.656499+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:26.656499+0000","last_undegraded":"2024-09-13T18:47:26.656499+0000","last_fullsized":"2024-09-13T18:47:26.656499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265775+0000","last_change":"2024-09-13T18:47:14.523024+0000","last_active":"2024-09-13T18:47:27.265775+0000","last_peered":"2024-09-13T18:47:27.265775+0000","last_clean":"2024-09-13T18:47:27.265775+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:27.265775+0000","last_undegraded":"2024-09-13T18:47:27.265775+0000","last_fullsized":"2024-09-13T18:47:27.265775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:41.142555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261242+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.261242+0000","last_peered":"2024-09-13T18:47:27.261242+0000","last_clean":"2024-09-13T18:47:27.261242+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.261242+0000","last_undegraded":"2024-09-13T18:47:27.261242+0000","last_fullsized":"2024-09-13T18:47:27.261242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265655+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:47:27.265655+0000","last_peered":"2024-09-13T18:47:27.265655+0000","last_clean":"2024-09-13T18:47:27.265655+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:27.265655+0000","last_undegraded":"2024-09-13T18:47:27.265655+0000","last_fullsized":"2024-09-13T18:47:27.265655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657139+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:26.657139+0000","last_peered":"2024-09-13T18:47:26.657139+0000","last_clean":"2024-09-13T18:47:26.657139+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:26.657139+0000","last_undegraded":"2024-09-13T18:47:26.657139+0000","last_fullsized":"2024-09-13T18:47:26.657139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267988+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:27.267988+0000","last_peered":"2024-09-13T18:47:27.267988+0000","last_clean":"2024-09-13T18:47:27.267988+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:27.267988+0000","last_undegraded":"2024-09-13T18:47:27.267988+0000","last_fullsized":"2024-09-13T18:47:27.267988+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261098+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:27.261098+0000","last_peered":"2024-09-13T18:47:27.261098+0000","last_clean":"2024-09-13T18:47:27.261098+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:27.261098+0000","last_undegraded":"2024-09-13T18:47:27.261098+0000","last_fullsized":"2024-09-13T18:47:27.261098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264134+0000","last_change":"2024-09-13T18:47:14.654438+0000","last_active":"2024-09-13T18:47:27.264134+0000","last_peered":"2024-09-13T18:47:27.264134+0000","last_clean":"2024-09-13T18:47:27.264134+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:27.264134+0000","last_undegraded":"2024-09-13T18:47:27.264134+0000","last_fullsized":"2024-09-13T18:47:27.264134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:43.091822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264617+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.264617+0000","last_peered":"2024-09-13T18:47:27.264617+0000","last_clean":"2024-09-13T18:47:27.264617+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.264617+0000","last_undegraded":"2024-09-13T18:47:27.264617+0000","last_fullsized":"2024-09-13T18:47:27.264617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265972+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:27.265972+0000","last_peered":"2024-09-13T18:47:27.265972+0000","last_clean":"2024-09-13T18:47:27.265972+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:27.265972+0000","last_undegraded":"2024-09-13T18:47:27.265972+0000","last_fullsized":"2024-09-13T18:47:27.265972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266196+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:47:27.266196+0000","last_peered":"2024-09-13T18:47:27.266196+0000","last_clean":"2024-09-13T18:47:27.266196+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:27.266196+0000","last_undegraded":"2024-09-13T18:47:27.266196+0000","last_fullsized":"2024-09-13T18:47:27.266196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263761+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.263761+0000","last_peered":"2024-09-13T18:47:27.263761+0000","last_clean":"2024-09-13T18:47:27.263761+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.263761+0000","last_undegraded":"2024-09-13T18:47:27.263761+0000","last_fullsized":"2024-09-13T18:47:27.263761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263104+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:27.263104+0000","last_peered":"2024-09-13T18:47:27.263104+0000","last_clean":"2024-09-13T18:47:27.263104+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:27.263104+0000","last_undegraded":"2024-09-13T18:47:27.263104+0000","last_fullsized":"2024-09-13T18:47:27.263104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264479+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:47:27.264479+0000","last_peered":"2024-09-13T18:47:27.264479+0000","last_clean":"2024-09-13T18:47:27.264479+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:27.264479+0000","last_undegraded":"2024-09-13T18:47:27.264479+0000","last_fullsized":"2024-09-13T18:47:27.264479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266569+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.266569+0000","last_peered":"2024-09-13T18:47:27.266569+0000","last_clean":"2024-09-13T18:47:27.266569+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.266569+0000","last_undegraded":"2024-09-13T18:47:27.266569+0000","last_fullsized":"2024-09-13T18:47:27.266569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900808+0000","last_change":"2024-09-13T18:47:14.649751+0000","last_active":"2024-09-13T18:47:27.900808+0000","last_peered":"2024-09-13T18:47:27.900808+0000","last_clean":"2024-09-13T18:47:27.900808+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:27.900808+0000","last_undegraded":"2024-09-13T18:47:27.900808+0000","last_fullsized":"2024-09-13T18:47:27.900808+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:41.327461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656244+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:47:26.656244+0000","last_peered":"2024-09-13T18:47:26.656244+0000","last_clean":"2024-09-13T18:47:26.656244+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:26.656244+0000","last_undegraded":"2024-09-13T18:47:26.656244+0000","last_fullsized":"2024-09-13T18:47:26.656244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656411+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:27.656411+0000","last_peered":"2024-09-13T18:47:27.656411+0000","last_clean":"2024-09-13T18:47:27.656411+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:27.656411+0000","last_undegraded":"2024-09-13T18:47:27.656411+0000","last_fullsized":"2024-09-13T18:47:27.656411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266384+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:27.266384+0000","last_peered":"2024-09-13T18:47:27.266384+0000","last_clean":"2024-09-13T18:47:27.266384+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:27.266384+0000","last_undegraded":"2024-09-13T18:47:27.266384+0000","last_fullsized":"2024-09-13T18:47:27.266384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"67'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898590+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:47:27.898590+0000","last_peered":"2024-09-13T18:47:27.898590+0000","last_clean":"2024-09-13T18:47:27.898590+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:27.898590+0000","last_undegraded":"2024-09-13T18:47:27.898590+0000","last_fullsized":"2024-09-13T18:47:27.898590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655745+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:26.655745+0000","last_peered":"2024-09-13T18:47:26.655745+0000","last_clean":"2024-09-13T18:47:26.655745+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:26.655745+0000","last_undegraded":"2024-09-13T18:47:26.655745+0000","last_fullsized":"2024-09-13T18:47:26.655745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659183+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:47:27.659183+0000","last_peered":"2024-09-13T18:47:27.659183+0000","last_clean":"2024-09-13T18:47:27.659183+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:27.659183+0000","last_undegraded":"2024-09-13T18:47:27.659183+0000","last_fullsized":"2024-09-13T18:47:27.659183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264885+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:47:27.264885+0000","last_peered":"2024-09-13T18:47:27.264885+0000","last_clean":"2024-09-13T18:47:27.264885+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:27.264885+0000","last_undegraded":"2024-09-13T18:47:27.264885+0000","last_fullsized":"2024-09-13T18:47:27.264885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.896644+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:27.896644+0000","last_peered":"2024-09-13T18:47:27.896644+0000","last_clean":"2024-09-13T18:47:27.896644+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:27.896644+0000","last_undegraded":"2024-09-13T18:47:27.896644+0000","last_fullsized":"2024-09-13T18:47:27.896644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901899+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:47:27.901899+0000","last_peered":"2024-09-13T18:47:27.901899+0000","last_clean":"2024-09-13T18:47:27.901899+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:47:27.901899+0000","last_undegraded":"2024-09-13T18:47:27.901899+0000","last_fullsized":"2024-09-13T18:47:27.901899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262272+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.262272+0000","last_peered":"2024-09-13T18:47:27.262272+0000","last_clean":"2024-09-13T18:47:27.262272+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.262272+0000","last_undegraded":"2024-09-13T18:47:27.262272+0000","last_fullsized":"2024-09-13T18:47:27.262272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657696+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:27.657696+0000","last_peered":"2024-09-13T18:47:27.657696+0000","last_clean":"2024-09-13T18:47:27.657696+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:27.657696+0000","last_undegraded":"2024-09-13T18:47:27.657696+0000","last_fullsized":"2024-09-13T18:47:27.657696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657664+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:26.657664+0000","last_peered":"2024-09-13T18:47:26.657664+0000","last_clean":"2024-09-13T18:47:26.657664+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:26.657664+0000","last_undegraded":"2024-09-13T18:47:26.657664+0000","last_fullsized":"2024-09-13T18:47:26.657664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657922+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:47:27.657922+0000","last_peered":"2024-09-13T18:47:27.657922+0000","last_clean":"2024-09-13T18:47:27.657922+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:27.657922+0000","last_undegraded":"2024-09-13T18:47:27.657922+0000","last_fullsized":"2024-09-13T18:47:27.657922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265110+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:47:27.265110+0000","last_peered":"2024-09-13T18:47:27.265110+0000","last_clean":"2024-09-13T18:47:27.265110+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:27.265110+0000","last_undegraded":"2024-09-13T18:47:27.265110+0000","last_fullsized":"2024-09-13T18:47:27.265110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267014+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.267014+0000","last_peered":"2024-09-13T18:47:27.267014+0000","last_clean":"2024-09-13T18:47:27.267014+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.267014+0000","last_undegraded":"2024-09-13T18:47:27.267014+0000","last_fullsized":"2024-09-13T18:47:27.267014+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655855+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:27.655855+0000","last_peered":"2024-09-13T18:47:27.655855+0000","last_clean":"2024-09-13T18:47:27.655855+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:27.655855+0000","last_undegraded":"2024-09-13T18:47:27.655855+0000","last_fullsized":"2024-09-13T18:47:27.655855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263416+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:47:27.263416+0000","last_peered":"2024-09-13T18:47:27.263416+0000","last_clean":"2024-09-13T18:47:27.263416+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:27.263416+0000","last_undegraded":"2024-09-13T18:47:27.263416+0000","last_fullsized":"2024-09-13T18:47:27.263416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266250+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.266250+0000","last_peered":"2024-09-13T18:47:27.266250+0000","last_clean":"2024-09-13T18:47:27.266250+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.266250+0000","last_undegraded":"2024-09-13T18:47:27.266250+0000","last_fullsized":"2024-09-13T18:47:27.266250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657508+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:26.657508+0000","last_peered":"2024-09-13T18:47:26.657508+0000","last_clean":"2024-09-13T18:47:26.657508+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:26.657508+0000","last_undegraded":"2024-09-13T18:47:26.657508+0000","last_fullsized":"2024-09-13T18:47:26.657508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657187+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:26.657187+0000","last_peered":"2024-09-13T18:47:26.657187+0000","last_clean":"2024-09-13T18:47:26.657187+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:26.657187+0000","last_undegraded":"2024-09-13T18:47:26.657187+0000","last_fullsized":"2024-09-13T18:47:26.657187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267573+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:47:27.267573+0000","last_peered":"2024-09-13T18:47:27.267573+0000","last_clean":"2024-09-13T18:47:27.267573+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:27.267573+0000","last_undegraded":"2024-09-13T18:47:27.267573+0000","last_fullsized":"2024-09-13T18:47:27.267573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261404+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:27.261404+0000","last_peered":"2024-09-13T18:47:27.261404+0000","last_clean":"2024-09-13T18:47:27.261404+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:27.261404+0000","last_undegraded":"2024-09-13T18:47:27.261404+0000","last_fullsized":"2024-09-13T18:47:27.261404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264741+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:27.264741+0000","last_peered":"2024-09-13T18:47:27.264741+0000","last_clean":"2024-09-13T18:47:27.264741+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:27.264741+0000","last_undegraded":"2024-09-13T18:47:27.264741+0000","last_fullsized":"2024-09-13T18:47:27.264741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655701+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:47:26.655701+0000","last_peered":"2024-09-13T18:47:26.655701+0000","last_clean":"2024-09-13T18:47:26.655701+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:26.655701+0000","last_undegraded":"2024-09-13T18:47:26.655701+0000","last_fullsized":"2024-09-13T18:47:26.655701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266338+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:27.266338+0000","last_peered":"2024-09-13T18:47:27.266338+0000","last_clean":"2024-09-13T18:47:27.266338+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:27.266338+0000","last_undegraded":"2024-09-13T18:47:27.266338+0000","last_fullsized":"2024-09-13T18:47:27.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266075+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:27.266075+0000","last_peered":"2024-09-13T18:47:27.266075+0000","last_clean":"2024-09-13T18:47:27.266075+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:27.266075+0000","last_undegraded":"2024-09-13T18:47:27.266075+0000","last_fullsized":"2024-09-13T18:47:27.266075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267343+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:27.267343+0000","last_peered":"2024-09-13T18:47:27.267343+0000","last_clean":"2024-09-13T18:47:27.267343+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:27.267343+0000","last_undegraded":"2024-09-13T18:47:27.267343+0000","last_fullsized":"2024-09-13T18:47:27.267343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263537+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:27.263537+0000","last_peered":"2024-09-13T18:47:27.263537+0000","last_clean":"2024-09-13T18:47:27.263537+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:27.263537+0000","last_undegraded":"2024-09-13T18:47:27.263537+0000","last_fullsized":"2024-09-13T18:47:27.263537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264135+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:27.264135+0000","last_peered":"2024-09-13T18:47:27.264135+0000","last_clean":"2024-09-13T18:47:27.264135+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:27.264135+0000","last_undegraded":"2024-09-13T18:47:27.264135+0000","last_fullsized":"2024-09-13T18:47:27.264135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656312+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:26.656312+0000","last_peered":"2024-09-13T18:47:26.656312+0000","last_clean":"2024-09-13T18:47:26.656312+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:26.656312+0000","last_undegraded":"2024-09-13T18:47:26.656312+0000","last_fullsized":"2024-09-13T18:47:26.656312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268166+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:27.268166+0000","last_peered":"2024-09-13T18:47:27.268166+0000","last_clean":"2024-09-13T18:47:27.268166+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:27.268166+0000","last_undegraded":"2024-09-13T18:47:27.268166+0000","last_fullsized":"2024-09-13T18:47:27.268166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265579+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:27.265579+0000","last_peered":"2024-09-13T18:47:27.265579+0000","last_clean":"2024-09-13T18:47:27.265579+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:27.265579+0000","last_undegraded":"2024-09-13T18:47:27.265579+0000","last_fullsized":"2024-09-13T18:47:27.265579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266255+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:47:27.266255+0000","last_peered":"2024-09-13T18:47:27.266255+0000","last_clean":"2024-09-13T18:47:27.266255+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:27.266255+0000","last_undegraded":"2024-09-13T18:47:27.266255+0000","last_fullsized":"2024-09-13T18:47:27.266255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261334+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:27.261334+0000","last_peered":"2024-09-13T18:47:27.261334+0000","last_clean":"2024-09-13T18:47:27.261334+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:27.261334+0000","last_undegraded":"2024-09-13T18:47:27.261334+0000","last_fullsized":"2024-09-13T18:47:27.261334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657229+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:26.657229+0000","last_peered":"2024-09-13T18:47:26.657229+0000","last_clean":"2024-09-13T18:47:26.657229+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:26.657229+0000","last_undegraded":"2024-09-13T18:47:26.657229+0000","last_fullsized":"2024-09-13T18:47:26.657229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264995+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:27.264995+0000","last_peered":"2024-09-13T18:47:27.264995+0000","last_clean":"2024-09-13T18:47:27.264995+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:27.264995+0000","last_undegraded":"2024-09-13T18:47:27.264995+0000","last_fullsized":"2024-09-13T18:47:27.264995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266855+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:27.266855+0000","last_peered":"2024-09-13T18:47:27.266855+0000","last_clean":"2024-09-13T18:47:27.266855+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:27.266855+0000","last_undegraded":"2024-09-13T18:47:27.266855+0000","last_fullsized":"2024-09-13T18:47:27.266855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265943+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:27.265943+0000","last_peered":"2024-09-13T18:47:27.265943+0000","last_clean":"2024-09-13T18:47:27.265943+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:27.265943+0000","last_undegraded":"2024-09-13T18:47:27.265943+0000","last_fullsized":"2024-09-13T18:47:27.265943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266928+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:27.266928+0000","last_peered":"2024-09-13T18:47:27.266928+0000","last_clean":"2024-09-13T18:47:27.266928+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:27.266928+0000","last_undegraded":"2024-09-13T18:47:27.266928+0000","last_fullsized":"2024-09-13T18:47:27.266928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265447+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:47:27.265447+0000","last_peered":"2024-09-13T18:47:27.265447+0000","last_clean":"2024-09-13T18:47:27.265447+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:27.265447+0000","last_undegraded":"2024-09-13T18:47:27.265447+0000","last_fullsized":"2024-09-13T18:47:27.265447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265838+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:27.265838+0000","last_peered":"2024-09-13T18:47:27.265838+0000","last_clean":"2024-09-13T18:47:27.265838+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:27.265838+0000","last_undegraded":"2024-09-13T18:47:27.265838+0000","last_fullsized":"2024-09-13T18:47:27.265838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"64'1","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263722+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:47:27.263722+0000","last_peered":"2024-09-13T18:47:27.263722+0000","last_clean":"2024-09-13T18:47:27.263722+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:27.263722+0000","last_undegraded":"2024-09-13T18:47:27.263722+0000","last_fullsized":"2024-09-13T18:47:27.263722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264382+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:47:27.264382+0000","last_peered":"2024-09-13T18:47:27.264382+0000","last_clean":"2024-09-13T18:47:27.264382+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:27.264382+0000","last_undegraded":"2024-09-13T18:47:27.264382+0000","last_fullsized":"2024-09-13T18:47:27.264382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:47.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900689+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:27.900689+0000","last_peered":"2024-09-13T18:47:27.900689+0000","last_clean":"2024-09-13T18:47:27.900689+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:27.900689+0000","last_undegraded":"2024-09-13T18:47:27.900689+0000","last_fullsized":"2024-09-13T18:47:27.900689+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:12.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264596+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:27.264596+0000","last_peered":"2024-09-13T18:47:27.264596+0000","last_clean":"2024-09-13T18:47:27.264596+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:27.264596+0000","last_undegraded":"2024-09-13T18:47:27.264596+0000","last_fullsized":"2024-09-13T18:47:27.264596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:42.267150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262298+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:27.262298+0000","last_peered":"2024-09-13T18:47:27.262298+0000","last_clean":"2024-09-13T18:47:27.262298+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:27.262298+0000","last_undegraded":"2024-09-13T18:47:27.262298+0000","last_fullsized":"2024-09-13T18:47:27.262298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264635+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:27.264635+0000","last_peered":"2024-09-13T18:47:27.264635+0000","last_clean":"2024-09-13T18:47:27.264635+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:27.264635+0000","last_undegraded":"2024-09-13T18:47:27.264635+0000","last_fullsized":"2024-09-13T18:47:27.264635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266197+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:27.266197+0000","last_peered":"2024-09-13T18:47:27.266197+0000","last_clean":"2024-09-13T18:47:27.266197+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:27.266197+0000","last_undegraded":"2024-09-13T18:47:27.266197+0000","last_fullsized":"2024-09-13T18:47:27.266197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656019+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:47:26.656019+0000","last_peered":"2024-09-13T18:47:26.656019+0000","last_clean":"2024-09-13T18:47:26.656019+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:26.656019+0000","last_undegraded":"2024-09-13T18:47:26.656019+0000","last_fullsized":"2024-09-13T18:47:26.656019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264505+0000","last_change":"2024-09-13T18:47:14.522436+0000","last_active":"2024-09-13T18:47:27.264505+0000","last_peered":"2024-09-13T18:47:27.264505+0000","last_clean":"2024-09-13T18:47:27.264505+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:27.264505+0000","last_undegraded":"2024-09-13T18:47:27.264505+0000","last_fullsized":"2024-09-13T18:47:27.264505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:19.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656017+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:47:26.656017+0000","last_peered":"2024-09-13T18:47:26.656017+0000","last_clean":"2024-09-13T18:47:26.656017+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:26.656017+0000","last_undegraded":"2024-09-13T18:47:26.656017+0000","last_fullsized":"2024-09-13T18:47:26.656017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267711+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:27.267711+0000","last_peered":"2024-09-13T18:47:27.267711+0000","last_clean":"2024-09-13T18:47:27.267711+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:27.267711+0000","last_undegraded":"2024-09-13T18:47:27.267711+0000","last_fullsized":"2024-09-13T18:47:27.267711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267932+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:27.267932+0000","last_peered":"2024-09-13T18:47:27.267932+0000","last_clean":"2024-09-13T18:47:27.267932+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:27.267932+0000","last_undegraded":"2024-09-13T18:47:27.267932+0000","last_fullsized":"2024-09-13T18:47:27.267932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265619+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:27.265619+0000","last_peered":"2024-09-13T18:47:27.265619+0000","last_clean":"2024-09-13T18:47:27.265619+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:27.265619+0000","last_undegraded":"2024-09-13T18:47:27.265619+0000","last_fullsized":"2024-09-13T18:47:27.265619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38661,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":82,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2529999999999999,"5min":2.585,"15min":2.585},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.871,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7649999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.1539999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.393,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.353}]},{"osd":2,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.1439999999999999,"15min":1.1739999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.196,"15min":1.244},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5980000000000001,"5min":1.778,"15min":1.778},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.222},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5149999999999999,"5min":1.665,"15min":1.665},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.3080000000000001,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.5469999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2989999999999999,"15min":1.337},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.55,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.6000000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3939999999999999,"15min":1.427},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.337,"15min":1.3560000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.4059999999999999,"15min":1.4359999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.4470000000000001,"15min":1.5009999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5920000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.2370000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":521564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.411},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.141,"15min":1.181},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.355,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0720000000000001,"15min":1.0960000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94499999999999995,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.71}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.2949999999999999,"15min":1.347},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.609,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.2410000000000001,"15min":1.272},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.23}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.254,"15min":1.28},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5649999999999999,"5min":1.788,"15min":1.788},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2829999999999999,"15min":1.3169999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3500000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.1850000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.462,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.446,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.46}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3500000000000001,"15min":1.3839999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.504,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.3680000000000001,"15min":1.413},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5660000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.5309999999999999,"15min":1.587},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5609999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.518},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.4550000000000001,"15min":1.4990000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6120000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":2.1789999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":1.383},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.6359999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":1.7130000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.496},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.4299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.546},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":1.5900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.9650000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.748}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.7769999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.98699999999999999,"15min":1.034},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.256}]},{"osd":2,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1379999999999999,"15min":1.1519999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.006},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1299999999999999,"15min":1.1659999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.014,"15min":1.006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.4630000000000001,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.516},{"interface":"front","average":{"1min":1.012,"5min":1.264,"15min":1.306},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.444}]},{"osd":4,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.2969999999999999,"15min":1.3420000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.1989999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4089999999999998,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.617},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3520000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.454}]},{"osd":6,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.252,"15min":1.2809999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.204},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.411,"15min":1.4350000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.5649999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.4159999999999999,"15min":1.47},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2360000000000002,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.3779999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.4099999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.123}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0249999999999999,"15min":1.05},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0509999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2150000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2989999999999999,"5min":1.375,"15min":1.375},"last":1.175}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.105,"15min":1.135},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.125,"15min":1.151},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2210000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.105}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.86099999999999999},"min":{"1min":0.80700000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0409999999999999,"15min":1.0489999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.038},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.339},{"interface":"front","average":{"1min":1.03,"5min":0.96399999999999997,"15min":0.95299999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.133,"15min":1.127},"min":{"1min":0.77200000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.228}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3169999999999999,"5min":1.427,"15min":1.427},"last":1.569},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4139999999999999,"5min":1.532,"15min":1.532},"last":1.4830000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.341,"5min":1.349,"15min":1.349},"last":1.4550000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2070000000000001,"5min":1.216,"15min":1.216},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.2290000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3700000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.194,"5min":1.466,"15min":1.466},"last":1.659}]},{"osd":4,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90300000000000002,"15min":0.90200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.077},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5169999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.46,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.4259999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0429999999999999,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.27}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":1.367}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":1.081}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.538}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.5649999999999999},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":1.4019999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.298},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.3380000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.119}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.226},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.4750000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1003520,"data_stored":522236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.94499999999999995,"15min":0.98499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1659999999999999,"5min":1.76,"15min":1.76},"last":1.202},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.012,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.538,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0820000000000001,"15min":1.1040000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.45,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.63400000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.121,"15min":1.1519999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.611,"5min":2.032,"15min":2.032},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.403,"15min":1.4890000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.581,"15min":1.681},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3300000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98999999999999999,"15min":0.99399999999999999},"min":{"1min":0.66300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3069999999999999,"5min":1.46,"15min":1.46},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4099999999999999,"5min":1.552,"15min":1.552},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2729999999999999,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.552,"5min":1.694,"15min":1.694},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5680000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:31.911 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:32.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.082+0000 7f20a7200700 1 Processor -- start 2024-09-13T18:47:32.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.082+0000 7f20a7200700 1 -- start start 2024-09-13T18:47:32.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.082+0000 7f20a7200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20a80c6960 0x7f20a8070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.082+0000 7f20a7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 0x7f20a8073e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a80c6430 con 0x7f20a81512f0 2024-09-13T18:47:32.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a80c7910 con 0x7f20a80c6960 2024-09-13T18:47:32.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a80c8630 con 0x7f20a80c81c0 2024-09-13T18:47:32.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 0x7f20a8073e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f20a80c6960 0x7f20a8070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 0x7f20a8073e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52808/0 (socket says 172.21.15.32:52808) 2024-09-13T18:47:32.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 -- 172.21.15.32:0/2712738287 learned_addr learned my addr 172.21.15.32:0/2712738287 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:32.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a5e00700 1 --1- 172.21.15.32:0/2712738287 >> v1:172.21.15.32:6789/0 conn(0x7f20a81512f0 0x7f20a8073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39824/0 (socket says 172.21.15.32:39824) 2024-09-13T18:47:32.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 -- 172.21.15.32:0/2712738287 >> v2:172.21.15.86:3300/0 conn(0x7f20a80c6960 msgr2=0x7f20a8070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:32.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 --2- 172.21.15.32:0/2712738287 >> v2:172.21.15.86:3300/0 conn(0x7f20a80c6960 0x7f20a8070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 -- 172.21.15.32:0/2712738287 >> v1:172.21.15.32:6789/0 conn(0x7f20a81512f0 legacy=0x7f20a8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 -- 172.21.15.32:0/2712738287 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8157f40 con 0x7f20a80c81c0 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a6800700 1 --2- 172.21.15.32:0/2712738287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 0x7f20a8073e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009e50 tx=0x7f20a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d645deeab1481d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a4a00700 1 -- 172.21.15.32:0/2712738287 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000e070 con 0x7f20a80c81c0 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a4a00700 1 -- 172.21.15.32:0/2712738287 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000b910 con 0x7f20a80c81c0 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a4a00700 1 -- 172.21.15.32:0/2712738287 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000bcc0 con 0x7f20a80c81c0 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- 172.21.15.32:0/2712738287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 msgr2=0x7f20a8073e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 --2- 172.21.15.32:0/2712738287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 0x7f20a8073e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009e50 tx=0x7f20a000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- 172.21.15.32:0/2712738287 shutdown_connections 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 --2- 172.21.15.32:0/2712738287 >> v2:172.21.15.86:3300/0 conn(0x7f20a80c6960 0x7f20a8070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.095 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 --2- 172.21.15.32:0/2712738287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c81c0 0x7f20a8073e30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- 172.21.15.32:0/2712738287 >> 172.21.15.32:0/2712738287 conn(0x7f20a8072550 msgr2=0x7f20a80cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.086+0000 7f20a7200700 1 -- 172.21.15.32:0/2712738287 shutdown_connections 2024-09-13T18:47:32.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 -- 172.21.15.32:0/2712738287 wait complete. 2024-09-13T18:47:32.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 Processor -- start 2024-09-13T18:47:32.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 -- start start 2024-09-13T18:47:32.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 0x7f20a81edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20a80c81c0 0x7f20a81eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20a81512f0 0x7f20a814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81597a0 con 0x7f20a80c81c0 2024-09-13T18:47:32.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81f09e0 con 0x7f20a81512f0 2024-09-13T18:47:32.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8159990 con 0x7f20a80c6960 2024-09-13T18:47:32.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a5400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20a80c81c0 0x7f20a81eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 0x7f20a81edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 0x7f20a81edc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52816/0 (socket says 172.21.15.32:52816) 2024-09-13T18:47:32.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a6800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20a81512f0 0x7f20a814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.101 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.090+0000 7f20a5e00700 1 -- 172.21.15.32:0/1864503024 learned_addr learned my addr 172.21.15.32:0/1864503024 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a5e00700 1 -- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20a81512f0 msgr2=0x7f20a814d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a5e00700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20a81512f0 0x7f20a814d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a5e00700 1 -- 172.21.15.32:0/1864503024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20a80c81c0 msgr2=0x7f20a81eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a5e00700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20a80c81c0 0x7f20a81eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a5e00700 1 -- 172.21.15.32:0/1864503024 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009b30 con 0x7f20a80c6960 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a5e00700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 0x7f20a81edc00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f209800c500 tx=0x7f209800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.103 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098005cd0 con 0x7f20a80c6960 2024-09-13T18:47:32.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209800ce90 con 0x7f20a80c6960 2024-09-13T18:47:32.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980072d0 con 0x7f20a80c6960 2024-09-13T18:47:32.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a8159c70 con 0x7f20a80c6960 2024-09-13T18:47:32.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a80c5f60 con 0x7f20a80c6960 2024-09-13T18:47:32.104 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.094+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a80c9f90 con 0x7f20a80c6960 2024-09-13T18:47:32.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.098+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2098007430 con 0x7f20a80c6960 2024-09-13T18:47:32.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.098+0000 7f209e000700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2088066730 0x7f2088068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.105 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.098+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f2098083e80 con 0x7f20a80c6960 2024-09-13T18:47:32.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.098+0000 7f20a5400700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2088066730 0x7f2088068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.106 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.098+0000 7f20a5400700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2088066730 0x7f2088068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20a81504c0 tx=0x7f2094009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.113 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.106+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2098050f10 con 0x7f20a80c6960 2024-09-13T18:47:32.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.298+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20a8158200 con 0x7f2088066730 2024-09-13T18:47:32.326 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.318+0000 7f209e000700 1 -- 172.21.15.32:0/1864503024 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367769 (secure 0 0 0) 0x7f20940118c0 con 0x7f2088066730 2024-09-13T18:47:32.333 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2088066730 msgr2=0x7f2088068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2088066730 0x7f2088068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20a81504c0 tx=0x7f2094009240 comp rx=0 tx=0).stop 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 msgr2=0x7f20a81edc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 0x7f20a81edc00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f209800c500 tx=0x7f209800c810 comp rx=0 tx=0).stop 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 shutdown_connections 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2088066730 0x7f2088068bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20a81512f0 0x7f20a814d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.338 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20a80c81c0 0x7f20a81eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 --2- 172.21.15.32:0/1864503024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20a80c6960 0x7f20a81edc00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 >> 172.21.15.32:0/1864503024 conn(0x7f20a8072550 msgr2=0x7f20a806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 shutdown_connections 2024-09-13T18:47:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.326+0000 7f20a7200700 1 -- 172.21.15.32:0/1864503024 wait complete. 2024-09-13T18:47:32.339 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:47:32.356 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-13T18:47:32.115296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629029,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":243,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249468,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725252,"statfs":{"total":773094113280,"available":772838658048,"internally_reserved":0,"allocated":8904704,"data_stored":5130154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.471993"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658843+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:26.658843+0000","last_peered":"2024-09-13T18:47:26.658843+0000","last_clean":"2024-09-13T18:47:26.658843+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:26.658843+0000","last_undegraded":"2024-09-13T18:47:26.658843+0000","last_fullsized":"2024-09-13T18:47:26.658843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268110+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:47:27.268110+0000","last_peered":"2024-09-13T18:47:27.268110+0000","last_clean":"2024-09-13T18:47:27.268110+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:27.268110+0000","last_undegraded":"2024-09-13T18:47:27.268110+0000","last_fullsized":"2024-09-13T18:47:27.268110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261007+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.261007+0000","last_peered":"2024-09-13T18:47:27.261007+0000","last_clean":"2024-09-13T18:47:27.261007+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.261007+0000","last_undegraded":"2024-09-13T18:47:27.261007+0000","last_fullsized":"2024-09-13T18:47:27.261007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:46.084608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268242+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:47:27.268242+0000","last_peered":"2024-09-13T18:47:27.268242+0000","last_clean":"2024-09-13T18:47:27.268242+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:27.268242+0000","last_undegraded":"2024-09-13T18:47:27.268242+0000","last_fullsized":"2024-09-13T18:47:27.268242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268231+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:47:27.268231+0000","last_peered":"2024-09-13T18:47:27.268231+0000","last_clean":"2024-09-13T18:47:27.268231+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:27.268231+0000","last_undegraded":"2024-09-13T18:47:27.268231+0000","last_fullsized":"2024-09-13T18:47:27.268231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899078+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:27.899078+0000","last_peered":"2024-09-13T18:47:27.899078+0000","last_clean":"2024-09-13T18:47:27.899078+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:27.899078+0000","last_undegraded":"2024-09-13T18:47:27.899078+0000","last_fullsized":"2024-09-13T18:47:27.899078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"64'3","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901004+0000","last_change":"2024-09-13T18:47:14.525177+0000","last_active":"2024-09-13T18:47:27.901004+0000","last_peered":"2024-09-13T18:47:27.901004+0000","last_clean":"2024-09-13T18:47:27.901004+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:27.901004+0000","last_undegraded":"2024-09-13T18:47:27.901004+0000","last_fullsized":"2024-09-13T18:47:27.901004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:30.537891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261691+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:27.261691+0000","last_peered":"2024-09-13T18:47:27.261691+0000","last_clean":"2024-09-13T18:47:27.261691+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:27.261691+0000","last_undegraded":"2024-09-13T18:47:27.261691+0000","last_fullsized":"2024-09-13T18:47:27.261691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655757+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:26.655757+0000","last_peered":"2024-09-13T18:47:26.655757+0000","last_clean":"2024-09-13T18:47:26.655757+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:26.655757+0000","last_undegraded":"2024-09-13T18:47:26.655757+0000","last_fullsized":"2024-09-13T18:47:26.655757+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901044+0000","last_change":"2024-09-13T18:47:14.525584+0000","last_active":"2024-09-13T18:47:27.901044+0000","last_peered":"2024-09-13T18:47:27.901044+0000","last_clean":"2024-09-13T18:47:27.901044+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:27.901044+0000","last_undegraded":"2024-09-13T18:47:27.901044+0000","last_fullsized":"2024-09-13T18:47:27.901044+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:18.465119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266553+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:27.266553+0000","last_peered":"2024-09-13T18:47:27.266553+0000","last_clean":"2024-09-13T18:47:27.266553+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:27.266553+0000","last_undegraded":"2024-09-13T18:47:27.266553+0000","last_fullsized":"2024-09-13T18:47:27.266553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655470+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:26.655470+0000","last_peered":"2024-09-13T18:47:26.655470+0000","last_clean":"2024-09-13T18:47:26.655470+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:26.655470+0000","last_undegraded":"2024-09-13T18:47:26.655470+0000","last_fullsized":"2024-09-13T18:47:26.655470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266005+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:47:27.266005+0000","last_peered":"2024-09-13T18:47:27.266005+0000","last_clean":"2024-09-13T18:47:27.266005+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:27.266005+0000","last_undegraded":"2024-09-13T18:47:27.266005+0000","last_fullsized":"2024-09-13T18:47:27.266005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"64'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266144+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:47:27.266144+0000","last_peered":"2024-09-13T18:47:27.266144+0000","last_clean":"2024-09-13T18:47:27.266144+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:27.266144+0000","last_undegraded":"2024-09-13T18:47:27.266144+0000","last_fullsized":"2024-09-13T18:47:27.266144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266891+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.266891+0000","last_peered":"2024-09-13T18:47:27.266891+0000","last_clean":"2024-09-13T18:47:27.266891+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.266891+0000","last_undegraded":"2024-09-13T18:47:27.266891+0000","last_fullsized":"2024-09-13T18:47:27.266891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264104+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:27.264104+0000","last_peered":"2024-09-13T18:47:27.264104+0000","last_clean":"2024-09-13T18:47:27.264104+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:27.264104+0000","last_undegraded":"2024-09-13T18:47:27.264104+0000","last_fullsized":"2024-09-13T18:47:27.264104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263324+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.263324+0000","last_peered":"2024-09-13T18:47:27.263324+0000","last_clean":"2024-09-13T18:47:27.263324+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.263324+0000","last_undegraded":"2024-09-13T18:47:27.263324+0000","last_fullsized":"2024-09-13T18:47:27.263324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265099+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.265099+0000","last_peered":"2024-09-13T18:47:27.265099+0000","last_clean":"2024-09-13T18:47:27.265099+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.265099+0000","last_undegraded":"2024-09-13T18:47:27.265099+0000","last_fullsized":"2024-09-13T18:47:27.265099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.954234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656833+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:26.656833+0000","last_peered":"2024-09-13T18:47:26.656833+0000","last_clean":"2024-09-13T18:47:26.656833+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:26.656833+0000","last_undegraded":"2024-09-13T18:47:26.656833+0000","last_fullsized":"2024-09-13T18:47:26.656833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657838+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:26.657838+0000","last_peered":"2024-09-13T18:47:26.657838+0000","last_clean":"2024-09-13T18:47:26.657838+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:26.657838+0000","last_undegraded":"2024-09-13T18:47:26.657838+0000","last_fullsized":"2024-09-13T18:47:26.657838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266878+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.266878+0000","last_peered":"2024-09-13T18:47:27.266878+0000","last_clean":"2024-09-13T18:47:27.266878+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.266878+0000","last_undegraded":"2024-09-13T18:47:27.266878+0000","last_fullsized":"2024-09-13T18:47:27.266878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265730+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:27.265730+0000","last_peered":"2024-09-13T18:47:27.265730+0000","last_clean":"2024-09-13T18:47:27.265730+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:27.265730+0000","last_undegraded":"2024-09-13T18:47:27.265730+0000","last_fullsized":"2024-09-13T18:47:27.265730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263552+0000","last_change":"2024-09-13T18:47:14.520002+0000","last_active":"2024-09-13T18:47:27.263552+0000","last_peered":"2024-09-13T18:47:27.263552+0000","last_clean":"2024-09-13T18:47:27.263552+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:27.263552+0000","last_undegraded":"2024-09-13T18:47:27.263552+0000","last_fullsized":"2024-09-13T18:47:27.263552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:01.778129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656294+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:26.656294+0000","last_peered":"2024-09-13T18:47:26.656294+0000","last_clean":"2024-09-13T18:47:26.656294+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:26.656294+0000","last_undegraded":"2024-09-13T18:47:26.656294+0000","last_fullsized":"2024-09-13T18:47:26.656294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657925+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:26.657925+0000","last_peered":"2024-09-13T18:47:26.657925+0000","last_clean":"2024-09-13T18:47:26.657925+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:26.657925+0000","last_undegraded":"2024-09-13T18:47:26.657925+0000","last_fullsized":"2024-09-13T18:47:26.657925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266890+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.266890+0000","last_peered":"2024-09-13T18:47:27.266890+0000","last_clean":"2024-09-13T18:47:27.266890+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.266890+0000","last_undegraded":"2024-09-13T18:47:27.266890+0000","last_fullsized":"2024-09-13T18:47:27.266890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655511+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:26.655511+0000","last_peered":"2024-09-13T18:47:26.655511+0000","last_clean":"2024-09-13T18:47:26.655511+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:26.655511+0000","last_undegraded":"2024-09-13T18:47:26.655511+0000","last_fullsized":"2024-09-13T18:47:26.655511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658909+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:26.658909+0000","last_peered":"2024-09-13T18:47:26.658909+0000","last_clean":"2024-09-13T18:47:26.658909+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:26.658909+0000","last_undegraded":"2024-09-13T18:47:26.658909+0000","last_fullsized":"2024-09-13T18:47:26.658909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"70'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658459+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:47:26.658459+0000","last_peered":"2024-09-13T18:47:26.658459+0000","last_clean":"2024-09-13T18:47:26.658459+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:26.658459+0000","last_undegraded":"2024-09-13T18:47:26.658459+0000","last_fullsized":"2024-09-13T18:47:26.658459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656651+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:26.656651+0000","last_peered":"2024-09-13T18:47:26.656651+0000","last_clean":"2024-09-13T18:47:26.656651+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:26.656651+0000","last_undegraded":"2024-09-13T18:47:26.656651+0000","last_fullsized":"2024-09-13T18:47:26.656651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263802+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:27.263802+0000","last_peered":"2024-09-13T18:47:27.263802+0000","last_clean":"2024-09-13T18:47:27.263802+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:27.263802+0000","last_undegraded":"2024-09-13T18:47:27.263802+0000","last_fullsized":"2024-09-13T18:47:27.263802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266744+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:47:27.266744+0000","last_peered":"2024-09-13T18:47:27.266744+0000","last_clean":"2024-09-13T18:47:27.266744+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:27.266744+0000","last_undegraded":"2024-09-13T18:47:27.266744+0000","last_fullsized":"2024-09-13T18:47:27.266744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264165+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.264165+0000","last_peered":"2024-09-13T18:47:27.264165+0000","last_clean":"2024-09-13T18:47:27.264165+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.264165+0000","last_undegraded":"2024-09-13T18:47:27.264165+0000","last_fullsized":"2024-09-13T18:47:27.264165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656088+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:47:26.656088+0000","last_peered":"2024-09-13T18:47:26.656088+0000","last_clean":"2024-09-13T18:47:26.656088+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:26.656088+0000","last_undegraded":"2024-09-13T18:47:26.656088+0000","last_fullsized":"2024-09-13T18:47:26.656088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266528+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:47:27.266528+0000","last_peered":"2024-09-13T18:47:27.266528+0000","last_clean":"2024-09-13T18:47:27.266528+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:27.266528+0000","last_undegraded":"2024-09-13T18:47:27.266528+0000","last_fullsized":"2024-09-13T18:47:27.266528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263593+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:47:27.263593+0000","last_peered":"2024-09-13T18:47:27.263593+0000","last_clean":"2024-09-13T18:47:27.263593+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:27.263593+0000","last_undegraded":"2024-09-13T18:47:27.263593+0000","last_fullsized":"2024-09-13T18:47:27.263593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264264+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:27.264264+0000","last_peered":"2024-09-13T18:47:27.264264+0000","last_clean":"2024-09-13T18:47:27.264264+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:27.264264+0000","last_undegraded":"2024-09-13T18:47:27.264264+0000","last_fullsized":"2024-09-13T18:47:27.264264+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:58.188762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265891+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.265891+0000","last_peered":"2024-09-13T18:47:27.265891+0000","last_clean":"2024-09-13T18:47:27.265891+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.265891+0000","last_undegraded":"2024-09-13T18:47:27.265891+0000","last_fullsized":"2024-09-13T18:47:27.265891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263927+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:47:27.263927+0000","last_peered":"2024-09-13T18:47:27.263927+0000","last_clean":"2024-09-13T18:47:27.263927+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:27.263927+0000","last_undegraded":"2024-09-13T18:47:27.263927+0000","last_fullsized":"2024-09-13T18:47:27.263927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264936+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:47:27.264936+0000","last_peered":"2024-09-13T18:47:27.264936+0000","last_clean":"2024-09-13T18:47:27.264936+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:27.264936+0000","last_undegraded":"2024-09-13T18:47:27.264936+0000","last_fullsized":"2024-09-13T18:47:27.264936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"67'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266493+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:47:27.266493+0000","last_peered":"2024-09-13T18:47:27.266493+0000","last_clean":"2024-09-13T18:47:27.266493+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:27.266493+0000","last_undegraded":"2024-09-13T18:47:27.266493+0000","last_fullsized":"2024-09-13T18:47:27.266493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264888+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:47:27.264888+0000","last_peered":"2024-09-13T18:47:27.264888+0000","last_clean":"2024-09-13T18:47:27.264888+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:27.264888+0000","last_undegraded":"2024-09-13T18:47:27.264888+0000","last_fullsized":"2024-09-13T18:47:27.264888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263663+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:47:27.263663+0000","last_peered":"2024-09-13T18:47:27.263663+0000","last_clean":"2024-09-13T18:47:27.263663+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:27.263663+0000","last_undegraded":"2024-09-13T18:47:27.263663+0000","last_fullsized":"2024-09-13T18:47:27.263663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265583+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.265583+0000","last_peered":"2024-09-13T18:47:27.265583+0000","last_clean":"2024-09-13T18:47:27.265583+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.265583+0000","last_undegraded":"2024-09-13T18:47:27.265583+0000","last_fullsized":"2024-09-13T18:47:27.265583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267795+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.267795+0000","last_peered":"2024-09-13T18:47:27.267795+0000","last_clean":"2024-09-13T18:47:27.267795+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.267795+0000","last_undegraded":"2024-09-13T18:47:27.267795+0000","last_fullsized":"2024-09-13T18:47:27.267795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657527+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:26.657527+0000","last_peered":"2024-09-13T18:47:26.657527+0000","last_clean":"2024-09-13T18:47:26.657527+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:26.657527+0000","last_undegraded":"2024-09-13T18:47:26.657527+0000","last_fullsized":"2024-09-13T18:47:26.657527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266055+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.266055+0000","last_peered":"2024-09-13T18:47:27.266055+0000","last_clean":"2024-09-13T18:47:27.266055+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.266055+0000","last_undegraded":"2024-09-13T18:47:27.266055+0000","last_fullsized":"2024-09-13T18:47:27.266055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261221+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:47:27.261221+0000","last_peered":"2024-09-13T18:47:27.261221+0000","last_clean":"2024-09-13T18:47:27.261221+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:27.261221+0000","last_undegraded":"2024-09-13T18:47:27.261221+0000","last_fullsized":"2024-09-13T18:47:27.261221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266732+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.266732+0000","last_peered":"2024-09-13T18:47:27.266732+0000","last_clean":"2024-09-13T18:47:27.266732+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.266732+0000","last_undegraded":"2024-09-13T18:47:27.266732+0000","last_fullsized":"2024-09-13T18:47:27.266732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266415+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:27.266415+0000","last_peered":"2024-09-13T18:47:27.266415+0000","last_clean":"2024-09-13T18:47:27.266415+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:27.266415+0000","last_undegraded":"2024-09-13T18:47:27.266415+0000","last_fullsized":"2024-09-13T18:47:27.266415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263597+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.263597+0000","last_peered":"2024-09-13T18:47:27.263597+0000","last_clean":"2024-09-13T18:47:27.263597+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.263597+0000","last_undegraded":"2024-09-13T18:47:27.263597+0000","last_fullsized":"2024-09-13T18:47:27.263597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655686+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:26.655686+0000","last_peered":"2024-09-13T18:47:26.655686+0000","last_clean":"2024-09-13T18:47:26.655686+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:26.655686+0000","last_undegraded":"2024-09-13T18:47:26.655686+0000","last_fullsized":"2024-09-13T18:47:26.655686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265175+0000","last_change":"2024-09-13T18:47:14.709999+0000","last_active":"2024-09-13T18:47:27.265175+0000","last_peered":"2024-09-13T18:47:27.265175+0000","last_clean":"2024-09-13T18:47:27.265175+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:27.265175+0000","last_undegraded":"2024-09-13T18:47:27.265175+0000","last_fullsized":"2024-09-13T18:47:27.265175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:43.817137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267884+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:47:27.267884+0000","last_peered":"2024-09-13T18:47:27.267884+0000","last_clean":"2024-09-13T18:47:27.267884+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:27.267884+0000","last_undegraded":"2024-09-13T18:47:27.267884+0000","last_fullsized":"2024-09-13T18:47:27.267884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267160+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.267160+0000","last_peered":"2024-09-13T18:47:27.267160+0000","last_clean":"2024-09-13T18:47:27.267160+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.267160+0000","last_undegraded":"2024-09-13T18:47:27.267160+0000","last_fullsized":"2024-09-13T18:47:27.267160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265710+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:27.265710+0000","last_peered":"2024-09-13T18:47:27.265710+0000","last_clean":"2024-09-13T18:47:27.265710+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:27.265710+0000","last_undegraded":"2024-09-13T18:47:27.265710+0000","last_fullsized":"2024-09-13T18:47:27.265710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:41.204767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658197+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:26.658197+0000","last_peered":"2024-09-13T18:47:26.658197+0000","last_clean":"2024-09-13T18:47:26.658197+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:26.658197+0000","last_undegraded":"2024-09-13T18:47:26.658197+0000","last_fullsized":"2024-09-13T18:47:26.658197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265409+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.265409+0000","last_peered":"2024-09-13T18:47:27.265409+0000","last_clean":"2024-09-13T18:47:27.265409+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.265409+0000","last_undegraded":"2024-09-13T18:47:27.265409+0000","last_fullsized":"2024-09-13T18:47:27.265409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656499+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:47:26.656499+0000","last_peered":"2024-09-13T18:47:26.656499+0000","last_clean":"2024-09-13T18:47:26.656499+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:26.656499+0000","last_undegraded":"2024-09-13T18:47:26.656499+0000","last_fullsized":"2024-09-13T18:47:26.656499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265775+0000","last_change":"2024-09-13T18:47:14.523024+0000","last_active":"2024-09-13T18:47:27.265775+0000","last_peered":"2024-09-13T18:47:27.265775+0000","last_clean":"2024-09-13T18:47:27.265775+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:27.265775+0000","last_undegraded":"2024-09-13T18:47:27.265775+0000","last_fullsized":"2024-09-13T18:47:27.265775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:41.142555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261242+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.261242+0000","last_peered":"2024-09-13T18:47:27.261242+0000","last_clean":"2024-09-13T18:47:27.261242+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.261242+0000","last_undegraded":"2024-09-13T18:47:27.261242+0000","last_fullsized":"2024-09-13T18:47:27.261242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265655+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:47:27.265655+0000","last_peered":"2024-09-13T18:47:27.265655+0000","last_clean":"2024-09-13T18:47:27.265655+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:27.265655+0000","last_undegraded":"2024-09-13T18:47:27.265655+0000","last_fullsized":"2024-09-13T18:47:27.265655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657139+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:26.657139+0000","last_peered":"2024-09-13T18:47:26.657139+0000","last_clean":"2024-09-13T18:47:26.657139+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:26.657139+0000","last_undegraded":"2024-09-13T18:47:26.657139+0000","last_fullsized":"2024-09-13T18:47:26.657139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267988+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:27.267988+0000","last_peered":"2024-09-13T18:47:27.267988+0000","last_clean":"2024-09-13T18:47:27.267988+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:27.267988+0000","last_undegraded":"2024-09-13T18:47:27.267988+0000","last_fullsized":"2024-09-13T18:47:27.267988+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261098+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:27.261098+0000","last_peered":"2024-09-13T18:47:27.261098+0000","last_clean":"2024-09-13T18:47:27.261098+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:27.261098+0000","last_undegraded":"2024-09-13T18:47:27.261098+0000","last_fullsized":"2024-09-13T18:47:27.261098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264134+0000","last_change":"2024-09-13T18:47:14.654438+0000","last_active":"2024-09-13T18:47:27.264134+0000","last_peered":"2024-09-13T18:47:27.264134+0000","last_clean":"2024-09-13T18:47:27.264134+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:27.264134+0000","last_undegraded":"2024-09-13T18:47:27.264134+0000","last_fullsized":"2024-09-13T18:47:27.264134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:43.091822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264617+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.264617+0000","last_peered":"2024-09-13T18:47:27.264617+0000","last_clean":"2024-09-13T18:47:27.264617+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.264617+0000","last_undegraded":"2024-09-13T18:47:27.264617+0000","last_fullsized":"2024-09-13T18:47:27.264617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265972+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:27.265972+0000","last_peered":"2024-09-13T18:47:27.265972+0000","last_clean":"2024-09-13T18:47:27.265972+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:27.265972+0000","last_undegraded":"2024-09-13T18:47:27.265972+0000","last_fullsized":"2024-09-13T18:47:27.265972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266196+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:47:27.266196+0000","last_peered":"2024-09-13T18:47:27.266196+0000","last_clean":"2024-09-13T18:47:27.266196+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:27.266196+0000","last_undegraded":"2024-09-13T18:47:27.266196+0000","last_fullsized":"2024-09-13T18:47:27.266196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263761+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.263761+0000","last_peered":"2024-09-13T18:47:27.263761+0000","last_clean":"2024-09-13T18:47:27.263761+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.263761+0000","last_undegraded":"2024-09-13T18:47:27.263761+0000","last_fullsized":"2024-09-13T18:47:27.263761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263104+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:27.263104+0000","last_peered":"2024-09-13T18:47:27.263104+0000","last_clean":"2024-09-13T18:47:27.263104+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:27.263104+0000","last_undegraded":"2024-09-13T18:47:27.263104+0000","last_fullsized":"2024-09-13T18:47:27.263104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264479+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:47:27.264479+0000","last_peered":"2024-09-13T18:47:27.264479+0000","last_clean":"2024-09-13T18:47:27.264479+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:27.264479+0000","last_undegraded":"2024-09-13T18:47:27.264479+0000","last_fullsized":"2024-09-13T18:47:27.264479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266569+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.266569+0000","last_peered":"2024-09-13T18:47:27.266569+0000","last_clean":"2024-09-13T18:47:27.266569+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.266569+0000","last_undegraded":"2024-09-13T18:47:27.266569+0000","last_fullsized":"2024-09-13T18:47:27.266569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900808+0000","last_change":"2024-09-13T18:47:14.649751+0000","last_active":"2024-09-13T18:47:27.900808+0000","last_peered":"2024-09-13T18:47:27.900808+0000","last_clean":"2024-09-13T18:47:27.900808+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:27.900808+0000","last_undegraded":"2024-09-13T18:47:27.900808+0000","last_fullsized":"2024-09-13T18:47:27.900808+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:41.327461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656244+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:47:26.656244+0000","last_peered":"2024-09-13T18:47:26.656244+0000","last_clean":"2024-09-13T18:47:26.656244+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:26.656244+0000","last_undegraded":"2024-09-13T18:47:26.656244+0000","last_fullsized":"2024-09-13T18:47:26.656244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656411+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:27.656411+0000","last_peered":"2024-09-13T18:47:27.656411+0000","last_clean":"2024-09-13T18:47:27.656411+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:27.656411+0000","last_undegraded":"2024-09-13T18:47:27.656411+0000","last_fullsized":"2024-09-13T18:47:27.656411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266384+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:27.266384+0000","last_peered":"2024-09-13T18:47:27.266384+0000","last_clean":"2024-09-13T18:47:27.266384+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:27.266384+0000","last_undegraded":"2024-09-13T18:47:27.266384+0000","last_fullsized":"2024-09-13T18:47:27.266384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"67'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898590+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:47:27.898590+0000","last_peered":"2024-09-13T18:47:27.898590+0000","last_clean":"2024-09-13T18:47:27.898590+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:27.898590+0000","last_undegraded":"2024-09-13T18:47:27.898590+0000","last_fullsized":"2024-09-13T18:47:27.898590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655745+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:26.655745+0000","last_peered":"2024-09-13T18:47:26.655745+0000","last_clean":"2024-09-13T18:47:26.655745+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:26.655745+0000","last_undegraded":"2024-09-13T18:47:26.655745+0000","last_fullsized":"2024-09-13T18:47:26.655745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659183+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:47:27.659183+0000","last_peered":"2024-09-13T18:47:27.659183+0000","last_clean":"2024-09-13T18:47:27.659183+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:27.659183+0000","last_undegraded":"2024-09-13T18:47:27.659183+0000","last_fullsized":"2024-09-13T18:47:27.659183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264885+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:47:27.264885+0000","last_peered":"2024-09-13T18:47:27.264885+0000","last_clean":"2024-09-13T18:47:27.264885+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:27.264885+0000","last_undegraded":"2024-09-13T18:47:27.264885+0000","last_fullsized":"2024-09-13T18:47:27.264885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.896644+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:27.896644+0000","last_peered":"2024-09-13T18:47:27.896644+0000","last_clean":"2024-09-13T18:47:27.896644+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:27.896644+0000","last_undegraded":"2024-09-13T18:47:27.896644+0000","last_fullsized":"2024-09-13T18:47:27.896644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901899+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:47:27.901899+0000","last_peered":"2024-09-13T18:47:27.901899+0000","last_clean":"2024-09-13T18:47:27.901899+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:47:27.901899+0000","last_undegraded":"2024-09-13T18:47:27.901899+0000","last_fullsized":"2024-09-13T18:47:27.901899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262272+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.262272+0000","last_peered":"2024-09-13T18:47:27.262272+0000","last_clean":"2024-09-13T18:47:27.262272+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.262272+0000","last_undegraded":"2024-09-13T18:47:27.262272+0000","last_fullsized":"2024-09-13T18:47:27.262272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657696+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:27.657696+0000","last_peered":"2024-09-13T18:47:27.657696+0000","last_clean":"2024-09-13T18:47:27.657696+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:27.657696+0000","last_undegraded":"2024-09-13T18:47:27.657696+0000","last_fullsized":"2024-09-13T18:47:27.657696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657664+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:26.657664+0000","last_peered":"2024-09-13T18:47:26.657664+0000","last_clean":"2024-09-13T18:47:26.657664+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:26.657664+0000","last_undegraded":"2024-09-13T18:47:26.657664+0000","last_fullsized":"2024-09-13T18:47:26.657664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657922+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:47:27.657922+0000","last_peered":"2024-09-13T18:47:27.657922+0000","last_clean":"2024-09-13T18:47:27.657922+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:27.657922+0000","last_undegraded":"2024-09-13T18:47:27.657922+0000","last_fullsized":"2024-09-13T18:47:27.657922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265110+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:47:27.265110+0000","last_peered":"2024-09-13T18:47:27.265110+0000","last_clean":"2024-09-13T18:47:27.265110+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:27.265110+0000","last_undegraded":"2024-09-13T18:47:27.265110+0000","last_fullsized":"2024-09-13T18:47:27.265110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267014+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.267014+0000","last_peered":"2024-09-13T18:47:27.267014+0000","last_clean":"2024-09-13T18:47:27.267014+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.267014+0000","last_undegraded":"2024-09-13T18:47:27.267014+0000","last_fullsized":"2024-09-13T18:47:27.267014+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655855+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:27.655855+0000","last_peered":"2024-09-13T18:47:27.655855+0000","last_clean":"2024-09-13T18:47:27.655855+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:27.655855+0000","last_undegraded":"2024-09-13T18:47:27.655855+0000","last_fullsized":"2024-09-13T18:47:27.655855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263416+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:47:27.263416+0000","last_peered":"2024-09-13T18:47:27.263416+0000","last_clean":"2024-09-13T18:47:27.263416+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:27.263416+0000","last_undegraded":"2024-09-13T18:47:27.263416+0000","last_fullsized":"2024-09-13T18:47:27.263416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266250+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.266250+0000","last_peered":"2024-09-13T18:47:27.266250+0000","last_clean":"2024-09-13T18:47:27.266250+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.266250+0000","last_undegraded":"2024-09-13T18:47:27.266250+0000","last_fullsized":"2024-09-13T18:47:27.266250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657508+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:26.657508+0000","last_peered":"2024-09-13T18:47:26.657508+0000","last_clean":"2024-09-13T18:47:26.657508+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:26.657508+0000","last_undegraded":"2024-09-13T18:47:26.657508+0000","last_fullsized":"2024-09-13T18:47:26.657508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657187+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:26.657187+0000","last_peered":"2024-09-13T18:47:26.657187+0000","last_clean":"2024-09-13T18:47:26.657187+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:26.657187+0000","last_undegraded":"2024-09-13T18:47:26.657187+0000","last_fullsized":"2024-09-13T18:47:26.657187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267573+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:47:27.267573+0000","last_peered":"2024-09-13T18:47:27.267573+0000","last_clean":"2024-09-13T18:47:27.267573+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:27.267573+0000","last_undegraded":"2024-09-13T18:47:27.267573+0000","last_fullsized":"2024-09-13T18:47:27.267573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261404+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:27.261404+0000","last_peered":"2024-09-13T18:47:27.261404+0000","last_clean":"2024-09-13T18:47:27.261404+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:27.261404+0000","last_undegraded":"2024-09-13T18:47:27.261404+0000","last_fullsized":"2024-09-13T18:47:27.261404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264741+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:27.264741+0000","last_peered":"2024-09-13T18:47:27.264741+0000","last_clean":"2024-09-13T18:47:27.264741+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:27.264741+0000","last_undegraded":"2024-09-13T18:47:27.264741+0000","last_fullsized":"2024-09-13T18:47:27.264741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655701+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:47:26.655701+0000","last_peered":"2024-09-13T18:47:26.655701+0000","last_clean":"2024-09-13T18:47:26.655701+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:26.655701+0000","last_undegraded":"2024-09-13T18:47:26.655701+0000","last_fullsized":"2024-09-13T18:47:26.655701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266338+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:27.266338+0000","last_peered":"2024-09-13T18:47:27.266338+0000","last_clean":"2024-09-13T18:47:27.266338+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:27.266338+0000","last_undegraded":"2024-09-13T18:47:27.266338+0000","last_fullsized":"2024-09-13T18:47:27.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266075+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:27.266075+0000","last_peered":"2024-09-13T18:47:27.266075+0000","last_clean":"2024-09-13T18:47:27.266075+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:27.266075+0000","last_undegraded":"2024-09-13T18:47:27.266075+0000","last_fullsized":"2024-09-13T18:47:27.266075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267343+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:27.267343+0000","last_peered":"2024-09-13T18:47:27.267343+0000","last_clean":"2024-09-13T18:47:27.267343+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:27.267343+0000","last_undegraded":"2024-09-13T18:47:27.267343+0000","last_fullsized":"2024-09-13T18:47:27.267343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263537+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:27.263537+0000","last_peered":"2024-09-13T18:47:27.263537+0000","last_clean":"2024-09-13T18:47:27.263537+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:27.263537+0000","last_undegraded":"2024-09-13T18:47:27.263537+0000","last_fullsized":"2024-09-13T18:47:27.263537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264135+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:27.264135+0000","last_peered":"2024-09-13T18:47:27.264135+0000","last_clean":"2024-09-13T18:47:27.264135+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:27.264135+0000","last_undegraded":"2024-09-13T18:47:27.264135+0000","last_fullsized":"2024-09-13T18:47:27.264135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656312+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:26.656312+0000","last_peered":"2024-09-13T18:47:26.656312+0000","last_clean":"2024-09-13T18:47:26.656312+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:26.656312+0000","last_undegraded":"2024-09-13T18:47:26.656312+0000","last_fullsized":"2024-09-13T18:47:26.656312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268166+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:27.268166+0000","last_peered":"2024-09-13T18:47:27.268166+0000","last_clean":"2024-09-13T18:47:27.268166+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:27.268166+0000","last_undegraded":"2024-09-13T18:47:27.268166+0000","last_fullsized":"2024-09-13T18:47:27.268166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265579+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:27.265579+0000","last_peered":"2024-09-13T18:47:27.265579+0000","last_clean":"2024-09-13T18:47:27.265579+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:27.265579+0000","last_undegraded":"2024-09-13T18:47:27.265579+0000","last_fullsized":"2024-09-13T18:47:27.265579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266255+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:47:27.266255+0000","last_peered":"2024-09-13T18:47:27.266255+0000","last_clean":"2024-09-13T18:47:27.266255+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:27.266255+0000","last_undegraded":"2024-09-13T18:47:27.266255+0000","last_fullsized":"2024-09-13T18:47:27.266255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261334+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:27.261334+0000","last_peered":"2024-09-13T18:47:27.261334+0000","last_clean":"2024-09-13T18:47:27.261334+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:27.261334+0000","last_undegraded":"2024-09-13T18:47:27.261334+0000","last_fullsized":"2024-09-13T18:47:27.261334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657229+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:26.657229+0000","last_peered":"2024-09-13T18:47:26.657229+0000","last_clean":"2024-09-13T18:47:26.657229+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:26.657229+0000","last_undegraded":"2024-09-13T18:47:26.657229+0000","last_fullsized":"2024-09-13T18:47:26.657229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264995+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:27.264995+0000","last_peered":"2024-09-13T18:47:27.264995+0000","last_clean":"2024-09-13T18:47:27.264995+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:27.264995+0000","last_undegraded":"2024-09-13T18:47:27.264995+0000","last_fullsized":"2024-09-13T18:47:27.264995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266855+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:27.266855+0000","last_peered":"2024-09-13T18:47:27.266855+0000","last_clean":"2024-09-13T18:47:27.266855+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:27.266855+0000","last_undegraded":"2024-09-13T18:47:27.266855+0000","last_fullsized":"2024-09-13T18:47:27.266855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265943+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:27.265943+0000","last_peered":"2024-09-13T18:47:27.265943+0000","last_clean":"2024-09-13T18:47:27.265943+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:27.265943+0000","last_undegraded":"2024-09-13T18:47:27.265943+0000","last_fullsized":"2024-09-13T18:47:27.265943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266928+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:27.266928+0000","last_peered":"2024-09-13T18:47:27.266928+0000","last_clean":"2024-09-13T18:47:27.266928+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:27.266928+0000","last_undegraded":"2024-09-13T18:47:27.266928+0000","last_fullsized":"2024-09-13T18:47:27.266928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265447+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:47:27.265447+0000","last_peered":"2024-09-13T18:47:27.265447+0000","last_clean":"2024-09-13T18:47:27.265447+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:27.265447+0000","last_undegraded":"2024-09-13T18:47:27.265447+0000","last_fullsized":"2024-09-13T18:47:27.265447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265838+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:27.265838+0000","last_peered":"2024-09-13T18:47:27.265838+0000","last_clean":"2024-09-13T18:47:27.265838+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:27.265838+0000","last_undegraded":"2024-09-13T18:47:27.265838+0000","last_fullsized":"2024-09-13T18:47:27.265838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"64'1","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263722+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:47:27.263722+0000","last_peered":"2024-09-13T18:47:27.263722+0000","last_clean":"2024-09-13T18:47:27.263722+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:27.263722+0000","last_undegraded":"2024-09-13T18:47:27.263722+0000","last_fullsized":"2024-09-13T18:47:27.263722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264382+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:47:27.264382+0000","last_peered":"2024-09-13T18:47:27.264382+0000","last_clean":"2024-09-13T18:47:27.264382+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:27.264382+0000","last_undegraded":"2024-09-13T18:47:27.264382+0000","last_fullsized":"2024-09-13T18:47:27.264382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:47.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900689+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:27.900689+0000","last_peered":"2024-09-13T18:47:27.900689+0000","last_clean":"2024-09-13T18:47:27.900689+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:27.900689+0000","last_undegraded":"2024-09-13T18:47:27.900689+0000","last_fullsized":"2024-09-13T18:47:27.900689+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:12.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.903085+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:27.903085+0000","last_peered":"2024-09-13T18:47:27.903085+0000","last_clean":"2024-09-13T18:47:27.903085+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:27.903085+0000","last_undegraded":"2024-09-13T18:47:27.903085+0000","last_fullsized":"2024-09-13T18:47:27.903085+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:42.267150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899218+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:27.899218+0000","last_peered":"2024-09-13T18:47:27.899218+0000","last_clean":"2024-09-13T18:47:27.899218+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:27.899218+0000","last_undegraded":"2024-09-13T18:47:27.899218+0000","last_fullsized":"2024-09-13T18:47:27.899218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264635+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:27.264635+0000","last_peered":"2024-09-13T18:47:27.264635+0000","last_clean":"2024-09-13T18:47:27.264635+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:27.264635+0000","last_undegraded":"2024-09-13T18:47:27.264635+0000","last_fullsized":"2024-09-13T18:47:27.264635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266197+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:27.266197+0000","last_peered":"2024-09-13T18:47:27.266197+0000","last_clean":"2024-09-13T18:47:27.266197+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:27.266197+0000","last_undegraded":"2024-09-13T18:47:27.266197+0000","last_fullsized":"2024-09-13T18:47:27.266197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656019+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:47:26.656019+0000","last_peered":"2024-09-13T18:47:26.656019+0000","last_clean":"2024-09-13T18:47:26.656019+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:26.656019+0000","last_undegraded":"2024-09-13T18:47:26.656019+0000","last_fullsized":"2024-09-13T18:47:26.656019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264505+0000","last_change":"2024-09-13T18:47:14.522436+0000","last_active":"2024-09-13T18:47:27.264505+0000","last_peered":"2024-09-13T18:47:27.264505+0000","last_clean":"2024-09-13T18:47:27.264505+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:27.264505+0000","last_undegraded":"2024-09-13T18:47:27.264505+0000","last_fullsized":"2024-09-13T18:47:27.264505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:19.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656017+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:47:26.656017+0000","last_peered":"2024-09-13T18:47:26.656017+0000","last_clean":"2024-09-13T18:47:26.656017+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:26.656017+0000","last_undegraded":"2024-09-13T18:47:26.656017+0000","last_fullsized":"2024-09-13T18:47:26.656017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267711+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:27.267711+0000","last_peered":"2024-09-13T18:47:27.267711+0000","last_clean":"2024-09-13T18:47:27.267711+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:27.267711+0000","last_undegraded":"2024-09-13T18:47:27.267711+0000","last_fullsized":"2024-09-13T18:47:27.267711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267932+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:27.267932+0000","last_peered":"2024-09-13T18:47:27.267932+0000","last_clean":"2024-09-13T18:47:27.267932+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:27.267932+0000","last_undegraded":"2024-09-13T18:47:27.267932+0000","last_fullsized":"2024-09-13T18:47:27.267932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265619+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:27.265619+0000","last_peered":"2024-09-13T18:47:27.265619+0000","last_clean":"2024-09-13T18:47:27.265619+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:27.265619+0000","last_undegraded":"2024-09-13T18:47:27.265619+0000","last_fullsized":"2024-09-13T18:47:27.265619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38661,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":82,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2529999999999999,"5min":2.585,"15min":2.585},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.871,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7649999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.85199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.393,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.6890000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.1439999999999999,"15min":1.1739999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.643},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.196,"15min":1.244},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5980000000000001,"5min":1.778,"15min":1.778},"last":1.774}]},{"osd":4,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.222},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5149999999999999,"5min":1.665,"15min":1.665},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.3080000000000001,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.7350000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2989999999999999,"15min":1.337},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.55,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.8049999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3939999999999999,"15min":1.427},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.837},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.337,"15min":1.3560000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.2310000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.4059999999999999,"15min":1.4359999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.321},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.4470000000000001,"15min":1.5009999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5920000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.597}]}]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":521564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.411},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.141,"15min":1.181},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.355,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0720000000000001,"15min":1.0960000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94499999999999995,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.71}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.2949999999999999,"15min":1.347},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.609,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.2410000000000001,"15min":1.272},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.23}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.254,"15min":1.28},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5649999999999999,"5min":1.788,"15min":1.788},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2829999999999999,"15min":1.3169999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3500000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.1850000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.462,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.446,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.46}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3500000000000001,"15min":1.3839999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.504,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.3680000000000001,"15min":1.413},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5660000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.5309999999999999,"15min":1.587},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5609999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.518},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.4550000000000001,"15min":1.4990000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6120000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":2.1789999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":1.383},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.6359999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":1.7130000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.496},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.3220000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.4299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.546},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":1.5900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.9650000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.748}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.7769999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.98699999999999999,"15min":1.034},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.256}]},{"osd":2,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1379999999999999,"15min":1.1519999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.006},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1299999999999999,"15min":1.1659999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.85199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.014,"15min":1.006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.4630000000000001,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.516},{"interface":"front","average":{"1min":1.012,"5min":1.264,"15min":1.306},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.444}]},{"osd":4,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.2969999999999999,"15min":1.3420000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.1989999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4089999999999998,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.617},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3520000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.454}]},{"osd":6,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.252,"15min":1.2809999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.204},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.411,"15min":1.4350000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.5649999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.4159999999999999,"15min":1.47},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2360000000000002,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.3779999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.4099999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.123}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0249999999999999,"15min":1.05},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0509999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2150000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2989999999999999,"5min":1.375,"15min":1.375},"last":1.175}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.105,"15min":1.135},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.125,"15min":1.151},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2210000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.105}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.86099999999999999},"min":{"1min":0.80700000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0409999999999999,"15min":1.0489999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.038},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.339},{"interface":"front","average":{"1min":1.03,"5min":0.96399999999999997,"15min":0.95299999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.133,"15min":1.127},"min":{"1min":0.77200000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.228}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3169999999999999,"5min":1.427,"15min":1.427},"last":1.569},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4139999999999999,"5min":1.532,"15min":1.532},"last":1.4830000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.341,"5min":1.349,"15min":1.349},"last":1.4550000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2070000000000001,"5min":1.216,"15min":1.216},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.2290000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3700000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.194,"5min":1.466,"15min":1.466},"last":1.659}]},{"osd":4,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90300000000000002,"15min":0.90200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.077},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5169999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.46,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.4259999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0429999999999999,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.27}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":1.367}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":1.081}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.538}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.5649999999999999},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":1.4019999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.298},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.3380000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.119}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.226},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.4750000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1003520,"data_stored":522236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.94499999999999995,"15min":0.98499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1659999999999999,"5min":1.76,"15min":1.76},"last":1.202},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.012,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.538,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0820000000000001,"15min":1.1040000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.45,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.63400000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.121,"15min":1.1519999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.611,"5min":2.032,"15min":2.032},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.403,"15min":1.4890000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.581,"15min":1.681},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3300000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98999999999999999,"15min":0.99399999999999999},"min":{"1min":0.66300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3069999999999999,"5min":1.46,"15min":1.46},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4099999999999999,"5min":1.552,"15min":1.552},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2729999999999999,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.552,"5min":1.694,"15min":1.694},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5680000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:32.364 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T18:47:32.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-13T18:47:32.579 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 Processor -- start 2024-09-13T18:47:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 -- start start 2024-09-13T18:47:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f918006ea50 0x7f918015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f91800c9e90 0x7f91800ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91800c9440 con 0x7f91800ca840 2024-09-13T18:47:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91800c9a70 con 0x7f918006ea50 2024-09-13T18:47:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.574+0000 7f9185400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91800c7aa0 con 0x7f91800c9e90 2024-09-13T18:47:32.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f918006ea50 0x7f918015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9184a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f91800ca840 0x7f918006fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39832/0 (socket says 172.21.15.32:39832) 2024-09-13T18:47:32.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9184a00700 1 -- 172.21.15.32:0/1345070895 learned_addr learned my addr 172.21.15.32:0/1345070895 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:32.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917f400700 1 --2- 172.21.15.32:0/1345070895 >> v2:172.21.15.86:3300/0 conn(0x7f91800c9e90 0x7f91800ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917ea00700 1 -- 172.21.15.32:0/1345070895 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771087324 0 0) 0x7f91800c9440 con 0x7f91800ca840 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917ea00700 1 -- 172.21.15.32:0/1345070895 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91640035d0 con 0x7f91800ca840 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917fe00700 1 -- 172.21.15.32:0/1345070895 >> v2:172.21.15.86:3300/0 conn(0x7f91800c9e90 msgr2=0x7f91800ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917fe00700 1 --2- 172.21.15.32:0/1345070895 >> v2:172.21.15.86:3300/0 conn(0x7f91800c9e90 0x7f91800ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917fe00700 1 -- 172.21.15.32:0/1345070895 >> v1:172.21.15.32:6789/0 conn(0x7f91800ca840 legacy=0x7f918006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917fe00700 1 -- 172.21.15.32:0/1345070895 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800c7d60 con 0x7f918006ea50 2024-09-13T18:47:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917fe00700 1 --2- 172.21.15.32:0/1345070895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f918006ea50 0x7f918015aa70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f91800c9390 tx=0x7f9170009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c0679012a06fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917ea00700 1 -- 172.21.15.32:0/1345070895 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011830 con 0x7f918006ea50 2024-09-13T18:47:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917ea00700 1 -- 172.21.15.32:0/1345070895 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170011990 con 0x7f918006ea50 2024-09-13T18:47:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f917ea00700 1 -- 172.21.15.32:0/1345070895 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011d20 con 0x7f918006ea50 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9185400700 1 -- 172.21.15.32:0/1345070895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f918006ea50 msgr2=0x7f918015aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9185400700 1 --2- 172.21.15.32:0/1345070895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f918006ea50 0x7f918015aa70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f91800c9390 tx=0x7f9170009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9185400700 1 -- 172.21.15.32:0/1345070895 shutdown_connections 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9185400700 1 --2- 172.21.15.32:0/1345070895 >> v2:172.21.15.86:3300/0 conn(0x7f91800c9e90 0x7f91800ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9185400700 1 --2- 172.21.15.32:0/1345070895 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f918006ea50 0x7f918015aa70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.578+0000 7f9185400700 1 -- 172.21.15.32:0/1345070895 >> 172.21.15.32:0/1345070895 conn(0x7f91800cac60 msgr2=0x7f91800cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.582+0000 7f9185400700 1 -- 172.21.15.32:0/1345070895 shutdown_connections 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.582+0000 7f9185400700 1 -- 172.21.15.32:0/1345070895 wait complete. 2024-09-13T18:47:32.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.582+0000 7f9185400700 1 Processor -- start 2024-09-13T18:47:32.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.582+0000 7f9185400700 1 -- start start 2024-09-13T18:47:32.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f918006ea50 0x7f91801f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 0x7f91801e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91800ca840 0x7f9180159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918015a450 con 0x7f91800c9e90 2024-09-13T18:47:32.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91801f7250 con 0x7f91800ca840 2024-09-13T18:47:32.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180158cb0 con 0x7f918006ea50 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 0x7f91801e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 0x7f91801e4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58002/0 (socket says 172.21.15.32:58002) 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f918006ea50 0x7f91801f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9184a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91800ca840 0x7f9180159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 -- 172.21.15.32:0/3082892074 learned_addr learned my addr 172.21.15.32:0/3082892074 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 -- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f918006ea50 msgr2=0x7f91801f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f918006ea50 0x7f91801f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 -- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91800ca840 msgr2=0x7f9180159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91800ca840 0x7f9180159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 -- 172.21.15.32:0/3082892074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700094b0 con 0x7f91800c9e90 2024-09-13T18:47:32.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f917f400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 0x7f91801e4930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f916c00e9d0 tx=0x7f916c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c009720 con 0x7f91800c9e90 2024-09-13T18:47:32.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00ee70 con 0x7f91800c9e90 2024-09-13T18:47:32.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9180159270 con 0x7f91800c9e90 2024-09-13T18:47:32.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00ca50 con 0x7f91800c9e90 2024-09-13T18:47:32.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.586+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91800c4ec0 con 0x7f91800c9e90 2024-09-13T18:47:32.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.590+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91800c9090 con 0x7f91800c9e90 2024-09-13T18:47:32.597 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.590+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f916c00cbb0 con 0x7f91800c9e90 2024-09-13T18:47:32.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.594+0000 7f9177e00700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9160066730 0x7f9160068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.594+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f916c0845c0 con 0x7f91800c9e90 2024-09-13T18:47:32.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.594+0000 7f917fe00700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9160066730 0x7f9160068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.594+0000 7f917fe00700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9160066730 0x7f9160068bf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c00 tx=0x7f9170008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.598+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f916c051520 con 0x7f91800c9e90 2024-09-13T18:47:32.789 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.782+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"} v 0) v1 -- 0x7f91800705e0 con 0x7f91800c9e90 2024-09-13T18:47:32.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.790+0000 7f9177e00700 1 -- 172.21.15.32:0/3082892074 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f916c00ce60 con 0x7f91800c9e90 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9160066730 msgr2=0x7f9160068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9160066730 0x7f9160068bf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c00 tx=0x7f9170008030 comp rx=0 tx=0).stop 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 msgr2=0x7f91801e4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 0x7f91801e4930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f916c00e9d0 tx=0x7f916c00ece0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 shutdown_connections 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9160066730 0x7f9160068bf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91800ca840 0x7f9180159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f91800c9e90 0x7f91801e4930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 --2- 172.21.15.32:0/3082892074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f918006ea50 0x7f91801f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 >> 172.21.15.32:0/3082892074 conn(0x7f91800cac60 msgr2=0x7f91800cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 shutdown_connections 2024-09-13T18:47:32.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:32.794+0000 7f9185400700 1 -- 172.21.15.32:0/3082892074 wait complete. 2024-09-13T18:47:32.824 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T18:47:32.833 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T18:47:32.833 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:47:32.834 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:32.852 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-13T18:47:32.852 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:32.911 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 Processor -- start 2024-09-13T18:47:33.140 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 -- start start 2024-09-13T18:47:33.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1d1415e8f0 0x7f1d14161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140cabf0 0x7f1d140719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d140c7740 0x7f1d14071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d140ca840 con 0x7f1d140c7740 2024-09-13T18:47:33.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d140c7e50 con 0x7f1d1415e8f0 2024-09-13T18:47:33.141 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d1b800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140cba80 con 0x7f1d140cabf0 2024-09-13T18:47:33.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d140c7740 0x7f1d14071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d140c7740 0x7f1d14071f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58016/0 (socket says 172.21.15.32:58016) 2024-09-13T18:47:33.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 -- 172.21.15.32:0/2190891854 learned_addr learned my addr 172.21.15.32:0/2190891854 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:33.142 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d18e00700 1 --2- 172.21.15.32:0/2190891854 >> v2:172.21.15.86:3300/0 conn(0x7f1d1415e8f0 0x7f1d14161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d13e00700 1 --2- 172.21.15.32:0/2190891854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140cabf0 0x7f1d140719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 -- 172.21.15.32:0/2190891854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140cabf0 msgr2=0x7f1d140719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 --2- 172.21.15.32:0/2190891854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140cabf0 0x7f1d140719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 -- 172.21.15.32:0/2190891854 >> v2:172.21.15.86:3300/0 conn(0x7f1d1415e8f0 msgr2=0x7f1d14161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 --2- 172.21.15.32:0/2190891854 >> v2:172.21.15.86:3300/0 conn(0x7f1d1415e8f0 0x7f1d14161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.134+0000 7f1d19800700 1 -- 172.21.15.32:0/2190891854 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d140c80f0 con 0x7f1d140c7740 2024-09-13T18:47:33.143 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d19800700 1 --2- 172.21.15.32:0/2190891854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140c7740 0x7f1d14071f30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009e50 tx=0x7f1d0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4607e20e48a295 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d13400700 1 -- 172.21.15.32:0/2190891854 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00e070 con 0x7f1d140c7740 2024-09-13T18:47:33.144 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d13400700 1 -- 172.21.15.32:0/2190891854 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00b8d0 con 0x7f1d140c7740 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d13400700 1 -- 172.21.15.32:0/2190891854 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00bc80 con 0x7f1d140c7740 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 -- 172.21.15.32:0/2190891854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140c7740 msgr2=0x7f1d14071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2190891854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140c7740 0x7f1d14071f30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009e50 tx=0x7f1d0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 -- 172.21.15.32:0/2190891854 shutdown_connections 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2190891854 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140cabf0 0x7f1d140719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2190891854 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140c7740 0x7f1d14071f30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2190891854 >> v2:172.21.15.86:3300/0 conn(0x7f1d1415e8f0 0x7f1d14161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 -- 172.21.15.32:0/2190891854 >> 172.21.15.32:0/2190891854 conn(0x7f1d14071240 msgr2=0x7f1d1406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 -- 172.21.15.32:0/2190891854 shutdown_connections 2024-09-13T18:47:33.145 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.138+0000 7f1d1b800700 1 -- 172.21.15.32:0/2190891854 wait complete. 2024-09-13T18:47:33.147 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 Processor -- start 2024-09-13T18:47:33.148 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 -- start start 2024-09-13T18:47:33.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140c7740 0x7f1d140ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 0x7f1d1406d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1415e8f0 0x7f1d140ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140abae0 con 0x7f1d140cabf0 2024-09-13T18:47:33.150 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14159990 con 0x7f1d1415e8f0 2024-09-13T18:47:33.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d1b800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1415a350 con 0x7f1d140c7740 2024-09-13T18:47:33.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d13e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 0x7f1d1406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d13e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 0x7f1d1406d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58032/0 (socket says 172.21.15.32:58032) 2024-09-13T18:47:33.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.142+0000 7f1d13e00700 1 -- 172.21.15.32:0/2851433438 learned_addr learned my addr 172.21.15.32:0/2851433438 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:33.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d19800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1415e8f0 0x7f1d140ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.152 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d18e00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140c7740 0x7f1d140ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d13e00700 1 -- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140c7740 msgr2=0x7f1d140ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d13e00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140c7740 0x7f1d140ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d13e00700 1 -- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1415e8f0 msgr2=0x7f1d140ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d13e00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1415e8f0 0x7f1d140ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d13e00700 1 -- 172.21.15.32:0/2851433438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c009b30 con 0x7f1d140cabf0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d13e00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 0x7f1d1406d830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000e890 tx=0x7f1d0000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004020 con 0x7f1d140cabf0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00004180 con 0x7f1d140cabf0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004530 con 0x7f1d140cabf0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d140ac1e0 con 0x7f1d140cabf0 2024-09-13T18:47:33.153 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d140ac480 con 0x7f1d140cabf0 2024-09-13T18:47:33.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.146+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d14070460 con 0x7f1d140cabf0 2024-09-13T18:47:33.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.150+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d000036c0 con 0x7f1d140cabf0 2024-09-13T18:47:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.150+0000 7f1d10c00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1cf4066730 0x7f1cf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.150+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f1d00084430 con 0x7f1d140cabf0 2024-09-13T18:47:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.150+0000 7f1d18e00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1cf4066730 0x7f1cf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.158 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.150+0000 7f1d18e00700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1cf4066730 0x7f1cf4068bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009b50 tx=0x7f1d08009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.164 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.158+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d00051410 con 0x7f1d140cabf0 2024-09-13T18:47:33.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.350+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d1415ecd0 con 0x7f1d140cabf0 2024-09-13T18:47:33.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.350+0000 7f1d10c00700 1 -- 172.21.15.32:0/2851433438 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18451 (secure 0 0 0) 0x7f1d00054a30 con 0x7f1d140cabf0 2024-09-13T18:47:33.358 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:33.358 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":81,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:47:27.647237+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:46:40.269675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.17","osds":[6,4,7,5]},{"pgid":"4.19","osds":[1,4,3,6]}],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1cf4066730 msgr2=0x7f1cf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1cf4066730 0x7f1cf4068bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009b50 tx=0x7f1d08009240 comp rx=0 tx=0).stop 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 msgr2=0x7f1d1406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 0x7f1d1406d830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000e890 tx=0x7f1d0000eba0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 shutdown_connections 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1cf4066730 0x7f1cf4068bf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d1415e8f0 0x7f1d140ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d140cabf0 0x7f1d1406d830 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 --2- 172.21.15.32:0/2851433438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d140c7740 0x7f1d140ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 >> 172.21.15.32:0/2851433438 conn(0x7f1d14071240 msgr2=0x7f1d140aa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 shutdown_connections 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.354+0000 7f1d1b800700 1 -- 172.21.15.32:0/2851433438 wait complete. 2024-09-13T18:47:33.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:44:50.146051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:44:59.596223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:00.330969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:45:03.385324+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:47:33.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:33.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.566+0000 7f9f93000700 1 Processor -- start 2024-09-13T18:47:33.574 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.566+0000 7f9f93000700 1 -- start start 2024-09-13T18:47:33.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f93000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f8c151a60 0x7f9f8c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f93000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0cd470 0x7f9f8c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f93000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c15aa50 con 0x7f9f8c151680 2024-09-13T18:47:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f93000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cd8c0 con 0x7f9f8c151a60 2024-09-13T18:47:33.578 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f93000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c15aca0 con 0x7f9f8c0cd470 2024-09-13T18:47:33.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f92600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0cd470 0x7f9f8c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f91200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f8c151a60 0x7f9f8c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.580 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f91c00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9f8c151680 0x7f9f8c06b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:44992/0 (socket says 172.21.15.32:44992) 2024-09-13T18:47:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f91c00700 1 -- 172.21.15.32:0/3830387416 learned_addr learned my addr 172.21.15.32:0/3830387416 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f92600700 1 -- 172.21.15.32:0/3830387416 >> v2:172.21.15.86:3300/0 conn(0x7f9f8c151a60 msgr2=0x7f9f8c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f92600700 1 --2- 172.21.15.32:0/3830387416 >> v2:172.21.15.86:3300/0 conn(0x7f9f8c151a60 0x7f9f8c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f92600700 1 -- 172.21.15.32:0/3830387416 >> v1:172.21.15.86:6789/0 conn(0x7f9f8c151680 legacy=0x7f9f8c06b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.581 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.570+0000 7f9f92600700 1 -- 172.21.15.32:0/3830387416 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c15af80 con 0x7f9f8c0cd470 2024-09-13T18:47:33.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f92600700 1 --2- 172.21.15.32:0/3830387416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0cd470 0x7f9f8c157a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009d90 tx=0x7f9f8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc5f5c51bff183 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f8be00700 1 -- 172.21.15.32:0/3830387416 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400e070 con 0x7f9f8c0cd470 2024-09-13T18:47:33.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f8be00700 1 -- 172.21.15.32:0/3830387416 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8400bb20 con 0x7f9f8c0cd470 2024-09-13T18:47:33.582 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f8be00700 1 -- 172.21.15.32:0/3830387416 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84012430 con 0x7f9f8c0cd470 2024-09-13T18:47:33.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 -- 172.21.15.32:0/3830387416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0cd470 msgr2=0x7f9f8c157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 --2- 172.21.15.32:0/3830387416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0cd470 0x7f9f8c157a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009d90 tx=0x7f9f8400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:33.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 -- 172.21.15.32:0/3830387416 shutdown_connections 2024-09-13T18:47:33.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 --2- 172.21.15.32:0/3830387416 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0cd470 0x7f9f8c157a30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.584 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 --2- 172.21.15.32:0/3830387416 >> v2:172.21.15.86:3300/0 conn(0x7f9f8c151a60 0x7f9f8c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 -- 172.21.15.32:0/3830387416 >> 172.21.15.32:0/3830387416 conn(0x7f9f8c071740 msgr2=0x7f9f8c071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 -- 172.21.15.32:0/3830387416 shutdown_connections 2024-09-13T18:47:33.585 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.574+0000 7f9f93000700 1 -- 172.21.15.32:0/3830387416 wait complete. 2024-09-13T18:47:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.578+0000 7f9f93000700 1 Processor -- start 2024-09-13T18:47:33.586 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.578+0000 7f9f93000700 1 -- start start 2024-09-13T18:47:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f8c0cd470 0x7f9f8c0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 0x7f9f8c14aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0ca4a0 0x7f9f8c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.590 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c14d680 con 0x7f9f8c0cd470 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c1ef880 con 0x7f9f8c151680 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c1efb60 con 0x7f9f8c0ca4a0 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f8c0cd470 0x7f9f8c0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 0x7f9f8c14aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f92600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0ca4a0 0x7f9f8c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 0x7f9f8c14aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:40060/0 (socket says 172.21.15.32:40060) 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 -- 172.21.15.32:0/2715280348 learned_addr learned my addr 172.21.15.32:0/2715280348 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 -- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0ca4a0 msgr2=0x7f9f8c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0ca4a0 0x7f9f8c14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 -- 172.21.15.32:0/2715280348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f8c0cd470 msgr2=0x7f9f8c0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f8c0cd470 0x7f9f8c0cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 -- 172.21.15.32:0/2715280348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009a70 con 0x7f9f8c151680 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f92600700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0ca4a0 0x7f9f8c14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f91200700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 0x7f9f8c14aa20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e840 tx=0x7f9f7800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780095a0 con 0x7f9f8c151680 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f78013680 con 0x7f9f8c151680 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c1efe40 con 0x7f9f8c151680 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780139f0 con 0x7f9f8c151680 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.582+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c1f0400 con 0x7f9f8c151680 2024-09-13T18:47:33.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.586+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c0c40b0 con 0x7f9f8c151680 2024-09-13T18:47:33.593 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.586+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f78013b50 con 0x7f9f8c151680 2024-09-13T18:47:33.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.590+0000 7f9f89600700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f6c066730 0x7f9f6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.594 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.590+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9f78084510 con 0x7f9f8c151680 2024-09-13T18:47:33.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.590+0000 7f9f91c00700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f6c066730 0x7f9f6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.596 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.590+0000 7f9f91c00700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f6c066730 0x7f9f6c068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f80005930 tx=0x7f9f80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.602+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f78051360 con 0x7f9f8c151680 2024-09-13T18:47:33.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.786+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f8c15a810 con 0x7f9f8c151680 2024-09-13T18:47:33.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.786+0000 7f9f89600700 1 -- 172.21.15.32:0/2715280348 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f78054980 con 0x7f9f8c151680 2024-09-13T18:47:33.792 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2024-09-13T18:47:33.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f6c066730 msgr2=0x7f9f6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f6c066730 0x7f9f6c068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f80005930 tx=0x7f9f80009040 comp rx=0 tx=0).stop 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 msgr2=0x7f9f8c14aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 0x7f9f8c14aa20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e840 tx=0x7f9f7800eb50 comp rx=0 tx=0).stop 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 shutdown_connections 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f6c066730 0x7f9f6c068bf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f8c0ca4a0 0x7f9f8c14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f8c151680 0x7f9f8c14aa20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 --2- 172.21.15.32:0/2715280348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f8c0cd470 0x7f9f8c0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 >> 172.21.15.32:0/2715280348 conn(0x7f9f8c071740 msgr2=0x7f9f8c071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 shutdown_connections 2024-09-13T18:47:33.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.790+0000 7f9f93000700 1 -- 172.21.15.32:0/2715280348 wait complete. 2024-09-13T18:47:33.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:34.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.994+0000 7f4b9a400700 1 Processor -- start 2024-09-13T18:47:34.001 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.994+0000 7f4b9a400700 1 -- start start 2024-09-13T18:47:34.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b9a400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b94151a60 0x7f4b940ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b9a400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b940cd8e0 con 0x7f4b940cd470 2024-09-13T18:47:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b9a400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9415aa50 con 0x7f4b94151680 2024-09-13T18:47:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b9a400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9415aca0 con 0x7f4b94151a60 2024-09-13T18:47:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b99000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4b94151680 0x7f4b9406b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45006/0 (socket says 172.21.15.32:45006) 2024-09-13T18:47:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b99000700 1 -- 172.21.15.32:0/277242698 learned_addr learned my addr 172.21.15.32:0/277242698 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:34.005 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b93e00700 1 --2- 172.21.15.32:0/277242698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b94151a60 0x7f4b940ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b93400700 1 -- 172.21.15.32:0/277242698 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143851628 0 0) 0x7f4b9415aa50 con 0x7f4b94151680 2024-09-13T18:47:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b93e00700 1 -- 172.21.15.32:0/277242698 >> v1:172.21.15.86:6789/0 conn(0x7f4b94151680 legacy=0x7f4b9406b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b93e00700 1 -- 172.21.15.32:0/277242698 >> v1:172.21.15.32:6789/0 conn(0x7f4b940cd470 legacy=0x7f4b94157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.006 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:33.998+0000 7f4b93e00700 1 -- 172.21.15.32:0/277242698 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9415af80 con 0x7f4b94151a60 2024-09-13T18:47:34.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b93e00700 1 --2- 172.21.15.32:0/277242698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b94151a60 0x7f4b940ccf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009880 tx=0x7f4b80009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a91792a7f0df1733 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b93400700 1 -- 172.21.15.32:0/277242698 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80004230 con 0x7f4b94151a60 2024-09-13T18:47:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b93400700 1 -- 172.21.15.32:0/277242698 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80004390 con 0x7f4b94151a60 2024-09-13T18:47:34.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b93400700 1 -- 172.21.15.32:0/277242698 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800036c0 con 0x7f4b94151a60 2024-09-13T18:47:34.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 -- 172.21.15.32:0/277242698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b94151a60 msgr2=0x7f4b940ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 --2- 172.21.15.32:0/277242698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b94151a60 0x7f4b940ccf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009880 tx=0x7f4b80009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:34.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 -- 172.21.15.32:0/277242698 shutdown_connections 2024-09-13T18:47:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 --2- 172.21.15.32:0/277242698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b94151a60 0x7f4b940ccf30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 -- 172.21.15.32:0/277242698 >> 172.21.15.32:0/277242698 conn(0x7f4b94071740 msgr2=0x7f4b94071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 -- 172.21.15.32:0/277242698 shutdown_connections 2024-09-13T18:47:34.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.002+0000 7f4b9a400700 1 -- 172.21.15.32:0/277242698 wait complete. 2024-09-13T18:47:34.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 Processor -- start 2024-09-13T18:47:34.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 -- start start 2024-09-13T18:47:34.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b940cd470 0x7f4b94159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b94151680 0x7f4b940a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b940a9ce0 0x7f4b941f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94153890 con 0x7f4b940a9ce0 2024-09-13T18:47:34.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940b24d0 con 0x7f4b94151680 2024-09-13T18:47:34.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b9a400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94153020 con 0x7f4b940cd470 2024-09-13T18:47:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b94151680 0x7f4b940a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b940cd470 0x7f4b94159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.006+0000 7f4b99a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b940a9ce0 0x7f4b941f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b94151680 0x7f4b940a97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:40062/0 (socket says 172.21.15.32:40062) 2024-09-13T18:47:34.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b93e00700 1 -- 172.21.15.32:0/3371626186 learned_addr learned my addr 172.21.15.32:0/3371626186 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99a00700 1 -- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b940cd470 msgr2=0x7f4b94159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99a00700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b940cd470 0x7f4b94159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99a00700 1 -- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b94151680 msgr2=0x7f4b940a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99a00700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b94151680 0x7f4b940a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99a00700 1 -- 172.21.15.32:0/3371626186 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800094b0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b99a00700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b940a9ce0 0x7f4b941f2eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c001f80 tx=0x7f4b8c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c003e50 con 0x7f4b940a9ce0 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0020d0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c00aa80 con 0x7f4b940a9ce0 2024-09-13T18:47:34.017 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94153a70 con 0x7f4b940a9ce0 2024-09-13T18:47:34.018 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.010+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94153d50 con 0x7f4b940a9ce0 2024-09-13T18:47:34.019 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.014+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b940b29b0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.021 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.014+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b8c00abe0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.022 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.018+0000 7f4b90c00700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b74066760 0x7f4b74068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.018+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4b8c083f60 con 0x7f4b940a9ce0 2024-09-13T18:47:34.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.018+0000 7f4b99000700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b74066760 0x7f4b74068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.024 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.018+0000 7f4b99000700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b74066760 0x7f4b74068c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4b88007b30 tx=0x7f4b88007a80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.029 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.022+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b940b29b0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.202+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b940b29b0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.202+0000 7f4b90c00700 1 -- 172.21.15.32:0/3371626186 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b940b29b0 con 0x7f4b940a9ce0 2024-09-13T18:47:34.209 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:47:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b74066760 msgr2=0x7f4b74068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b74066760 0x7f4b74068c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4b88007b30 tx=0x7f4b88007a80 comp rx=0 tx=0).stop 2024-09-13T18:47:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b940a9ce0 msgr2=0x7f4b941f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b940a9ce0 0x7f4b941f2eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c001f80 tx=0x7f4b8c00a340 comp rx=0 tx=0).stop 2024-09-13T18:47:34.212 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 shutdown_connections 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4b74066760 0x7f4b74068c20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4b940a9ce0 0x7f4b941f2eb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b94151680 0x7f4b940a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 --2- 172.21.15.32:0/3371626186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4b940cd470 0x7f4b94159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 >> 172.21.15.32:0/3371626186 conn(0x7f4b94071740 msgr2=0x7f4b940c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 shutdown_connections 2024-09-13T18:47:34.213 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.206+0000 7f4b9a400700 1 -- 172.21.15.32:0/3371626186 wait complete. 2024-09-13T18:47:34.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:34.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.406+0000 7f6aa7e00700 1 Processor -- start 2024-09-13T18:47:34.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.406+0000 7f6aa7e00700 1 -- start start 2024-09-13T18:47:34.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6aa8151680 0x7f6aa806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6aa8151a60 0x7f6aa806b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa815aa50 con 0x7f6aa80ccf30 2024-09-13T18:47:34.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa815aca0 con 0x7f6aa8151680 2024-09-13T18:47:34.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa815af80 con 0x7f6aa8151a60 2024-09-13T18:47:34.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6aa80ccf30 0x7f6aa80cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45018/0 (socket says 172.21.15.32:45018) 2024-09-13T18:47:34.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6aa8151680 0x7f6aa806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa7400700 1 -- 172.21.15.32:0/3312526781 learned_addr learned my addr 172.21.15.32:0/3312526781 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:34.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6000700 1 --2- 172.21.15.32:0/3312526781 >> v2:172.21.15.86:3300/0 conn(0x7f6aa8151a60 0x7f6aa806b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa5600700 1 -- 172.21.15.32:0/3312526781 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873683979 0 0) 0x7f6aa815aa50 con 0x7f6aa80ccf30 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa5600700 1 -- 172.21.15.32:0/3312526781 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a8c0035d0 con 0x7f6aa80ccf30 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6a00700 1 -- 172.21.15.32:0/3312526781 >> v2:172.21.15.86:3300/0 conn(0x7f6aa8151a60 msgr2=0x7f6aa806b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6a00700 1 --2- 172.21.15.32:0/3312526781 >> v2:172.21.15.86:3300/0 conn(0x7f6aa8151a60 0x7f6aa806b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6a00700 1 -- 172.21.15.32:0/3312526781 >> v1:172.21.15.86:6789/0 conn(0x7f6aa80ccf30 legacy=0x7f6aa80cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6a00700 1 -- 172.21.15.32:0/3312526781 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa815b260 con 0x7f6aa8151680 2024-09-13T18:47:34.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa6a00700 1 --2- 172.21.15.32:0/3312526781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa8151680 0x7f6aa806b260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6aa806e4d0 tx=0x7f6a98009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15ccafd20b4d6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.410+0000 7f6aa5600700 1 -- 172.21.15.32:0/3312526781 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98011830 con 0x7f6aa8151680 2024-09-13T18:47:34.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa5600700 1 -- 172.21.15.32:0/3312526781 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98011990 con 0x7f6aa8151680 2024-09-13T18:47:34.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa5600700 1 -- 172.21.15.32:0/3312526781 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98011d00 con 0x7f6aa8151680 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 -- 172.21.15.32:0/3312526781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa8151680 msgr2=0x7f6aa806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/3312526781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa8151680 0x7f6aa806b260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6aa806e4d0 tx=0x7f6a98009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 -- 172.21.15.32:0/3312526781 shutdown_connections 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/3312526781 >> v2:172.21.15.86:3300/0 conn(0x7f6aa8151a60 0x7f6aa806b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/3312526781 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa8151680 0x7f6aa806b260 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 -- 172.21.15.32:0/3312526781 >> 172.21.15.32:0/3312526781 conn(0x7f6aa8071740 msgr2=0x7f6aa8071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 -- 172.21.15.32:0/3312526781 shutdown_connections 2024-09-13T18:47:34.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.414+0000 7f6aa7e00700 1 -- 172.21.15.32:0/3312526781 wait complete. 2024-09-13T18:47:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 Processor -- start 2024-09-13T18:47:34.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 -- start start 2024-09-13T18:47:34.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80ccf30 0x7f6aa814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 0x7f6aa80c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6aa815a470 0x7f6aa80c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8071600 con 0x7f6aa80ccf30 2024-09-13T18:47:34.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80ccda0 con 0x7f6aa8151680 2024-09-13T18:47:34.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa7e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8154ed0 con 0x7f6aa815a470 2024-09-13T18:47:34.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.418+0000 7f6aa6a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80ccf30 0x7f6aa814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 0x7f6aa80c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 0x7f6aa80c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:40072/0 (socket says 172.21.15.32:40072) 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 -- 172.21.15.32:0/1320187009 learned_addr learned my addr 172.21.15.32:0/1320187009 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa7400700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6aa815a470 0x7f6aa80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 -- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6aa815a470 msgr2=0x7f6aa80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6aa815a470 0x7f6aa80c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 -- 172.21.15.32:0/1320187009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80ccf30 msgr2=0x7f6aa814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80ccf30 0x7f6aa814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 -- 172.21.15.32:0/1320187009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980094b0 con 0x7f6aa8151680 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa6000700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 0x7f6aa80c5430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400e870 tx=0x7f6a9400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940095a0 con 0x7f6aa8151680 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94013680 con 0x7f6aa8151680 2024-09-13T18:47:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940139f0 con 0x7f6aa8151680 2024-09-13T18:47:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa80c61e0 con 0x7f6aa8151680 2024-09-13T18:47:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa80c6430 con 0x7f6aa8151680 2024-09-13T18:47:34.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.422+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa80cd340 con 0x7f6aa8151680 2024-09-13T18:47:34.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.426+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a94013b50 con 0x7f6aa8151680 2024-09-13T18:47:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.430+0000 7f6a9f400700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6a88066760 0x7f6a88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.430+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f6a940846c0 con 0x7f6aa8151680 2024-09-13T18:47:34.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.430+0000 7f6aa6a00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6a88066760 0x7f6a88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.430+0000 7f6aa6a00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6a88066760 0x7f6a88068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000c00 tx=0x7f6a98008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.442 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.438+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6a94051730 con 0x7f6aa8151680 2024-09-13T18:47:34.627 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.622+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6aa80c65c0 con 0x7f6aa8151680 2024-09-13T18:47:34.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.622+0000 7f6a9f400700 1 -- 172.21.15.32:0/1320187009 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a94017020 con 0x7f6aa8151680 2024-09-13T18:47:34.629 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6a88066760 msgr2=0x7f6a88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6a88066760 0x7f6a88068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000c00 tx=0x7f6a98008030 comp rx=0 tx=0).stop 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 msgr2=0x7f6aa80c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 0x7f6aa80c5430 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400e870 tx=0x7f6a9400eb80 comp rx=0 tx=0).stop 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 shutdown_connections 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6a88066760 0x7f6a88068c20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6aa815a470 0x7f6aa80c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6aa8151680 0x7f6aa80c5430 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 --2- 172.21.15.32:0/1320187009 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80ccf30 0x7f6aa814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.634 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 >> 172.21.15.32:0/1320187009 conn(0x7f6aa8071740 msgr2=0x7f6aa8156620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 shutdown_connections 2024-09-13T18:47:34.635 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.626+0000 7f6aa7e00700 1 -- 172.21.15.32:0/1320187009 wait complete. 2024-09-13T18:47:34.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:47:34.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.830+0000 7f4d9f000700 1 Processor -- start 2024-09-13T18:47:34.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.830+0000 7f4d9f000700 1 -- start start 2024-09-13T18:47:34.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9f000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d980c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9f000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4d980c8950 0x7f4d9815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9f000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980c8370 con 0x7f4d98153840 2024-09-13T18:47:34.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9f000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9806b810 con 0x7f4d980c8950 2024-09-13T18:47:34.840 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9f000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c8650 con 0x7f4d980c8f10 2024-09-13T18:47:34.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d980c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9e600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4d980c8950 0x7f4d9815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d980c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52916/0 (socket says 172.21.15.32:52916) 2024-09-13T18:47:34.841 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9d200700 1 -- 172.21.15.32:0/3508571626 learned_addr learned my addr 172.21.15.32:0/3508571626 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9e600700 1 -- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 msgr2=0x7f4d980c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9e600700 1 --2- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d980c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9e600700 1 -- 172.21.15.32:0/3508571626 >> v1:172.21.15.86:6789/0 conn(0x7f4d98153840 legacy=0x7f4d980ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9e600700 1 -- 172.21.15.32:0/3508571626 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9806ae70 con 0x7f4d980c8950 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9d200700 1 --2- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d980c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d9e600700 1 --2- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d980c8950 0x7f4d9815cbe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009d90 tx=0x7f4d9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392e5dc2c162a152 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d97e00700 1 -- 172.21.15.32:0/3508571626 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000e070 con 0x7f4d980c8950 2024-09-13T18:47:34.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d97e00700 1 -- 172.21.15.32:0/3508571626 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9000bb20 con 0x7f4d980c8950 2024-09-13T18:47:34.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.834+0000 7f4d97e00700 1 -- 172.21.15.32:0/3508571626 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90012430 con 0x7f4d980c8950 2024-09-13T18:47:34.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 -- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d980c8950 msgr2=0x7f4d9815cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 --2- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d980c8950 0x7f4d9815cbe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009d90 tx=0x7f4d9000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 -- 172.21.15.32:0/3508571626 shutdown_connections 2024-09-13T18:47:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 --2- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d980c8950 0x7f4d9815cbe0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 --2- 172.21.15.32:0/3508571626 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d980c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 -- 172.21.15.32:0/3508571626 >> 172.21.15.32:0/3508571626 conn(0x7f4d98071740 msgr2=0x7f4d98071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 -- 172.21.15.32:0/3508571626 shutdown_connections 2024-09-13T18:47:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.838+0000 7f4d9f000700 1 -- 172.21.15.32:0/3508571626 wait complete. 2024-09-13T18:47:34.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 Processor -- start 2024-09-13T18:47:34.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 -- start start 2024-09-13T18:47:34.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d980c8950 0x7f4d980b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d981501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 0x7f4d98150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9814b1b0 con 0x7f4d980c8950 2024-09-13T18:47:34.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980b2230 con 0x7f4d98153840 2024-09-13T18:47:34.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9f000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980b2490 con 0x7f4d980c8f10 2024-09-13T18:47:34.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d981501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9dc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d980c8950 0x7f4d980b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9e600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 0x7f4d98150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9d200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d981501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52924/0 (socket says 172.21.15.32:52924) 2024-09-13T18:47:34.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9e600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 0x7f4d98150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:40094/0 (socket says 172.21.15.32:40094) 2024-09-13T18:47:34.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9d200700 1 -- 172.21.15.32:0/1853791734 learned_addr learned my addr 172.21.15.32:0/1853791734 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:34.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9dc00700 1 -- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 msgr2=0x7f4d981501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.850 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9dc00700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d981501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9dc00700 1 -- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 msgr2=0x7f4d98150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9dc00700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 0x7f4d98150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9dc00700 1 -- 172.21.15.32:0/1853791734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009570 con 0x7f4d980c8950 2024-09-13T18:47:34.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.842+0000 7f4d9e600700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 0x7f4d98150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:34.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d9dc00700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d980c8950 0x7f4d980b0760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00c410 tx=0x7f4d8c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0052d0 con 0x7f4d980c8950 2024-09-13T18:47:34.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c005430 con 0x7f4d980c8950 2024-09-13T18:47:34.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d90009a70 con 0x7f4d980c8950 2024-09-13T18:47:34.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0055a0 con 0x7f4d980c8950 2024-09-13T18:47:34.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9814b400 con 0x7f4d980c8950 2024-09-13T18:47:34.853 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.846+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d980b0cf0 con 0x7f4d980c8950 2024-09-13T18:47:34.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.850+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d8c0038e0 con 0x7f4d980c8950 2024-09-13T18:47:34.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.850+0000 7f4d95600700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4d78066760 0x7f4d78068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.857 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.850+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4d8c083850 con 0x7f4d980c8950 2024-09-13T18:47:34.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.850+0000 7f4d9d200700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4d78066760 0x7f4d78068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.858 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.854+0000 7f4d9d200700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4d78066760 0x7f4d78068c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d98151880 tx=0x7f4d840092e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.862 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:34.854+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d980b0cf0 con 0x7f4d980c8950 2024-09-13T18:47:35.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.038+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d980b0cf0 con 0x7f4d980c8950 2024-09-13T18:47:35.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.038+0000 7f4d95600700 1 -- 172.21.15.32:0/1853791734 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v81) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d8c017020 con 0x7f4d980c8950 2024-09-13T18:47:35.046 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2024-09-13T18:47:35.048 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4d78066760 msgr2=0x7f4d78068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4d78066760 0x7f4d78068c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d98151880 tx=0x7f4d840092e0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d980c8950 msgr2=0x7f4d980b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d980c8950 0x7f4d980b0760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00c410 tx=0x7f4d8c001e70 comp rx=0 tx=0).stop 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 shutdown_connections 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4d78066760 0x7f4d78068c20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d98153840 0x7f4d98150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d980c8f10 0x7f4d981501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 --2- 172.21.15.32:0/1853791734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d980c8950 0x7f4d980b0760 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 >> 172.21.15.32:0/1853791734 conn(0x7f4d98071740 msgr2=0x7f4d9806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 shutdown_connections 2024-09-13T18:47:35.050 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.042+0000 7f4d9f000700 1 -- 172.21.15.32:0/1853791734 wait complete. 2024-09-13T18:47:35.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:47:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 Processor -- start 2024-09-13T18:47:35.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 -- start start 2024-09-13T18:47:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2610151680 0x7f261006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26100cd640 0x7f261006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261015aa50 con 0x7f2610151a60 2024-09-13T18:47:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261015aca0 con 0x7f26100cd640 2024-09-13T18:47:35.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261015af80 con 0x7f2610151680 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2610151680 0x7f261006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260e000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f2610151a60 0x7f26100ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45026/0 (socket says 172.21.15.32:45026) 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260e000700 1 -- 172.21.15.32:0/718583308 learned_addr learned my addr 172.21.15.32:0/718583308 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260f400700 1 --2- 172.21.15.32:0/718583308 >> v2:172.21.15.32:3300/0 conn(0x7f26100cd640 0x7f261006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.238+0000 7f260d600700 1 -- 172.21.15.32:0/718583308 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046520548 0 0) 0x7f261015aa50 con 0x7f2610151a60 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260d600700 1 -- 172.21.15.32:0/718583308 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f40035d0 con 0x7f2610151a60 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260ea00700 1 -- 172.21.15.32:0/718583308 >> v2:172.21.15.32:3300/0 conn(0x7f26100cd640 msgr2=0x7f261006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260ea00700 1 --2- 172.21.15.32:0/718583308 >> v2:172.21.15.32:3300/0 conn(0x7f26100cd640 0x7f261006b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260ea00700 1 -- 172.21.15.32:0/718583308 >> v1:172.21.15.86:6789/0 conn(0x7f2610151a60 legacy=0x7f26100ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260ea00700 1 -- 172.21.15.32:0/718583308 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261015b260 con 0x7f2610151680 2024-09-13T18:47:35.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260ea00700 1 --2- 172.21.15.32:0/718583308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2610151680 0x7f261006b260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2600009850 tx=0x7f2600009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf03a8719643d814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260d600700 1 -- 172.21.15.32:0/718583308 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600011830 con 0x7f2610151680 2024-09-13T18:47:35.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260d600700 1 -- 172.21.15.32:0/718583308 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2600011990 con 0x7f2610151680 2024-09-13T18:47:35.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260d600700 1 -- 172.21.15.32:0/718583308 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600011d40 con 0x7f2610151680 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 -- 172.21.15.32:0/718583308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2610151680 msgr2=0x7f261006b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 --2- 172.21.15.32:0/718583308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2610151680 0x7f261006b260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2600009850 tx=0x7f2600009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 -- 172.21.15.32:0/718583308 shutdown_connections 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 --2- 172.21.15.32:0/718583308 >> v2:172.21.15.32:3300/0 conn(0x7f26100cd640 0x7f261006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 --2- 172.21.15.32:0/718583308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2610151680 0x7f261006b260 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 -- 172.21.15.32:0/718583308 >> 172.21.15.32:0/718583308 conn(0x7f2610071740 msgr2=0x7f2610071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 -- 172.21.15.32:0/718583308 shutdown_connections 2024-09-13T18:47:35.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 -- 172.21.15.32:0/718583308 wait complete. 2024-09-13T18:47:35.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.242+0000 7f260fe00700 1 Processor -- start 2024-09-13T18:47:35.250 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 -- start start 2024-09-13T18:47:35.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 0x7f26100c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610151680 0x7f261006f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26100c6170 0x7f261006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261015a860 con 0x7f26100c6170 2024-09-13T18:47:35.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101ef8f0 con 0x7f2610151680 2024-09-13T18:47:35.252 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100c66d0 con 0x7f26100cd640 2024-09-13T18:47:35.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 0x7f26100c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610151680 0x7f261006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 0x7f26100c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52946/0 (socket says 172.21.15.32:52946) 2024-09-13T18:47:35.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 -- 172.21.15.32:0/1692482208 learned_addr learned my addr 172.21.15.32:0/1692482208 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:35.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260f400700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26100c6170 0x7f261006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.253 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 -- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610151680 msgr2=0x7f261006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610151680 0x7f261006f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 -- 172.21.15.32:0/1692482208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26100c6170 msgr2=0x7f261006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26100c6170 0x7f261006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 -- 172.21.15.32:0/1692482208 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000094b0 con 0x7f26100cd640 2024-09-13T18:47:35.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260e000700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610151680 0x7f261006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:35.254 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260ea00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 0x7f26100c56a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26000090b0 tx=0x7f2600004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600004590 con 0x7f26100cd640 2024-09-13T18:47:35.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260001f070 con 0x7f26100cd640 2024-09-13T18:47:35.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26100cc5a0 con 0x7f26100cd640 2024-09-13T18:47:35.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.246+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600003900 con 0x7f26100cd640 2024-09-13T18:47:35.255 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.250+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26100cc840 con 0x7f26100cd640 2024-09-13T18:47:35.256 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.250+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2610061fa0 con 0x7f26100cd640 2024-09-13T18:47:35.257 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.250+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2600003a60 con 0x7f26100cd640 2024-09-13T18:47:35.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.254+0000 7f2606a00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f25f0066730 0x7f25f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.254+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f2600021070 con 0x7f26100cd640 2024-09-13T18:47:35.259 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.254+0000 7f260e000700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f25f0066730 0x7f25f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.260 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.254+0000 7f260e000700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f25f0066730 0x7f25f0068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f26100c8d90 tx=0x7f25fc007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.268 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.262+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2600052590 con 0x7f26100cd640 2024-09-13T18:47:35.464 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.458+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26100ccf30 con 0x7f26100cd640 2024-09-13T18:47:35.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.458+0000 7f2606a00700 1 -- 172.21.15.32:0/1692482208 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2600015080 con 0x7f26100cd640 2024-09-13T18:47:35.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f25f0066730 msgr2=0x7f25f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f25f0066730 0x7f25f0068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f26100c8d90 tx=0x7f25fc007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 msgr2=0x7f26100c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 0x7f26100c56a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26000090b0 tx=0x7f2600004770 comp rx=0 tx=0).stop 2024-09-13T18:47:35.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 shutdown_connections 2024-09-13T18:47:35.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f25f0066730 0x7f25f0068bf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26100c6170 0x7f261006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610151680 0x7f261006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 --2- 172.21.15.32:0/1692482208 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26100cd640 0x7f26100c56a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 >> 172.21.15.32:0/1692482208 conn(0x7f2610071740 msgr2=0x7f26100c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 shutdown_connections 2024-09-13T18:47:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:35.462+0000 7f260fe00700 1 -- 172.21.15.32:0/1692482208 wait complete. 2024-09-13T18:47:35.470 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2024-09-13T18:47:35.491 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:47:35.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:35.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:35.580 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:47:35.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:35.580 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:47:35.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:35.601 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2024-09-13T18:47:35.660 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:47:35.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:35.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:47:35.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:35.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2024-09-13T18:47:36.310 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:47:36.320 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:47:36.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1daa600700 1 Processor -- start 2024-09-13T18:47:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1daa600700 1 -- start start 2024-09-13T18:47:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1daa600700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1da40aa610 0x7f1da415b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1daa600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40c9420 con 0x7f1da40caa20 2024-09-13T18:47:36.508 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1daa600700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40c9140 con 0x7f1da40aa230 2024-09-13T18:47:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1daa600700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40724e0 con 0x7f1da40aa610 2024-09-13T18:47:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da3e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f1da40aa610 0x7f1da415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da3400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f1da40aa230 0x7f1da40cb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:45040/0 (socket says 172.21.15.32:45040) 2024-09-13T18:47:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da3400700 1 -- 172.21.15.32:0/2380065525 learned_addr learned my addr 172.21.15.32:0/2380065525 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:36.509 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1d9be00700 1 --1- 172.21.15.32:0/2380065525 >> v1:172.21.15.32:6789/0 conn(0x7f1da40caa20 0x7f1da4071dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39854/0 (socket says 172.21.15.32:39854) 2024-09-13T18:47:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da2a00700 1 -- 172.21.15.32:0/2380065525 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735257675 0 0) 0x7f1da40c9140 con 0x7f1da40aa230 2024-09-13T18:47:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da3e00700 1 -- 172.21.15.32:0/2380065525 >> v1:172.21.15.86:6789/0 conn(0x7f1da40aa230 legacy=0x7f1da40cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da3e00700 1 -- 172.21.15.32:0/2380065525 >> v1:172.21.15.32:6789/0 conn(0x7f1da40caa20 legacy=0x7f1da4071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.502+0000 7f1da3e00700 1 -- 172.21.15.32:0/2380065525 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40a95c0 con 0x7f1da40aa610 2024-09-13T18:47:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1da3e00700 1 --2- 172.21.15.32:0/2380065525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40aa610 0x7f1da415b350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009d90 tx=0x7f1d9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b66efa070608a358 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1da2a00700 1 -- 172.21.15.32:0/2380065525 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00e070 con 0x7f1da40aa610 2024-09-13T18:47:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1da2a00700 1 -- 172.21.15.32:0/2380065525 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c00bad0 con 0x7f1da40aa610 2024-09-13T18:47:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1da2a00700 1 -- 172.21.15.32:0/2380065525 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00be80 con 0x7f1da40aa610 2024-09-13T18:47:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 -- 172.21.15.32:0/2380065525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40aa610 msgr2=0x7f1da415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 --2- 172.21.15.32:0/2380065525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40aa610 0x7f1da415b350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009d90 tx=0x7f1d9c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 -- 172.21.15.32:0/2380065525 shutdown_connections 2024-09-13T18:47:36.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 --2- 172.21.15.32:0/2380065525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40aa610 0x7f1da415b350 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 -- 172.21.15.32:0/2380065525 >> 172.21.15.32:0/2380065525 conn(0x7f1da4071240 msgr2=0x7f1da406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 -- 172.21.15.32:0/2380065525 shutdown_connections 2024-09-13T18:47:36.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.506+0000 7f1daa600700 1 -- 172.21.15.32:0/2380065525 wait complete. 2024-09-13T18:47:36.514 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 Processor -- start 2024-09-13T18:47:36.515 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 -- start start 2024-09-13T18:47:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da40aa230 0x7f1da40ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 0x7f1da41ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40caa20 0x7f1da41ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.516 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40ab0e0 con 0x7f1da40aa230 2024-09-13T18:47:36.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40ac160 con 0x7f1da40caa20 2024-09-13T18:47:36.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1daa600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da40ac440 con 0x7f1da40aa610 2024-09-13T18:47:36.517 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 0x7f1da41ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 0x7f1da41ee180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52960/0 (socket says 172.21.15.32:52960) 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 -- 172.21.15.32:0/1135666829 learned_addr learned my addr 172.21.15.32:0/1135666829 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1da3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40caa20 0x7f1da41ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1da3400700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da40aa230 0x7f1da40ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 -- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40caa20 msgr2=0x7f1da41ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40caa20 0x7f1da41ee6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 -- 172.21.15.32:0/1135666829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da40aa230 msgr2=0x7f1da40ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da40aa230 0x7f1da40ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.518 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 -- 172.21.15.32:0/1135666829 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c009a70 con 0x7f1da40aa610 2024-09-13T18:47:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9be00700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 0x7f1da41ee180 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c750 tx=0x7f1d8c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c004ca0 con 0x7f1da40aa610 2024-09-13T18:47:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c004e00 con 0x7f1da40aa610 2024-09-13T18:47:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.510+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0072f0 con 0x7f1da40aa610 2024-09-13T18:47:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.514+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da40ac720 con 0x7f1da40aa610 2024-09-13T18:47:36.519 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.514+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da40ab3c0 con 0x7f1da40aa610 2024-09-13T18:47:36.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.514+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da40cb0c0 con 0x7f1da40aa610 2024-09-13T18:47:36.522 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.514+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d8c007450 con 0x7f1da40aa610 2024-09-13T18:47:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.518+0000 7f1d9b400700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.523 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.518+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f1d8c084260 con 0x7f1da40aa610 2024-09-13T18:47:36.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.518+0000 7f1da3400700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.518+0000 7f1da3400700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1d94000f60 tx=0x7f1d94007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.526+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d8c051130 con 0x7f1da40aa610 2024-09-13T18:47:36.723 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.718+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1da40ac2d0 con 0x7f1d80066730 2024-09-13T18:47:36.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.734+0000 7f1d9b400700 1 -- 172.21.15.32:0/1135666829 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367845 (secure 0 0 0) 0x7f1da40ac2d0 con 0x7f1d80066730 2024-09-13T18:47:36.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:36.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 msgr2=0x7f1d80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1d94000f60 tx=0x7f1d94007e00 comp rx=0 tx=0).stop 2024-09-13T18:47:36.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 msgr2=0x7f1da41ee180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 0x7f1da41ee180 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c750 tx=0x7f1d8c00ca60 comp rx=0 tx=0).stop 2024-09-13T18:47:36.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 shutdown_connections 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1d80066730 0x7f1d80068bf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1da40caa20 0x7f1da41ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1da40aa610 0x7f1da41ee180 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 --2- 172.21.15.32:0/1135666829 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1da40aa230 0x7f1da40ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 >> 172.21.15.32:0/1135666829 conn(0x7f1da4071240 msgr2=0x7f1da40ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 shutdown_connections 2024-09-13T18:47:36.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.746+0000 7f1daa600700 1 -- 172.21.15.32:0/1135666829 wait complete. 2024-09-13T18:47:36.754 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:47:36.775 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-13T18:47:36.116781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629029,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":243,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249468,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725252,"statfs":{"total":773094113280,"available":772838658048,"internally_reserved":0,"allocated":8904704,"data_stored":5130154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.464237"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658843+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:26.658843+0000","last_peered":"2024-09-13T18:47:26.658843+0000","last_clean":"2024-09-13T18:47:26.658843+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:26.658843+0000","last_undegraded":"2024-09-13T18:47:26.658843+0000","last_fullsized":"2024-09-13T18:47:26.658843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268110+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:47:27.268110+0000","last_peered":"2024-09-13T18:47:27.268110+0000","last_clean":"2024-09-13T18:47:27.268110+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:27.268110+0000","last_undegraded":"2024-09-13T18:47:27.268110+0000","last_fullsized":"2024-09-13T18:47:27.268110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261007+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.261007+0000","last_peered":"2024-09-13T18:47:27.261007+0000","last_clean":"2024-09-13T18:47:27.261007+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.261007+0000","last_undegraded":"2024-09-13T18:47:27.261007+0000","last_fullsized":"2024-09-13T18:47:27.261007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:46.084608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268242+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:47:27.268242+0000","last_peered":"2024-09-13T18:47:27.268242+0000","last_clean":"2024-09-13T18:47:27.268242+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:27.268242+0000","last_undegraded":"2024-09-13T18:47:27.268242+0000","last_fullsized":"2024-09-13T18:47:27.268242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268231+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:47:27.268231+0000","last_peered":"2024-09-13T18:47:27.268231+0000","last_clean":"2024-09-13T18:47:27.268231+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:27.268231+0000","last_undegraded":"2024-09-13T18:47:27.268231+0000","last_fullsized":"2024-09-13T18:47:27.268231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899078+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:27.899078+0000","last_peered":"2024-09-13T18:47:27.899078+0000","last_clean":"2024-09-13T18:47:27.899078+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:27.899078+0000","last_undegraded":"2024-09-13T18:47:27.899078+0000","last_fullsized":"2024-09-13T18:47:27.899078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"64'3","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901004+0000","last_change":"2024-09-13T18:47:14.525177+0000","last_active":"2024-09-13T18:47:27.901004+0000","last_peered":"2024-09-13T18:47:27.901004+0000","last_clean":"2024-09-13T18:47:27.901004+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:27.901004+0000","last_undegraded":"2024-09-13T18:47:27.901004+0000","last_fullsized":"2024-09-13T18:47:27.901004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:30.537891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899934+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:27.899934+0000","last_peered":"2024-09-13T18:47:27.899934+0000","last_clean":"2024-09-13T18:47:27.899934+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:27.899934+0000","last_undegraded":"2024-09-13T18:47:27.899934+0000","last_fullsized":"2024-09-13T18:47:27.899934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900988+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:27.900988+0000","last_peered":"2024-09-13T18:47:27.900988+0000","last_clean":"2024-09-13T18:47:27.900988+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:27.900988+0000","last_undegraded":"2024-09-13T18:47:27.900988+0000","last_fullsized":"2024-09-13T18:47:27.900988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901044+0000","last_change":"2024-09-13T18:47:14.525584+0000","last_active":"2024-09-13T18:47:27.901044+0000","last_peered":"2024-09-13T18:47:27.901044+0000","last_clean":"2024-09-13T18:47:27.901044+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:27.901044+0000","last_undegraded":"2024-09-13T18:47:27.901044+0000","last_fullsized":"2024-09-13T18:47:27.901044+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:18.465119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266553+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:27.266553+0000","last_peered":"2024-09-13T18:47:27.266553+0000","last_clean":"2024-09-13T18:47:27.266553+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:27.266553+0000","last_undegraded":"2024-09-13T18:47:27.266553+0000","last_fullsized":"2024-09-13T18:47:27.266553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900545+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:27.900545+0000","last_peered":"2024-09-13T18:47:27.900545+0000","last_clean":"2024-09-13T18:47:27.900545+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:27.900545+0000","last_undegraded":"2024-09-13T18:47:27.900545+0000","last_fullsized":"2024-09-13T18:47:27.900545+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266005+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:47:27.266005+0000","last_peered":"2024-09-13T18:47:27.266005+0000","last_clean":"2024-09-13T18:47:27.266005+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:27.266005+0000","last_undegraded":"2024-09-13T18:47:27.266005+0000","last_fullsized":"2024-09-13T18:47:27.266005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"64'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266144+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:47:27.266144+0000","last_peered":"2024-09-13T18:47:27.266144+0000","last_clean":"2024-09-13T18:47:27.266144+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:27.266144+0000","last_undegraded":"2024-09-13T18:47:27.266144+0000","last_fullsized":"2024-09-13T18:47:27.266144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266891+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.266891+0000","last_peered":"2024-09-13T18:47:27.266891+0000","last_clean":"2024-09-13T18:47:27.266891+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.266891+0000","last_undegraded":"2024-09-13T18:47:27.266891+0000","last_fullsized":"2024-09-13T18:47:27.266891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264104+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:27.264104+0000","last_peered":"2024-09-13T18:47:27.264104+0000","last_clean":"2024-09-13T18:47:27.264104+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:27.264104+0000","last_undegraded":"2024-09-13T18:47:27.264104+0000","last_fullsized":"2024-09-13T18:47:27.264104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263324+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.263324+0000","last_peered":"2024-09-13T18:47:27.263324+0000","last_clean":"2024-09-13T18:47:27.263324+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.263324+0000","last_undegraded":"2024-09-13T18:47:27.263324+0000","last_fullsized":"2024-09-13T18:47:27.263324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265099+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.265099+0000","last_peered":"2024-09-13T18:47:27.265099+0000","last_clean":"2024-09-13T18:47:27.265099+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.265099+0000","last_undegraded":"2024-09-13T18:47:27.265099+0000","last_fullsized":"2024-09-13T18:47:27.265099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.954234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656833+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:26.656833+0000","last_peered":"2024-09-13T18:47:26.656833+0000","last_clean":"2024-09-13T18:47:26.656833+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:26.656833+0000","last_undegraded":"2024-09-13T18:47:26.656833+0000","last_fullsized":"2024-09-13T18:47:26.656833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657838+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:26.657838+0000","last_peered":"2024-09-13T18:47:26.657838+0000","last_clean":"2024-09-13T18:47:26.657838+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:26.657838+0000","last_undegraded":"2024-09-13T18:47:26.657838+0000","last_fullsized":"2024-09-13T18:47:26.657838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266878+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.266878+0000","last_peered":"2024-09-13T18:47:27.266878+0000","last_clean":"2024-09-13T18:47:27.266878+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.266878+0000","last_undegraded":"2024-09-13T18:47:27.266878+0000","last_fullsized":"2024-09-13T18:47:27.266878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265730+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:27.265730+0000","last_peered":"2024-09-13T18:47:27.265730+0000","last_clean":"2024-09-13T18:47:27.265730+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:27.265730+0000","last_undegraded":"2024-09-13T18:47:27.265730+0000","last_fullsized":"2024-09-13T18:47:27.265730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263552+0000","last_change":"2024-09-13T18:47:14.520002+0000","last_active":"2024-09-13T18:47:27.263552+0000","last_peered":"2024-09-13T18:47:27.263552+0000","last_clean":"2024-09-13T18:47:27.263552+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:27.263552+0000","last_undegraded":"2024-09-13T18:47:27.263552+0000","last_fullsized":"2024-09-13T18:47:27.263552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:01.778129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656294+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:26.656294+0000","last_peered":"2024-09-13T18:47:26.656294+0000","last_clean":"2024-09-13T18:47:26.656294+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:26.656294+0000","last_undegraded":"2024-09-13T18:47:26.656294+0000","last_fullsized":"2024-09-13T18:47:26.656294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657925+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:26.657925+0000","last_peered":"2024-09-13T18:47:26.657925+0000","last_clean":"2024-09-13T18:47:26.657925+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:26.657925+0000","last_undegraded":"2024-09-13T18:47:26.657925+0000","last_fullsized":"2024-09-13T18:47:26.657925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266890+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.266890+0000","last_peered":"2024-09-13T18:47:27.266890+0000","last_clean":"2024-09-13T18:47:27.266890+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.266890+0000","last_undegraded":"2024-09-13T18:47:27.266890+0000","last_fullsized":"2024-09-13T18:47:27.266890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655511+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:26.655511+0000","last_peered":"2024-09-13T18:47:26.655511+0000","last_clean":"2024-09-13T18:47:26.655511+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:26.655511+0000","last_undegraded":"2024-09-13T18:47:26.655511+0000","last_fullsized":"2024-09-13T18:47:26.655511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658909+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:26.658909+0000","last_peered":"2024-09-13T18:47:26.658909+0000","last_clean":"2024-09-13T18:47:26.658909+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:26.658909+0000","last_undegraded":"2024-09-13T18:47:26.658909+0000","last_fullsized":"2024-09-13T18:47:26.658909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"70'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658459+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:47:26.658459+0000","last_peered":"2024-09-13T18:47:26.658459+0000","last_clean":"2024-09-13T18:47:26.658459+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:26.658459+0000","last_undegraded":"2024-09-13T18:47:26.658459+0000","last_fullsized":"2024-09-13T18:47:26.658459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656651+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:26.656651+0000","last_peered":"2024-09-13T18:47:26.656651+0000","last_clean":"2024-09-13T18:47:26.656651+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:26.656651+0000","last_undegraded":"2024-09-13T18:47:26.656651+0000","last_fullsized":"2024-09-13T18:47:26.656651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263802+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:27.263802+0000","last_peered":"2024-09-13T18:47:27.263802+0000","last_clean":"2024-09-13T18:47:27.263802+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:27.263802+0000","last_undegraded":"2024-09-13T18:47:27.263802+0000","last_fullsized":"2024-09-13T18:47:27.263802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266744+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:47:27.266744+0000","last_peered":"2024-09-13T18:47:27.266744+0000","last_clean":"2024-09-13T18:47:27.266744+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:27.266744+0000","last_undegraded":"2024-09-13T18:47:27.266744+0000","last_fullsized":"2024-09-13T18:47:27.266744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264165+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.264165+0000","last_peered":"2024-09-13T18:47:27.264165+0000","last_clean":"2024-09-13T18:47:27.264165+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.264165+0000","last_undegraded":"2024-09-13T18:47:27.264165+0000","last_fullsized":"2024-09-13T18:47:27.264165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656088+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:47:26.656088+0000","last_peered":"2024-09-13T18:47:26.656088+0000","last_clean":"2024-09-13T18:47:26.656088+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:26.656088+0000","last_undegraded":"2024-09-13T18:47:26.656088+0000","last_fullsized":"2024-09-13T18:47:26.656088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266528+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:47:27.266528+0000","last_peered":"2024-09-13T18:47:27.266528+0000","last_clean":"2024-09-13T18:47:27.266528+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:27.266528+0000","last_undegraded":"2024-09-13T18:47:27.266528+0000","last_fullsized":"2024-09-13T18:47:27.266528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263593+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:47:27.263593+0000","last_peered":"2024-09-13T18:47:27.263593+0000","last_clean":"2024-09-13T18:47:27.263593+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:27.263593+0000","last_undegraded":"2024-09-13T18:47:27.263593+0000","last_fullsized":"2024-09-13T18:47:27.263593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264264+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:27.264264+0000","last_peered":"2024-09-13T18:47:27.264264+0000","last_clean":"2024-09-13T18:47:27.264264+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:27.264264+0000","last_undegraded":"2024-09-13T18:47:27.264264+0000","last_fullsized":"2024-09-13T18:47:27.264264+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:58.188762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265891+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.265891+0000","last_peered":"2024-09-13T18:47:27.265891+0000","last_clean":"2024-09-13T18:47:27.265891+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.265891+0000","last_undegraded":"2024-09-13T18:47:27.265891+0000","last_fullsized":"2024-09-13T18:47:27.265891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263927+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:47:27.263927+0000","last_peered":"2024-09-13T18:47:27.263927+0000","last_clean":"2024-09-13T18:47:27.263927+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:27.263927+0000","last_undegraded":"2024-09-13T18:47:27.263927+0000","last_fullsized":"2024-09-13T18:47:27.263927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264936+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:47:27.264936+0000","last_peered":"2024-09-13T18:47:27.264936+0000","last_clean":"2024-09-13T18:47:27.264936+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:27.264936+0000","last_undegraded":"2024-09-13T18:47:27.264936+0000","last_fullsized":"2024-09-13T18:47:27.264936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"67'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266493+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:47:27.266493+0000","last_peered":"2024-09-13T18:47:27.266493+0000","last_clean":"2024-09-13T18:47:27.266493+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:27.266493+0000","last_undegraded":"2024-09-13T18:47:27.266493+0000","last_fullsized":"2024-09-13T18:47:27.266493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264888+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:47:27.264888+0000","last_peered":"2024-09-13T18:47:27.264888+0000","last_clean":"2024-09-13T18:47:27.264888+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:27.264888+0000","last_undegraded":"2024-09-13T18:47:27.264888+0000","last_fullsized":"2024-09-13T18:47:27.264888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263663+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:47:27.263663+0000","last_peered":"2024-09-13T18:47:27.263663+0000","last_clean":"2024-09-13T18:47:27.263663+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:27.263663+0000","last_undegraded":"2024-09-13T18:47:27.263663+0000","last_fullsized":"2024-09-13T18:47:27.263663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265583+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.265583+0000","last_peered":"2024-09-13T18:47:27.265583+0000","last_clean":"2024-09-13T18:47:27.265583+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.265583+0000","last_undegraded":"2024-09-13T18:47:27.265583+0000","last_fullsized":"2024-09-13T18:47:27.265583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267795+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.267795+0000","last_peered":"2024-09-13T18:47:27.267795+0000","last_clean":"2024-09-13T18:47:27.267795+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.267795+0000","last_undegraded":"2024-09-13T18:47:27.267795+0000","last_fullsized":"2024-09-13T18:47:27.267795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657527+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:26.657527+0000","last_peered":"2024-09-13T18:47:26.657527+0000","last_clean":"2024-09-13T18:47:26.657527+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:26.657527+0000","last_undegraded":"2024-09-13T18:47:26.657527+0000","last_fullsized":"2024-09-13T18:47:26.657527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266055+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.266055+0000","last_peered":"2024-09-13T18:47:27.266055+0000","last_clean":"2024-09-13T18:47:27.266055+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.266055+0000","last_undegraded":"2024-09-13T18:47:27.266055+0000","last_fullsized":"2024-09-13T18:47:27.266055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261221+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:47:27.261221+0000","last_peered":"2024-09-13T18:47:27.261221+0000","last_clean":"2024-09-13T18:47:27.261221+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:27.261221+0000","last_undegraded":"2024-09-13T18:47:27.261221+0000","last_fullsized":"2024-09-13T18:47:27.261221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266732+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.266732+0000","last_peered":"2024-09-13T18:47:27.266732+0000","last_clean":"2024-09-13T18:47:27.266732+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.266732+0000","last_undegraded":"2024-09-13T18:47:27.266732+0000","last_fullsized":"2024-09-13T18:47:27.266732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266415+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:27.266415+0000","last_peered":"2024-09-13T18:47:27.266415+0000","last_clean":"2024-09-13T18:47:27.266415+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:27.266415+0000","last_undegraded":"2024-09-13T18:47:27.266415+0000","last_fullsized":"2024-09-13T18:47:27.266415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263597+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.263597+0000","last_peered":"2024-09-13T18:47:27.263597+0000","last_clean":"2024-09-13T18:47:27.263597+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.263597+0000","last_undegraded":"2024-09-13T18:47:27.263597+0000","last_fullsized":"2024-09-13T18:47:27.263597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655686+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:26.655686+0000","last_peered":"2024-09-13T18:47:26.655686+0000","last_clean":"2024-09-13T18:47:26.655686+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:26.655686+0000","last_undegraded":"2024-09-13T18:47:26.655686+0000","last_fullsized":"2024-09-13T18:47:26.655686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265175+0000","last_change":"2024-09-13T18:47:14.709999+0000","last_active":"2024-09-13T18:47:27.265175+0000","last_peered":"2024-09-13T18:47:27.265175+0000","last_clean":"2024-09-13T18:47:27.265175+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:27.265175+0000","last_undegraded":"2024-09-13T18:47:27.265175+0000","last_fullsized":"2024-09-13T18:47:27.265175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:43.817137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267884+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:47:27.267884+0000","last_peered":"2024-09-13T18:47:27.267884+0000","last_clean":"2024-09-13T18:47:27.267884+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:27.267884+0000","last_undegraded":"2024-09-13T18:47:27.267884+0000","last_fullsized":"2024-09-13T18:47:27.267884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267160+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.267160+0000","last_peered":"2024-09-13T18:47:27.267160+0000","last_clean":"2024-09-13T18:47:27.267160+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.267160+0000","last_undegraded":"2024-09-13T18:47:27.267160+0000","last_fullsized":"2024-09-13T18:47:27.267160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265710+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:27.265710+0000","last_peered":"2024-09-13T18:47:27.265710+0000","last_clean":"2024-09-13T18:47:27.265710+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:27.265710+0000","last_undegraded":"2024-09-13T18:47:27.265710+0000","last_fullsized":"2024-09-13T18:47:27.265710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:41.204767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658197+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:26.658197+0000","last_peered":"2024-09-13T18:47:26.658197+0000","last_clean":"2024-09-13T18:47:26.658197+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:26.658197+0000","last_undegraded":"2024-09-13T18:47:26.658197+0000","last_fullsized":"2024-09-13T18:47:26.658197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265409+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.265409+0000","last_peered":"2024-09-13T18:47:27.265409+0000","last_clean":"2024-09-13T18:47:27.265409+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.265409+0000","last_undegraded":"2024-09-13T18:47:27.265409+0000","last_fullsized":"2024-09-13T18:47:27.265409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656499+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:47:26.656499+0000","last_peered":"2024-09-13T18:47:26.656499+0000","last_clean":"2024-09-13T18:47:26.656499+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:26.656499+0000","last_undegraded":"2024-09-13T18:47:26.656499+0000","last_fullsized":"2024-09-13T18:47:26.656499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265775+0000","last_change":"2024-09-13T18:47:14.523024+0000","last_active":"2024-09-13T18:47:27.265775+0000","last_peered":"2024-09-13T18:47:27.265775+0000","last_clean":"2024-09-13T18:47:27.265775+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:27.265775+0000","last_undegraded":"2024-09-13T18:47:27.265775+0000","last_fullsized":"2024-09-13T18:47:27.265775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:41.142555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261242+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.261242+0000","last_peered":"2024-09-13T18:47:27.261242+0000","last_clean":"2024-09-13T18:47:27.261242+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.261242+0000","last_undegraded":"2024-09-13T18:47:27.261242+0000","last_fullsized":"2024-09-13T18:47:27.261242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265655+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:47:27.265655+0000","last_peered":"2024-09-13T18:47:27.265655+0000","last_clean":"2024-09-13T18:47:27.265655+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:27.265655+0000","last_undegraded":"2024-09-13T18:47:27.265655+0000","last_fullsized":"2024-09-13T18:47:27.265655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657139+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:26.657139+0000","last_peered":"2024-09-13T18:47:26.657139+0000","last_clean":"2024-09-13T18:47:26.657139+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:26.657139+0000","last_undegraded":"2024-09-13T18:47:26.657139+0000","last_fullsized":"2024-09-13T18:47:26.657139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659005+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:27.659005+0000","last_peered":"2024-09-13T18:47:27.659005+0000","last_clean":"2024-09-13T18:47:27.659005+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:27.659005+0000","last_undegraded":"2024-09-13T18:47:27.659005+0000","last_fullsized":"2024-09-13T18:47:27.659005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261098+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:27.261098+0000","last_peered":"2024-09-13T18:47:27.261098+0000","last_clean":"2024-09-13T18:47:27.261098+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:27.261098+0000","last_undegraded":"2024-09-13T18:47:27.261098+0000","last_fullsized":"2024-09-13T18:47:27.261098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264134+0000","last_change":"2024-09-13T18:47:14.654438+0000","last_active":"2024-09-13T18:47:27.264134+0000","last_peered":"2024-09-13T18:47:27.264134+0000","last_clean":"2024-09-13T18:47:27.264134+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:27.264134+0000","last_undegraded":"2024-09-13T18:47:27.264134+0000","last_fullsized":"2024-09-13T18:47:27.264134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:43.091822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264617+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.264617+0000","last_peered":"2024-09-13T18:47:27.264617+0000","last_clean":"2024-09-13T18:47:27.264617+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.264617+0000","last_undegraded":"2024-09-13T18:47:27.264617+0000","last_fullsized":"2024-09-13T18:47:27.264617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265972+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:27.265972+0000","last_peered":"2024-09-13T18:47:27.265972+0000","last_clean":"2024-09-13T18:47:27.265972+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:27.265972+0000","last_undegraded":"2024-09-13T18:47:27.265972+0000","last_fullsized":"2024-09-13T18:47:27.265972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266196+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:47:27.266196+0000","last_peered":"2024-09-13T18:47:27.266196+0000","last_clean":"2024-09-13T18:47:27.266196+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:27.266196+0000","last_undegraded":"2024-09-13T18:47:27.266196+0000","last_fullsized":"2024-09-13T18:47:27.266196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263761+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.263761+0000","last_peered":"2024-09-13T18:47:27.263761+0000","last_clean":"2024-09-13T18:47:27.263761+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.263761+0000","last_undegraded":"2024-09-13T18:47:27.263761+0000","last_fullsized":"2024-09-13T18:47:27.263761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263104+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:27.263104+0000","last_peered":"2024-09-13T18:47:27.263104+0000","last_clean":"2024-09-13T18:47:27.263104+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:27.263104+0000","last_undegraded":"2024-09-13T18:47:27.263104+0000","last_fullsized":"2024-09-13T18:47:27.263104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264479+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:47:27.264479+0000","last_peered":"2024-09-13T18:47:27.264479+0000","last_clean":"2024-09-13T18:47:27.264479+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:27.264479+0000","last_undegraded":"2024-09-13T18:47:27.264479+0000","last_fullsized":"2024-09-13T18:47:27.264479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266569+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.266569+0000","last_peered":"2024-09-13T18:47:27.266569+0000","last_clean":"2024-09-13T18:47:27.266569+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.266569+0000","last_undegraded":"2024-09-13T18:47:27.266569+0000","last_fullsized":"2024-09-13T18:47:27.266569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900808+0000","last_change":"2024-09-13T18:47:14.649751+0000","last_active":"2024-09-13T18:47:27.900808+0000","last_peered":"2024-09-13T18:47:27.900808+0000","last_clean":"2024-09-13T18:47:27.900808+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:27.900808+0000","last_undegraded":"2024-09-13T18:47:27.900808+0000","last_fullsized":"2024-09-13T18:47:27.900808+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:41.327461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656244+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:47:26.656244+0000","last_peered":"2024-09-13T18:47:26.656244+0000","last_clean":"2024-09-13T18:47:26.656244+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:26.656244+0000","last_undegraded":"2024-09-13T18:47:26.656244+0000","last_fullsized":"2024-09-13T18:47:26.656244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656411+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:27.656411+0000","last_peered":"2024-09-13T18:47:27.656411+0000","last_clean":"2024-09-13T18:47:27.656411+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:27.656411+0000","last_undegraded":"2024-09-13T18:47:27.656411+0000","last_fullsized":"2024-09-13T18:47:27.656411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266384+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:27.266384+0000","last_peered":"2024-09-13T18:47:27.266384+0000","last_clean":"2024-09-13T18:47:27.266384+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:27.266384+0000","last_undegraded":"2024-09-13T18:47:27.266384+0000","last_fullsized":"2024-09-13T18:47:27.266384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"67'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898590+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:47:27.898590+0000","last_peered":"2024-09-13T18:47:27.898590+0000","last_clean":"2024-09-13T18:47:27.898590+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:27.898590+0000","last_undegraded":"2024-09-13T18:47:27.898590+0000","last_fullsized":"2024-09-13T18:47:27.898590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655745+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:26.655745+0000","last_peered":"2024-09-13T18:47:26.655745+0000","last_clean":"2024-09-13T18:47:26.655745+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:26.655745+0000","last_undegraded":"2024-09-13T18:47:26.655745+0000","last_fullsized":"2024-09-13T18:47:26.655745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659183+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:47:27.659183+0000","last_peered":"2024-09-13T18:47:27.659183+0000","last_clean":"2024-09-13T18:47:27.659183+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:27.659183+0000","last_undegraded":"2024-09-13T18:47:27.659183+0000","last_fullsized":"2024-09-13T18:47:27.659183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264885+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:47:27.264885+0000","last_peered":"2024-09-13T18:47:27.264885+0000","last_clean":"2024-09-13T18:47:27.264885+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:27.264885+0000","last_undegraded":"2024-09-13T18:47:27.264885+0000","last_fullsized":"2024-09-13T18:47:27.264885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.896644+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:27.896644+0000","last_peered":"2024-09-13T18:47:27.896644+0000","last_clean":"2024-09-13T18:47:27.896644+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:27.896644+0000","last_undegraded":"2024-09-13T18:47:27.896644+0000","last_fullsized":"2024-09-13T18:47:27.896644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901899+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:47:27.901899+0000","last_peered":"2024-09-13T18:47:27.901899+0000","last_clean":"2024-09-13T18:47:27.901899+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:47:27.901899+0000","last_undegraded":"2024-09-13T18:47:27.901899+0000","last_fullsized":"2024-09-13T18:47:27.901899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262272+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.262272+0000","last_peered":"2024-09-13T18:47:27.262272+0000","last_clean":"2024-09-13T18:47:27.262272+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.262272+0000","last_undegraded":"2024-09-13T18:47:27.262272+0000","last_fullsized":"2024-09-13T18:47:27.262272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657696+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:27.657696+0000","last_peered":"2024-09-13T18:47:27.657696+0000","last_clean":"2024-09-13T18:47:27.657696+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:27.657696+0000","last_undegraded":"2024-09-13T18:47:27.657696+0000","last_fullsized":"2024-09-13T18:47:27.657696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657664+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:26.657664+0000","last_peered":"2024-09-13T18:47:26.657664+0000","last_clean":"2024-09-13T18:47:26.657664+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:26.657664+0000","last_undegraded":"2024-09-13T18:47:26.657664+0000","last_fullsized":"2024-09-13T18:47:26.657664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657922+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:47:27.657922+0000","last_peered":"2024-09-13T18:47:27.657922+0000","last_clean":"2024-09-13T18:47:27.657922+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:27.657922+0000","last_undegraded":"2024-09-13T18:47:27.657922+0000","last_fullsized":"2024-09-13T18:47:27.657922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265110+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:47:27.265110+0000","last_peered":"2024-09-13T18:47:27.265110+0000","last_clean":"2024-09-13T18:47:27.265110+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:27.265110+0000","last_undegraded":"2024-09-13T18:47:27.265110+0000","last_fullsized":"2024-09-13T18:47:27.265110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267014+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.267014+0000","last_peered":"2024-09-13T18:47:27.267014+0000","last_clean":"2024-09-13T18:47:27.267014+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.267014+0000","last_undegraded":"2024-09-13T18:47:27.267014+0000","last_fullsized":"2024-09-13T18:47:27.267014+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655855+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:27.655855+0000","last_peered":"2024-09-13T18:47:27.655855+0000","last_clean":"2024-09-13T18:47:27.655855+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:27.655855+0000","last_undegraded":"2024-09-13T18:47:27.655855+0000","last_fullsized":"2024-09-13T18:47:27.655855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263416+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:47:27.263416+0000","last_peered":"2024-09-13T18:47:27.263416+0000","last_clean":"2024-09-13T18:47:27.263416+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:27.263416+0000","last_undegraded":"2024-09-13T18:47:27.263416+0000","last_fullsized":"2024-09-13T18:47:27.263416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266250+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.266250+0000","last_peered":"2024-09-13T18:47:27.266250+0000","last_clean":"2024-09-13T18:47:27.266250+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.266250+0000","last_undegraded":"2024-09-13T18:47:27.266250+0000","last_fullsized":"2024-09-13T18:47:27.266250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657317+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:27.657317+0000","last_peered":"2024-09-13T18:47:27.657317+0000","last_clean":"2024-09-13T18:47:27.657317+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:27.657317+0000","last_undegraded":"2024-09-13T18:47:27.657317+0000","last_fullsized":"2024-09-13T18:47:27.657317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657187+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:26.657187+0000","last_peered":"2024-09-13T18:47:26.657187+0000","last_clean":"2024-09-13T18:47:26.657187+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:26.657187+0000","last_undegraded":"2024-09-13T18:47:26.657187+0000","last_fullsized":"2024-09-13T18:47:26.657187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657724+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:47:27.657724+0000","last_peered":"2024-09-13T18:47:27.657724+0000","last_clean":"2024-09-13T18:47:27.657724+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:27.657724+0000","last_undegraded":"2024-09-13T18:47:27.657724+0000","last_fullsized":"2024-09-13T18:47:27.657724+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898388+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:27.898388+0000","last_peered":"2024-09-13T18:47:27.898388+0000","last_clean":"2024-09-13T18:47:27.898388+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:27.898388+0000","last_undegraded":"2024-09-13T18:47:27.898388+0000","last_fullsized":"2024-09-13T18:47:27.898388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264741+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:27.264741+0000","last_peered":"2024-09-13T18:47:27.264741+0000","last_clean":"2024-09-13T18:47:27.264741+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:27.264741+0000","last_undegraded":"2024-09-13T18:47:27.264741+0000","last_fullsized":"2024-09-13T18:47:27.264741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655701+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:47:26.655701+0000","last_peered":"2024-09-13T18:47:26.655701+0000","last_clean":"2024-09-13T18:47:26.655701+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:26.655701+0000","last_undegraded":"2024-09-13T18:47:26.655701+0000","last_fullsized":"2024-09-13T18:47:26.655701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266338+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:27.266338+0000","last_peered":"2024-09-13T18:47:27.266338+0000","last_clean":"2024-09-13T18:47:27.266338+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:27.266338+0000","last_undegraded":"2024-09-13T18:47:27.266338+0000","last_fullsized":"2024-09-13T18:47:27.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266075+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:27.266075+0000","last_peered":"2024-09-13T18:47:27.266075+0000","last_clean":"2024-09-13T18:47:27.266075+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:27.266075+0000","last_undegraded":"2024-09-13T18:47:27.266075+0000","last_fullsized":"2024-09-13T18:47:27.266075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267343+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:27.267343+0000","last_peered":"2024-09-13T18:47:27.267343+0000","last_clean":"2024-09-13T18:47:27.267343+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:27.267343+0000","last_undegraded":"2024-09-13T18:47:27.267343+0000","last_fullsized":"2024-09-13T18:47:27.267343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263537+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:27.263537+0000","last_peered":"2024-09-13T18:47:27.263537+0000","last_clean":"2024-09-13T18:47:27.263537+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:27.263537+0000","last_undegraded":"2024-09-13T18:47:27.263537+0000","last_fullsized":"2024-09-13T18:47:27.263537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264135+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:27.264135+0000","last_peered":"2024-09-13T18:47:27.264135+0000","last_clean":"2024-09-13T18:47:27.264135+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:27.264135+0000","last_undegraded":"2024-09-13T18:47:27.264135+0000","last_fullsized":"2024-09-13T18:47:27.264135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656312+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:26.656312+0000","last_peered":"2024-09-13T18:47:26.656312+0000","last_clean":"2024-09-13T18:47:26.656312+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:26.656312+0000","last_undegraded":"2024-09-13T18:47:26.656312+0000","last_fullsized":"2024-09-13T18:47:26.656312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268166+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:27.268166+0000","last_peered":"2024-09-13T18:47:27.268166+0000","last_clean":"2024-09-13T18:47:27.268166+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:27.268166+0000","last_undegraded":"2024-09-13T18:47:27.268166+0000","last_fullsized":"2024-09-13T18:47:27.268166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265579+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:27.265579+0000","last_peered":"2024-09-13T18:47:27.265579+0000","last_clean":"2024-09-13T18:47:27.265579+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:27.265579+0000","last_undegraded":"2024-09-13T18:47:27.265579+0000","last_fullsized":"2024-09-13T18:47:27.265579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266255+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:47:27.266255+0000","last_peered":"2024-09-13T18:47:27.266255+0000","last_clean":"2024-09-13T18:47:27.266255+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:27.266255+0000","last_undegraded":"2024-09-13T18:47:27.266255+0000","last_fullsized":"2024-09-13T18:47:27.266255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261334+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:27.261334+0000","last_peered":"2024-09-13T18:47:27.261334+0000","last_clean":"2024-09-13T18:47:27.261334+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:27.261334+0000","last_undegraded":"2024-09-13T18:47:27.261334+0000","last_fullsized":"2024-09-13T18:47:27.261334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657229+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:26.657229+0000","last_peered":"2024-09-13T18:47:26.657229+0000","last_clean":"2024-09-13T18:47:26.657229+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:26.657229+0000","last_undegraded":"2024-09-13T18:47:26.657229+0000","last_fullsized":"2024-09-13T18:47:26.657229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264995+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:27.264995+0000","last_peered":"2024-09-13T18:47:27.264995+0000","last_clean":"2024-09-13T18:47:27.264995+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:27.264995+0000","last_undegraded":"2024-09-13T18:47:27.264995+0000","last_fullsized":"2024-09-13T18:47:27.264995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266855+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:27.266855+0000","last_peered":"2024-09-13T18:47:27.266855+0000","last_clean":"2024-09-13T18:47:27.266855+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:27.266855+0000","last_undegraded":"2024-09-13T18:47:27.266855+0000","last_fullsized":"2024-09-13T18:47:27.266855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265943+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:27.265943+0000","last_peered":"2024-09-13T18:47:27.265943+0000","last_clean":"2024-09-13T18:47:27.265943+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:27.265943+0000","last_undegraded":"2024-09-13T18:47:27.265943+0000","last_fullsized":"2024-09-13T18:47:27.265943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266928+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:27.266928+0000","last_peered":"2024-09-13T18:47:27.266928+0000","last_clean":"2024-09-13T18:47:27.266928+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:27.266928+0000","last_undegraded":"2024-09-13T18:47:27.266928+0000","last_fullsized":"2024-09-13T18:47:27.266928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265447+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:47:27.265447+0000","last_peered":"2024-09-13T18:47:27.265447+0000","last_clean":"2024-09-13T18:47:27.265447+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:27.265447+0000","last_undegraded":"2024-09-13T18:47:27.265447+0000","last_fullsized":"2024-09-13T18:47:27.265447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265838+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:27.265838+0000","last_peered":"2024-09-13T18:47:27.265838+0000","last_clean":"2024-09-13T18:47:27.265838+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:27.265838+0000","last_undegraded":"2024-09-13T18:47:27.265838+0000","last_fullsized":"2024-09-13T18:47:27.265838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"64'1","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263722+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:47:27.263722+0000","last_peered":"2024-09-13T18:47:27.263722+0000","last_clean":"2024-09-13T18:47:27.263722+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:27.263722+0000","last_undegraded":"2024-09-13T18:47:27.263722+0000","last_fullsized":"2024-09-13T18:47:27.263722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264382+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:47:27.264382+0000","last_peered":"2024-09-13T18:47:27.264382+0000","last_clean":"2024-09-13T18:47:27.264382+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:27.264382+0000","last_undegraded":"2024-09-13T18:47:27.264382+0000","last_fullsized":"2024-09-13T18:47:27.264382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:47.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900689+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:27.900689+0000","last_peered":"2024-09-13T18:47:27.900689+0000","last_clean":"2024-09-13T18:47:27.900689+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:27.900689+0000","last_undegraded":"2024-09-13T18:47:27.900689+0000","last_fullsized":"2024-09-13T18:47:27.900689+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:12.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.903085+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:27.903085+0000","last_peered":"2024-09-13T18:47:27.903085+0000","last_clean":"2024-09-13T18:47:27.903085+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:27.903085+0000","last_undegraded":"2024-09-13T18:47:27.903085+0000","last_fullsized":"2024-09-13T18:47:27.903085+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:42.267150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899218+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:27.899218+0000","last_peered":"2024-09-13T18:47:27.899218+0000","last_clean":"2024-09-13T18:47:27.899218+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:27.899218+0000","last_undegraded":"2024-09-13T18:47:27.899218+0000","last_fullsized":"2024-09-13T18:47:27.899218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655666+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:27.655666+0000","last_peered":"2024-09-13T18:47:27.655666+0000","last_clean":"2024-09-13T18:47:27.655666+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:27.655666+0000","last_undegraded":"2024-09-13T18:47:27.655666+0000","last_fullsized":"2024-09-13T18:47:27.655666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266197+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:27.266197+0000","last_peered":"2024-09-13T18:47:27.266197+0000","last_clean":"2024-09-13T18:47:27.266197+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:27.266197+0000","last_undegraded":"2024-09-13T18:47:27.266197+0000","last_fullsized":"2024-09-13T18:47:27.266197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900294+0000","last_change":"2024-09-13T18:47:14.522436+0000","last_active":"2024-09-13T18:47:27.900294+0000","last_peered":"2024-09-13T18:47:27.900294+0000","last_clean":"2024-09-13T18:47:27.900294+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:27.900294+0000","last_undegraded":"2024-09-13T18:47:27.900294+0000","last_fullsized":"2024-09-13T18:47:27.900294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:19.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656017+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:47:26.656017+0000","last_peered":"2024-09-13T18:47:26.656017+0000","last_clean":"2024-09-13T18:47:26.656017+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:26.656017+0000","last_undegraded":"2024-09-13T18:47:26.656017+0000","last_fullsized":"2024-09-13T18:47:26.656017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267711+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:27.267711+0000","last_peered":"2024-09-13T18:47:27.267711+0000","last_clean":"2024-09-13T18:47:27.267711+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:27.267711+0000","last_undegraded":"2024-09-13T18:47:27.267711+0000","last_fullsized":"2024-09-13T18:47:27.267711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267932+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:27.267932+0000","last_peered":"2024-09-13T18:47:27.267932+0000","last_clean":"2024-09-13T18:47:27.267932+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:27.267932+0000","last_undegraded":"2024-09-13T18:47:27.267932+0000","last_fullsized":"2024-09-13T18:47:27.267932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265619+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:27.265619+0000","last_peered":"2024-09-13T18:47:27.265619+0000","last_clean":"2024-09-13T18:47:27.265619+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:27.265619+0000","last_undegraded":"2024-09-13T18:47:27.265619+0000","last_fullsized":"2024-09-13T18:47:27.265619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38661,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":82,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2529999999999999,"5min":2.585,"15min":2.585},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.871,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7649999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.393,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.448}]},{"osd":2,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.1439999999999999,"15min":1.1739999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.544},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.196,"15min":1.244},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5980000000000001,"5min":1.778,"15min":1.778},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.222},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5149999999999999,"5min":1.665,"15min":1.665},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.3080000000000001,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.306}]},{"osd":5,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2989999999999999,"15min":1.337},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.55,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.6459999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3939999999999999,"15min":1.427},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.73},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.337,"15min":1.3560000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.101}]},{"osd":7,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.4059999999999999,"15min":1.4359999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.4470000000000001,"15min":1.5009999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5920000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3620000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":521564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.141,"15min":1.181},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.355,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0720000000000001,"15min":1.0960000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94499999999999995,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.1439999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.2949999999999999,"15min":1.347},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.609,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.753},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.2410000000000001,"15min":1.272},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.254,"15min":1.28},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5649999999999999,"5min":1.788,"15min":1.788},"last":1.087},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2829999999999999,"15min":1.3169999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3500000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.325}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.462,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.468},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.446,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3500000000000001,"15min":1.3839999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.504,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.3680000000000001,"15min":1.413},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5660000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.179}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.5309999999999999,"15min":1.587},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5609999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.4550000000000001,"15min":1.4990000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6120000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.5680000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":4.2910000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":4.4729999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":4.6879999999999997},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":4.7409999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":5.0129999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":5.1950000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":4.8220000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":4.9000000000000004},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":4.7869999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":4.6390000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":4.9459999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":5.0380000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":4.8600000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.98699999999999999,"15min":1.034},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1379999999999999,"15min":1.1519999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.212},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1299999999999999,"15min":1.1659999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.147}]},{"osd":3,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.014,"15min":1.006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.4630000000000001,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.264,"15min":1.306},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.292}]},{"osd":4,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.2969999999999999,"15min":1.3420000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.1989999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.353},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4089999999999998,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.28},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3520000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.3200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.252,"15min":1.2809999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.411,"15min":1.4350000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.4159999999999999,"15min":1.47},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2360000000000002,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.409},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.3779999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":0.89600000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.145},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.5429999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0249999999999999,"15min":1.05},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.216},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0509999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2150000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.923}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":2.105},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2989999999999999,"5min":1.375,"15min":1.375},"last":2.2109999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.105,"15min":1.135},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.125,"15min":1.151},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2210000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.8029999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.86099999999999999},"min":{"1min":0.80700000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0409999999999999,"15min":1.0489999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.038},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.96399999999999997,"15min":0.95299999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.133,"15min":1.127},"min":{"1min":0.77200000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.95299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3169999999999999,"5min":1.427,"15min":1.427},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4139999999999999,"5min":1.532,"15min":1.532},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.341,"5min":1.349,"15min":1.349},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2070000000000001,"5min":1.216,"15min":1.216},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.204}]},{"osd":3,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3700000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.194,"5min":1.466,"15min":1.466},"last":1.083}]},{"osd":4,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90300000000000002,"15min":0.90200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.75},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5169999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.46,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.139}]},{"osd":7,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0429999999999999,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1679999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":1.014}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":1.153}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.121},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.242},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.21}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1003520,"data_stored":522236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.94499999999999995,"15min":0.98499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1659999999999999,"5min":1.76,"15min":1.76},"last":1.202},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.012,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.538,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0820000000000001,"15min":1.1040000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.45,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.63400000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.121,"15min":1.1519999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.611,"5min":2.032,"15min":2.032},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.403,"15min":1.4890000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.581,"15min":1.681},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3300000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98999999999999999,"15min":0.99399999999999999},"min":{"1min":0.66300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3069999999999999,"5min":1.46,"15min":1.46},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4099999999999999,"5min":1.552,"15min":1.552},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2729999999999999,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.552,"5min":1.694,"15min":1.694},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5680000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:36.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:36.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.986+0000 7fb0bbe00700 1 Processor -- start 2024-09-13T18:47:36.994 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.986+0000 7fb0bbe00700 1 -- start start 2024-09-13T18:47:36.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0bbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc0c8db0 0x7fb0bc070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.997 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0bbe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0bc0c9190 0x7fb0bc0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0bbe00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc0c7570 con 0x7fb0bc06ee10 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0bbe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc0c5b50 con 0x7fb0bc0c9190 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0bbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0cbbe0 con 0x7fb0bc0c8db0 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0bc0c9190 0x7fb0bc0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0bc0c9190 0x7fb0bc0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58126/0 (socket says 172.21.15.32:58126) 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 -- 172.21.15.32:0/1958686968 learned_addr learned my addr 172.21.15.32:0/1958686968 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:36.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0baa00700 1 --2- 172.21.15.32:0/1958686968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc0c8db0 0x7fb0bc070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 -- 172.21.15.32:0/1958686968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc0c8db0 msgr2=0x7fb0bc070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:36.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 --2- 172.21.15.32:0/1958686968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc0c8db0 0x7fb0bc070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 -- 172.21.15.32:0/1958686968 >> v1:172.21.15.32:6789/0 conn(0x7fb0bc06ee10 legacy=0x7fb0bc159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.990+0000 7fb0b2000700 1 -- 172.21.15.32:0/1958686968 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0c7290 con 0x7fb0bc0c9190 2024-09-13T18:47:36.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0b2000700 1 --2- 172.21.15.32:0/1958686968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc0c7a10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400d150 tx=0x7fb0a400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9191d589b7dbfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.999 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0ba000700 1 -- 172.21.15.32:0/1958686968 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4010070 con 0x7fb0bc0c9190 2024-09-13T18:47:37.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0ba000700 1 -- 172.21.15.32:0/1958686968 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a400ddc0 con 0x7fb0bc0c9190 2024-09-13T18:47:37.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0ba000700 1 -- 172.21.15.32:0/1958686968 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400b310 con 0x7fb0bc0c9190 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 -- 172.21.15.32:0/1958686968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 msgr2=0x7fb0bc0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/1958686968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc0c7a10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400d150 tx=0x7fb0a400d460 comp rx=0 tx=0).stop 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 -- 172.21.15.32:0/1958686968 shutdown_connections 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/1958686968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc0c7a10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/1958686968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc0c8db0 0x7fb0bc070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 -- 172.21.15.32:0/1958686968 >> 172.21.15.32:0/1958686968 conn(0x7fb0bc0cad40 msgr2=0x7fb0bc0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 -- 172.21.15.32:0/1958686968 shutdown_connections 2024-09-13T18:47:37.002 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.994+0000 7fb0bbe00700 1 -- 172.21.15.32:0/1958686968 wait complete. 2024-09-13T18:47:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 Processor -- start 2024-09-13T18:47:37.004 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 -- start start 2024-09-13T18:47:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 0x7fb0bc0c1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0bc0c8db0 0x7fb0bc1eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc1445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc1ee790 con 0x7fb0bc0c9190 2024-09-13T18:47:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc1eb270 con 0x7fb0bc0c8db0 2024-09-13T18:47:37.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:36.998+0000 7fb0bbe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc06d950 con 0x7fb0bc06ee10 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 0x7fb0bc0c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 0x7fb0bc0c1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:52982/0 (socket says 172.21.15.32:52982) 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 -- 172.21.15.32:0/4201290262 learned_addr learned my addr 172.21.15.32:0/4201290262 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0bb400700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc1445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0b2000700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0bc0c8db0 0x7fb0bc1eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 -- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0bc0c8db0 msgr2=0x7fb0bc1eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0bc0c8db0 0x7fb0bc1eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 -- 172.21.15.32:0/4201290262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 msgr2=0x7fb0bc1445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.010 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc1445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 -- 172.21.15.32:0/4201290262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a400bd40 con 0x7fb0bc06ee10 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0baa00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 0x7fb0bc0c1150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00d830 tx=0x7fb0ac00db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0125f0 con 0x7fb0bc06ee10 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac012750 con 0x7fb0bc06ee10 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc06dc10 con 0x7fb0bc06ee10 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac012ac0 con 0x7fb0bc06ee10 2024-09-13T18:47:37.011 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc06e1d0 con 0x7fb0bc06ee10 2024-09-13T18:47:37.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.002+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc070470 con 0x7fb0bc06ee10 2024-09-13T18:47:37.012 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.006+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0ac012c20 con 0x7fb0bc06ee10 2024-09-13T18:47:37.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.006+0000 7fb0b3400700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb098066730 0x7fb098068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.014 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.006+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb0ac084630 con 0x7fb0bc06ee10 2024-09-13T18:47:37.015 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.010+0000 7fb0b2000700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb098066730 0x7fb098068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.016 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.010+0000 7fb0b2000700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb098066730 0x7fb098068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400d150 tx=0x7fb0a400b000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.023 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.018+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0ac051640 con 0x7fb0bc06ee10 2024-09-13T18:47:37.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.206+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0bc0c57e0 con 0x7fb098066730 2024-09-13T18:47:37.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.222+0000 7fb0b3400700 1 -- 172.21.15.32:0/4201290262 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367845 (secure 0 0 0) 0x7fb0a4023070 con 0x7fb098066730 2024-09-13T18:47:37.230 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.230+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb098066730 msgr2=0x7fb098068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.230+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb098066730 0x7fb098068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400d150 tx=0x7fb0a400b000 comp rx=0 tx=0).stop 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.230+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 msgr2=0x7fb0bc0c1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.230+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 0x7fb0bc0c1150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00d830 tx=0x7fb0ac00db40 comp rx=0 tx=0).stop 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 shutdown_connections 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb098066730 0x7fb098068bf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0bc0c9190 0x7fb0bc1445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0bc0c8db0 0x7fb0bc1eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 --2- 172.21.15.32:0/4201290262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0bc06ee10 0x7fb0bc0c1150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 >> 172.21.15.32:0/4201290262 conn(0x7fb0bc0cad40 msgr2=0x7fb0bc148aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 shutdown_connections 2024-09-13T18:47:37.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.234+0000 7fb0bbe00700 1 -- 172.21.15.32:0/4201290262 wait complete. 2024-09-13T18:47:37.241 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:47:37.264 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-13T18:47:36.116781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629029,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":243,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249468,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725252,"statfs":{"total":773094113280,"available":772838658048,"internally_reserved":0,"allocated":8904704,"data_stored":5130154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.464237"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658843+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:26.658843+0000","last_peered":"2024-09-13T18:47:26.658843+0000","last_clean":"2024-09-13T18:47:26.658843+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:26.658843+0000","last_undegraded":"2024-09-13T18:47:26.658843+0000","last_fullsized":"2024-09-13T18:47:26.658843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268110+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:47:27.268110+0000","last_peered":"2024-09-13T18:47:27.268110+0000","last_clean":"2024-09-13T18:47:27.268110+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:27.268110+0000","last_undegraded":"2024-09-13T18:47:27.268110+0000","last_fullsized":"2024-09-13T18:47:27.268110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261007+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.261007+0000","last_peered":"2024-09-13T18:47:27.261007+0000","last_clean":"2024-09-13T18:47:27.261007+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.261007+0000","last_undegraded":"2024-09-13T18:47:27.261007+0000","last_fullsized":"2024-09-13T18:47:27.261007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:46.084608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268242+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:47:27.268242+0000","last_peered":"2024-09-13T18:47:27.268242+0000","last_clean":"2024-09-13T18:47:27.268242+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:27.268242+0000","last_undegraded":"2024-09-13T18:47:27.268242+0000","last_fullsized":"2024-09-13T18:47:27.268242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268231+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:47:27.268231+0000","last_peered":"2024-09-13T18:47:27.268231+0000","last_clean":"2024-09-13T18:47:27.268231+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:27.268231+0000","last_undegraded":"2024-09-13T18:47:27.268231+0000","last_fullsized":"2024-09-13T18:47:27.268231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899078+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:27.899078+0000","last_peered":"2024-09-13T18:47:27.899078+0000","last_clean":"2024-09-13T18:47:27.899078+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:27.899078+0000","last_undegraded":"2024-09-13T18:47:27.899078+0000","last_fullsized":"2024-09-13T18:47:27.899078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"64'3","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901004+0000","last_change":"2024-09-13T18:47:14.525177+0000","last_active":"2024-09-13T18:47:27.901004+0000","last_peered":"2024-09-13T18:47:27.901004+0000","last_clean":"2024-09-13T18:47:27.901004+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:27.901004+0000","last_undegraded":"2024-09-13T18:47:27.901004+0000","last_fullsized":"2024-09-13T18:47:27.901004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:30.537891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899934+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:27.899934+0000","last_peered":"2024-09-13T18:47:27.899934+0000","last_clean":"2024-09-13T18:47:27.899934+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:27.899934+0000","last_undegraded":"2024-09-13T18:47:27.899934+0000","last_fullsized":"2024-09-13T18:47:27.899934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900988+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:27.900988+0000","last_peered":"2024-09-13T18:47:27.900988+0000","last_clean":"2024-09-13T18:47:27.900988+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:27.900988+0000","last_undegraded":"2024-09-13T18:47:27.900988+0000","last_fullsized":"2024-09-13T18:47:27.900988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901044+0000","last_change":"2024-09-13T18:47:14.525584+0000","last_active":"2024-09-13T18:47:27.901044+0000","last_peered":"2024-09-13T18:47:27.901044+0000","last_clean":"2024-09-13T18:47:27.901044+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:27.901044+0000","last_undegraded":"2024-09-13T18:47:27.901044+0000","last_fullsized":"2024-09-13T18:47:27.901044+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:18.465119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266553+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:27.266553+0000","last_peered":"2024-09-13T18:47:27.266553+0000","last_clean":"2024-09-13T18:47:27.266553+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:27.266553+0000","last_undegraded":"2024-09-13T18:47:27.266553+0000","last_fullsized":"2024-09-13T18:47:27.266553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900545+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:27.900545+0000","last_peered":"2024-09-13T18:47:27.900545+0000","last_clean":"2024-09-13T18:47:27.900545+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:27.900545+0000","last_undegraded":"2024-09-13T18:47:27.900545+0000","last_fullsized":"2024-09-13T18:47:27.900545+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266005+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:47:27.266005+0000","last_peered":"2024-09-13T18:47:27.266005+0000","last_clean":"2024-09-13T18:47:27.266005+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:27.266005+0000","last_undegraded":"2024-09-13T18:47:27.266005+0000","last_fullsized":"2024-09-13T18:47:27.266005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"64'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266144+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:47:27.266144+0000","last_peered":"2024-09-13T18:47:27.266144+0000","last_clean":"2024-09-13T18:47:27.266144+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:27.266144+0000","last_undegraded":"2024-09-13T18:47:27.266144+0000","last_fullsized":"2024-09-13T18:47:27.266144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266891+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.266891+0000","last_peered":"2024-09-13T18:47:27.266891+0000","last_clean":"2024-09-13T18:47:27.266891+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.266891+0000","last_undegraded":"2024-09-13T18:47:27.266891+0000","last_fullsized":"2024-09-13T18:47:27.266891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264104+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:27.264104+0000","last_peered":"2024-09-13T18:47:27.264104+0000","last_clean":"2024-09-13T18:47:27.264104+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:27.264104+0000","last_undegraded":"2024-09-13T18:47:27.264104+0000","last_fullsized":"2024-09-13T18:47:27.264104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263324+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.263324+0000","last_peered":"2024-09-13T18:47:27.263324+0000","last_clean":"2024-09-13T18:47:27.263324+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.263324+0000","last_undegraded":"2024-09-13T18:47:27.263324+0000","last_fullsized":"2024-09-13T18:47:27.263324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265099+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.265099+0000","last_peered":"2024-09-13T18:47:27.265099+0000","last_clean":"2024-09-13T18:47:27.265099+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.265099+0000","last_undegraded":"2024-09-13T18:47:27.265099+0000","last_fullsized":"2024-09-13T18:47:27.265099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.954234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656833+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:26.656833+0000","last_peered":"2024-09-13T18:47:26.656833+0000","last_clean":"2024-09-13T18:47:26.656833+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:26.656833+0000","last_undegraded":"2024-09-13T18:47:26.656833+0000","last_fullsized":"2024-09-13T18:47:26.656833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657838+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:26.657838+0000","last_peered":"2024-09-13T18:47:26.657838+0000","last_clean":"2024-09-13T18:47:26.657838+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:26.657838+0000","last_undegraded":"2024-09-13T18:47:26.657838+0000","last_fullsized":"2024-09-13T18:47:26.657838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266878+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.266878+0000","last_peered":"2024-09-13T18:47:27.266878+0000","last_clean":"2024-09-13T18:47:27.266878+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.266878+0000","last_undegraded":"2024-09-13T18:47:27.266878+0000","last_fullsized":"2024-09-13T18:47:27.266878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265730+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:27.265730+0000","last_peered":"2024-09-13T18:47:27.265730+0000","last_clean":"2024-09-13T18:47:27.265730+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:27.265730+0000","last_undegraded":"2024-09-13T18:47:27.265730+0000","last_fullsized":"2024-09-13T18:47:27.265730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263552+0000","last_change":"2024-09-13T18:47:14.520002+0000","last_active":"2024-09-13T18:47:27.263552+0000","last_peered":"2024-09-13T18:47:27.263552+0000","last_clean":"2024-09-13T18:47:27.263552+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:27.263552+0000","last_undegraded":"2024-09-13T18:47:27.263552+0000","last_fullsized":"2024-09-13T18:47:27.263552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:01.778129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656294+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:26.656294+0000","last_peered":"2024-09-13T18:47:26.656294+0000","last_clean":"2024-09-13T18:47:26.656294+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:26.656294+0000","last_undegraded":"2024-09-13T18:47:26.656294+0000","last_fullsized":"2024-09-13T18:47:26.656294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657925+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:26.657925+0000","last_peered":"2024-09-13T18:47:26.657925+0000","last_clean":"2024-09-13T18:47:26.657925+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:26.657925+0000","last_undegraded":"2024-09-13T18:47:26.657925+0000","last_fullsized":"2024-09-13T18:47:26.657925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266890+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.266890+0000","last_peered":"2024-09-13T18:47:27.266890+0000","last_clean":"2024-09-13T18:47:27.266890+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.266890+0000","last_undegraded":"2024-09-13T18:47:27.266890+0000","last_fullsized":"2024-09-13T18:47:27.266890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655511+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:26.655511+0000","last_peered":"2024-09-13T18:47:26.655511+0000","last_clean":"2024-09-13T18:47:26.655511+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:26.655511+0000","last_undegraded":"2024-09-13T18:47:26.655511+0000","last_fullsized":"2024-09-13T18:47:26.655511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658909+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:26.658909+0000","last_peered":"2024-09-13T18:47:26.658909+0000","last_clean":"2024-09-13T18:47:26.658909+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:26.658909+0000","last_undegraded":"2024-09-13T18:47:26.658909+0000","last_fullsized":"2024-09-13T18:47:26.658909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"70'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658459+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:47:26.658459+0000","last_peered":"2024-09-13T18:47:26.658459+0000","last_clean":"2024-09-13T18:47:26.658459+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:26.658459+0000","last_undegraded":"2024-09-13T18:47:26.658459+0000","last_fullsized":"2024-09-13T18:47:26.658459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656651+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:26.656651+0000","last_peered":"2024-09-13T18:47:26.656651+0000","last_clean":"2024-09-13T18:47:26.656651+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:26.656651+0000","last_undegraded":"2024-09-13T18:47:26.656651+0000","last_fullsized":"2024-09-13T18:47:26.656651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263802+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:27.263802+0000","last_peered":"2024-09-13T18:47:27.263802+0000","last_clean":"2024-09-13T18:47:27.263802+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:27.263802+0000","last_undegraded":"2024-09-13T18:47:27.263802+0000","last_fullsized":"2024-09-13T18:47:27.263802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266744+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:47:27.266744+0000","last_peered":"2024-09-13T18:47:27.266744+0000","last_clean":"2024-09-13T18:47:27.266744+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:27.266744+0000","last_undegraded":"2024-09-13T18:47:27.266744+0000","last_fullsized":"2024-09-13T18:47:27.266744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264165+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.264165+0000","last_peered":"2024-09-13T18:47:27.264165+0000","last_clean":"2024-09-13T18:47:27.264165+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.264165+0000","last_undegraded":"2024-09-13T18:47:27.264165+0000","last_fullsized":"2024-09-13T18:47:27.264165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656088+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:47:26.656088+0000","last_peered":"2024-09-13T18:47:26.656088+0000","last_clean":"2024-09-13T18:47:26.656088+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:26.656088+0000","last_undegraded":"2024-09-13T18:47:26.656088+0000","last_fullsized":"2024-09-13T18:47:26.656088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266528+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:47:27.266528+0000","last_peered":"2024-09-13T18:47:27.266528+0000","last_clean":"2024-09-13T18:47:27.266528+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:27.266528+0000","last_undegraded":"2024-09-13T18:47:27.266528+0000","last_fullsized":"2024-09-13T18:47:27.266528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263593+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:47:27.263593+0000","last_peered":"2024-09-13T18:47:27.263593+0000","last_clean":"2024-09-13T18:47:27.263593+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:27.263593+0000","last_undegraded":"2024-09-13T18:47:27.263593+0000","last_fullsized":"2024-09-13T18:47:27.263593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264264+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:27.264264+0000","last_peered":"2024-09-13T18:47:27.264264+0000","last_clean":"2024-09-13T18:47:27.264264+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:27.264264+0000","last_undegraded":"2024-09-13T18:47:27.264264+0000","last_fullsized":"2024-09-13T18:47:27.264264+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:58.188762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265891+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.265891+0000","last_peered":"2024-09-13T18:47:27.265891+0000","last_clean":"2024-09-13T18:47:27.265891+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.265891+0000","last_undegraded":"2024-09-13T18:47:27.265891+0000","last_fullsized":"2024-09-13T18:47:27.265891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263927+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:47:27.263927+0000","last_peered":"2024-09-13T18:47:27.263927+0000","last_clean":"2024-09-13T18:47:27.263927+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:27.263927+0000","last_undegraded":"2024-09-13T18:47:27.263927+0000","last_fullsized":"2024-09-13T18:47:27.263927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264936+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:47:27.264936+0000","last_peered":"2024-09-13T18:47:27.264936+0000","last_clean":"2024-09-13T18:47:27.264936+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:27.264936+0000","last_undegraded":"2024-09-13T18:47:27.264936+0000","last_fullsized":"2024-09-13T18:47:27.264936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"67'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266493+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:47:27.266493+0000","last_peered":"2024-09-13T18:47:27.266493+0000","last_clean":"2024-09-13T18:47:27.266493+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:27.266493+0000","last_undegraded":"2024-09-13T18:47:27.266493+0000","last_fullsized":"2024-09-13T18:47:27.266493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264888+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:47:27.264888+0000","last_peered":"2024-09-13T18:47:27.264888+0000","last_clean":"2024-09-13T18:47:27.264888+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:27.264888+0000","last_undegraded":"2024-09-13T18:47:27.264888+0000","last_fullsized":"2024-09-13T18:47:27.264888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263663+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:47:27.263663+0000","last_peered":"2024-09-13T18:47:27.263663+0000","last_clean":"2024-09-13T18:47:27.263663+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:27.263663+0000","last_undegraded":"2024-09-13T18:47:27.263663+0000","last_fullsized":"2024-09-13T18:47:27.263663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265583+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.265583+0000","last_peered":"2024-09-13T18:47:27.265583+0000","last_clean":"2024-09-13T18:47:27.265583+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.265583+0000","last_undegraded":"2024-09-13T18:47:27.265583+0000","last_fullsized":"2024-09-13T18:47:27.265583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267795+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.267795+0000","last_peered":"2024-09-13T18:47:27.267795+0000","last_clean":"2024-09-13T18:47:27.267795+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.267795+0000","last_undegraded":"2024-09-13T18:47:27.267795+0000","last_fullsized":"2024-09-13T18:47:27.267795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657527+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:26.657527+0000","last_peered":"2024-09-13T18:47:26.657527+0000","last_clean":"2024-09-13T18:47:26.657527+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:26.657527+0000","last_undegraded":"2024-09-13T18:47:26.657527+0000","last_fullsized":"2024-09-13T18:47:26.657527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266055+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.266055+0000","last_peered":"2024-09-13T18:47:27.266055+0000","last_clean":"2024-09-13T18:47:27.266055+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.266055+0000","last_undegraded":"2024-09-13T18:47:27.266055+0000","last_fullsized":"2024-09-13T18:47:27.266055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261221+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:47:27.261221+0000","last_peered":"2024-09-13T18:47:27.261221+0000","last_clean":"2024-09-13T18:47:27.261221+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:27.261221+0000","last_undegraded":"2024-09-13T18:47:27.261221+0000","last_fullsized":"2024-09-13T18:47:27.261221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266732+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.266732+0000","last_peered":"2024-09-13T18:47:27.266732+0000","last_clean":"2024-09-13T18:47:27.266732+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.266732+0000","last_undegraded":"2024-09-13T18:47:27.266732+0000","last_fullsized":"2024-09-13T18:47:27.266732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266415+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:27.266415+0000","last_peered":"2024-09-13T18:47:27.266415+0000","last_clean":"2024-09-13T18:47:27.266415+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:27.266415+0000","last_undegraded":"2024-09-13T18:47:27.266415+0000","last_fullsized":"2024-09-13T18:47:27.266415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263597+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.263597+0000","last_peered":"2024-09-13T18:47:27.263597+0000","last_clean":"2024-09-13T18:47:27.263597+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.263597+0000","last_undegraded":"2024-09-13T18:47:27.263597+0000","last_fullsized":"2024-09-13T18:47:27.263597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655686+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:26.655686+0000","last_peered":"2024-09-13T18:47:26.655686+0000","last_clean":"2024-09-13T18:47:26.655686+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:26.655686+0000","last_undegraded":"2024-09-13T18:47:26.655686+0000","last_fullsized":"2024-09-13T18:47:26.655686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265175+0000","last_change":"2024-09-13T18:47:14.709999+0000","last_active":"2024-09-13T18:47:27.265175+0000","last_peered":"2024-09-13T18:47:27.265175+0000","last_clean":"2024-09-13T18:47:27.265175+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:27.265175+0000","last_undegraded":"2024-09-13T18:47:27.265175+0000","last_fullsized":"2024-09-13T18:47:27.265175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:43.817137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267884+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:47:27.267884+0000","last_peered":"2024-09-13T18:47:27.267884+0000","last_clean":"2024-09-13T18:47:27.267884+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:27.267884+0000","last_undegraded":"2024-09-13T18:47:27.267884+0000","last_fullsized":"2024-09-13T18:47:27.267884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267160+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.267160+0000","last_peered":"2024-09-13T18:47:27.267160+0000","last_clean":"2024-09-13T18:47:27.267160+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.267160+0000","last_undegraded":"2024-09-13T18:47:27.267160+0000","last_fullsized":"2024-09-13T18:47:27.267160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265710+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:27.265710+0000","last_peered":"2024-09-13T18:47:27.265710+0000","last_clean":"2024-09-13T18:47:27.265710+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:27.265710+0000","last_undegraded":"2024-09-13T18:47:27.265710+0000","last_fullsized":"2024-09-13T18:47:27.265710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:41.204767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658197+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:26.658197+0000","last_peered":"2024-09-13T18:47:26.658197+0000","last_clean":"2024-09-13T18:47:26.658197+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:26.658197+0000","last_undegraded":"2024-09-13T18:47:26.658197+0000","last_fullsized":"2024-09-13T18:47:26.658197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265409+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.265409+0000","last_peered":"2024-09-13T18:47:27.265409+0000","last_clean":"2024-09-13T18:47:27.265409+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.265409+0000","last_undegraded":"2024-09-13T18:47:27.265409+0000","last_fullsized":"2024-09-13T18:47:27.265409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656499+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:47:26.656499+0000","last_peered":"2024-09-13T18:47:26.656499+0000","last_clean":"2024-09-13T18:47:26.656499+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:26.656499+0000","last_undegraded":"2024-09-13T18:47:26.656499+0000","last_fullsized":"2024-09-13T18:47:26.656499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265775+0000","last_change":"2024-09-13T18:47:14.523024+0000","last_active":"2024-09-13T18:47:27.265775+0000","last_peered":"2024-09-13T18:47:27.265775+0000","last_clean":"2024-09-13T18:47:27.265775+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:27.265775+0000","last_undegraded":"2024-09-13T18:47:27.265775+0000","last_fullsized":"2024-09-13T18:47:27.265775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:41.142555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261242+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.261242+0000","last_peered":"2024-09-13T18:47:27.261242+0000","last_clean":"2024-09-13T18:47:27.261242+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.261242+0000","last_undegraded":"2024-09-13T18:47:27.261242+0000","last_fullsized":"2024-09-13T18:47:27.261242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265655+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:47:27.265655+0000","last_peered":"2024-09-13T18:47:27.265655+0000","last_clean":"2024-09-13T18:47:27.265655+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:27.265655+0000","last_undegraded":"2024-09-13T18:47:27.265655+0000","last_fullsized":"2024-09-13T18:47:27.265655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657139+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:26.657139+0000","last_peered":"2024-09-13T18:47:26.657139+0000","last_clean":"2024-09-13T18:47:26.657139+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:26.657139+0000","last_undegraded":"2024-09-13T18:47:26.657139+0000","last_fullsized":"2024-09-13T18:47:26.657139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659005+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:27.659005+0000","last_peered":"2024-09-13T18:47:27.659005+0000","last_clean":"2024-09-13T18:47:27.659005+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:27.659005+0000","last_undegraded":"2024-09-13T18:47:27.659005+0000","last_fullsized":"2024-09-13T18:47:27.659005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261098+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:27.261098+0000","last_peered":"2024-09-13T18:47:27.261098+0000","last_clean":"2024-09-13T18:47:27.261098+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:27.261098+0000","last_undegraded":"2024-09-13T18:47:27.261098+0000","last_fullsized":"2024-09-13T18:47:27.261098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264134+0000","last_change":"2024-09-13T18:47:14.654438+0000","last_active":"2024-09-13T18:47:27.264134+0000","last_peered":"2024-09-13T18:47:27.264134+0000","last_clean":"2024-09-13T18:47:27.264134+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:27.264134+0000","last_undegraded":"2024-09-13T18:47:27.264134+0000","last_fullsized":"2024-09-13T18:47:27.264134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:43.091822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264617+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.264617+0000","last_peered":"2024-09-13T18:47:27.264617+0000","last_clean":"2024-09-13T18:47:27.264617+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.264617+0000","last_undegraded":"2024-09-13T18:47:27.264617+0000","last_fullsized":"2024-09-13T18:47:27.264617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265972+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:27.265972+0000","last_peered":"2024-09-13T18:47:27.265972+0000","last_clean":"2024-09-13T18:47:27.265972+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:27.265972+0000","last_undegraded":"2024-09-13T18:47:27.265972+0000","last_fullsized":"2024-09-13T18:47:27.265972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266196+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:47:27.266196+0000","last_peered":"2024-09-13T18:47:27.266196+0000","last_clean":"2024-09-13T18:47:27.266196+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:27.266196+0000","last_undegraded":"2024-09-13T18:47:27.266196+0000","last_fullsized":"2024-09-13T18:47:27.266196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263761+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.263761+0000","last_peered":"2024-09-13T18:47:27.263761+0000","last_clean":"2024-09-13T18:47:27.263761+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.263761+0000","last_undegraded":"2024-09-13T18:47:27.263761+0000","last_fullsized":"2024-09-13T18:47:27.263761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263104+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:27.263104+0000","last_peered":"2024-09-13T18:47:27.263104+0000","last_clean":"2024-09-13T18:47:27.263104+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:27.263104+0000","last_undegraded":"2024-09-13T18:47:27.263104+0000","last_fullsized":"2024-09-13T18:47:27.263104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264479+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:47:27.264479+0000","last_peered":"2024-09-13T18:47:27.264479+0000","last_clean":"2024-09-13T18:47:27.264479+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:27.264479+0000","last_undegraded":"2024-09-13T18:47:27.264479+0000","last_fullsized":"2024-09-13T18:47:27.264479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266569+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.266569+0000","last_peered":"2024-09-13T18:47:27.266569+0000","last_clean":"2024-09-13T18:47:27.266569+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.266569+0000","last_undegraded":"2024-09-13T18:47:27.266569+0000","last_fullsized":"2024-09-13T18:47:27.266569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900808+0000","last_change":"2024-09-13T18:47:14.649751+0000","last_active":"2024-09-13T18:47:27.900808+0000","last_peered":"2024-09-13T18:47:27.900808+0000","last_clean":"2024-09-13T18:47:27.900808+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:27.900808+0000","last_undegraded":"2024-09-13T18:47:27.900808+0000","last_fullsized":"2024-09-13T18:47:27.900808+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:41.327461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656244+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:47:26.656244+0000","last_peered":"2024-09-13T18:47:26.656244+0000","last_clean":"2024-09-13T18:47:26.656244+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:26.656244+0000","last_undegraded":"2024-09-13T18:47:26.656244+0000","last_fullsized":"2024-09-13T18:47:26.656244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656411+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:27.656411+0000","last_peered":"2024-09-13T18:47:27.656411+0000","last_clean":"2024-09-13T18:47:27.656411+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:27.656411+0000","last_undegraded":"2024-09-13T18:47:27.656411+0000","last_fullsized":"2024-09-13T18:47:27.656411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266384+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:27.266384+0000","last_peered":"2024-09-13T18:47:27.266384+0000","last_clean":"2024-09-13T18:47:27.266384+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:27.266384+0000","last_undegraded":"2024-09-13T18:47:27.266384+0000","last_fullsized":"2024-09-13T18:47:27.266384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"67'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898590+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:47:27.898590+0000","last_peered":"2024-09-13T18:47:27.898590+0000","last_clean":"2024-09-13T18:47:27.898590+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:27.898590+0000","last_undegraded":"2024-09-13T18:47:27.898590+0000","last_fullsized":"2024-09-13T18:47:27.898590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655745+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:26.655745+0000","last_peered":"2024-09-13T18:47:26.655745+0000","last_clean":"2024-09-13T18:47:26.655745+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:26.655745+0000","last_undegraded":"2024-09-13T18:47:26.655745+0000","last_fullsized":"2024-09-13T18:47:26.655745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659183+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:47:27.659183+0000","last_peered":"2024-09-13T18:47:27.659183+0000","last_clean":"2024-09-13T18:47:27.659183+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:27.659183+0000","last_undegraded":"2024-09-13T18:47:27.659183+0000","last_fullsized":"2024-09-13T18:47:27.659183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264885+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:47:27.264885+0000","last_peered":"2024-09-13T18:47:27.264885+0000","last_clean":"2024-09-13T18:47:27.264885+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:27.264885+0000","last_undegraded":"2024-09-13T18:47:27.264885+0000","last_fullsized":"2024-09-13T18:47:27.264885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.896644+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:27.896644+0000","last_peered":"2024-09-13T18:47:27.896644+0000","last_clean":"2024-09-13T18:47:27.896644+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:27.896644+0000","last_undegraded":"2024-09-13T18:47:27.896644+0000","last_fullsized":"2024-09-13T18:47:27.896644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901899+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:47:27.901899+0000","last_peered":"2024-09-13T18:47:27.901899+0000","last_clean":"2024-09-13T18:47:27.901899+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:47:27.901899+0000","last_undegraded":"2024-09-13T18:47:27.901899+0000","last_fullsized":"2024-09-13T18:47:27.901899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262272+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.262272+0000","last_peered":"2024-09-13T18:47:27.262272+0000","last_clean":"2024-09-13T18:47:27.262272+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.262272+0000","last_undegraded":"2024-09-13T18:47:27.262272+0000","last_fullsized":"2024-09-13T18:47:27.262272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657696+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:27.657696+0000","last_peered":"2024-09-13T18:47:27.657696+0000","last_clean":"2024-09-13T18:47:27.657696+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:27.657696+0000","last_undegraded":"2024-09-13T18:47:27.657696+0000","last_fullsized":"2024-09-13T18:47:27.657696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657664+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:26.657664+0000","last_peered":"2024-09-13T18:47:26.657664+0000","last_clean":"2024-09-13T18:47:26.657664+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:26.657664+0000","last_undegraded":"2024-09-13T18:47:26.657664+0000","last_fullsized":"2024-09-13T18:47:26.657664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657922+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:47:27.657922+0000","last_peered":"2024-09-13T18:47:27.657922+0000","last_clean":"2024-09-13T18:47:27.657922+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:27.657922+0000","last_undegraded":"2024-09-13T18:47:27.657922+0000","last_fullsized":"2024-09-13T18:47:27.657922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265110+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:47:27.265110+0000","last_peered":"2024-09-13T18:47:27.265110+0000","last_clean":"2024-09-13T18:47:27.265110+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:27.265110+0000","last_undegraded":"2024-09-13T18:47:27.265110+0000","last_fullsized":"2024-09-13T18:47:27.265110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267014+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.267014+0000","last_peered":"2024-09-13T18:47:27.267014+0000","last_clean":"2024-09-13T18:47:27.267014+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.267014+0000","last_undegraded":"2024-09-13T18:47:27.267014+0000","last_fullsized":"2024-09-13T18:47:27.267014+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655855+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:27.655855+0000","last_peered":"2024-09-13T18:47:27.655855+0000","last_clean":"2024-09-13T18:47:27.655855+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:27.655855+0000","last_undegraded":"2024-09-13T18:47:27.655855+0000","last_fullsized":"2024-09-13T18:47:27.655855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263416+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:47:27.263416+0000","last_peered":"2024-09-13T18:47:27.263416+0000","last_clean":"2024-09-13T18:47:27.263416+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:27.263416+0000","last_undegraded":"2024-09-13T18:47:27.263416+0000","last_fullsized":"2024-09-13T18:47:27.263416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266250+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.266250+0000","last_peered":"2024-09-13T18:47:27.266250+0000","last_clean":"2024-09-13T18:47:27.266250+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.266250+0000","last_undegraded":"2024-09-13T18:47:27.266250+0000","last_fullsized":"2024-09-13T18:47:27.266250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657317+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:27.657317+0000","last_peered":"2024-09-13T18:47:27.657317+0000","last_clean":"2024-09-13T18:47:27.657317+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:27.657317+0000","last_undegraded":"2024-09-13T18:47:27.657317+0000","last_fullsized":"2024-09-13T18:47:27.657317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657187+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:26.657187+0000","last_peered":"2024-09-13T18:47:26.657187+0000","last_clean":"2024-09-13T18:47:26.657187+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:26.657187+0000","last_undegraded":"2024-09-13T18:47:26.657187+0000","last_fullsized":"2024-09-13T18:47:26.657187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657724+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:47:27.657724+0000","last_peered":"2024-09-13T18:47:27.657724+0000","last_clean":"2024-09-13T18:47:27.657724+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:27.657724+0000","last_undegraded":"2024-09-13T18:47:27.657724+0000","last_fullsized":"2024-09-13T18:47:27.657724+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898388+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:27.898388+0000","last_peered":"2024-09-13T18:47:27.898388+0000","last_clean":"2024-09-13T18:47:27.898388+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:27.898388+0000","last_undegraded":"2024-09-13T18:47:27.898388+0000","last_fullsized":"2024-09-13T18:47:27.898388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264741+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:27.264741+0000","last_peered":"2024-09-13T18:47:27.264741+0000","last_clean":"2024-09-13T18:47:27.264741+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:27.264741+0000","last_undegraded":"2024-09-13T18:47:27.264741+0000","last_fullsized":"2024-09-13T18:47:27.264741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655701+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:47:26.655701+0000","last_peered":"2024-09-13T18:47:26.655701+0000","last_clean":"2024-09-13T18:47:26.655701+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:26.655701+0000","last_undegraded":"2024-09-13T18:47:26.655701+0000","last_fullsized":"2024-09-13T18:47:26.655701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266338+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:27.266338+0000","last_peered":"2024-09-13T18:47:27.266338+0000","last_clean":"2024-09-13T18:47:27.266338+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:27.266338+0000","last_undegraded":"2024-09-13T18:47:27.266338+0000","last_fullsized":"2024-09-13T18:47:27.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266075+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:27.266075+0000","last_peered":"2024-09-13T18:47:27.266075+0000","last_clean":"2024-09-13T18:47:27.266075+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:27.266075+0000","last_undegraded":"2024-09-13T18:47:27.266075+0000","last_fullsized":"2024-09-13T18:47:27.266075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267343+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:27.267343+0000","last_peered":"2024-09-13T18:47:27.267343+0000","last_clean":"2024-09-13T18:47:27.267343+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:27.267343+0000","last_undegraded":"2024-09-13T18:47:27.267343+0000","last_fullsized":"2024-09-13T18:47:27.267343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263537+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:27.263537+0000","last_peered":"2024-09-13T18:47:27.263537+0000","last_clean":"2024-09-13T18:47:27.263537+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:27.263537+0000","last_undegraded":"2024-09-13T18:47:27.263537+0000","last_fullsized":"2024-09-13T18:47:27.263537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264135+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:27.264135+0000","last_peered":"2024-09-13T18:47:27.264135+0000","last_clean":"2024-09-13T18:47:27.264135+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:27.264135+0000","last_undegraded":"2024-09-13T18:47:27.264135+0000","last_fullsized":"2024-09-13T18:47:27.264135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656312+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:26.656312+0000","last_peered":"2024-09-13T18:47:26.656312+0000","last_clean":"2024-09-13T18:47:26.656312+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:26.656312+0000","last_undegraded":"2024-09-13T18:47:26.656312+0000","last_fullsized":"2024-09-13T18:47:26.656312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268166+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:27.268166+0000","last_peered":"2024-09-13T18:47:27.268166+0000","last_clean":"2024-09-13T18:47:27.268166+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:27.268166+0000","last_undegraded":"2024-09-13T18:47:27.268166+0000","last_fullsized":"2024-09-13T18:47:27.268166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265579+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:27.265579+0000","last_peered":"2024-09-13T18:47:27.265579+0000","last_clean":"2024-09-13T18:47:27.265579+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:27.265579+0000","last_undegraded":"2024-09-13T18:47:27.265579+0000","last_fullsized":"2024-09-13T18:47:27.265579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266255+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:47:27.266255+0000","last_peered":"2024-09-13T18:47:27.266255+0000","last_clean":"2024-09-13T18:47:27.266255+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:27.266255+0000","last_undegraded":"2024-09-13T18:47:27.266255+0000","last_fullsized":"2024-09-13T18:47:27.266255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261334+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:27.261334+0000","last_peered":"2024-09-13T18:47:27.261334+0000","last_clean":"2024-09-13T18:47:27.261334+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:27.261334+0000","last_undegraded":"2024-09-13T18:47:27.261334+0000","last_fullsized":"2024-09-13T18:47:27.261334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657229+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:26.657229+0000","last_peered":"2024-09-13T18:47:26.657229+0000","last_clean":"2024-09-13T18:47:26.657229+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:26.657229+0000","last_undegraded":"2024-09-13T18:47:26.657229+0000","last_fullsized":"2024-09-13T18:47:26.657229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264995+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:27.264995+0000","last_peered":"2024-09-13T18:47:27.264995+0000","last_clean":"2024-09-13T18:47:27.264995+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:27.264995+0000","last_undegraded":"2024-09-13T18:47:27.264995+0000","last_fullsized":"2024-09-13T18:47:27.264995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266855+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:27.266855+0000","last_peered":"2024-09-13T18:47:27.266855+0000","last_clean":"2024-09-13T18:47:27.266855+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:27.266855+0000","last_undegraded":"2024-09-13T18:47:27.266855+0000","last_fullsized":"2024-09-13T18:47:27.266855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265943+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:27.265943+0000","last_peered":"2024-09-13T18:47:27.265943+0000","last_clean":"2024-09-13T18:47:27.265943+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:27.265943+0000","last_undegraded":"2024-09-13T18:47:27.265943+0000","last_fullsized":"2024-09-13T18:47:27.265943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266928+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:27.266928+0000","last_peered":"2024-09-13T18:47:27.266928+0000","last_clean":"2024-09-13T18:47:27.266928+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:27.266928+0000","last_undegraded":"2024-09-13T18:47:27.266928+0000","last_fullsized":"2024-09-13T18:47:27.266928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265447+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:47:27.265447+0000","last_peered":"2024-09-13T18:47:27.265447+0000","last_clean":"2024-09-13T18:47:27.265447+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:27.265447+0000","last_undegraded":"2024-09-13T18:47:27.265447+0000","last_fullsized":"2024-09-13T18:47:27.265447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265838+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:27.265838+0000","last_peered":"2024-09-13T18:47:27.265838+0000","last_clean":"2024-09-13T18:47:27.265838+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:27.265838+0000","last_undegraded":"2024-09-13T18:47:27.265838+0000","last_fullsized":"2024-09-13T18:47:27.265838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"64'1","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263722+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:47:27.263722+0000","last_peered":"2024-09-13T18:47:27.263722+0000","last_clean":"2024-09-13T18:47:27.263722+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:27.263722+0000","last_undegraded":"2024-09-13T18:47:27.263722+0000","last_fullsized":"2024-09-13T18:47:27.263722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264382+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:47:27.264382+0000","last_peered":"2024-09-13T18:47:27.264382+0000","last_clean":"2024-09-13T18:47:27.264382+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:27.264382+0000","last_undegraded":"2024-09-13T18:47:27.264382+0000","last_fullsized":"2024-09-13T18:47:27.264382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:47.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900689+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:27.900689+0000","last_peered":"2024-09-13T18:47:27.900689+0000","last_clean":"2024-09-13T18:47:27.900689+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:27.900689+0000","last_undegraded":"2024-09-13T18:47:27.900689+0000","last_fullsized":"2024-09-13T18:47:27.900689+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:12.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.903085+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:27.903085+0000","last_peered":"2024-09-13T18:47:27.903085+0000","last_clean":"2024-09-13T18:47:27.903085+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:27.903085+0000","last_undegraded":"2024-09-13T18:47:27.903085+0000","last_fullsized":"2024-09-13T18:47:27.903085+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:42.267150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899218+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:27.899218+0000","last_peered":"2024-09-13T18:47:27.899218+0000","last_clean":"2024-09-13T18:47:27.899218+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:27.899218+0000","last_undegraded":"2024-09-13T18:47:27.899218+0000","last_fullsized":"2024-09-13T18:47:27.899218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655666+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:27.655666+0000","last_peered":"2024-09-13T18:47:27.655666+0000","last_clean":"2024-09-13T18:47:27.655666+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:27.655666+0000","last_undegraded":"2024-09-13T18:47:27.655666+0000","last_fullsized":"2024-09-13T18:47:27.655666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266197+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:27.266197+0000","last_peered":"2024-09-13T18:47:27.266197+0000","last_clean":"2024-09-13T18:47:27.266197+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:27.266197+0000","last_undegraded":"2024-09-13T18:47:27.266197+0000","last_fullsized":"2024-09-13T18:47:27.266197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900294+0000","last_change":"2024-09-13T18:47:14.522436+0000","last_active":"2024-09-13T18:47:27.900294+0000","last_peered":"2024-09-13T18:47:27.900294+0000","last_clean":"2024-09-13T18:47:27.900294+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:27.900294+0000","last_undegraded":"2024-09-13T18:47:27.900294+0000","last_fullsized":"2024-09-13T18:47:27.900294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:19.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656017+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:47:26.656017+0000","last_peered":"2024-09-13T18:47:26.656017+0000","last_clean":"2024-09-13T18:47:26.656017+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:26.656017+0000","last_undegraded":"2024-09-13T18:47:26.656017+0000","last_fullsized":"2024-09-13T18:47:26.656017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267711+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:27.267711+0000","last_peered":"2024-09-13T18:47:27.267711+0000","last_clean":"2024-09-13T18:47:27.267711+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:27.267711+0000","last_undegraded":"2024-09-13T18:47:27.267711+0000","last_fullsized":"2024-09-13T18:47:27.267711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267932+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:27.267932+0000","last_peered":"2024-09-13T18:47:27.267932+0000","last_clean":"2024-09-13T18:47:27.267932+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:27.267932+0000","last_undegraded":"2024-09-13T18:47:27.267932+0000","last_fullsized":"2024-09-13T18:47:27.267932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265619+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:27.265619+0000","last_peered":"2024-09-13T18:47:27.265619+0000","last_clean":"2024-09-13T18:47:27.265619+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:27.265619+0000","last_undegraded":"2024-09-13T18:47:27.265619+0000","last_fullsized":"2024-09-13T18:47:27.265619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38661,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":82,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2529999999999999,"5min":2.585,"15min":2.585},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.871,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7649999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.393,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.448}]},{"osd":2,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.1439999999999999,"15min":1.1739999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.544},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.196,"15min":1.244},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5980000000000001,"5min":1.778,"15min":1.778},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.222},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5149999999999999,"5min":1.665,"15min":1.665},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.3080000000000001,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.306}]},{"osd":5,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2989999999999999,"15min":1.337},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.55,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.6459999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3939999999999999,"15min":1.427},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.73},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.337,"15min":1.3560000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.101}]},{"osd":7,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.4059999999999999,"15min":1.4359999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.4470000000000001,"15min":1.5009999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5920000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3620000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":521564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.141,"15min":1.181},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.355,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0720000000000001,"15min":1.0960000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94499999999999995,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.1439999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.2949999999999999,"15min":1.347},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.609,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.753},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.2410000000000001,"15min":1.272},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.254,"15min":1.28},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5649999999999999,"5min":1.788,"15min":1.788},"last":1.087},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2829999999999999,"15min":1.3169999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3500000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.325}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.462,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.468},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.446,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3500000000000001,"15min":1.3839999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.504,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.3680000000000001,"15min":1.413},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5660000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.179}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.5309999999999999,"15min":1.587},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5609999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.4550000000000001,"15min":1.4990000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6120000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.5680000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":4.2910000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":4.4729999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":4.6879999999999997},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":4.7409999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":5.0129999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":5.1950000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":4.8220000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":4.9000000000000004},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":4.7869999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":4.6390000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":4.9459999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":5.0380000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":4.8600000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.98699999999999999,"15min":1.034},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1379999999999999,"15min":1.1519999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.212},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1299999999999999,"15min":1.1659999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.147}]},{"osd":3,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.014,"15min":1.006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.4630000000000001,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.264,"15min":1.306},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.292}]},{"osd":4,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.2969999999999999,"15min":1.3420000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.1989999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.353},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4089999999999998,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.28},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3520000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.3200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.252,"15min":1.2809999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.411,"15min":1.4350000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.4159999999999999,"15min":1.47},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2360000000000002,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.409},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.3779999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":0.89600000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.145},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.5429999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0249999999999999,"15min":1.05},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.216},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0509999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2150000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.923}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":2.105},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2989999999999999,"5min":1.375,"15min":1.375},"last":2.2109999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.105,"15min":1.135},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.125,"15min":1.151},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2210000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.8029999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.86099999999999999},"min":{"1min":0.80700000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0409999999999999,"15min":1.0489999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.038},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.96399999999999997,"15min":0.95299999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.133,"15min":1.127},"min":{"1min":0.77200000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.95299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3169999999999999,"5min":1.427,"15min":1.427},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4139999999999999,"5min":1.532,"15min":1.532},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.341,"5min":1.349,"15min":1.349},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2070000000000001,"5min":1.216,"15min":1.216},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.204}]},{"osd":3,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3700000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.194,"5min":1.466,"15min":1.466},"last":1.083}]},{"osd":4,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90300000000000002,"15min":0.90200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.75},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5169999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.46,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.139}]},{"osd":7,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0429999999999999,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1679999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":1.014}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":1.153}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.121},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.242},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.21}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1003520,"data_stored":522236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.94499999999999995,"15min":0.98499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1659999999999999,"5min":1.76,"15min":1.76},"last":1.202},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.012,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.538,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0820000000000001,"15min":1.1040000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.45,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.63400000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.121,"15min":1.1519999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.611,"5min":2.032,"15min":2.032},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.403,"15min":1.4890000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.581,"15min":1.681},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3300000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98999999999999999,"15min":0.99399999999999999},"min":{"1min":0.66300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3069999999999999,"5min":1.46,"15min":1.46},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4099999999999999,"5min":1.552,"15min":1.552},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2729999999999999,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.552,"5min":1.694,"15min":1.694},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5680000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:37.271 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:47:37.271 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:37.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.474+0000 7f4cf6000700 1 Processor -- start 2024-09-13T18:47:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.474+0000 7f4cf6000700 1 -- start start 2024-09-13T18:47:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf6000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cf015cfd0 0x7f4cf015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf6000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015d8f0 0x7f4cf0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf6000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf0072370 con 0x7f4cf00cb860 2024-09-13T18:47:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf6000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf00aa1a0 con 0x7f4cf015cfd0 2024-09-13T18:47:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf6000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00a9d00 con 0x7f4cf015d8f0 2024-09-13T18:47:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cf015cfd0 0x7f4cf015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cf015cfd0 0x7f4cf015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58144/0 (socket says 172.21.15.32:58144) 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 -- 172.21.15.32:0/3329003471 learned_addr learned my addr 172.21.15.32:0/3329003471 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf5600700 1 --2- 172.21.15.32:0/3329003471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015d8f0 0x7f4cf0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 -- 172.21.15.32:0/3329003471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015d8f0 msgr2=0x7f4cf0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 --2- 172.21.15.32:0/3329003471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015d8f0 0x7f4cf0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 -- 172.21.15.32:0/3329003471 >> v1:172.21.15.86:6789/0 conn(0x7f4cf00cb860 legacy=0x7f4cf00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 -- 172.21.15.32:0/3329003471 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00725c0 con 0x7f4cf015cfd0 2024-09-13T18:47:37.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cefe00700 1 -- 172.21.15.32:0/3329003471 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342361246 0 0) 0x7f4cf0072370 con 0x7f4cf00cb860 2024-09-13T18:47:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cf4c00700 1 --2- 172.21.15.32:0/3329003471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf015cfd0 0x7f4cf015d3b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009910 tx=0x7f4cd8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2ee006f6311a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.478+0000 7f4cefe00700 1 -- 172.21.15.32:0/3329003471 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011830 con 0x7f4cf015cfd0 2024-09-13T18:47:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cefe00700 1 -- 172.21.15.32:0/3329003471 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8011990 con 0x7f4cf015cfd0 2024-09-13T18:47:37.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cefe00700 1 -- 172.21.15.32:0/3329003471 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011d40 con 0x7f4cf015cfd0 2024-09-13T18:47:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 -- 172.21.15.32:0/3329003471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf015cfd0 msgr2=0x7f4cf015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 --2- 172.21.15.32:0/3329003471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf015cfd0 0x7f4cf015d3b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009910 tx=0x7f4cd8009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 -- 172.21.15.32:0/3329003471 shutdown_connections 2024-09-13T18:47:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 --2- 172.21.15.32:0/3329003471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015d8f0 0x7f4cf0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 --2- 172.21.15.32:0/3329003471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf015cfd0 0x7f4cf015d3b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 -- 172.21.15.32:0/3329003471 >> 172.21.15.32:0/3329003471 conn(0x7f4cf00cad40 msgr2=0x7f4cf00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 -- 172.21.15.32:0/3329003471 shutdown_connections 2024-09-13T18:47:37.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.482+0000 7f4cf6000700 1 -- 172.21.15.32:0/3329003471 wait complete. 2024-09-13T18:47:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 Processor -- start 2024-09-13T18:47:37.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 -- start start 2024-09-13T18:47:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf00cb860 0x7f4cf00c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015cfd0 0x7f4cf00c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 0x7f4cf01e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00c4f60 con 0x7f4cf00cb860 2024-09-13T18:47:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01e3c00 con 0x7f4cf015d8f0 2024-09-13T18:47:37.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf6000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01e3ec0 con 0x7f4cf015cfd0 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 0x7f4cf01e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4ce7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015cfd0 0x7f4cf00c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf4c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf00cb860 0x7f4cf00c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 0x7f4cf01e49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:40128/0 (socket says 172.21.15.32:40128) 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 -- 172.21.15.32:0/1679607753 learned_addr learned my addr 172.21.15.32:0/1679607753 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 -- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015cfd0 msgr2=0x7f4cf00c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015cfd0 0x7f4cf00c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 -- 172.21.15.32:0/1679607753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf00cb860 msgr2=0x7f4cf00c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf00cb860 0x7f4cf00c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.486+0000 7f4cf5600700 1 -- 172.21.15.32:0/1679607753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8009570 con 0x7f4cf015d8f0 2024-09-13T18:47:37.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4cf5600700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 0x7f4cf01e49a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800efc0 tx=0x7f4ce800c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800cad0 con 0x7f4cf015d8f0 2024-09-13T18:47:37.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf01e41a0 con 0x7f4cf015d8f0 2024-09-13T18:47:37.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce800f040 con 0x7f4cf015d8f0 2024-09-13T18:47:37.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800ce70 con 0x7f4cf015d8f0 2024-09-13T18:47:37.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf00c43b0 con 0x7f4cf015d8f0 2024-09-13T18:47:37.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.490+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf01e46c0 con 0x7f4cf015d8f0 2024-09-13T18:47:37.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.494+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ce8014480 con 0x7f4cf015d8f0 2024-09-13T18:47:37.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.494+0000 7f4ced600700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ccc066730 0x7f4ccc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.494+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4ce8085610 con 0x7f4cf015d8f0 2024-09-13T18:47:37.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.494+0000 7f4cf4c00700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ccc066730 0x7f4ccc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.498+0000 7f4cf4c00700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ccc066730 0x7f4ccc068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8000c00 tx=0x7f4cd8008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.502+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ce80525f0 con 0x7f4cf015d8f0 2024-09-13T18:47:37.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.690+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cf00706e0 con 0x7f4ccc066730 2024-09-13T18:47:37.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.710+0000 7f4ced600700 1 -- 172.21.15.32:0/1679607753 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367845 (secure 0 0 0) 0x7f4cd8011cb0 con 0x7f4ccc066730 2024-09-13T18:47:37.720 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:37.725 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ccc066730 msgr2=0x7f4ccc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ccc066730 0x7f4ccc068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8000c00 tx=0x7f4cd8008030 comp rx=0 tx=0).stop 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 msgr2=0x7f4cf01e49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 0x7f4cf01e49a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800efc0 tx=0x7f4ce800c0c0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 shutdown_connections 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ccc066730 0x7f4ccc068bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf015d8f0 0x7f4cf01e49a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cf015cfd0 0x7f4cf00c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 --2- 172.21.15.32:0/1679607753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cf00cb860 0x7f4cf00c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 >> 172.21.15.32:0/1679607753 conn(0x7f4cf00cad40 msgr2=0x7f4cf00cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 shutdown_connections 2024-09-13T18:47:37.726 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.718+0000 7f4cf6000700 1 -- 172.21.15.32:0/1679607753 wait complete. 2024-09-13T18:47:37.727 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:47:37.748 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-13T18:47:36.116781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629029,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":243,"num_write_kb":2487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249468,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725252,"statfs":{"total":773094113280,"available":772838658048,"internally_reserved":0,"allocated":8904704,"data_stored":5130154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.464237"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658843+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:26.658843+0000","last_peered":"2024-09-13T18:47:26.658843+0000","last_clean":"2024-09-13T18:47:26.658843+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:26.658843+0000","last_undegraded":"2024-09-13T18:47:26.658843+0000","last_fullsized":"2024-09-13T18:47:26.658843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268110+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:47:27.268110+0000","last_peered":"2024-09-13T18:47:27.268110+0000","last_clean":"2024-09-13T18:47:27.268110+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:27.268110+0000","last_undegraded":"2024-09-13T18:47:27.268110+0000","last_fullsized":"2024-09-13T18:47:27.268110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261007+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.261007+0000","last_peered":"2024-09-13T18:47:27.261007+0000","last_clean":"2024-09-13T18:47:27.261007+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.261007+0000","last_undegraded":"2024-09-13T18:47:27.261007+0000","last_fullsized":"2024-09-13T18:47:27.261007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:46.084608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268242+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:47:27.268242+0000","last_peered":"2024-09-13T18:47:27.268242+0000","last_clean":"2024-09-13T18:47:27.268242+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:27.268242+0000","last_undegraded":"2024-09-13T18:47:27.268242+0000","last_fullsized":"2024-09-13T18:47:27.268242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268231+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:47:27.268231+0000","last_peered":"2024-09-13T18:47:27.268231+0000","last_clean":"2024-09-13T18:47:27.268231+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:27.268231+0000","last_undegraded":"2024-09-13T18:47:27.268231+0000","last_fullsized":"2024-09-13T18:47:27.268231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899078+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:27.899078+0000","last_peered":"2024-09-13T18:47:27.899078+0000","last_clean":"2024-09-13T18:47:27.899078+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:27.899078+0000","last_undegraded":"2024-09-13T18:47:27.899078+0000","last_fullsized":"2024-09-13T18:47:27.899078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"64'3","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901004+0000","last_change":"2024-09-13T18:47:14.525177+0000","last_active":"2024-09-13T18:47:27.901004+0000","last_peered":"2024-09-13T18:47:27.901004+0000","last_clean":"2024-09-13T18:47:27.901004+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:27.901004+0000","last_undegraded":"2024-09-13T18:47:27.901004+0000","last_fullsized":"2024-09-13T18:47:27.901004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:30.537891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899934+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:27.899934+0000","last_peered":"2024-09-13T18:47:27.899934+0000","last_clean":"2024-09-13T18:47:27.899934+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:27.899934+0000","last_undegraded":"2024-09-13T18:47:27.899934+0000","last_fullsized":"2024-09-13T18:47:27.899934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900988+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:27.900988+0000","last_peered":"2024-09-13T18:47:27.900988+0000","last_clean":"2024-09-13T18:47:27.900988+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:27.900988+0000","last_undegraded":"2024-09-13T18:47:27.900988+0000","last_fullsized":"2024-09-13T18:47:27.900988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901044+0000","last_change":"2024-09-13T18:47:14.525584+0000","last_active":"2024-09-13T18:47:27.901044+0000","last_peered":"2024-09-13T18:47:27.901044+0000","last_clean":"2024-09-13T18:47:27.901044+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:27.901044+0000","last_undegraded":"2024-09-13T18:47:27.901044+0000","last_fullsized":"2024-09-13T18:47:27.901044+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:18.465119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266553+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:27.266553+0000","last_peered":"2024-09-13T18:47:27.266553+0000","last_clean":"2024-09-13T18:47:27.266553+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:27.266553+0000","last_undegraded":"2024-09-13T18:47:27.266553+0000","last_fullsized":"2024-09-13T18:47:27.266553+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900545+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:27.900545+0000","last_peered":"2024-09-13T18:47:27.900545+0000","last_clean":"2024-09-13T18:47:27.900545+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:27.900545+0000","last_undegraded":"2024-09-13T18:47:27.900545+0000","last_fullsized":"2024-09-13T18:47:27.900545+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266005+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:47:27.266005+0000","last_peered":"2024-09-13T18:47:27.266005+0000","last_clean":"2024-09-13T18:47:27.266005+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:27.266005+0000","last_undegraded":"2024-09-13T18:47:27.266005+0000","last_fullsized":"2024-09-13T18:47:27.266005+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"64'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266144+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:47:27.266144+0000","last_peered":"2024-09-13T18:47:27.266144+0000","last_clean":"2024-09-13T18:47:27.266144+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:27.266144+0000","last_undegraded":"2024-09-13T18:47:27.266144+0000","last_fullsized":"2024-09-13T18:47:27.266144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266891+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.266891+0000","last_peered":"2024-09-13T18:47:27.266891+0000","last_clean":"2024-09-13T18:47:27.266891+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.266891+0000","last_undegraded":"2024-09-13T18:47:27.266891+0000","last_fullsized":"2024-09-13T18:47:27.266891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264104+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:27.264104+0000","last_peered":"2024-09-13T18:47:27.264104+0000","last_clean":"2024-09-13T18:47:27.264104+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:27.264104+0000","last_undegraded":"2024-09-13T18:47:27.264104+0000","last_fullsized":"2024-09-13T18:47:27.264104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263324+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.263324+0000","last_peered":"2024-09-13T18:47:27.263324+0000","last_clean":"2024-09-13T18:47:27.263324+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.263324+0000","last_undegraded":"2024-09-13T18:47:27.263324+0000","last_fullsized":"2024-09-13T18:47:27.263324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265099+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.265099+0000","last_peered":"2024-09-13T18:47:27.265099+0000","last_clean":"2024-09-13T18:47:27.265099+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.265099+0000","last_undegraded":"2024-09-13T18:47:27.265099+0000","last_fullsized":"2024-09-13T18:47:27.265099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.954234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656833+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:26.656833+0000","last_peered":"2024-09-13T18:47:26.656833+0000","last_clean":"2024-09-13T18:47:26.656833+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:26.656833+0000","last_undegraded":"2024-09-13T18:47:26.656833+0000","last_fullsized":"2024-09-13T18:47:26.656833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657838+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:26.657838+0000","last_peered":"2024-09-13T18:47:26.657838+0000","last_clean":"2024-09-13T18:47:26.657838+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:26.657838+0000","last_undegraded":"2024-09-13T18:47:26.657838+0000","last_fullsized":"2024-09-13T18:47:26.657838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266878+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.266878+0000","last_peered":"2024-09-13T18:47:27.266878+0000","last_clean":"2024-09-13T18:47:27.266878+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.266878+0000","last_undegraded":"2024-09-13T18:47:27.266878+0000","last_fullsized":"2024-09-13T18:47:27.266878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265730+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:27.265730+0000","last_peered":"2024-09-13T18:47:27.265730+0000","last_clean":"2024-09-13T18:47:27.265730+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:27.265730+0000","last_undegraded":"2024-09-13T18:47:27.265730+0000","last_fullsized":"2024-09-13T18:47:27.265730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263552+0000","last_change":"2024-09-13T18:47:14.520002+0000","last_active":"2024-09-13T18:47:27.263552+0000","last_peered":"2024-09-13T18:47:27.263552+0000","last_clean":"2024-09-13T18:47:27.263552+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:27.263552+0000","last_undegraded":"2024-09-13T18:47:27.263552+0000","last_fullsized":"2024-09-13T18:47:27.263552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:01.778129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656294+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:26.656294+0000","last_peered":"2024-09-13T18:47:26.656294+0000","last_clean":"2024-09-13T18:47:26.656294+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:26.656294+0000","last_undegraded":"2024-09-13T18:47:26.656294+0000","last_fullsized":"2024-09-13T18:47:26.656294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657925+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:26.657925+0000","last_peered":"2024-09-13T18:47:26.657925+0000","last_clean":"2024-09-13T18:47:26.657925+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:26.657925+0000","last_undegraded":"2024-09-13T18:47:26.657925+0000","last_fullsized":"2024-09-13T18:47:26.657925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266890+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.266890+0000","last_peered":"2024-09-13T18:47:27.266890+0000","last_clean":"2024-09-13T18:47:27.266890+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.266890+0000","last_undegraded":"2024-09-13T18:47:27.266890+0000","last_fullsized":"2024-09-13T18:47:27.266890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655511+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:26.655511+0000","last_peered":"2024-09-13T18:47:26.655511+0000","last_clean":"2024-09-13T18:47:26.655511+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:26.655511+0000","last_undegraded":"2024-09-13T18:47:26.655511+0000","last_fullsized":"2024-09-13T18:47:26.655511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658909+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:26.658909+0000","last_peered":"2024-09-13T18:47:26.658909+0000","last_clean":"2024-09-13T18:47:26.658909+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:26.658909+0000","last_undegraded":"2024-09-13T18:47:26.658909+0000","last_fullsized":"2024-09-13T18:47:26.658909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"70'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658459+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:47:26.658459+0000","last_peered":"2024-09-13T18:47:26.658459+0000","last_clean":"2024-09-13T18:47:26.658459+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:26.658459+0000","last_undegraded":"2024-09-13T18:47:26.658459+0000","last_fullsized":"2024-09-13T18:47:26.658459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656651+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:26.656651+0000","last_peered":"2024-09-13T18:47:26.656651+0000","last_clean":"2024-09-13T18:47:26.656651+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:26.656651+0000","last_undegraded":"2024-09-13T18:47:26.656651+0000","last_fullsized":"2024-09-13T18:47:26.656651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263802+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:27.263802+0000","last_peered":"2024-09-13T18:47:27.263802+0000","last_clean":"2024-09-13T18:47:27.263802+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:27.263802+0000","last_undegraded":"2024-09-13T18:47:27.263802+0000","last_fullsized":"2024-09-13T18:47:27.263802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266744+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:47:27.266744+0000","last_peered":"2024-09-13T18:47:27.266744+0000","last_clean":"2024-09-13T18:47:27.266744+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:27.266744+0000","last_undegraded":"2024-09-13T18:47:27.266744+0000","last_fullsized":"2024-09-13T18:47:27.266744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264165+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.264165+0000","last_peered":"2024-09-13T18:47:27.264165+0000","last_clean":"2024-09-13T18:47:27.264165+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.264165+0000","last_undegraded":"2024-09-13T18:47:27.264165+0000","last_fullsized":"2024-09-13T18:47:27.264165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656088+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:47:26.656088+0000","last_peered":"2024-09-13T18:47:26.656088+0000","last_clean":"2024-09-13T18:47:26.656088+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:26.656088+0000","last_undegraded":"2024-09-13T18:47:26.656088+0000","last_fullsized":"2024-09-13T18:47:26.656088+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266528+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:47:27.266528+0000","last_peered":"2024-09-13T18:47:27.266528+0000","last_clean":"2024-09-13T18:47:27.266528+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:27.266528+0000","last_undegraded":"2024-09-13T18:47:27.266528+0000","last_fullsized":"2024-09-13T18:47:27.266528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263593+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:47:27.263593+0000","last_peered":"2024-09-13T18:47:27.263593+0000","last_clean":"2024-09-13T18:47:27.263593+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:27.263593+0000","last_undegraded":"2024-09-13T18:47:27.263593+0000","last_fullsized":"2024-09-13T18:47:27.263593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264264+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:27.264264+0000","last_peered":"2024-09-13T18:47:27.264264+0000","last_clean":"2024-09-13T18:47:27.264264+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:27.264264+0000","last_undegraded":"2024-09-13T18:47:27.264264+0000","last_fullsized":"2024-09-13T18:47:27.264264+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:58.188762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265891+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.265891+0000","last_peered":"2024-09-13T18:47:27.265891+0000","last_clean":"2024-09-13T18:47:27.265891+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.265891+0000","last_undegraded":"2024-09-13T18:47:27.265891+0000","last_fullsized":"2024-09-13T18:47:27.265891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263927+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:47:27.263927+0000","last_peered":"2024-09-13T18:47:27.263927+0000","last_clean":"2024-09-13T18:47:27.263927+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:27.263927+0000","last_undegraded":"2024-09-13T18:47:27.263927+0000","last_fullsized":"2024-09-13T18:47:27.263927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264936+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:47:27.264936+0000","last_peered":"2024-09-13T18:47:27.264936+0000","last_clean":"2024-09-13T18:47:27.264936+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:27.264936+0000","last_undegraded":"2024-09-13T18:47:27.264936+0000","last_fullsized":"2024-09-13T18:47:27.264936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"67'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266493+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:47:27.266493+0000","last_peered":"2024-09-13T18:47:27.266493+0000","last_clean":"2024-09-13T18:47:27.266493+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:27.266493+0000","last_undegraded":"2024-09-13T18:47:27.266493+0000","last_fullsized":"2024-09-13T18:47:27.266493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264888+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:47:27.264888+0000","last_peered":"2024-09-13T18:47:27.264888+0000","last_clean":"2024-09-13T18:47:27.264888+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:27.264888+0000","last_undegraded":"2024-09-13T18:47:27.264888+0000","last_fullsized":"2024-09-13T18:47:27.264888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263663+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:47:27.263663+0000","last_peered":"2024-09-13T18:47:27.263663+0000","last_clean":"2024-09-13T18:47:27.263663+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:27.263663+0000","last_undegraded":"2024-09-13T18:47:27.263663+0000","last_fullsized":"2024-09-13T18:47:27.263663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265583+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.265583+0000","last_peered":"2024-09-13T18:47:27.265583+0000","last_clean":"2024-09-13T18:47:27.265583+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.265583+0000","last_undegraded":"2024-09-13T18:47:27.265583+0000","last_fullsized":"2024-09-13T18:47:27.265583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267795+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.267795+0000","last_peered":"2024-09-13T18:47:27.267795+0000","last_clean":"2024-09-13T18:47:27.267795+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.267795+0000","last_undegraded":"2024-09-13T18:47:27.267795+0000","last_fullsized":"2024-09-13T18:47:27.267795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657527+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:26.657527+0000","last_peered":"2024-09-13T18:47:26.657527+0000","last_clean":"2024-09-13T18:47:26.657527+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:26.657527+0000","last_undegraded":"2024-09-13T18:47:26.657527+0000","last_fullsized":"2024-09-13T18:47:26.657527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266055+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.266055+0000","last_peered":"2024-09-13T18:47:27.266055+0000","last_clean":"2024-09-13T18:47:27.266055+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.266055+0000","last_undegraded":"2024-09-13T18:47:27.266055+0000","last_fullsized":"2024-09-13T18:47:27.266055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261221+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:47:27.261221+0000","last_peered":"2024-09-13T18:47:27.261221+0000","last_clean":"2024-09-13T18:47:27.261221+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:27.261221+0000","last_undegraded":"2024-09-13T18:47:27.261221+0000","last_fullsized":"2024-09-13T18:47:27.261221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266732+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.266732+0000","last_peered":"2024-09-13T18:47:27.266732+0000","last_clean":"2024-09-13T18:47:27.266732+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.266732+0000","last_undegraded":"2024-09-13T18:47:27.266732+0000","last_fullsized":"2024-09-13T18:47:27.266732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266415+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:27.266415+0000","last_peered":"2024-09-13T18:47:27.266415+0000","last_clean":"2024-09-13T18:47:27.266415+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:27.266415+0000","last_undegraded":"2024-09-13T18:47:27.266415+0000","last_fullsized":"2024-09-13T18:47:27.266415+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263597+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.263597+0000","last_peered":"2024-09-13T18:47:27.263597+0000","last_clean":"2024-09-13T18:47:27.263597+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.263597+0000","last_undegraded":"2024-09-13T18:47:27.263597+0000","last_fullsized":"2024-09-13T18:47:27.263597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655686+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:26.655686+0000","last_peered":"2024-09-13T18:47:26.655686+0000","last_clean":"2024-09-13T18:47:26.655686+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:26.655686+0000","last_undegraded":"2024-09-13T18:47:26.655686+0000","last_fullsized":"2024-09-13T18:47:26.655686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265175+0000","last_change":"2024-09-13T18:47:14.709999+0000","last_active":"2024-09-13T18:47:27.265175+0000","last_peered":"2024-09-13T18:47:27.265175+0000","last_clean":"2024-09-13T18:47:27.265175+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:27.265175+0000","last_undegraded":"2024-09-13T18:47:27.265175+0000","last_fullsized":"2024-09-13T18:47:27.265175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:43.817137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267884+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:47:27.267884+0000","last_peered":"2024-09-13T18:47:27.267884+0000","last_clean":"2024-09-13T18:47:27.267884+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:27.267884+0000","last_undegraded":"2024-09-13T18:47:27.267884+0000","last_fullsized":"2024-09-13T18:47:27.267884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267160+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.267160+0000","last_peered":"2024-09-13T18:47:27.267160+0000","last_clean":"2024-09-13T18:47:27.267160+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.267160+0000","last_undegraded":"2024-09-13T18:47:27.267160+0000","last_fullsized":"2024-09-13T18:47:27.267160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265710+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:27.265710+0000","last_peered":"2024-09-13T18:47:27.265710+0000","last_clean":"2024-09-13T18:47:27.265710+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:27.265710+0000","last_undegraded":"2024-09-13T18:47:27.265710+0000","last_fullsized":"2024-09-13T18:47:27.265710+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:41.204767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658197+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:26.658197+0000","last_peered":"2024-09-13T18:47:26.658197+0000","last_clean":"2024-09-13T18:47:26.658197+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:26.658197+0000","last_undegraded":"2024-09-13T18:47:26.658197+0000","last_fullsized":"2024-09-13T18:47:26.658197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265409+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.265409+0000","last_peered":"2024-09-13T18:47:27.265409+0000","last_clean":"2024-09-13T18:47:27.265409+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.265409+0000","last_undegraded":"2024-09-13T18:47:27.265409+0000","last_fullsized":"2024-09-13T18:47:27.265409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656499+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:47:26.656499+0000","last_peered":"2024-09-13T18:47:26.656499+0000","last_clean":"2024-09-13T18:47:26.656499+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:26.656499+0000","last_undegraded":"2024-09-13T18:47:26.656499+0000","last_fullsized":"2024-09-13T18:47:26.656499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265775+0000","last_change":"2024-09-13T18:47:14.523024+0000","last_active":"2024-09-13T18:47:27.265775+0000","last_peered":"2024-09-13T18:47:27.265775+0000","last_clean":"2024-09-13T18:47:27.265775+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:27.265775+0000","last_undegraded":"2024-09-13T18:47:27.265775+0000","last_fullsized":"2024-09-13T18:47:27.265775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:41.142555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261242+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.261242+0000","last_peered":"2024-09-13T18:47:27.261242+0000","last_clean":"2024-09-13T18:47:27.261242+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.261242+0000","last_undegraded":"2024-09-13T18:47:27.261242+0000","last_fullsized":"2024-09-13T18:47:27.261242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265655+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:47:27.265655+0000","last_peered":"2024-09-13T18:47:27.265655+0000","last_clean":"2024-09-13T18:47:27.265655+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:27.265655+0000","last_undegraded":"2024-09-13T18:47:27.265655+0000","last_fullsized":"2024-09-13T18:47:27.265655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657139+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:26.657139+0000","last_peered":"2024-09-13T18:47:26.657139+0000","last_clean":"2024-09-13T18:47:26.657139+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:26.657139+0000","last_undegraded":"2024-09-13T18:47:26.657139+0000","last_fullsized":"2024-09-13T18:47:26.657139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659005+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:27.659005+0000","last_peered":"2024-09-13T18:47:27.659005+0000","last_clean":"2024-09-13T18:47:27.659005+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:27.659005+0000","last_undegraded":"2024-09-13T18:47:27.659005+0000","last_fullsized":"2024-09-13T18:47:27.659005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261098+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:27.261098+0000","last_peered":"2024-09-13T18:47:27.261098+0000","last_clean":"2024-09-13T18:47:27.261098+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:27.261098+0000","last_undegraded":"2024-09-13T18:47:27.261098+0000","last_fullsized":"2024-09-13T18:47:27.261098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264134+0000","last_change":"2024-09-13T18:47:14.654438+0000","last_active":"2024-09-13T18:47:27.264134+0000","last_peered":"2024-09-13T18:47:27.264134+0000","last_clean":"2024-09-13T18:47:27.264134+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:27.264134+0000","last_undegraded":"2024-09-13T18:47:27.264134+0000","last_fullsized":"2024-09-13T18:47:27.264134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:43.091822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264617+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.264617+0000","last_peered":"2024-09-13T18:47:27.264617+0000","last_clean":"2024-09-13T18:47:27.264617+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.264617+0000","last_undegraded":"2024-09-13T18:47:27.264617+0000","last_fullsized":"2024-09-13T18:47:27.264617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265972+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:27.265972+0000","last_peered":"2024-09-13T18:47:27.265972+0000","last_clean":"2024-09-13T18:47:27.265972+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:27.265972+0000","last_undegraded":"2024-09-13T18:47:27.265972+0000","last_fullsized":"2024-09-13T18:47:27.265972+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266196+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:47:27.266196+0000","last_peered":"2024-09-13T18:47:27.266196+0000","last_clean":"2024-09-13T18:47:27.266196+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:27.266196+0000","last_undegraded":"2024-09-13T18:47:27.266196+0000","last_fullsized":"2024-09-13T18:47:27.266196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263761+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.263761+0000","last_peered":"2024-09-13T18:47:27.263761+0000","last_clean":"2024-09-13T18:47:27.263761+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.263761+0000","last_undegraded":"2024-09-13T18:47:27.263761+0000","last_fullsized":"2024-09-13T18:47:27.263761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263104+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:27.263104+0000","last_peered":"2024-09-13T18:47:27.263104+0000","last_clean":"2024-09-13T18:47:27.263104+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:27.263104+0000","last_undegraded":"2024-09-13T18:47:27.263104+0000","last_fullsized":"2024-09-13T18:47:27.263104+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264479+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:47:27.264479+0000","last_peered":"2024-09-13T18:47:27.264479+0000","last_clean":"2024-09-13T18:47:27.264479+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:27.264479+0000","last_undegraded":"2024-09-13T18:47:27.264479+0000","last_fullsized":"2024-09-13T18:47:27.264479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266569+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.266569+0000","last_peered":"2024-09-13T18:47:27.266569+0000","last_clean":"2024-09-13T18:47:27.266569+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.266569+0000","last_undegraded":"2024-09-13T18:47:27.266569+0000","last_fullsized":"2024-09-13T18:47:27.266569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900808+0000","last_change":"2024-09-13T18:47:14.649751+0000","last_active":"2024-09-13T18:47:27.900808+0000","last_peered":"2024-09-13T18:47:27.900808+0000","last_clean":"2024-09-13T18:47:27.900808+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:27.900808+0000","last_undegraded":"2024-09-13T18:47:27.900808+0000","last_fullsized":"2024-09-13T18:47:27.900808+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:41.327461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"70'24","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656244+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:47:26.656244+0000","last_peered":"2024-09-13T18:47:26.656244+0000","last_clean":"2024-09-13T18:47:26.656244+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:26.656244+0000","last_undegraded":"2024-09-13T18:47:26.656244+0000","last_fullsized":"2024-09-13T18:47:26.656244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656411+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:27.656411+0000","last_peered":"2024-09-13T18:47:27.656411+0000","last_clean":"2024-09-13T18:47:27.656411+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:27.656411+0000","last_undegraded":"2024-09-13T18:47:27.656411+0000","last_fullsized":"2024-09-13T18:47:27.656411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266384+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:27.266384+0000","last_peered":"2024-09-13T18:47:27.266384+0000","last_clean":"2024-09-13T18:47:27.266384+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:27.266384+0000","last_undegraded":"2024-09-13T18:47:27.266384+0000","last_fullsized":"2024-09-13T18:47:27.266384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"67'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898590+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:47:27.898590+0000","last_peered":"2024-09-13T18:47:27.898590+0000","last_clean":"2024-09-13T18:47:27.898590+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:27.898590+0000","last_undegraded":"2024-09-13T18:47:27.898590+0000","last_fullsized":"2024-09-13T18:47:27.898590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655745+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:26.655745+0000","last_peered":"2024-09-13T18:47:26.655745+0000","last_clean":"2024-09-13T18:47:26.655745+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:26.655745+0000","last_undegraded":"2024-09-13T18:47:26.655745+0000","last_fullsized":"2024-09-13T18:47:26.655745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659183+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:47:27.659183+0000","last_peered":"2024-09-13T18:47:27.659183+0000","last_clean":"2024-09-13T18:47:27.659183+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:27.659183+0000","last_undegraded":"2024-09-13T18:47:27.659183+0000","last_fullsized":"2024-09-13T18:47:27.659183+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264885+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:47:27.264885+0000","last_peered":"2024-09-13T18:47:27.264885+0000","last_clean":"2024-09-13T18:47:27.264885+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:27.264885+0000","last_undegraded":"2024-09-13T18:47:27.264885+0000","last_fullsized":"2024-09-13T18:47:27.264885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:41.572481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.896644+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:27.896644+0000","last_peered":"2024-09-13T18:47:27.896644+0000","last_clean":"2024-09-13T18:47:27.896644+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:27.896644+0000","last_undegraded":"2024-09-13T18:47:27.896644+0000","last_fullsized":"2024-09-13T18:47:27.896644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901899+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:47:27.901899+0000","last_peered":"2024-09-13T18:47:27.901899+0000","last_clean":"2024-09-13T18:47:27.901899+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:47:27.901899+0000","last_undegraded":"2024-09-13T18:47:27.901899+0000","last_fullsized":"2024-09-13T18:47:27.901899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262272+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.262272+0000","last_peered":"2024-09-13T18:47:27.262272+0000","last_clean":"2024-09-13T18:47:27.262272+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.262272+0000","last_undegraded":"2024-09-13T18:47:27.262272+0000","last_fullsized":"2024-09-13T18:47:27.262272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657696+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:27.657696+0000","last_peered":"2024-09-13T18:47:27.657696+0000","last_clean":"2024-09-13T18:47:27.657696+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:27.657696+0000","last_undegraded":"2024-09-13T18:47:27.657696+0000","last_fullsized":"2024-09-13T18:47:27.657696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657664+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:26.657664+0000","last_peered":"2024-09-13T18:47:26.657664+0000","last_clean":"2024-09-13T18:47:26.657664+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:26.657664+0000","last_undegraded":"2024-09-13T18:47:26.657664+0000","last_fullsized":"2024-09-13T18:47:26.657664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657922+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:47:27.657922+0000","last_peered":"2024-09-13T18:47:27.657922+0000","last_clean":"2024-09-13T18:47:27.657922+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:27.657922+0000","last_undegraded":"2024-09-13T18:47:27.657922+0000","last_fullsized":"2024-09-13T18:47:27.657922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265110+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:47:27.265110+0000","last_peered":"2024-09-13T18:47:27.265110+0000","last_clean":"2024-09-13T18:47:27.265110+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:27.265110+0000","last_undegraded":"2024-09-13T18:47:27.265110+0000","last_fullsized":"2024-09-13T18:47:27.265110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267014+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.267014+0000","last_peered":"2024-09-13T18:47:27.267014+0000","last_clean":"2024-09-13T18:47:27.267014+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.267014+0000","last_undegraded":"2024-09-13T18:47:27.267014+0000","last_fullsized":"2024-09-13T18:47:27.267014+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655855+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:27.655855+0000","last_peered":"2024-09-13T18:47:27.655855+0000","last_clean":"2024-09-13T18:47:27.655855+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:27.655855+0000","last_undegraded":"2024-09-13T18:47:27.655855+0000","last_fullsized":"2024-09-13T18:47:27.655855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263416+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:47:27.263416+0000","last_peered":"2024-09-13T18:47:27.263416+0000","last_clean":"2024-09-13T18:47:27.263416+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:27.263416+0000","last_undegraded":"2024-09-13T18:47:27.263416+0000","last_fullsized":"2024-09-13T18:47:27.263416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266250+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.266250+0000","last_peered":"2024-09-13T18:47:27.266250+0000","last_clean":"2024-09-13T18:47:27.266250+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.266250+0000","last_undegraded":"2024-09-13T18:47:27.266250+0000","last_fullsized":"2024-09-13T18:47:27.266250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657317+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:27.657317+0000","last_peered":"2024-09-13T18:47:27.657317+0000","last_clean":"2024-09-13T18:47:27.657317+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:27.657317+0000","last_undegraded":"2024-09-13T18:47:27.657317+0000","last_fullsized":"2024-09-13T18:47:27.657317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657187+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:26.657187+0000","last_peered":"2024-09-13T18:47:26.657187+0000","last_clean":"2024-09-13T18:47:26.657187+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:26.657187+0000","last_undegraded":"2024-09-13T18:47:26.657187+0000","last_fullsized":"2024-09-13T18:47:26.657187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657724+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:47:27.657724+0000","last_peered":"2024-09-13T18:47:27.657724+0000","last_clean":"2024-09-13T18:47:27.657724+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:27.657724+0000","last_undegraded":"2024-09-13T18:47:27.657724+0000","last_fullsized":"2024-09-13T18:47:27.657724+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898388+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:27.898388+0000","last_peered":"2024-09-13T18:47:27.898388+0000","last_clean":"2024-09-13T18:47:27.898388+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:27.898388+0000","last_undegraded":"2024-09-13T18:47:27.898388+0000","last_fullsized":"2024-09-13T18:47:27.898388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264741+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:27.264741+0000","last_peered":"2024-09-13T18:47:27.264741+0000","last_clean":"2024-09-13T18:47:27.264741+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:27.264741+0000","last_undegraded":"2024-09-13T18:47:27.264741+0000","last_fullsized":"2024-09-13T18:47:27.264741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655701+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:47:26.655701+0000","last_peered":"2024-09-13T18:47:26.655701+0000","last_clean":"2024-09-13T18:47:26.655701+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:26.655701+0000","last_undegraded":"2024-09-13T18:47:26.655701+0000","last_fullsized":"2024-09-13T18:47:26.655701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266338+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:27.266338+0000","last_peered":"2024-09-13T18:47:27.266338+0000","last_clean":"2024-09-13T18:47:27.266338+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:27.266338+0000","last_undegraded":"2024-09-13T18:47:27.266338+0000","last_fullsized":"2024-09-13T18:47:27.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266075+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:27.266075+0000","last_peered":"2024-09-13T18:47:27.266075+0000","last_clean":"2024-09-13T18:47:27.266075+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:27.266075+0000","last_undegraded":"2024-09-13T18:47:27.266075+0000","last_fullsized":"2024-09-13T18:47:27.266075+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267343+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:27.267343+0000","last_peered":"2024-09-13T18:47:27.267343+0000","last_clean":"2024-09-13T18:47:27.267343+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:27.267343+0000","last_undegraded":"2024-09-13T18:47:27.267343+0000","last_fullsized":"2024-09-13T18:47:27.267343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263537+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:27.263537+0000","last_peered":"2024-09-13T18:47:27.263537+0000","last_clean":"2024-09-13T18:47:27.263537+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:27.263537+0000","last_undegraded":"2024-09-13T18:47:27.263537+0000","last_fullsized":"2024-09-13T18:47:27.263537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264135+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:27.264135+0000","last_peered":"2024-09-13T18:47:27.264135+0000","last_clean":"2024-09-13T18:47:27.264135+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:27.264135+0000","last_undegraded":"2024-09-13T18:47:27.264135+0000","last_fullsized":"2024-09-13T18:47:27.264135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656312+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:26.656312+0000","last_peered":"2024-09-13T18:47:26.656312+0000","last_clean":"2024-09-13T18:47:26.656312+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:26.656312+0000","last_undegraded":"2024-09-13T18:47:26.656312+0000","last_fullsized":"2024-09-13T18:47:26.656312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268166+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:27.268166+0000","last_peered":"2024-09-13T18:47:27.268166+0000","last_clean":"2024-09-13T18:47:27.268166+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:27.268166+0000","last_undegraded":"2024-09-13T18:47:27.268166+0000","last_fullsized":"2024-09-13T18:47:27.268166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265579+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:27.265579+0000","last_peered":"2024-09-13T18:47:27.265579+0000","last_clean":"2024-09-13T18:47:27.265579+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:27.265579+0000","last_undegraded":"2024-09-13T18:47:27.265579+0000","last_fullsized":"2024-09-13T18:47:27.265579+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266255+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:47:27.266255+0000","last_peered":"2024-09-13T18:47:27.266255+0000","last_clean":"2024-09-13T18:47:27.266255+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:27.266255+0000","last_undegraded":"2024-09-13T18:47:27.266255+0000","last_fullsized":"2024-09-13T18:47:27.266255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261334+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:27.261334+0000","last_peered":"2024-09-13T18:47:27.261334+0000","last_clean":"2024-09-13T18:47:27.261334+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:27.261334+0000","last_undegraded":"2024-09-13T18:47:27.261334+0000","last_fullsized":"2024-09-13T18:47:27.261334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657229+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:26.657229+0000","last_peered":"2024-09-13T18:47:26.657229+0000","last_clean":"2024-09-13T18:47:26.657229+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:26.657229+0000","last_undegraded":"2024-09-13T18:47:26.657229+0000","last_fullsized":"2024-09-13T18:47:26.657229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264995+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:27.264995+0000","last_peered":"2024-09-13T18:47:27.264995+0000","last_clean":"2024-09-13T18:47:27.264995+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:27.264995+0000","last_undegraded":"2024-09-13T18:47:27.264995+0000","last_fullsized":"2024-09-13T18:47:27.264995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266855+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:27.266855+0000","last_peered":"2024-09-13T18:47:27.266855+0000","last_clean":"2024-09-13T18:47:27.266855+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:27.266855+0000","last_undegraded":"2024-09-13T18:47:27.266855+0000","last_fullsized":"2024-09-13T18:47:27.266855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265943+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:27.265943+0000","last_peered":"2024-09-13T18:47:27.265943+0000","last_clean":"2024-09-13T18:47:27.265943+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:27.265943+0000","last_undegraded":"2024-09-13T18:47:27.265943+0000","last_fullsized":"2024-09-13T18:47:27.265943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266928+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:27.266928+0000","last_peered":"2024-09-13T18:47:27.266928+0000","last_clean":"2024-09-13T18:47:27.266928+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:27.266928+0000","last_undegraded":"2024-09-13T18:47:27.266928+0000","last_fullsized":"2024-09-13T18:47:27.266928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265447+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:47:27.265447+0000","last_peered":"2024-09-13T18:47:27.265447+0000","last_clean":"2024-09-13T18:47:27.265447+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:27.265447+0000","last_undegraded":"2024-09-13T18:47:27.265447+0000","last_fullsized":"2024-09-13T18:47:27.265447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265838+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:27.265838+0000","last_peered":"2024-09-13T18:47:27.265838+0000","last_clean":"2024-09-13T18:47:27.265838+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:27.265838+0000","last_undegraded":"2024-09-13T18:47:27.265838+0000","last_fullsized":"2024-09-13T18:47:27.265838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"64'1","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263722+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:47:27.263722+0000","last_peered":"2024-09-13T18:47:27.263722+0000","last_clean":"2024-09-13T18:47:27.263722+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:27.263722+0000","last_undegraded":"2024-09-13T18:47:27.263722+0000","last_fullsized":"2024-09-13T18:47:27.263722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264382+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:47:27.264382+0000","last_peered":"2024-09-13T18:47:27.264382+0000","last_clean":"2024-09-13T18:47:27.264382+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:27.264382+0000","last_undegraded":"2024-09-13T18:47:27.264382+0000","last_fullsized":"2024-09-13T18:47:27.264382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:47.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900689+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:27.900689+0000","last_peered":"2024-09-13T18:47:27.900689+0000","last_clean":"2024-09-13T18:47:27.900689+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:27.900689+0000","last_undegraded":"2024-09-13T18:47:27.900689+0000","last_fullsized":"2024-09-13T18:47:27.900689+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:12.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.903085+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:27.903085+0000","last_peered":"2024-09-13T18:47:27.903085+0000","last_clean":"2024-09-13T18:47:27.903085+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:27.903085+0000","last_undegraded":"2024-09-13T18:47:27.903085+0000","last_fullsized":"2024-09-13T18:47:27.903085+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:42.267150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899218+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:27.899218+0000","last_peered":"2024-09-13T18:47:27.899218+0000","last_clean":"2024-09-13T18:47:27.899218+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:27.899218+0000","last_undegraded":"2024-09-13T18:47:27.899218+0000","last_fullsized":"2024-09-13T18:47:27.899218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.655666+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:27.655666+0000","last_peered":"2024-09-13T18:47:27.655666+0000","last_clean":"2024-09-13T18:47:27.655666+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:27.655666+0000","last_undegraded":"2024-09-13T18:47:27.655666+0000","last_fullsized":"2024-09-13T18:47:27.655666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266197+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:27.266197+0000","last_peered":"2024-09-13T18:47:27.266197+0000","last_clean":"2024-09-13T18:47:27.266197+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:27.266197+0000","last_undegraded":"2024-09-13T18:47:27.266197+0000","last_fullsized":"2024-09-13T18:47:27.266197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900798+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:47:27.900798+0000","last_peered":"2024-09-13T18:47:27.900798+0000","last_clean":"2024-09-13T18:47:27.900798+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:27.900798+0000","last_undegraded":"2024-09-13T18:47:27.900798+0000","last_fullsized":"2024-09-13T18:47:27.900798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900294+0000","last_change":"2024-09-13T18:47:14.522436+0000","last_active":"2024-09-13T18:47:27.900294+0000","last_peered":"2024-09-13T18:47:27.900294+0000","last_clean":"2024-09-13T18:47:27.900294+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:27.900294+0000","last_undegraded":"2024-09-13T18:47:27.900294+0000","last_fullsized":"2024-09-13T18:47:27.900294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:19.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656017+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:47:26.656017+0000","last_peered":"2024-09-13T18:47:26.656017+0000","last_clean":"2024-09-13T18:47:26.656017+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:26.656017+0000","last_undegraded":"2024-09-13T18:47:26.656017+0000","last_fullsized":"2024-09-13T18:47:26.656017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267711+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:27.267711+0000","last_peered":"2024-09-13T18:47:27.267711+0000","last_clean":"2024-09-13T18:47:27.267711+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:27.267711+0000","last_undegraded":"2024-09-13T18:47:27.267711+0000","last_fullsized":"2024-09-13T18:47:27.267711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":82,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267932+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:27.267932+0000","last_peered":"2024-09-13T18:47:27.267932+0000","last_clean":"2024-09-13T18:47:27.267932+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:27.267932+0000","last_undegraded":"2024-09-13T18:47:27.267932+0000","last_fullsized":"2024-09-13T18:47:27.267932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265619+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:27.265619+0000","last_peered":"2024-09-13T18:47:27.265619+0000","last_clean":"2024-09-13T18:47:27.265619+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:27.265619+0000","last_undegraded":"2024-09-13T18:47:27.265619+0000","last_fullsized":"2024-09-13T18:47:27.265619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38661,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":82,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2529999999999999,"5min":2.585,"15min":2.585},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.871,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7649999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.393,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.448}]},{"osd":2,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.1439999999999999,"15min":1.1739999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.544},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.196,"15min":1.244},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5980000000000001,"5min":1.778,"15min":1.778},"last":1.1870000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.222},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5149999999999999,"5min":1.665,"15min":1.665},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.3080000000000001,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.306}]},{"osd":5,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2989999999999999,"15min":1.337},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.55,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.6459999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3939999999999999,"15min":1.427},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.73},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.337,"15min":1.3560000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.101}]},{"osd":7,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.4059999999999999,"15min":1.4359999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.4470000000000001,"15min":1.5009999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5920000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3620000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":521564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.141,"15min":1.181},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.355,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0720000000000001,"15min":1.0960000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94499999999999995,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.1439999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.2949999999999999,"15min":1.347},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.609,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.753},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.2410000000000001,"15min":1.272},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.254,"15min":1.28},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5649999999999999,"5min":1.788,"15min":1.788},"last":1.087},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2829999999999999,"15min":1.3169999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3500000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.325}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.462,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.468},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.446,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.516}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3500000000000001,"15min":1.3839999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.504,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.3680000000000001,"15min":1.413},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5660000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.179}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.5309999999999999,"15min":1.587},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5609999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.4550000000000001,"15min":1.4990000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6120000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.5680000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":4.2910000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":4.4729999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":4.6879999999999997},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":4.7409999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":5.0129999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":5.1950000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":4.8220000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":4.9000000000000004},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":4.7869999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":4.6390000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":4.9459999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":5.0380000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":4.8600000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.98699999999999999,"15min":1.034},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1379999999999999,"15min":1.1519999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.212},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1299999999999999,"15min":1.1659999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.147}]},{"osd":3,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.014,"15min":1.006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.4630000000000001,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.264,"15min":1.306},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.292}]},{"osd":4,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.2969999999999999,"15min":1.3420000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.1989999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.353},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.97399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4089999999999998,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.28},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3520000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.3200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.252,"15min":1.2809999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.411,"15min":1.4350000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.4159999999999999,"15min":1.47},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2360000000000002,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.409},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.3779999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":0.89600000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.145},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.5429999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0249999999999999,"15min":1.05},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.216},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0509999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2150000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.923}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":2.105},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2989999999999999,"5min":1.375,"15min":1.375},"last":2.2109999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.105,"15min":1.135},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.125,"15min":1.151},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2210000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.8029999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.86099999999999999},"min":{"1min":0.80700000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0409999999999999,"15min":1.0489999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.038},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.96399999999999997,"15min":0.95299999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.133,"15min":1.127},"min":{"1min":0.77200000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.95299999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3169999999999999,"5min":1.427,"15min":1.427},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4139999999999999,"5min":1.532,"15min":1.532},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.341,"5min":1.349,"15min":1.349},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2070000000000001,"5min":1.216,"15min":1.216},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.204}]},{"osd":3,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3700000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.194,"5min":1.466,"15min":1.466},"last":1.083}]},{"osd":4,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90300000000000002,"15min":0.90200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.75},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5169999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.46,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.139}]},{"osd":7,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0429999999999999,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1679999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":1.014}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":1.153}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.121},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.242},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.21}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1003520,"data_stored":522236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.94499999999999995,"15min":0.98499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1659999999999999,"5min":1.76,"15min":1.76},"last":1.202},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.012,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.538,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0820000000000001,"15min":1.1040000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.45,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.63400000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.121,"15min":1.1519999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.611,"5min":2.032,"15min":2.032},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.403,"15min":1.4890000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.581,"15min":1.681},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3300000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98999999999999999,"15min":0.99399999999999999},"min":{"1min":0.66300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3069999999999999,"5min":1.46,"15min":1.46},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4099999999999999,"5min":1.552,"15min":1.552},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2729999999999999,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.552,"5min":1.694,"15min":1.694},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5680000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.097}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:37.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:37.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 Processor -- start 2024-09-13T18:47:37.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 -- start start 2024-09-13T18:47:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d815b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 0x7fe6d806b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d806b990 con 0x7fe6d80c9a40 2024-09-13T18:47:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d8157730 con 0x7fe6d80c8450 2024-09-13T18:47:37.973 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6df200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8157a10 con 0x7fe6d80c8070 2024-09-13T18:47:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dde00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dd400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 0x7fe6d806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6de800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe6d80c9a40 0x7fe6d80c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39872/0 (socket says 172.21.15.32:39872) 2024-09-13T18:47:37.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dd400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 0x7fe6d806b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:40140/0 (socket says 172.21.15.32:40140) 2024-09-13T18:47:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6de800700 1 -- 172.21.15.32:0/3393174010 learned_addr learned my addr 172.21.15.32:0/3393174010 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dde00700 1 -- 172.21.15.32:0/3393174010 >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 msgr2=0x7fe6d806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dde00700 1 --2- 172.21.15.32:0/3393174010 >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 0x7fe6d806b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dde00700 1 -- 172.21.15.32:0/3393174010 >> v1:172.21.15.32:6789/0 conn(0x7fe6d80c9a40 legacy=0x7fe6d80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dde00700 1 -- 172.21.15.32:0/3393174010 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8157cf0 con 0x7fe6d80c8070 2024-09-13T18:47:37.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.966+0000 7fe6dd400700 1 --2- 172.21.15.32:0/3393174010 >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 0x7fe6d806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:37.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6dde00700 1 --2- 172.21.15.32:0/3393174010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d815b430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009850 tx=0x7fe6cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179b154baeba65d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.976 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6dca00700 1 -- 172.21.15.32:0/3393174010 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc011830 con 0x7fe6d80c8070 2024-09-13T18:47:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6dca00700 1 -- 172.21.15.32:0/3393174010 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc011990 con 0x7fe6d80c8070 2024-09-13T18:47:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6dca00700 1 -- 172.21.15.32:0/3393174010 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc011d40 con 0x7fe6d80c8070 2024-09-13T18:47:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 -- 172.21.15.32:0/3393174010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 msgr2=0x7fe6d815b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 --2- 172.21.15.32:0/3393174010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d815b430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009850 tx=0x7fe6cc009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 -- 172.21.15.32:0/3393174010 shutdown_connections 2024-09-13T18:47:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 --2- 172.21.15.32:0/3393174010 >> v2:172.21.15.86:3300/0 conn(0x7fe6d80c8450 0x7fe6d806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 --2- 172.21.15.32:0/3393174010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d815b430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 -- 172.21.15.32:0/3393174010 >> 172.21.15.32:0/3393174010 conn(0x7fe6d806c200 msgr2=0x7fe6d806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 -- 172.21.15.32:0/3393174010 shutdown_connections 2024-09-13T18:47:37.978 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.970+0000 7fe6df200700 1 -- 172.21.15.32:0/3393174010 wait complete. 2024-09-13T18:47:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 Processor -- start 2024-09-13T18:47:37.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 -- start start 2024-09-13T18:47:37.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d80c8450 0x7fe6d8145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.982 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 0x7fe6d8146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81ea8e0 con 0x7fe6d80c9a40 2024-09-13T18:47:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8070920 con 0x7fe6d80c8450 2024-09-13T18:47:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.974+0000 7fe6df200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81479f0 con 0x7fe6d80c8070 2024-09-13T18:47:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6de800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 0x7fe6d8146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d80c8450 0x7fe6d8145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.983 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6de800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 0x7fe6d8146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58168/0 (socket says 172.21.15.32:58168) 2024-09-13T18:47:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6de800700 1 -- 172.21.15.32:0/2244164062 learned_addr learned my addr 172.21.15.32:0/2244164062 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dde00700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 -- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 msgr2=0x7fe6d814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.984 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 -- 172.21.15.32:0/2244164062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 msgr2=0x7fe6d8146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 0x7fe6d8146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 -- 172.21.15.32:0/2244164062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c800d950 con 0x7fe6d80c8450 2024-09-13T18:47:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6de800700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 0x7fe6d8146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6dd400700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d80c8450 0x7fe6d8145f10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8012fc0 tx=0x7fe6c80100c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8010940 con 0x7fe6d80c8450 2024-09-13T18:47:37.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc0094b0 con 0x7fe6d80c8450 2024-09-13T18:47:37.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8013040 con 0x7fe6d80c8450 2024-09-13T18:47:37.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8010ce0 con 0x7fe6d80c8450 2024-09-13T18:47:37.986 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.978+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d806f5d0 con 0x7fe6d80c8450 2024-09-13T18:47:37.987 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.982+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d81eaa50 con 0x7fe6d80c8450 2024-09-13T18:47:37.989 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.982+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe6c8005a40 con 0x7fe6d80c8450 2024-09-13T18:47:37.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.986+0000 7fe6d2000700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe6bc066730 0x7fe6bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.986+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fe6c80890c0 con 0x7fe6d80c8450 2024-09-13T18:47:37.991 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.986+0000 7fe6dde00700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe6bc066730 0x7fe6bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.992 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.986+0000 7fe6dde00700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe6bc066730 0x7fe6bc068bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0090b0 tx=0x7fe6cc008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:37.990+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe6c8055f90 con 0x7fe6d80c8450 2024-09-13T18:47:38.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.186+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6d806b450 con 0x7fe6d80c8450 2024-09-13T18:47:38.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.190+0000 7fe6d2000700 1 -- 172.21.15.32:0/2244164062 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18451 (secure 0 0 0) 0x7fe6c80595b0 con 0x7fe6d80c8450 2024-09-13T18:47:38.198 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:38.198 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":81,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:47:27.647237+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:46:40.269675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.17","osds":[6,4,7,5]},{"pgid":"4.19","osds":[1,4,3,6]}],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.194+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe6bc066730 msgr2=0x7fe6bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.194+0000 7fe6df200700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe6bc066730 0x7fe6bc068bf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0090b0 tx=0x7fe6cc008030 comp rx=0 tx=0).stop 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.194+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d80c8450 msgr2=0x7fe6d8145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.194+0000 7fe6df200700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d80c8450 0x7fe6d8145f10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8012fc0 tx=0x7fe6c80100c0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 shutdown_connections 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe6bc066730 0x7fe6bc068bf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6d80c9a40 0x7fe6d8146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d80c8450 0x7fe6d8145f10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 --2- 172.21.15.32:0/2244164062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d80c8070 0x7fe6d814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 >> 172.21.15.32:0/2244164062 conn(0x7fe6d806c200 msgr2=0x7fe6d8150e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 shutdown_connections 2024-09-13T18:47:38.203 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:38.198+0000 7fe6df200700 1 -- 172.21.15.32:0/2244164062 wait complete. 2024-09-13T18:47:39.227 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:47:39.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:39.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.409+0000 7f56f3200700 1 Processor -- start 2024-09-13T18:47:39.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.409+0000 7f56f3200700 1 -- start start 2024-09-13T18:47:39.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f3200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f56ec0c6cf0 0x7f56ec06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec0c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f3200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0c4610 con 0x7f56ec0c7870 2024-09-13T18:47:39.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f3200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec1585a0 con 0x7f56ec0c6cf0 2024-09-13T18:47:39.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec157fe0 con 0x7f56ec0c70d0 2024-09-13T18:47:39.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec0c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f2800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f56ec0c7870 0x7f56ec1575c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52320/0 (socket says 172.21.15.32:52320) 2024-09-13T18:47:39.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f2800700 1 -- 172.21.15.32:0/3746465474 learned_addr learned my addr 172.21.15.32:0/3746465474 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:39.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1e00700 1 --2- 172.21.15.32:0/3746465474 >> v2:172.21.15.32:3300/0 conn(0x7f56ec0c6cf0 0x7f56ec06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f0a00700 1 -- 172.21.15.32:0/3746465474 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903146885 0 0) 0x7f56ec0c4610 con 0x7f56ec0c7870 2024-09-13T18:47:39.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f0a00700 1 -- 172.21.15.32:0/3746465474 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d40035d0 con 0x7f56ec0c7870 2024-09-13T18:47:39.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1e00700 1 -- 172.21.15.32:0/3746465474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 msgr2=0x7f56ec0c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1e00700 1 --2- 172.21.15.32:0/3746465474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec0c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1e00700 1 -- 172.21.15.32:0/3746465474 >> v1:172.21.15.86:6789/0 conn(0x7f56ec0c7870 legacy=0x7f56ec1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1e00700 1 -- 172.21.15.32:0/3746465474 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec1582c0 con 0x7f56ec0c6cf0 2024-09-13T18:47:39.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1400700 1 --2- 172.21.15.32:0/3746465474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:39.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f1e00700 1 --2- 172.21.15.32:0/3746465474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec06a390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009850 tx=0x7f56e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377d4e73a95ec5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f0a00700 1 -- 172.21.15.32:0/3746465474 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0011830 con 0x7f56ec0c6cf0 2024-09-13T18:47:39.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f0a00700 1 -- 172.21.15.32:0/3746465474 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0011990 con 0x7f56ec0c6cf0 2024-09-13T18:47:39.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.413+0000 7f56f0a00700 1 -- 172.21.15.32:0/3746465474 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0011d00 con 0x7f56ec0c6cf0 2024-09-13T18:47:39.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 -- 172.21.15.32:0/3746465474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c6cf0 msgr2=0x7f56ec06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 --2- 172.21.15.32:0/3746465474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec06a390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009850 tx=0x7f56e0009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:39.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 -- 172.21.15.32:0/3746465474 shutdown_connections 2024-09-13T18:47:39.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 --2- 172.21.15.32:0/3746465474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 --2- 172.21.15.32:0/3746465474 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec06a390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 -- 172.21.15.32:0/3746465474 >> 172.21.15.32:0/3746465474 conn(0x7f56ec0ccf70 msgr2=0x7f56ec0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 -- 172.21.15.32:0/3746465474 shutdown_connections 2024-09-13T18:47:39.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 -- 172.21.15.32:0/3746465474 wait complete. 2024-09-13T18:47:39.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 Processor -- start 2024-09-13T18:47:39.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.417+0000 7f56f3200700 1 -- start start 2024-09-13T18:47:39.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec1f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c7870 0x7f56ec159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec155060 con 0x7f56ec0c7870 2024-09-13T18:47:39.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0c5740 con 0x7f56ec0c6cf0 2024-09-13T18:47:39.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0c59e0 con 0x7f56ec0c70d0 2024-09-13T18:47:39.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f1400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec1f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c7870 0x7f56ec159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f1400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec1f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59868/0 (socket says 172.21.15.32:59868) 2024-09-13T18:47:39.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f1400700 1 -- 172.21.15.32:0/3188267464 learned_addr learned my addr 172.21.15.32:0/3188267464 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:39.428 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51698/0 (socket says 172.21.15.32:51698) 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 -- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 msgr2=0x7f56ec1f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec1f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 -- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0c6cf0 msgr2=0x7f56ec15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0c6cf0 0x7f56ec15aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 -- 172.21.15.32:0/3188267464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0094b0 con 0x7f56ec0c7870 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f1400700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0c70d0 0x7f56ec1f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:39.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f2800700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c7870 0x7f56ec159440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f56e800caa0 tx=0x7f56e800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8007480 con 0x7f56ec0c7870 2024-09-13T18:47:39.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e80075e0 con 0x7f56ec0c7870 2024-09-13T18:47:39.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e00094b0 con 0x7f56ec0c7870 2024-09-13T18:47:39.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8007950 con 0x7f56ec0c7870 2024-09-13T18:47:39.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.421+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec154a10 con 0x7f56ec0c7870 2024-09-13T18:47:39.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.425+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56ec06bab0 con 0x7f56ec0c7870 2024-09-13T18:47:39.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.425+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56e801b3b0 con 0x7f56ec0c7870 2024-09-13T18:47:39.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.425+0000 7f56e6000700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f56d0066730 0x7f56d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f56e8083bf0 con 0x7f56ec0c7870 2024-09-13T18:47:39.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56f1e00700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f56d0066730 0x7f56d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56e6000700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f56d006ff90 0x7f56d0072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56d0072b00 con 0x7f56d006ff90 2024-09-13T18:47:39.435 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56e8088280 con 0x7f56ec0c7870 2024-09-13T18:47:39.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56f1400700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f56d006ff90 0x7f56d0072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56f1e00700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f56d0066730 0x7f56d0068bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56e00090b0 tx=0x7f56e0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56f1400700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f56d006ff90 0x7f56d0072430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.437 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.429+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== osd.0 v2:172.21.15.32:6813/3679908055 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f56d0072b00 con 0x7f56d006ff90 2024-09-13T18:47:39.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 --> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56ec0c4b90 con 0x7f56d006ff90 2024-09-13T18:47:39.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56e6000700 1 -- 172.21.15.32:0/3188267464 <== osd.0 v2:172.21.15.32:6813/3679908055 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f56dc0115c0 con 0x7f56d006ff90 2024-09-13T18:47:39.455 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:39.455 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:39.456 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:39.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f56d006ff90 msgr2=0x7f56d0072430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.456 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:6813/3679908055,v1:172.21.15.32:6815/3679908055] conn(0x7f56d006ff90 0x7f56d0072430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f56d0066730 msgr2=0x7f56d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f56d0066730 0x7f56d0068bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56e00090b0 tx=0x7f56e0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c7870 msgr2=0x7f56ec159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 --2- 172.21.15.32:0/3188267464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f56ec0c7870 0x7f56ec159440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f56e800caa0 tx=0x7f56e800cad0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f2800700 1 -- 172.21.15.32:0/3188267464 reap_dead start 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 shutdown_connections 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 >> 172.21.15.32:0/3188267464 conn(0x7f56ec0ccf70 msgr2=0x7f56ec0c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 shutdown_connections 2024-09-13T18:47:39.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.449+0000 7f56f3200700 1 -- 172.21.15.32:0/3188267464 wait complete. 2024-09-13T18:47:39.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:47:39.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.653+0000 7f52d1c00700 1 Processor -- start 2024-09-13T18:47:39.662 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.653+0000 7f52d1c00700 1 -- start start 2024-09-13T18:47:39.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52cc0c9e90 0x7f52cc0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52cc0ca840 0x7f52cc06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0c9440 con 0x7f52cc06ea50 2024-09-13T18:47:39.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0c9a70 con 0x7f52cc0ca840 2024-09-13T18:47:39.664 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0c7aa0 con 0x7f52cc0c9e90 2024-09-13T18:47:39.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52cc0ca840 0x7f52cc06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52cc0c9e90 0x7f52cc0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.666 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f52cc0ca840 0x7f52cc06fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33820/0 (socket says 172.21.15.32:33820) 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52cc0c9e90 0x7f52cc0ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51704/0 (socket says 172.21.15.32:51704) 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52d1200700 1 -- 172.21.15.32:0/3904191503 learned_addr learned my addr 172.21.15.32:0/3904191503 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 -- 172.21.15.32:0/3904191503 >> v2:172.21.15.32:3300/0 conn(0x7f52cc0ca840 msgr2=0x7f52cc06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 --2- 172.21.15.32:0/3904191503 >> v2:172.21.15.32:3300/0 conn(0x7f52cc0ca840 0x7f52cc06fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 -- 172.21.15.32:0/3904191503 >> v1:172.21.15.86:6789/0 conn(0x7f52cc06ea50 legacy=0x7f52cc15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 -- 172.21.15.32:0/3904191503 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0c7d60 con 0x7f52cc0c9e90 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52cb400700 1 --2- 172.21.15.32:0/3904191503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0c9e90 0x7f52cc0ca300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0c9390 tx=0x7f52b8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd875bbd0d2a127 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52caa00700 1 -- 172.21.15.32:0/3904191503 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011830 con 0x7f52cc0c9e90 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.657+0000 7f52caa00700 1 -- 172.21.15.32:0/3904191503 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011990 con 0x7f52cc0c9e90 2024-09-13T18:47:39.667 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52caa00700 1 -- 172.21.15.32:0/3904191503 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011d20 con 0x7f52cc0c9e90 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 -- 172.21.15.32:0/3904191503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0c9e90 msgr2=0x7f52cc0ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 --2- 172.21.15.32:0/3904191503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0c9e90 0x7f52cc0ca300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0c9390 tx=0x7f52b8009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 -- 172.21.15.32:0/3904191503 shutdown_connections 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 --2- 172.21.15.32:0/3904191503 >> v2:172.21.15.32:3300/0 conn(0x7f52cc0ca840 0x7f52cc06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 --2- 172.21.15.32:0/3904191503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0c9e90 0x7f52cc0ca300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 -- 172.21.15.32:0/3904191503 >> 172.21.15.32:0/3904191503 conn(0x7f52cc0cac60 msgr2=0x7f52cc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 -- 172.21.15.32:0/3904191503 shutdown_connections 2024-09-13T18:47:39.668 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 -- 172.21.15.32:0/3904191503 wait complete. 2024-09-13T18:47:39.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 Processor -- start 2024-09-13T18:47:39.670 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.661+0000 7f52d1c00700 1 -- start start 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52cc06ea50 0x7f52cc1dec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 0x7f52cc1df150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0ca840 0x7f52cc1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1534c0 con 0x7f52cc06ea50 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1528b0 con 0x7f52cc0ca840 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0c8d60 con 0x7f52cc0c9e90 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cbe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52cc06ea50 0x7f52cc1dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 0x7f52cc1df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0ca840 0x7f52cc1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 0x7f52cc1df150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59882/0 (socket says 172.21.15.32:59882) 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 -- 172.21.15.32:0/2628020676 learned_addr learned my addr 172.21.15.32:0/2628020676 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 -- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0ca840 msgr2=0x7f52cc1538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0ca840 0x7f52cc1538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 -- 172.21.15.32:0/2628020676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52cc06ea50 msgr2=0x7f52cc1dec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52cc06ea50 0x7f52cc1dec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 -- 172.21.15.32:0/2628020676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80094b0 con 0x7f52cc0c9e90 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52cb400700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 0x7f52cc1df150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009b70 tx=0x7f52b8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.675 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8004550 con 0x7f52cc0c9e90 2024-09-13T18:47:39.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b801f070 con 0x7f52cc0c9e90 2024-09-13T18:47:39.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80038e0 con 0x7f52cc0c9e90 2024-09-13T18:47:39.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.665+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc152b20 con 0x7f52cc0c9e90 2024-09-13T18:47:39.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.669+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc1530e0 con 0x7f52cc0c9e90 2024-09-13T18:47:39.676 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.669+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc153600 con 0x7f52cc0c9e90 2024-09-13T18:47:39.678 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.669+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52b8003a40 con 0x7f52cc0c9e90 2024-09-13T18:47:39.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.673+0000 7f52c3e00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f52ac066760 0x7f52ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.673+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f52b8021070 con 0x7f52cc0c9e90 2024-09-13T18:47:39.680 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.673+0000 7f52cbe00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f52ac066760 0x7f52ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.681 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.673+0000 7f52cbe00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f52ac066760 0x7f52ac068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0018a0 tx=0x7f52bc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.687 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.681+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52b8052ca0 con 0x7f52cc0c9e90 2024-09-13T18:47:39.871 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.861+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f52cc0ae8f0 con 0x7f52ac066760 2024-09-13T18:47:39.872 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.865+0000 7f52c3e00700 1 -- 172.21.15.32:0/2628020676 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52cc0ae8f0 con 0x7f52ac066760 2024-09-13T18:47:39.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.865+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f52ac066760 msgr2=0x7f52ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.875 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.865+0000 7f52d1c00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f52ac066760 0x7f52ac068c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0018a0 tx=0x7f52bc009040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.865+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 msgr2=0x7f52cc1df150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.865+0000 7f52d1c00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 0x7f52cc1df150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009b70 tx=0x7f52b8004770 comp rx=0 tx=0).stop 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 shutdown_connections 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f52ac066760 0x7f52ac068c20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc0ca840 0x7f52cc1538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52cc0c9e90 0x7f52cc1df150 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 --2- 172.21.15.32:0/2628020676 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52cc06ea50 0x7f52cc1dec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 >> 172.21.15.32:0/2628020676 conn(0x7f52cc0cac60 msgr2=0x7f52cc06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 shutdown_connections 2024-09-13T18:47:39.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:39.869+0000 7f52d1c00700 1 -- 172.21.15.32:0/2628020676 wait complete. 2024-09-13T18:47:39.878 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:47:39.898 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:47:39.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:40.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.069+0000 7f0bf0a00700 1 Processor -- start 2024-09-13T18:47:40.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.069+0000 7f0bf0a00700 1 -- start start 2024-09-13T18:47:40.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bf0a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f0bec0a9490 0x7f0bec0a9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bf0a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec0c9070 con 0x7f0bec071f00 2024-09-13T18:47:40.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bf0a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec158170 con 0x7f0bec070a20 2024-09-13T18:47:40.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bf0a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec0a9db0 con 0x7f0bec0a9490 2024-09-13T18:47:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0beaa00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0bec071f00 0x7f0bec0c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52684/0 (socket says 172.21.15.32:52684) 2024-09-13T18:47:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0beaa00700 1 -- 172.21.15.32:0/3162421772 learned_addr learned my addr 172.21.15.32:0/3162421772 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bebe00700 1 --1- 172.21.15.32:0/3162421772 >> v1:172.21.15.86:6789/0 conn(0x7f0bec070a20 0x7f0bec161ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52346/0 (socket says 172.21.15.32:52346) 2024-09-13T18:47:40.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0beb400700 1 --2- 172.21.15.32:0/3162421772 >> v2:172.21.15.86:3300/0 conn(0x7f0bec0a9490 0x7f0bec0a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561020554 0 0) 0x7f0bec0c9070 con 0x7f0bec071f00 2024-09-13T18:47:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd00035d0 con 0x7f0bec071f00 2024-09-13T18:47:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791791514 0 0) 0x7f0bec158170 con 0x7f0bec070a20 2024-09-13T18:47:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bec0c9070 con 0x7f0bec070a20 2024-09-13T18:47:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0beb400700 1 -- 172.21.15.32:0/3162421772 >> v1:172.21.15.86:6789/0 conn(0x7f0bec070a20 legacy=0x7f0bec161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0beb400700 1 -- 172.21.15.32:0/3162421772 >> v1:172.21.15.32:6789/0 conn(0x7f0bec071f00 legacy=0x7f0bec0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.073+0000 7f0beb400700 1 -- 172.21.15.32:0/3162421772 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec158450 con 0x7f0bec0a9490 2024-09-13T18:47:40.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0beb400700 1 --2- 172.21.15.32:0/3162421772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec0a9490 0x7f0bec0a9870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009850 tx=0x7f0bdc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cce59228b431cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc011830 con 0x7f0bec0a9490 2024-09-13T18:47:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc011990 con 0x7f0bec0a9490 2024-09-13T18:47:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bea000700 1 -- 172.21.15.32:0/3162421772 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc011d40 con 0x7f0bec0a9490 2024-09-13T18:47:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 -- 172.21.15.32:0/3162421772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec0a9490 msgr2=0x7f0bec0a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 --2- 172.21.15.32:0/3162421772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec0a9490 0x7f0bec0a9870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009850 tx=0x7f0bdc009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 -- 172.21.15.32:0/3162421772 shutdown_connections 2024-09-13T18:47:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 --2- 172.21.15.32:0/3162421772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec0a9490 0x7f0bec0a9870 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 -- 172.21.15.32:0/3162421772 >> 172.21.15.32:0/3162421772 conn(0x7f0bec0c78b0 msgr2=0x7f0bec0c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 -- 172.21.15.32:0/3162421772 shutdown_connections 2024-09-13T18:47:40.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.077+0000 7f0bf0a00700 1 -- 172.21.15.32:0/3162421772 wait complete. 2024-09-13T18:47:40.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 Processor -- start 2024-09-13T18:47:40.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 -- start start 2024-09-13T18:47:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec070a20 0x7f0bec0c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bec071f00 0x7f0bec0abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bec0a9490 0x7f0bec0ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0ab840 con 0x7f0bec0a9490 2024-09-13T18:47:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c21b0 con 0x7f0bec070a20 2024-09-13T18:47:40.089 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bf0a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0ab4f0 con 0x7f0bec071f00 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec070a20 0x7f0bec0c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec070a20 0x7f0bec0c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51744/0 (socket says 172.21.15.32:51744) 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 -- 172.21.15.32:0/1867168171 learned_addr learned my addr 172.21.15.32:0/1867168171 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beaa00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bec071f00 0x7f0bec0abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0bebe00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bec0a9490 0x7f0bec0ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 -- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bec071f00 msgr2=0x7f0bec0abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bec071f00 0x7f0bec0abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 -- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bec0a9490 msgr2=0x7f0bec0ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0bec0a9490 0x7f0bec0ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 -- 172.21.15.32:0/1867168171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0094b0 con 0x7f0bec070a20 2024-09-13T18:47:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.081+0000 7f0beb400700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec070a20 0x7f0bec0c3210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0bec067d90 tx=0x7f0bdc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc01a990 con 0x7f0bec070a20 2024-09-13T18:47:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc01f070 con 0x7f0bec070a20 2024-09-13T18:47:40.091 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec0aa390 con 0x7f0bec070a20 2024-09-13T18:47:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc01ad30 con 0x7f0bec070a20 2024-09-13T18:47:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec0c26a0 con 0x7f0bec070a20 2024-09-13T18:47:40.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0bec0c8f00 con 0x7f0bec070a20 2024-09-13T18:47:40.094 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.085+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0bdc01b430 con 0x7f0bec070a20 2024-09-13T18:47:40.096 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0be3400700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0bcc066730 0x7f0bcc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f0bdc0860d0 con 0x7f0bec070a20 2024-09-13T18:47:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0beaa00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0bcc066730 0x7f0bcc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0be3400700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0bcc06ff90 0x7f0bcc072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bcc072b00 con 0x7f0bcc06ff90 2024-09-13T18:47:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bdc086480 con 0x7f0bec070a20 2024-09-13T18:47:40.097 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0bebe00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0bcc06ff90 0x7f0bcc072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0beaa00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0bcc066730 0x7f0bcc068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0bec154dc0 tx=0x7f0bd8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.089+0000 7f0bebe00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0bcc06ff90 0x7f0bcc072430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.099 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.093+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== osd.1 v2:172.21.15.32:6800/1416437982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0bcc072b00 con 0x7f0bcc06ff90 2024-09-13T18:47:40.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.109+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 --> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0bec0c5b60 con 0x7f0bcc06ff90 2024-09-13T18:47:40.118 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.109+0000 7f0be3400700 1 -- 172.21.15.32:0/1867168171 <== osd.1 v2:172.21.15.32:6800/1416437982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0bec0c5b60 con 0x7f0bcc06ff90 2024-09-13T18:47:40.119 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:40.119 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:40.119 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:40.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0bcc06ff90 msgr2=0x7f0bcc072430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.32:6800/1416437982,v1:172.21.15.32:6801/1416437982] conn(0x7f0bcc06ff90 0x7f0bcc072430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0bcc066730 msgr2=0x7f0bcc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f0bcc066730 0x7f0bcc068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0bec154dc0 tx=0x7f0bd8009040 comp rx=0 tx=0).stop 2024-09-13T18:47:40.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec070a20 msgr2=0x7f0bec0c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.120 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 --2- 172.21.15.32:0/1867168171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bec070a20 0x7f0bec0c3210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0bec067d90 tx=0x7f0bdc004770 comp rx=0 tx=0).stop 2024-09-13T18:47:40.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bebe00700 1 -- 172.21.15.32:0/1867168171 reap_dead start 2024-09-13T18:47:40.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 shutdown_connections 2024-09-13T18:47:40.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 >> 172.21.15.32:0/1867168171 conn(0x7f0bec0c78b0 msgr2=0x7f0bec0c0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 shutdown_connections 2024-09-13T18:47:40.121 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.113+0000 7f0bf0a00700 1 -- 172.21.15.32:0/1867168171 wait complete. 2024-09-13T18:47:40.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:47:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.345+0000 7ff3cdc00700 1 Processor -- start 2024-09-13T18:47:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.345+0000 7ff3cdc00700 1 -- start start 2024-09-13T18:47:40.355 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3cdc00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3c80724c0 0x7ff3c806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3cdc00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7ff3c815a240 0x7ff3c8163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3cdc00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c81599b0 con 0x7ff3c8159e40 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3cdc00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80c9090 con 0x7ff3c80724c0 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3cdc00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c815dc20 con 0x7ff3c815a240 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3c80724c0 0x7ff3c806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7400700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7ff3c8159e40 0x7ff3c80c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52348/0 (socket says 172.21.15.32:52348) 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7400700 1 -- 172.21.15.32:0/4107272816 learned_addr learned my addr 172.21.15.32:0/4107272816 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3cd200700 1 --2- 172.21.15.32:0/4107272816 >> v2:172.21.15.86:3300/0 conn(0x7ff3c815a240 0x7ff3c8163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c6a00700 1 -- 172.21.15.32:0/4107272816 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131131113 0 0) 0x7ff3c81599b0 con 0x7ff3c8159e40 2024-09-13T18:47:40.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7e00700 1 -- 172.21.15.32:0/4107272816 >> v2:172.21.15.86:3300/0 conn(0x7ff3c815a240 msgr2=0x7ff3c8163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7e00700 1 --2- 172.21.15.32:0/4107272816 >> v2:172.21.15.86:3300/0 conn(0x7ff3c815a240 0x7ff3c8163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7e00700 1 -- 172.21.15.32:0/4107272816 >> v1:172.21.15.86:6789/0 conn(0x7ff3c8159e40 legacy=0x7ff3c80c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.357 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7e00700 1 -- 172.21.15.32:0/4107272816 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80728a0 con 0x7ff3c80724c0 2024-09-13T18:47:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c7e00700 1 --2- 172.21.15.32:0/4107272816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c80724c0 0x7ff3c806fc10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8070a20 tx=0x7ff3b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9a15dee7bee342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c6a00700 1 -- 172.21.15.32:0/4107272816 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8011830 con 0x7ff3c80724c0 2024-09-13T18:47:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c6a00700 1 -- 172.21.15.32:0/4107272816 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8011990 con 0x7ff3c80724c0 2024-09-13T18:47:40.358 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.349+0000 7ff3c6a00700 1 -- 172.21.15.32:0/4107272816 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8011d20 con 0x7ff3c80724c0 2024-09-13T18:47:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 -- 172.21.15.32:0/4107272816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c80724c0 msgr2=0x7ff3c806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/4107272816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c80724c0 0x7ff3c806fc10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8070a20 tx=0x7ff3b8009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 -- 172.21.15.32:0/4107272816 shutdown_connections 2024-09-13T18:47:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/4107272816 >> v2:172.21.15.86:3300/0 conn(0x7ff3c815a240 0x7ff3c8163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/4107272816 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c80724c0 0x7ff3c806fc10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.359 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 -- 172.21.15.32:0/4107272816 >> 172.21.15.32:0/4107272816 conn(0x7ff3c80cac60 msgr2=0x7ff3c80cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 -- 172.21.15.32:0/4107272816 shutdown_connections 2024-09-13T18:47:40.360 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 -- 172.21.15.32:0/4107272816 wait complete. 2024-09-13T18:47:40.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 Processor -- start 2024-09-13T18:47:40.362 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.353+0000 7ff3cdc00700 1 -- start start 2024-09-13T18:47:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 0x7ff3c81e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3c8159e40 0x7ff3c8157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 0x7ff3c81f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81e5440 con 0x7ff3c815a240 2024-09-13T18:47:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8152950 con 0x7ff3c80724c0 2024-09-13T18:47:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81f28c0 con 0x7ff3c8159e40 2024-09-13T18:47:40.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cd200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 0x7ff3c81f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3c8159e40 0x7ff3c8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.366 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 0x7ff3c81e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 0x7ff3c81e4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51770/0 (socket says 172.21.15.32:51770) 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3c8159e40 0x7ff3c8157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59902/0 (socket says 172.21.15.32:59902) 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 -- 172.21.15.32:0/3122785114 learned_addr learned my addr 172.21.15.32:0/3122785114 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cd200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 0x7ff3c81f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33858/0 (socket says 172.21.15.32:33858) 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 -- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3c8159e40 msgr2=0x7ff3c8157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3c8159e40 0x7ff3c8157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 -- 172.21.15.32:0/3122785114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 msgr2=0x7ff3c81f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 0x7ff3c81f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 -- 172.21.15.32:0/3122785114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80094b0 con 0x7ff3c80724c0 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cd200700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 0x7ff3c81f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3c7e00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 0x7ff3c81e4f00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80c76c0 tx=0x7ff3b8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8004400 con 0x7ff3c80724c0 2024-09-13T18:47:40.367 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b801f070 con 0x7ff3c80724c0 2024-09-13T18:47:40.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c81e3eb0 con 0x7ff3c80724c0 2024-09-13T18:47:40.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.357+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8003900 con 0x7ff3c80724c0 2024-09-13T18:47:40.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.361+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c8157bb0 con 0x7ff3c80724c0 2024-09-13T18:47:40.368 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.361+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c815d660 con 0x7ff3c80724c0 2024-09-13T18:47:40.370 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.361+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3b8021030 con 0x7ff3c80724c0 2024-09-13T18:47:40.371 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.365+0000 7ff3bfe00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff3a8066760 0x7ff3a8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.365+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7ff3b80857f0 con 0x7ff3c80724c0 2024-09-13T18:47:40.372 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.365+0000 7ff3c7400700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff3a8066760 0x7ff3a8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.373 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.365+0000 7ff3c7400700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff3a8066760 0x7ff3a8068c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80ca960 tx=0x7ff3b4007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.381 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.373+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3b80528f0 con 0x7ff3c80724c0 2024-09-13T18:47:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.565+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3c80c6340 con 0x7ff3a8066760 2024-09-13T18:47:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.565+0000 7ff3bfe00700 1 -- 172.21.15.32:0/3122785114 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff3c80c6340 con 0x7ff3a8066760 2024-09-13T18:47:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff3a8066760 msgr2=0x7ff3a8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff3a8066760 0x7ff3a8068c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80ca960 tx=0x7ff3b4007e00 comp rx=0 tx=0).stop 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 msgr2=0x7ff3c81e4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 0x7ff3c81e4f00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80c76c0 tx=0x7ff3b8004770 comp rx=0 tx=0).stop 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 shutdown_connections 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7ff3a8066760 0x7ff3a8068c20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3c815a240 0x7ff3c81f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3c8159e40 0x7ff3c8157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 --2- 172.21.15.32:0/3122785114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3c80724c0 0x7ff3c81e4f00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 >> 172.21.15.32:0/3122785114 conn(0x7ff3c80cac60 msgr2=0x7ff3c8158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 shutdown_connections 2024-09-13T18:47:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.569+0000 7ff3cdc00700 1 -- 172.21.15.32:0/3122785114 wait complete. 2024-09-13T18:47:40.578 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:47:40.596 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:47:40.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:40.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 Processor -- start 2024-09-13T18:47:40.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 -- start start 2024-09-13T18:47:40.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f3b200c68f0 0x7f3b20157570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3b20157ab0 0x7f3b20073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2006fa10 con 0x7f3b201518f0 2024-09-13T18:47:40.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200c7670 con 0x7f3b20157ab0 2024-09-13T18:47:40.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.765+0000 7f3b1f200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200c8400 con 0x7f3b200c68f0 2024-09-13T18:47:40.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1de00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3b201518f0 0x7f3b2015b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52700/0 (socket says 172.21.15.32:52700) 2024-09-13T18:47:40.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1de00700 1 -- 172.21.15.32:0/2494260349 learned_addr learned my addr 172.21.15.32:0/2494260349 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:40.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1e800700 1 --2- 172.21.15.32:0/2494260349 >> v2:172.21.15.32:3300/0 conn(0x7f3b20157ab0 0x7f3b20073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1d400700 1 --2- 172.21.15.32:0/2494260349 >> v2:172.21.15.86:3300/0 conn(0x7f3b200c68f0 0x7f3b20157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1ca00700 1 -- 172.21.15.32:0/2494260349 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659778912 0 0) 0x7f3b2006fa10 con 0x7f3b201518f0 2024-09-13T18:47:40.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1ca00700 1 -- 172.21.15.32:0/2494260349 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b040035d0 con 0x7f3b201518f0 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1e800700 1 -- 172.21.15.32:0/2494260349 >> v2:172.21.15.86:3300/0 conn(0x7f3b200c68f0 msgr2=0x7f3b20157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1e800700 1 --2- 172.21.15.32:0/2494260349 >> v2:172.21.15.86:3300/0 conn(0x7f3b200c68f0 0x7f3b20157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1e800700 1 -- 172.21.15.32:0/2494260349 >> v1:172.21.15.32:6789/0 conn(0x7f3b201518f0 legacy=0x7f3b2015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1e800700 1 -- 172.21.15.32:0/2494260349 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20151cd0 con 0x7f3b20157ab0 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1d400700 1 --2- 172.21.15.32:0/2494260349 >> v2:172.21.15.86:3300/0 conn(0x7f3b200c68f0 0x7f3b20157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1e800700 1 --2- 172.21.15.32:0/2494260349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b20157ab0 0x7f3b20073720 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3b201586a0 tx=0x7f3b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea986b6bcf1076a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1ca00700 1 -- 172.21.15.32:0/2494260349 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800e070 con 0x7f3b20157ab0 2024-09-13T18:47:40.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1ca00700 1 -- 172.21.15.32:0/2494260349 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1800bb20 con 0x7f3b20157ab0 2024-09-13T18:47:40.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.769+0000 7f3b1ca00700 1 -- 172.21.15.32:0/2494260349 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18012430 con 0x7f3b20157ab0 2024-09-13T18:47:40.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 -- 172.21.15.32:0/2494260349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b20157ab0 msgr2=0x7f3b20073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 --2- 172.21.15.32:0/2494260349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b20157ab0 0x7f3b20073720 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3b201586a0 tx=0x7f3b1800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:40.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 -- 172.21.15.32:0/2494260349 shutdown_connections 2024-09-13T18:47:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 --2- 172.21.15.32:0/2494260349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b20157ab0 0x7f3b20073720 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 --2- 172.21.15.32:0/2494260349 >> v2:172.21.15.86:3300/0 conn(0x7f3b200c68f0 0x7f3b20157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 -- 172.21.15.32:0/2494260349 >> 172.21.15.32:0/2494260349 conn(0x7f3b200c89f0 msgr2=0x7f3b200c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 -- 172.21.15.32:0/2494260349 shutdown_connections 2024-09-13T18:47:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 -- 172.21.15.32:0/2494260349 wait complete. 2024-09-13T18:47:40.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 Processor -- start 2024-09-13T18:47:40.781 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.773+0000 7f3b1f200700 1 -- start start 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b200c68f0 0x7f3b20156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b201518f0 0x7f3b200ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b20157ab0 0x7f3b20154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200af9f0 con 0x7f3b200c68f0 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200adcb0 con 0x7f3b201518f0 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200afc40 con 0x7f3b20157ab0 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1de00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b200c68f0 0x7f3b20156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b20157ab0 0x7f3b20154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b20157ab0 0x7f3b20154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59906/0 (socket says 172.21.15.32:59906) 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 -- 172.21.15.32:0/237960723 learned_addr learned my addr 172.21.15.32:0/237960723 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1d400700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b201518f0 0x7f3b200ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 -- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b201518f0 msgr2=0x7f3b200ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b201518f0 0x7f3b200ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 -- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b200c68f0 msgr2=0x7f3b20156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b200c68f0 0x7f3b20156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 -- 172.21.15.32:0/237960723 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18009a70 con 0x7f3b20157ab0 2024-09-13T18:47:40.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1e800700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b20157ab0 0x7f3b20154170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b18014040 tx=0x7f3b18004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18012430 con 0x7f3b20157ab0 2024-09-13T18:47:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18020070 con 0x7f3b20157ab0 2024-09-13T18:47:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18004040 con 0x7f3b20157ab0 2024-09-13T18:47:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b200aff20 con 0x7f3b20157ab0 2024-09-13T18:47:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b200b04e0 con 0x7f3b20157ab0 2024-09-13T18:47:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.777+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b2006ff40 con 0x7f3b20157ab0 2024-09-13T18:47:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b180041a0 con 0x7f3b20157ab0 2024-09-13T18:47:40.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b16000700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3b00066730 0x7f3b00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f3b18022070 con 0x7f3b20157ab0 2024-09-13T18:47:40.790 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b1de00700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3b00066730 0x7f3b00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b16000700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3b0006fe90 0x7f3b00072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b00072a00 con 0x7f3b0006fe90 2024-09-13T18:47:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.781+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b18086970 con 0x7f3b20157ab0 2024-09-13T18:47:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.785+0000 7f3b1d400700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3b0006fe90 0x7f3b00072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.785+0000 7f3b1de00700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3b00066730 0x7f3b00068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3b10007fd0 tx=0x7f3b10007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.792 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.785+0000 7f3b1d400700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3b0006fe90 0x7f3b00072330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.793 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.785+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== osd.2 v2:172.21.15.32:6808/1016396602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3b00072a00 con 0x7f3b0006fe90 2024-09-13T18:47:40.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 --> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b2006fc60 con 0x7f3b0006fe90 2024-09-13T18:47:40.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b16000700 1 -- 172.21.15.32:0/237960723 <== osd.2 v2:172.21.15.32:6808/1016396602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3b0c009a80 con 0x7f3b0006fe90 2024-09-13T18:47:40.812 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:40.812 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:40.813 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3b0006fe90 msgr2=0x7f3b00072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.32:6808/1016396602,v1:172.21.15.32:6809/1016396602] conn(0x7f3b0006fe90 0x7f3b00072330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3b00066730 msgr2=0x7f3b00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f3b00066730 0x7f3b00068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3b10007fd0 tx=0x7f3b10007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b20157ab0 msgr2=0x7f3b20154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 --2- 172.21.15.32:0/237960723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b20157ab0 0x7f3b20154170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b18014040 tx=0x7f3b18004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1e800700 1 -- 172.21.15.32:0/237960723 reap_dead start 2024-09-13T18:47:40.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 shutdown_connections 2024-09-13T18:47:40.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 >> 172.21.15.32:0/237960723 conn(0x7f3b200c89f0 msgr2=0x7f3b2006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 shutdown_connections 2024-09-13T18:47:40.815 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:40.805+0000 7f3b1f200700 1 -- 172.21.15.32:0/237960723 wait complete. 2024-09-13T18:47:40.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 Processor -- start 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 -- start start 2024-09-13T18:47:41.033 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f6184071360 0x7f6184070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6184071ef0 0x7f6184072380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61841620d0 con 0x7f6184157fb0 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61840c5fa0 con 0x7f6184071ef0 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61840cb990 con 0x7f6184071360 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6182a00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6184157fb0 0x7f618415dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52364/0 (socket says 172.21.15.32:52364) 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6182a00700 1 -- 172.21.15.32:0/69559855 learned_addr learned my addr 172.21.15.32:0/69559855 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6183400700 1 --2- 172.21.15.32:0/69559855 >> v2:172.21.15.32:3300/0 conn(0x7f6184071ef0 0x7f6184072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.025+0000 7f6182000700 1 --2- 172.21.15.32:0/69559855 >> v2:172.21.15.86:3300/0 conn(0x7f6184071360 0x7f6184070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6181600700 1 -- 172.21.15.32:0/69559855 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995638579 0 0) 0x7f61841620d0 con 0x7f6184157fb0 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6181600700 1 -- 172.21.15.32:0/69559855 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61680035d0 con 0x7f6184157fb0 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6182000700 1 -- 172.21.15.32:0/69559855 >> v2:172.21.15.32:3300/0 conn(0x7f6184071ef0 msgr2=0x7f6184072380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6182000700 1 --2- 172.21.15.32:0/69559855 >> v2:172.21.15.32:3300/0 conn(0x7f6184071ef0 0x7f6184072380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6182000700 1 -- 172.21.15.32:0/69559855 >> v1:172.21.15.86:6789/0 conn(0x7f6184157fb0 legacy=0x7f618415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6182000700 1 -- 172.21.15.32:0/69559855 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840b46a0 con 0x7f6184071360 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6182000700 1 --2- 172.21.15.32:0/69559855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184071360 0x7f6184070560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f61840d0180 tx=0x7f6170009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af85f13d472cf583 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6181600700 1 -- 172.21.15.32:0/69559855 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170011830 con 0x7f6184071360 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6181600700 1 -- 172.21.15.32:0/69559855 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6170011990 con 0x7f6184071360 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6181600700 1 -- 172.21.15.32:0/69559855 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170011d20 con 0x7f6184071360 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 -- 172.21.15.32:0/69559855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184071360 msgr2=0x7f6184070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 --2- 172.21.15.32:0/69559855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184071360 0x7f6184070560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f61840d0180 tx=0x7f6170009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 -- 172.21.15.32:0/69559855 shutdown_connections 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 --2- 172.21.15.32:0/69559855 >> v2:172.21.15.32:3300/0 conn(0x7f6184071ef0 0x7f6184072380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 --2- 172.21.15.32:0/69559855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184071360 0x7f6184070560 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 -- 172.21.15.32:0/69559855 >> 172.21.15.32:0/69559855 conn(0x7f61840cbfe0 msgr2=0x7f61840cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 -- 172.21.15.32:0/69559855 shutdown_connections 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.029+0000 7f6183e00700 1 -- 172.21.15.32:0/69559855 wait complete. 2024-09-13T18:47:41.040 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.033+0000 7f6183e00700 1 Processor -- start 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.033+0000 7f6183e00700 1 -- start start 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6184071360 0x7f61841f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 0x7f61841527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184157fb0 0x7f6184160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841f7490 con 0x7f6184071360 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6184152d00 con 0x7f6184157fb0 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61840c69c0 con 0x7f6184071ef0 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6184071360 0x7f61841f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 0x7f61841527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 0x7f61841527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59914/0 (socket says 172.21.15.32:59914) 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 -- 172.21.15.32:0/199848216 learned_addr learned my addr 172.21.15.32:0/199848216 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183400700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184157fb0 0x7f6184160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 -- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184157fb0 msgr2=0x7f6184160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184157fb0 0x7f6184160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 -- 172.21.15.32:0/199848216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6184071360 msgr2=0x7f61841f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6184071360 0x7f61841f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 -- 172.21.15.32:0/199848216 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700094b0 con 0x7f6184071ef0 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6182000700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 0x7f61841527c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6170009b70 tx=0x7f6170004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170004380 con 0x7f6184071ef0 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617001f070 con 0x7f6184071ef0 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61840c6ca0 con 0x7f6184071ef0 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700036c0 con 0x7f6184071ef0 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.037+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6184151fc0 con 0x7f6184071ef0 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.041+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61840c71c0 con 0x7f6184071ef0 2024-09-13T18:47:41.049 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.041+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6170021030 con 0x7f6184071ef0 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.045+0000 7f617aa00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6164066760 0x7f6164068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.045+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f61700850e0 con 0x7f6184071ef0 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.045+0000 7f6182a00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6164066760 0x7f6164068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.052 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.045+0000 7f6182a00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6164066760 0x7f6164068c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6174007fd0 tx=0x7f6174007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.049+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61700520d0 con 0x7f6184071ef0 2024-09-13T18:47:41.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.237+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6184158390 con 0x7f6164066760 2024-09-13T18:47:41.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.237+0000 7f617aa00700 1 -- 172.21.15.32:0/199848216 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6174006bf0 con 0x7f6164066760 2024-09-13T18:47:41.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6164066760 msgr2=0x7f6164068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6164066760 0x7f6164068c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6174007fd0 tx=0x7f6174007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.247 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 msgr2=0x7f61841527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 0x7f61841527c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6170009b70 tx=0x7f6170004770 comp rx=0 tx=0).stop 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 shutdown_connections 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6164066760 0x7f6164068c20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6184157fb0 0x7f6184160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6184071ef0 0x7f61841527c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 --2- 172.21.15.32:0/199848216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6184071360 0x7f61841f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 >> 172.21.15.32:0/199848216 conn(0x7f61840cbfe0 msgr2=0x7f61840cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.248 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 shutdown_connections 2024-09-13T18:47:41.249 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.241+0000 7f6183e00700 1 -- 172.21.15.32:0/199848216 wait complete. 2024-09-13T18:47:41.250 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:47:41.271 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:47:41.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:41.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.473+0000 7f9b45000700 1 Processor -- start 2024-09-13T18:47:41.480 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.473+0000 7f9b45000700 1 -- start start 2024-09-13T18:47:41.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b45000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b401507a0 0x7f9b4006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b45000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b400c7ca0 0x7f9b40159e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b45000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4006d5a0 con 0x7f9b4006e940 2024-09-13T18:47:41.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b45000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b40150b80 con 0x7f9b400c7ca0 2024-09-13T18:47:41.483 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b45000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b40159a40 con 0x7f9b401507a0 2024-09-13T18:47:41.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b401507a0 0x7f9b4006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9b401507a0 0x7f9b4006ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51814/0 (socket says 172.21.15.32:51814) 2024-09-13T18:47:41.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 -- 172.21.15.32:0/65561128 learned_addr learned my addr 172.21.15.32:0/65561128 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:41.484 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3fe00700 1 --2- 172.21.15.32:0/65561128 >> v2:172.21.15.32:3300/0 conn(0x7f9b400c7ca0 0x7f9b40159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 -- 172.21.15.32:0/65561128 >> v2:172.21.15.32:3300/0 conn(0x7f9b400c7ca0 msgr2=0x7f9b40159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 --2- 172.21.15.32:0/65561128 >> v2:172.21.15.32:3300/0 conn(0x7f9b400c7ca0 0x7f9b40159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.485 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 -- 172.21.15.32:0/65561128 >> v1:172.21.15.86:6789/0 conn(0x7f9b4006e940 legacy=0x7f9b400718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 -- 172.21.15.32:0/65561128 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4006d880 con 0x7f9b401507a0 2024-09-13T18:47:41.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3e000700 1 -- 172.21.15.32:0/65561128 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194860444 0 0) 0x7f9b4006d5a0 con 0x7f9b4006e940 2024-09-13T18:47:41.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3f400700 1 --2- 172.21.15.32:0/65561128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 0x7f9b4006ee20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b400cce80 tx=0x7f9b30009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47205067987d83f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3e000700 1 -- 172.21.15.32:0/65561128 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011830 con 0x7f9b401507a0 2024-09-13T18:47:41.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3e000700 1 -- 172.21.15.32:0/65561128 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30011990 con 0x7f9b401507a0 2024-09-13T18:47:41.486 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.477+0000 7f9b3e000700 1 -- 172.21.15.32:0/65561128 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011d20 con 0x7f9b401507a0 2024-09-13T18:47:41.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 -- 172.21.15.32:0/65561128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 msgr2=0x7f9b4006ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.487 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 --2- 172.21.15.32:0/65561128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 0x7f9b4006ee20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b400cce80 tx=0x7f9b30009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 -- 172.21.15.32:0/65561128 shutdown_connections 2024-09-13T18:47:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 --2- 172.21.15.32:0/65561128 >> v2:172.21.15.32:3300/0 conn(0x7f9b400c7ca0 0x7f9b40159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 --2- 172.21.15.32:0/65561128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 0x7f9b4006ee20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 -- 172.21.15.32:0/65561128 >> 172.21.15.32:0/65561128 conn(0x7f9b400c89f0 msgr2=0x7f9b400c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 -- 172.21.15.32:0/65561128 shutdown_connections 2024-09-13T18:47:41.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.481+0000 7f9b45000700 1 -- 172.21.15.32:0/65561128 wait complete. 2024-09-13T18:47:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 Processor -- start 2024-09-13T18:47:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 -- start start 2024-09-13T18:47:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b4006e940 0x7f9b40158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b400c7ca0 0x7f9b401f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 0x7f9b4006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401586d0 con 0x7f9b4006e940 2024-09-13T18:47:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40143890 con 0x7f9b401507a0 2024-09-13T18:47:41.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b45000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401f34d0 con 0x7f9b400c7ca0 2024-09-13T18:47:41.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b4006e940 0x7f9b40158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 0x7f9b4006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b4006e940 0x7f9b40158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33926/0 (socket says 172.21.15.32:33926) 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b400c7ca0 0x7f9b401f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 -- 172.21.15.32:0/3106816519 learned_addr learned my addr 172.21.15.32:0/3106816519 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 -- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b400c7ca0 msgr2=0x7f9b401f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9b400c7ca0 0x7f9b401f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 -- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 msgr2=0x7f9b4006fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b401507a0 0x7f9b4006fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.485+0000 7f9b3f400700 1 -- 172.21.15.32:0/3106816519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30009570 con 0x7f9b4006e940 2024-09-13T18:47:41.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b3f400700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b4006e940 0x7f9b40158190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b400cbe30 tx=0x7f9b30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30004380 con 0x7f9b4006e940 2024-09-13T18:47:41.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b40158b00 con 0x7f9b4006e940 2024-09-13T18:47:41.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3001f070 con 0x7f9b4006e940 2024-09-13T18:47:41.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300036c0 con 0x7f9b4006e940 2024-09-13T18:47:41.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b40143e90 con 0x7f9b4006e940 2024-09-13T18:47:41.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.489+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b400c9370 con 0x7f9b4006e940 2024-09-13T18:47:41.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b30021030 con 0x7f9b4006e940 2024-09-13T18:47:41.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b37400700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9b20066730 0x7f9b20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.501 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9b300853a0 con 0x7f9b4006e940 2024-09-13T18:47:41.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b3ea00700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9b20066730 0x7f9b20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b37400700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9b2006fe90 0x7f9b20072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b20072a00 con 0x7f9b2006fe90 2024-09-13T18:47:41.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b30087980 con 0x7f9b4006e940 2024-09-13T18:47:41.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.493+0000 7f9b3fe00700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9b2006fe90 0x7f9b20072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.497+0000 7f9b3ea00700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9b20066730 0x7f9b20068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9b400b1650 tx=0x7f9b2c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.497+0000 7f9b3fe00700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9b2006fe90 0x7f9b20072330 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.497+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== osd.3 v2:172.21.15.32:6824/2476570305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9b20072a00 con 0x7f9b2006fe90 2024-09-13T18:47:41.524 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 --> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b400c76b0 con 0x7f9b2006fe90 2024-09-13T18:47:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b37400700 1 -- 172.21.15.32:0/3106816519 <== osd.3 v2:172.21.15.32:6824/2476570305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9b400c76b0 con 0x7f9b2006fe90 2024-09-13T18:47:41.525 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:41.525 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9b2006fe90 msgr2=0x7f9b20072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:6824/2476570305,v1:172.21.15.32:6825/2476570305] conn(0x7f9b2006fe90 0x7f9b20072330 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9b20066730 msgr2=0x7f9b20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9b20066730 0x7f9b20068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9b400b1650 tx=0x7f9b2c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b4006e940 msgr2=0x7f9b40158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 --2- 172.21.15.32:0/3106816519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b4006e940 0x7f9b40158190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b400cbe30 tx=0x7f9b30004770 comp rx=0 tx=0).stop 2024-09-13T18:47:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b3fe00700 1 -- 172.21.15.32:0/3106816519 reap_dead start 2024-09-13T18:47:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 shutdown_connections 2024-09-13T18:47:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.517+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 >> 172.21.15.32:0/3106816519 conn(0x7f9b400c89f0 msgr2=0x7f9b400718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.521+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 shutdown_connections 2024-09-13T18:47:41.527 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.521+0000 7f9b45000700 1 -- 172.21.15.32:0/3106816519 wait complete. 2024-09-13T18:47:41.549 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:47:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.729+0000 7feb33e00700 1 Processor -- start 2024-09-13T18:47:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.729+0000 7feb33e00700 1 -- start start 2024-09-13T18:47:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7feb3406fac0 0x7feb3406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340c9440 con 0x7feb340c9e90 2024-09-13T18:47:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340c7aa0 con 0x7feb3406ea50 2024-09-13T18:47:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb340c9a70 con 0x7feb3406fac0 2024-09-13T18:47:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb32000700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7feb340c9e90 0x7feb340ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52708/0 (socket says 172.21.15.32:52708) 2024-09-13T18:47:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb32000700 1 -- 172.21.15.32:0/1806796707 learned_addr learned my addr 172.21.15.32:0/1806796707 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb32a00700 1 --1- 172.21.15.32:0/1806796707 >> v1:172.21.15.86:6789/0 conn(0x7feb3406ea50 0x7feb3415aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52386/0 (socket says 172.21.15.32:52386) 2024-09-13T18:47:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33400700 1 --2- 172.21.15.32:0/1806796707 >> v2:172.21.15.86:3300/0 conn(0x7feb3406fac0 0x7feb3406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33400700 1 -- 172.21.15.32:0/1806796707 >> v1:172.21.15.86:6789/0 conn(0x7feb3406ea50 legacy=0x7feb3415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33400700 1 -- 172.21.15.32:0/1806796707 >> v1:172.21.15.32:6789/0 conn(0x7feb340c9e90 legacy=0x7feb340ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33400700 1 -- 172.21.15.32:0/1806796707 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340c7d60 con 0x7feb3406fac0 2024-09-13T18:47:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.733+0000 7feb33400700 1 --2- 172.21.15.32:0/1806796707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406fac0 0x7feb3406ff70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009d90 tx=0x7feb2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe7c77cf4165c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb31600700 1 -- 172.21.15.32:0/1806796707 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c00e070 con 0x7feb3406fac0 2024-09-13T18:47:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb31600700 1 -- 172.21.15.32:0/1806796707 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c00bbd0 con 0x7feb3406fac0 2024-09-13T18:47:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb31600700 1 -- 172.21.15.32:0/1806796707 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c012430 con 0x7feb3406fac0 2024-09-13T18:47:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 -- 172.21.15.32:0/1806796707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406fac0 msgr2=0x7feb3406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 --2- 172.21.15.32:0/1806796707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406fac0 0x7feb3406ff70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009d90 tx=0x7feb2c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 -- 172.21.15.32:0/1806796707 shutdown_connections 2024-09-13T18:47:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 --2- 172.21.15.32:0/1806796707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406fac0 0x7feb3406ff70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 -- 172.21.15.32:0/1806796707 >> 172.21.15.32:0/1806796707 conn(0x7feb340cac60 msgr2=0x7feb340cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 -- 172.21.15.32:0/1806796707 shutdown_connections 2024-09-13T18:47:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.737+0000 7feb33e00700 1 -- 172.21.15.32:0/1806796707 wait complete. 2024-09-13T18:47:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 Processor -- start 2024-09-13T18:47:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 -- start start 2024-09-13T18:47:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406ea50 0x7feb340ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb3406fac0 0x7feb340c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 0x7feb341eea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3414f660 con 0x7feb340c9e90 2024-09-13T18:47:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb340c20b0 con 0x7feb3406ea50 2024-09-13T18:47:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb340c2e00 con 0x7feb3406fac0 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb32a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406ea50 0x7feb340ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 0x7feb341eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 0x7feb341eea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33940/0 (socket says 172.21.15.32:33940) 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb33400700 1 -- 172.21.15.32:0/629974933 learned_addr learned my addr 172.21.15.32:0/629974933 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb32000700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb3406fac0 0x7feb340c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.741+0000 7feb32a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406ea50 0x7feb340ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51830/0 (socket says 172.21.15.32:51830) 2024-09-13T18:47:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33400700 1 -- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb3406fac0 msgr2=0x7feb340c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33400700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb3406fac0 0x7feb340c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33400700 1 -- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406ea50 msgr2=0x7feb340ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33400700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406ea50 0x7feb340ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33400700 1 -- 172.21.15.32:0/629974933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009a70 con 0x7feb340c9e90 2024-09-13T18:47:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33400700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 0x7feb341eea70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b370 tx=0x7feb2c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c012430 con 0x7feb340c9e90 2024-09-13T18:47:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c020070 con 0x7feb340c9e90 2024-09-13T18:47:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb340c2320 con 0x7feb340c9e90 2024-09-13T18:47:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c004040 con 0x7feb340c9e90 2024-09-13T18:47:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb340c28e0 con 0x7feb340c9e90 2024-09-13T18:47:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.745+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb340c9090 con 0x7feb340c9e90 2024-09-13T18:47:41.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.749+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb2c0041a0 con 0x7feb340c9e90 2024-09-13T18:47:41.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.749+0000 7feb2aa00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb10066760 0x7feb10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.749+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7feb2c022070 con 0x7feb340c9e90 2024-09-13T18:47:41.757 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.749+0000 7feb32a00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb10066760 0x7feb10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.749+0000 7feb32a00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb10066760 0x7feb10068c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb24004e50 tx=0x7feb24007ef0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.757+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb2c053310 con 0x7feb340c9e90 2024-09-13T18:47:41.948 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.941+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7feb340caa10 con 0x7feb10066760 2024-09-13T18:47:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.941+0000 7feb2aa00700 1 -- 172.21.15.32:0/629974933 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feb240133f0 con 0x7feb10066760 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb10066760 msgr2=0x7feb10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb10066760 0x7feb10068c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb24004e50 tx=0x7feb24007ef0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 msgr2=0x7feb341eea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 0x7feb341eea70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00b370 tx=0x7feb2c004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 shutdown_connections 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feb10066760 0x7feb10068c20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feb340c9e90 0x7feb341eea70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.956 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb3406fac0 0x7feb340c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 --2- 172.21.15.32:0/629974933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb3406ea50 0x7feb340ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 >> 172.21.15.32:0/629974933 conn(0x7feb340cac60 msgr2=0x7feb340afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 shutdown_connections 2024-09-13T18:47:41.957 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:41.945+0000 7feb33e00700 1 -- 172.21.15.32:0/629974933 wait complete. 2024-09-13T18:47:41.957 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:47:41.977 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:47:41.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:42.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.157+0000 7fe09a800700 1 Processor -- start 2024-09-13T18:47:42.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe09a800700 1 -- start start 2024-09-13T18:47:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe09a800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fe094157c50 0x7fe09415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe09a800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0940ca2a0 0x7fe0940b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe09a800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09415e080 con 0x7fe0940c9ec0 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe09a800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0940b3ee0 con 0x7fe094157c50 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe09a800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415e320 con 0x7fe0940ca2a0 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe098a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe0940c9ec0 0x7fe0940b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52720/0 (socket says 172.21.15.32:52720) 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe098a00700 1 -- 172.21.15.32:0/2608165674 learned_addr learned my addr 172.21.15.32:0/2608165674 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe099400700 1 --2- 172.21.15.32:0/2608165674 >> v2:172.21.15.86:3300/0 conn(0x7fe094157c50 0x7fe09415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe099e00700 1 --2- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0940ca2a0 0x7fe0940b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe093e00700 1 -- 172.21.15.32:0/2608165674 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700364000 0 0) 0x7fe09415e080 con 0x7fe0940c9ec0 2024-09-13T18:47:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe093e00700 1 -- 172.21.15.32:0/2608165674 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe07c0035d0 con 0x7fe0940c9ec0 2024-09-13T18:47:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe099400700 1 -- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0940ca2a0 msgr2=0x7fe0940b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe099400700 1 --2- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0940ca2a0 0x7fe0940b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe099400700 1 -- 172.21.15.32:0/2608165674 >> v1:172.21.15.32:6789/0 conn(0x7fe0940c9ec0 legacy=0x7fe0940b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.161+0000 7fe099400700 1 -- 172.21.15.32:0/2608165674 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09415e600 con 0x7fe094157c50 2024-09-13T18:47:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe099400700 1 --2- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe094157c50 0x7fe09415d9f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe088009850 tx=0x7fe088009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414bf4893e18142d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe093e00700 1 -- 172.21.15.32:0/2608165674 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088011830 con 0x7fe094157c50 2024-09-13T18:47:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe093e00700 1 -- 172.21.15.32:0/2608165674 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088011990 con 0x7fe094157c50 2024-09-13T18:47:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe093e00700 1 -- 172.21.15.32:0/2608165674 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088011d40 con 0x7fe094157c50 2024-09-13T18:47:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 -- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe094157c50 msgr2=0x7fe09415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 --2- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe094157c50 0x7fe09415d9f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe088009850 tx=0x7fe088009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 -- 172.21.15.32:0/2608165674 shutdown_connections 2024-09-13T18:47:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 --2- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe0940ca2a0 0x7fe0940b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 --2- 172.21.15.32:0/2608165674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe094157c50 0x7fe09415d9f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 -- 172.21.15.32:0/2608165674 >> 172.21.15.32:0/2608165674 conn(0x7fe094071dc0 msgr2=0x7fe0940721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 -- 172.21.15.32:0/2608165674 shutdown_connections 2024-09-13T18:47:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.165+0000 7fe09a800700 1 -- 172.21.15.32:0/2608165674 wait complete. 2024-09-13T18:47:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 Processor -- start 2024-09-13T18:47:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 -- start start 2024-09-13T18:47:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0940c9ec0 0x7fe094158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0940ca2a0 0x7fe0941f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe094157c50 0x7fe0940c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0941f72b0 con 0x7fe0940c9ec0 2024-09-13T18:47:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0941613c0 con 0x7fe0940ca2a0 2024-09-13T18:47:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe09a800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0941616a0 con 0x7fe094157c50 2024-09-13T18:47:42.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0940c9ec0 0x7fe094158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe094157c50 0x7fe0940c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe098a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0940ca2a0 0x7fe0941f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe094157c50 0x7fe0940c3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59952/0 (socket says 172.21.15.32:59952) 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 -- 172.21.15.32:0/2376654874 learned_addr learned my addr 172.21.15.32:0/2376654874 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 -- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0940ca2a0 msgr2=0x7fe0941f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe0940ca2a0 0x7fe0941f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 -- 172.21.15.32:0/2376654874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0940c9ec0 msgr2=0x7fe094158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0940c9ec0 0x7fe094158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099e00700 1 -- 172.21.15.32:0/2376654874 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880094b0 con 0x7fe094157c50 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.169+0000 7fe099400700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0940c9ec0 0x7fe094158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:42.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe099e00700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe094157c50 0x7fe0940c3320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00ef90 tx=0x7fe08c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00cc90 con 0x7fe094157c50 2024-09-13T18:47:42.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c00f040 con 0x7fe094157c50 2024-09-13T18:47:42.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c014480 con 0x7fe094157c50 2024-09-13T18:47:42.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09415f660 con 0x7fe094157c50 2024-09-13T18:47:42.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe094160720 con 0x7fe094157c50 2024-09-13T18:47:42.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.173+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe094158030 con 0x7fe094157c50 2024-09-13T18:47:42.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe08c0145e0 con 0x7fe094157c50 2024-09-13T18:47:42.184 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe091600700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe074066730 0x7fe074068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fe08c085a90 con 0x7fe094157c50 2024-09-13T18:47:42.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe099400700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe074066730 0x7fe074068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe091600700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fe07406fe90 0x7fe074072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe074072a00 con 0x7fe07406fe90 2024-09-13T18:47:42.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe08c085e00 con 0x7fe094157c50 2024-09-13T18:47:42.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe098a00700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fe07406fe90 0x7fe074072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.177+0000 7fe099400700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe074066730 0x7fe074068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe0880090b0 tx=0x7fe08801c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.181+0000 7fe098a00700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fe07406fe90 0x7fe074072330 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.181+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== osd.4 v2:172.21.15.86:6808/838245911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe074072a00 con 0x7fe07406fe90 2024-09-13T18:47:42.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 --> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe0940b3b00 con 0x7fe07406fe90 2024-09-13T18:47:42.208 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe091600700 1 -- 172.21.15.32:0/2376654874 <== osd.4 v2:172.21.15.86:6808/838245911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe080004890 con 0x7fe07406fe90 2024-09-13T18:47:42.209 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:42.209 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:42.209 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fe07406fe90 msgr2=0x7fe074072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6808/838245911,v1:172.21.15.86:6811/838245911] conn(0x7fe07406fe90 0x7fe074072330 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe074066730 msgr2=0x7fe074068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe074066730 0x7fe074068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe0880090b0 tx=0x7fe08801c040 comp rx=0 tx=0).stop 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe094157c50 msgr2=0x7fe0940c3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 --2- 172.21.15.32:0/2376654874 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe094157c50 0x7fe0940c3320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00ef90 tx=0x7fe08c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe099e00700 1 -- 172.21.15.32:0/2376654874 reap_dead start 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 shutdown_connections 2024-09-13T18:47:42.210 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 >> 172.21.15.32:0/2376654874 conn(0x7fe094071dc0 msgr2=0x7fe09415b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 shutdown_connections 2024-09-13T18:47:42.211 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.201+0000 7fe09a800700 1 -- 172.21.15.32:0/2376654874 wait complete. 2024-09-13T18:47:42.238 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:47:42.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 Processor -- start 2024-09-13T18:47:42.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 -- start start 2024-09-13T18:47:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1dc06ea50 0x7fb1dc15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1dc0c9e90 0x7fb1dc0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc0c9440 con 0x7fb1dc0ca840 2024-09-13T18:47:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc0c9a70 con 0x7fb1dc06ea50 2024-09-13T18:47:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.409+0000 7fb1e2400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc0c7aa0 con 0x7fb1dc0c9e90 2024-09-13T18:47:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1dc06ea50 0x7fb1dc15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1dbe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1dc0c9e90 0x7fb1dc0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1a00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7fb1dc0ca840 0x7fb1dc06fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52398/0 (socket says 172.21.15.32:52398) 2024-09-13T18:47:42.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1a00700 1 -- 172.21.15.32:0/1142097645 learned_addr learned my addr 172.21.15.32:0/1142097645 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1db400700 1 -- 172.21.15.32:0/1142097645 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498362815 0 0) 0x7fb1dc0c9440 con 0x7fb1dc0ca840 2024-09-13T18:47:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1000700 1 -- 172.21.15.32:0/1142097645 >> v2:172.21.15.86:3300/0 conn(0x7fb1dc0c9e90 msgr2=0x7fb1dc0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1000700 1 --2- 172.21.15.32:0/1142097645 >> v2:172.21.15.86:3300/0 conn(0x7fb1dc0c9e90 0x7fb1dc0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1000700 1 -- 172.21.15.32:0/1142097645 >> v1:172.21.15.86:6789/0 conn(0x7fb1dc0ca840 legacy=0x7fb1dc06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1000700 1 -- 172.21.15.32:0/1142097645 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0c7d60 con 0x7fb1dc06ea50 2024-09-13T18:47:42.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e1000700 1 --2- 172.21.15.32:0/1142097645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc15aa70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0c9390 tx=0x7fb1d0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc445d87e7a4be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1db400700 1 -- 172.21.15.32:0/1142097645 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011830 con 0x7fb1dc06ea50 2024-09-13T18:47:42.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1db400700 1 -- 172.21.15.32:0/1142097645 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0011990 con 0x7fb1dc06ea50 2024-09-13T18:47:42.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1db400700 1 -- 172.21.15.32:0/1142097645 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011d20 con 0x7fb1dc06ea50 2024-09-13T18:47:42.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 -- 172.21.15.32:0/1142097645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc06ea50 msgr2=0x7fb1dc15aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1142097645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc15aa70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0c9390 tx=0x7fb1d0009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:42.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 -- 172.21.15.32:0/1142097645 shutdown_connections 2024-09-13T18:47:42.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1142097645 >> v2:172.21.15.86:3300/0 conn(0x7fb1dc0c9e90 0x7fb1dc0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.422 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1142097645 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc15aa70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 -- 172.21.15.32:0/1142097645 >> 172.21.15.32:0/1142097645 conn(0x7fb1dc0cac60 msgr2=0x7fb1dc0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 -- 172.21.15.32:0/1142097645 shutdown_connections 2024-09-13T18:47:42.423 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.413+0000 7fb1e2400700 1 -- 172.21.15.32:0/1142097645 wait complete. 2024-09-13T18:47:42.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.417+0000 7fb1e2400700 1 Processor -- start 2024-09-13T18:47:42.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.417+0000 7fb1e2400700 1 -- start start 2024-09-13T18:47:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc1e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1dc0c9e90 0x7fb1dc0c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 0x7fb1dc152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0c4ba0 con 0x7fb1dc0ca840 2024-09-13T18:47:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc1539f0 con 0x7fb1dc06ea50 2024-09-13T18:47:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc1ef920 con 0x7fb1dc0c9e90 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 0x7fb1dc152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc1e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1dbe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1dc0c9e90 0x7fb1dc0c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 0x7fb1dc152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33962/0 (socket says 172.21.15.32:33962) 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 -- 172.21.15.32:0/1971491483 learned_addr learned my addr 172.21.15.32:0/1971491483 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc1e5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51862/0 (socket says 172.21.15.32:51862) 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 -- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1dc0c9e90 msgr2=0x7fb1dc0c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1dc0c9e90 0x7fb1dc0c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 -- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 msgr2=0x7fb1dc1e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc1e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 -- 172.21.15.32:0/1971491483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00094b0 con 0x7fb1dc0ca840 2024-09-13T18:47:42.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1000700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc1e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:42.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e1a00700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 0x7fb1dc152d20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400cb40 tx=0x7fb1d400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400a980 con 0x7fb1dc0ca840 2024-09-13T18:47:42.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400ab00 con 0x7fb1dc0ca840 2024-09-13T18:47:42.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc0bffc0 con 0x7fb1dc0ca840 2024-09-13T18:47:42.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40070d0 con 0x7fb1dc0ca840 2024-09-13T18:47:42.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.421+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc0c48c0 con 0x7fb1dc0ca840 2024-09-13T18:47:42.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.425+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc0c9090 con 0x7fb1dc0ca840 2024-09-13T18:47:42.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.425+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1d4007230 con 0x7fb1dc0ca840 2024-09-13T18:47:42.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.425+0000 7fb1d8c00700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1bc066730 0x7fb1bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.425+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb1d4084100 con 0x7fb1dc0ca840 2024-09-13T18:47:42.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.425+0000 7fb1e1000700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1bc066730 0x7fb1bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.429+0000 7fb1e1000700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1bc066730 0x7fb1bc068bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00090b0 tx=0x7fb1d0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.441 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.433+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1d4051060 con 0x7fb1dc0ca840 2024-09-13T18:47:42.628 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.621+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1dc15afb0 con 0x7fb1bc066730 2024-09-13T18:47:42.629 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.621+0000 7fb1d8c00700 1 -- 172.21.15.32:0/1971491483 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1d0011c00 con 0x7fb1bc066730 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1bc066730 msgr2=0x7fb1bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1bc066730 0x7fb1bc068bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00090b0 tx=0x7fb1d0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 msgr2=0x7fb1dc152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 0x7fb1dc152d20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400cb40 tx=0x7fb1d400ce50 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 shutdown_connections 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb1bc066730 0x7fb1bc068bf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1dc0ca840 0x7fb1dc152d20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1dc0c9e90 0x7fb1dc0c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 --2- 172.21.15.32:0/1971491483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1dc06ea50 0x7fb1dc1e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 >> 172.21.15.32:0/1971491483 conn(0x7fb1dc0cac60 msgr2=0x7fb1dc0a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 shutdown_connections 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.625+0000 7fb1e2400700 1 -- 172.21.15.32:0/1971491483 wait complete. 2024-09-13T18:47:42.635 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:47:42.653 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:47:42.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 Processor -- start 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 -- start start 2024-09-13T18:47:42.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa378071b80 0x7fa378072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.834 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3780a9490 0x7fa3780a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa378158600 con 0x7fa378154f90 2024-09-13T18:47:42.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3780aa310 con 0x7fa3780a9490 2024-09-13T18:47:42.835 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.825+0000 7fa37f600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ca620 con 0x7fa378071b80 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3780a9490 0x7fa3780a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3780a9490 0x7fa3780a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33970/0 (socket says 172.21.15.32:33970) 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 -- 172.21.15.32:0/254209440 learned_addr learned my addr 172.21.15.32:0/254209440 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa377e00700 1 --2- 172.21.15.32:0/254209440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa378071b80 0x7fa378072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 -- 172.21.15.32:0/254209440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa378071b80 msgr2=0x7fa378072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 --2- 172.21.15.32:0/254209440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa378071b80 0x7fa378072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 -- 172.21.15.32:0/254209440 >> v1:172.21.15.32:6789/0 conn(0x7fa378154f90 legacy=0x7fa378157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 -- 172.21.15.32:0/254209440 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780ca900 con 0x7fa3780a9490 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37d600700 1 --2- 172.21.15.32:0/254209440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3780a9490 0x7fa3780a9920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa370009e80 tx=0x7fa37000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32f6c155007a7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa377400700 1 -- 172.21.15.32:0/254209440 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000e070 con 0x7fa3780a9490 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa377400700 1 -- 172.21.15.32:0/254209440 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000b980 con 0x7fa3780a9490 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa377400700 1 -- 172.21.15.32:0/254209440 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000bd30 con 0x7fa3780a9490 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 -- 172.21.15.32:0/254209440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3780a9490 msgr2=0x7fa3780a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 --2- 172.21.15.32:0/254209440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3780a9490 0x7fa3780a9920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa370009e80 tx=0x7fa37000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 -- 172.21.15.32:0/254209440 shutdown_connections 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 --2- 172.21.15.32:0/254209440 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3780a9490 0x7fa3780a9920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 --2- 172.21.15.32:0/254209440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa378071b80 0x7fa378072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 -- 172.21.15.32:0/254209440 >> 172.21.15.32:0/254209440 conn(0x7fa3780accb0 msgr2=0x7fa3780ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 -- 172.21.15.32:0/254209440 shutdown_connections 2024-09-13T18:47:42.839 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.829+0000 7fa37f600700 1 -- 172.21.15.32:0/254209440 wait complete. 2024-09-13T18:47:42.842 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.833+0000 7fa37f600700 1 Processor -- start 2024-09-13T18:47:42.843 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 -- start start 2024-09-13T18:47:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa378071b80 0x7fa37814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3780a9490 0x7fa3781475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa378154f90 0x7fa378147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ac910 con 0x7fa378154f90 2024-09-13T18:47:42.844 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ac180 con 0x7fa378071b80 2024-09-13T18:47:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37f600700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37806e4f0 con 0x7fa3780a9490 2024-09-13T18:47:42.845 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa378154f90 0x7fa378147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37cc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa378071b80 0x7fa37814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa377e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3780a9490 0x7fa3781475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa378154f90 0x7fa378147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33982/0 (socket says 172.21.15.32:33982) 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa377e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3780a9490 0x7fa3781475e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:59982/0 (socket says 172.21.15.32:59982) 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 -- 172.21.15.32:0/606851040 learned_addr learned my addr 172.21.15.32:0/606851040 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37cc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa378071b80 0x7fa37814ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51868/0 (socket says 172.21.15.32:51868) 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 -- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3780a9490 msgr2=0x7fa3781475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3780a9490 0x7fa3781475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 -- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa378071b80 msgr2=0x7fa37814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.846 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa378071b80 0x7fa37814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 -- 172.21.15.32:0/606851040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009b30 con 0x7fa378154f90 2024-09-13T18:47:42.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa37d600700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa378154f90 0x7fa378147b20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa3780c7960 tx=0x7fa370004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370004800 con 0x7fa378154f90 2024-09-13T18:47:42.847 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.837+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3700092e0 con 0x7fa378154f90 2024-09-13T18:47:42.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.841+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37001c680 con 0x7fa378154f90 2024-09-13T18:47:42.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.841+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37806e230 con 0x7fa378154f90 2024-09-13T18:47:42.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.841+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37806c5c0 con 0x7fa378154f90 2024-09-13T18:47:42.848 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.841+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3781576c0 con 0x7fa378154f90 2024-09-13T18:47:42.849 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.841+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa37001c7e0 con 0x7fa378154f90 2024-09-13T18:47:42.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa374c00700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa358066730 0x7fa358068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fa370086010 con 0x7fa378154f90 2024-09-13T18:47:42.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa374c00700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa35806ff10 0x7fa3580723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa358072a80 con 0x7fa35806ff10 2024-09-13T18:47:42.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa37cc00700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa358066730 0x7fa358068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.851 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa370086380 con 0x7fa378154f90 2024-09-13T18:47:42.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa377e00700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa35806ff10 0x7fa3580723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa37cc00700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa358066730 0x7fa358068bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa36c001800 tx=0x7fa36c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.852 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa377e00700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa35806ff10 0x7fa3580723b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.856 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.845+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== osd.5 v2:172.21.15.86:6810/2187629356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa358072a80 con 0x7fa35806ff10 2024-09-13T18:47:42.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.865+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 --> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa3781579d0 con 0x7fa35806ff10 2024-09-13T18:47:42.874 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.865+0000 7fa374c00700 1 -- 172.21.15.32:0/606851040 <== osd.5 v2:172.21.15.86:6810/2187629356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa364006de0 con 0x7fa35806ff10 2024-09-13T18:47:42.875 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:42.875 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:42.875 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa35806ff10 msgr2=0x7fa3580723b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6810/2187629356,v1:172.21.15.86:6813/2187629356] conn(0x7fa35806ff10 0x7fa3580723b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa358066730 msgr2=0x7fa358068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fa358066730 0x7fa358068bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa36c001800 tx=0x7fa36c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa378154f90 msgr2=0x7fa378147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 --2- 172.21.15.32:0/606851040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa378154f90 0x7fa378147b20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa3780c7960 tx=0x7fa370004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.876 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37d600700 1 -- 172.21.15.32:0/606851040 reap_dead start 2024-09-13T18:47:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 shutdown_connections 2024-09-13T18:47:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 >> 172.21.15.32:0/606851040 conn(0x7fa3780accb0 msgr2=0x7fa3781555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 shutdown_connections 2024-09-13T18:47:42.877 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:42.869+0000 7fa37f600700 1 -- 172.21.15.32:0/606851040 wait complete. 2024-09-13T18:47:42.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:47:43.076 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 Processor -- start 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 -- start start 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41840c2b80 0x7f4184156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f418406fcd0 0x7f4184150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4184157420 con 0x7f41840c27a0 2024-09-13T18:47:43.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418406edc0 con 0x7f418406fcd0 2024-09-13T18:47:43.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4189400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418406ded0 con 0x7f41840c2b80 2024-09-13T18:47:43.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f417b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41840c2b80 0x7f4184156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4183e00700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f41840c27a0 0x7f418406f5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52406/0 (socket says 172.21.15.32:52406) 2024-09-13T18:47:43.080 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4183e00700 1 -- 172.21.15.32:0/3831283786 learned_addr learned my addr 172.21.15.32:0/3831283786 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.069+0000 7f4188a00700 1 --2- 172.21.15.32:0/3831283786 >> v2:172.21.15.86:3300/0 conn(0x7f418406fcd0 0x7f4184150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f417b400700 1 -- 172.21.15.32:0/3831283786 >> v2:172.21.15.86:3300/0 conn(0x7f418406fcd0 msgr2=0x7f4184150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f417b400700 1 --2- 172.21.15.32:0/3831283786 >> v2:172.21.15.86:3300/0 conn(0x7f418406fcd0 0x7f4184150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4183400700 1 -- 172.21.15.32:0/3831283786 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629335928 0 0) 0x7f4174001110 con 0x7f41840c27a0 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f417b400700 1 -- 172.21.15.32:0/3831283786 >> v1:172.21.15.86:6789/0 conn(0x7f41840c27a0 legacy=0x7f418406f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f417b400700 1 -- 172.21.15.32:0/3831283786 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418406e1b0 con 0x7f41840c2b80 2024-09-13T18:47:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f417b400700 1 --2- 172.21.15.32:0/3831283786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41840c2b80 0x7f4184156ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f416c009850 tx=0x7f416c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b899858f6bbbd486 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4183400700 1 -- 172.21.15.32:0/3831283786 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00f8a0 con 0x7f41840c2b80 2024-09-13T18:47:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4183400700 1 -- 172.21.15.32:0/3831283786 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00fa00 con 0x7f41840c2b80 2024-09-13T18:47:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4183400700 1 -- 172.21.15.32:0/3831283786 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00fdb0 con 0x7f41840c2b80 2024-09-13T18:47:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 -- 172.21.15.32:0/3831283786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41840c2b80 msgr2=0x7f4184156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 --2- 172.21.15.32:0/3831283786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41840c2b80 0x7f4184156ee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f416c009850 tx=0x7f416c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:43.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 -- 172.21.15.32:0/3831283786 shutdown_connections 2024-09-13T18:47:43.083 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 --2- 172.21.15.32:0/3831283786 >> v2:172.21.15.86:3300/0 conn(0x7f418406fcd0 0x7f4184150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 --2- 172.21.15.32:0/3831283786 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41840c2b80 0x7f4184156ee0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 -- 172.21.15.32:0/3831283786 >> 172.21.15.32:0/3831283786 conn(0x7f41840c8a60 msgr2=0x7f41840c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 -- 172.21.15.32:0/3831283786 shutdown_connections 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.073+0000 7f4189400700 1 -- 172.21.15.32:0/3831283786 wait complete. 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 Processor -- start 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 -- start start 2024-09-13T18:47:43.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f418406fcd0 0x7f4184148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 0x7f41841579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840c2b80 0x7f4184157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184145db0 con 0x7f41840c27a0 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184145630 con 0x7f41840c2b80 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4189400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418414e5f0 con 0x7f418406fcd0 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 0x7f41841579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4188a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840c2b80 0x7f4184157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 0x7f41841579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33990/0 (socket says 172.21.15.32:33990) 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 -- 172.21.15.32:0/2688433666 learned_addr learned my addr 172.21.15.32:0/2688433666 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4183e00700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f418406fcd0 0x7f4184148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 -- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f418406fcd0 msgr2=0x7f4184148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f418406fcd0 0x7f4184148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 -- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840c2b80 msgr2=0x7f4184157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840c2b80 0x7f4184157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 -- 172.21.15.32:0/2688433666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0094b0 con 0x7f41840c27a0 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f417b400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 0x7f41841579a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.077+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c010cf0 con 0x7f41840c27a0 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.081+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c010e50 con 0x7f41840c27a0 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.081+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c019640 con 0x7f41840c27a0 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.081+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418414e8d0 con 0x7f41840c27a0 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.081+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184150710 con 0x7f41840c27a0 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.081+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418414ea90 con 0x7f41840c27a0 2024-09-13T18:47:43.090 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.081+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f416c0197a0 con 0x7f41840c27a0 2024-09-13T18:47:43.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.085+0000 7f4180c00700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4160066730 0x7f4160068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.085+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f416c085a60 con 0x7f41840c27a0 2024-09-13T18:47:43.092 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.085+0000 7f4183e00700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4160066730 0x7f4160068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.093 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.085+0000 7f4183e00700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4160066730 0x7f4160068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4174000f60 tx=0x7f4174007c40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.098 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.093+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f416c0529c0 con 0x7f41840c27a0 2024-09-13T18:47:43.281 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.273+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4184074620 con 0x7f4160066730 2024-09-13T18:47:43.282 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.273+0000 7f4180c00700 1 -- 172.21.15.32:0/2688433666 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4184074620 con 0x7f4160066730 2024-09-13T18:47:43.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4160066730 msgr2=0x7f4160068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4160066730 0x7f4160068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4174000f60 tx=0x7f4174007c40 comp rx=0 tx=0).stop 2024-09-13T18:47:43.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 msgr2=0x7f41841579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 0x7f41841579a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:43.287 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 shutdown_connections 2024-09-13T18:47:43.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4160066730 0x7f4160068bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840c2b80 0x7f4184157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41840c27a0 0x7f41841579a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 --2- 172.21.15.32:0/2688433666 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f418406fcd0 0x7f4184148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.288 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 >> 172.21.15.32:0/2688433666 conn(0x7f41840c8a60 msgr2=0x7f418414c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 shutdown_connections 2024-09-13T18:47:43.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.277+0000 7f4189400700 1 -- 172.21.15.32:0/2688433666 wait complete. 2024-09-13T18:47:43.289 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:47:43.309 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:47:43.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.481+0000 7f6d37a00700 1 Processor -- start 2024-09-13T18:47:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.481+0000 7f6d37a00700 1 -- start start 2024-09-13T18:47:43.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d37a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d301517f0 0x7f6d300c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d37a00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6d300c5fa0 0x7f6d3006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d37a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300c8270 con 0x7f6d30151410 2024-09-13T18:47:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d37a00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3015b0c0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d37a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300c84c0 con 0x7f6d301517f0 2024-09-13T18:47:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d35000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f6d30151410 0x7f6d30073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52418/0 (socket says 172.21.15.32:52418) 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d35000700 1 -- 172.21.15.32:0/3210562677 learned_addr learned my addr 172.21.15.32:0/3210562677 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2fe00700 1 --2- 172.21.15.32:0/3210562677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d301517f0 0x7f6d300c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d35a00700 1 --2- 172.21.15.32:0/3210562677 >> v2:172.21.15.32:3300/0 conn(0x7f6d300c5fa0 0x7f6d3006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2fe00700 1 -- 172.21.15.32:0/3210562677 >> v2:172.21.15.32:3300/0 conn(0x7f6d300c5fa0 msgr2=0x7f6d3006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2fe00700 1 --2- 172.21.15.32:0/3210562677 >> v2:172.21.15.32:3300/0 conn(0x7f6d300c5fa0 0x7f6d3006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2fe00700 1 -- 172.21.15.32:0/3210562677 >> v1:172.21.15.86:6789/0 conn(0x7f6d30151410 legacy=0x7f6d30073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2fe00700 1 -- 172.21.15.32:0/3210562677 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300c87a0 con 0x7f6d301517f0 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d35a00700 1 --2- 172.21.15.32:0/3210562677 >> v2:172.21.15.32:3300/0 conn(0x7f6d300c5fa0 0x7f6d3006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:43.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2f400700 1 -- 172.21.15.32:0/3210562677 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674325120 0 0) 0x7f6d300c8270 con 0x7f6d30151410 2024-09-13T18:47:43.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.485+0000 7f6d2fe00700 1 --2- 172.21.15.32:0/3210562677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d301517f0 0x7f6d300c69d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009850 tx=0x7f6d1c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5e0bfdc9564566 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d2f400700 1 -- 172.21.15.32:0/3210562677 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c011830 con 0x7f6d301517f0 2024-09-13T18:47:43.495 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d2f400700 1 -- 172.21.15.32:0/3210562677 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c011990 con 0x7f6d301517f0 2024-09-13T18:47:43.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d2f400700 1 -- 172.21.15.32:0/3210562677 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c011d20 con 0x7f6d301517f0 2024-09-13T18:47:43.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 -- 172.21.15.32:0/3210562677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d301517f0 msgr2=0x7f6d300c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 --2- 172.21.15.32:0/3210562677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d301517f0 0x7f6d300c69d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009850 tx=0x7f6d1c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:43.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 -- 172.21.15.32:0/3210562677 shutdown_connections 2024-09-13T18:47:43.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 --2- 172.21.15.32:0/3210562677 >> v2:172.21.15.32:3300/0 conn(0x7f6d300c5fa0 0x7f6d3006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 --2- 172.21.15.32:0/3210562677 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d301517f0 0x7f6d300c69d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 -- 172.21.15.32:0/3210562677 >> 172.21.15.32:0/3210562677 conn(0x7f6d300cbfd0 msgr2=0x7f6d300cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 -- 172.21.15.32:0/3210562677 shutdown_connections 2024-09-13T18:47:43.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.489+0000 7f6d37a00700 1 -- 172.21.15.32:0/3210562677 wait complete. 2024-09-13T18:47:43.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 Processor -- start 2024-09-13T18:47:43.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 -- start start 2024-09-13T18:47:43.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d300c5fa0 0x7f6d301e0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d30151410 0x7f6d30152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.502 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d301517f0 0x7f6d301ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30150f10 con 0x7f6d300c5fa0 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d301f03f0 con 0x7f6d301517f0 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d37a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d301ecda0 con 0x7f6d30151410 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d35000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d300c5fa0 0x7f6d301e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d35000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d300c5fa0 0x7f6d301e0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34002/0 (socket says 172.21.15.32:34002) 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.493+0000 7f6d35000700 1 -- 172.21.15.32:0/1391254935 learned_addr learned my addr 172.21.15.32:0/1391254935 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35a00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d301517f0 0x7f6d301ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.503 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d2fe00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d30151410 0x7f6d30152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35000700 1 -- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d30151410 msgr2=0x7f6d30152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35000700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6d30151410 0x7f6d30152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35000700 1 -- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d301517f0 msgr2=0x7f6d301ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35000700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d301517f0 0x7f6d301ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35000700 1 -- 172.21.15.32:0/1391254935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c0094b0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.504 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d35000700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d300c5fa0 0x7f6d301e0970 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400c4e0 tx=0x7f6d2400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24004ca0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24004e20 con 0x7f6d300c5fa0 2024-09-13T18:47:43.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24007310 con 0x7f6d300c5fa0 2024-09-13T18:47:43.505 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d301f0180 con 0x7f6d300c5fa0 2024-09-13T18:47:43.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d301551e0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.506 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.497+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d3015ace0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.507 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d24007470 con 0x7f6d300c5fa0 2024-09-13T18:47:43.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2cc00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d10066730 0x7f6d10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f6d240841e0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2cc00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f6d1006ff10 0x7f6d100723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d10072a80 con 0x7f6d1006ff10 2024-09-13T18:47:43.510 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d240867c0 con 0x7f6d300c5fa0 2024-09-13T18:47:43.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d2fe00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d10066730 0x7f6d10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.511 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.501+0000 7f6d35a00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f6d1006ff10 0x7f6d100723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.505+0000 7f6d35a00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f6d1006ff10 0x7f6d100723b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.512 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.505+0000 7f6d2fe00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d10066730 0x7f6d10068bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009850 tx=0x7f6d1c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.513 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.505+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== osd.6 v2:172.21.15.86:6800/4096931368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6d10072a80 con 0x7f6d1006ff10 2024-09-13T18:47:43.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 --> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d3006d4c0 con 0x7f6d1006ff10 2024-09-13T18:47:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d2cc00700 1 -- 172.21.15.32:0/1391254935 <== osd.6 v2:172.21.15.86:6800/4096931368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d3006d4c0 con 0x7f6d1006ff10 2024-09-13T18:47:43.533 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:43.533 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:43.533 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f6d1006ff10 msgr2=0x7f6d100723b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6800/4096931368,v1:172.21.15.86:6801/4096931368] conn(0x7f6d1006ff10 0x7f6d100723b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d10066730 msgr2=0x7f6d10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6d10066730 0x7f6d10068bf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009850 tx=0x7f6d1c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d300c5fa0 msgr2=0x7f6d301e0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 --2- 172.21.15.32:0/1391254935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6d300c5fa0 0x7f6d301e0970 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400c4e0 tx=0x7f6d2400c7f0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d35a00700 1 -- 172.21.15.32:0/1391254935 reap_dead start 2024-09-13T18:47:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 shutdown_connections 2024-09-13T18:47:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 >> 172.21.15.32:0/1391254935 conn(0x7f6d300cbfd0 msgr2=0x7f6d30071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 shutdown_connections 2024-09-13T18:47:43.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.525+0000 7f6d37a00700 1 -- 172.21.15.32:0/1391254935 wait complete. 2024-09-13T18:47:43.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:47:43.731 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 Processor -- start 2024-09-13T18:47:43.732 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 -- start start 2024-09-13T18:47:43.733 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f3c153450 0x7f7f3c153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c15a620 con 0x7f7f3c072590 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c0716a0 con 0x7f7f3c153450 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c153e40 con 0x7f7f3c0721b0 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f3a800700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f3c153450 0x7f7f3c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f39e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.734 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f39e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:60038/0 (socket says 172.21.15.32:60038) 2024-09-13T18:47:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.725+0000 7f7f39e00700 1 -- 172.21.15.32:0/922012039 learned_addr learned my addr 172.21.15.32:0/922012039 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3a800700 1 -- 172.21.15.32:0/922012039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 msgr2=0x7f7f3c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3a800700 1 --2- 172.21.15.32:0/922012039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3a800700 1 -- 172.21.15.32:0/922012039 >> v1:172.21.15.32:6789/0 conn(0x7f7f3c072590 legacy=0x7f7f3c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3a800700 1 -- 172.21.15.32:0/922012039 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c15db50 con 0x7f7f3c153450 2024-09-13T18:47:43.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f38a00700 1 -- 172.21.15.32:0/922012039 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987410266 0 0) 0x7f7f3c15a620 con 0x7f7f3c072590 2024-09-13T18:47:43.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3a800700 1 --2- 172.21.15.32:0/922012039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c153900 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009d90 tx=0x7f7f3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7aa9e1b46432a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.736 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f38a00700 1 -- 172.21.15.32:0/922012039 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400e070 con 0x7f7f3c153450 2024-09-13T18:47:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f38a00700 1 -- 172.21.15.32:0/922012039 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3400bb20 con 0x7f7f3c153450 2024-09-13T18:47:43.737 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f38a00700 1 -- 172.21.15.32:0/922012039 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34012430 con 0x7f7f3c153450 2024-09-13T18:47:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 -- 172.21.15.32:0/922012039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 msgr2=0x7f7f3c153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 --2- 172.21.15.32:0/922012039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c153900 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009d90 tx=0x7f7f3400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 -- 172.21.15.32:0/922012039 shutdown_connections 2024-09-13T18:47:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 --2- 172.21.15.32:0/922012039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c153900 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.738 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 --2- 172.21.15.32:0/922012039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 -- 172.21.15.32:0/922012039 >> 172.21.15.32:0/922012039 conn(0x7f7f3c0cbfe0 msgr2=0x7f7f3c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 -- 172.21.15.32:0/922012039 shutdown_connections 2024-09-13T18:47:43.739 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.729+0000 7f7f3b200700 1 -- 172.21.15.32:0/922012039 wait complete. 2024-09-13T18:47:43.741 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.733+0000 7f7f3b200700 1 Processor -- start 2024-09-13T18:47:43.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.733+0000 7f7f3b200700 1 -- start start 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f3c072590 0x7f7f3c151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c14fa80 con 0x7f7f3c153450 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c15ad60 con 0x7f7f3c072590 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c15beb0 con 0x7f7f3c0721b0 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f39e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f39400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f3c072590 0x7f7f3c151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f39e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:60054/0 (socket says 172.21.15.32:60054) 2024-09-13T18:47:43.744 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f39e00700 1 -- 172.21.15.32:0/3049533955 learned_addr learned my addr 172.21.15.32:0/3049533955 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 -- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 msgr2=0x7f7f3c15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 -- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f3c072590 msgr2=0x7f7f3c151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f3c072590 0x7f7f3c151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 -- 172.21.15.32:0/3049533955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34009a70 con 0x7f7f3c153450 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3a800700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c1f21e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7f34016000 tx=0x7f7f34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34012430 con 0x7f7f3c153450 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34020070 con 0x7f7f3c153450 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34004280 con 0x7f7f3c153450 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c15c470 con 0x7f7f3c153450 2024-09-13T18:47:43.746 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.737+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c15af90 con 0x7f7f3c153450 2024-09-13T18:47:43.747 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.741+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c15c600 con 0x7f7f3c153450 2024-09-13T18:47:43.748 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.741+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f340043e0 con 0x7f7f3c153450 2024-09-13T18:47:43.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.741+0000 7f7f32000700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7f1c066730 0x7f7f1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.741+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f7f34022070 con 0x7f7f3c153450 2024-09-13T18:47:43.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.745+0000 7f7f39e00700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7f1c066730 0x7f7f1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.751 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.745+0000 7f7f39e00700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7f1c066730 0x7f7f1c068bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006fd0 tx=0x7f7f2c0092e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.749+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f340530f0 con 0x7f7f3c153450 2024-09-13T18:47:43.940 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.933+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f3c15d2b0 con 0x7f7f1c066730 2024-09-13T18:47:43.941 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.933+0000 7f7f32000700 1 -- 172.21.15.32:0/3049533955 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f2c009980 con 0x7f7f1c066730 2024-09-13T18:47:43.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7f1c066730 msgr2=0x7f7f1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.945 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7f1c066730 0x7f7f1c068bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006fd0 tx=0x7f7f2c0092e0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 msgr2=0x7f7f3c1f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c1f21e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7f34016000 tx=0x7f7f34004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 shutdown_connections 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f7f1c066730 0x7f7f1c068bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c153450 0x7f7f3c1f21e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f3c072590 0x7f7f3c151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 --2- 172.21.15.32:0/3049533955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7f3c0721b0 0x7f7f3c15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 >> 172.21.15.32:0/3049533955 conn(0x7f7f3c0cbfe0 msgr2=0x7f7f3c159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 shutdown_connections 2024-09-13T18:47:43.946 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:43.937+0000 7f7f3b200700 1 -- 172.21.15.32:0/3049533955 wait complete. 2024-09-13T18:47:43.948 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:47:43.968 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:47:43.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:47:44.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 Processor -- start 2024-09-13T18:47:44.151 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 -- start start 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f9f3015a1b0 0x7f9f3006f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f3006fa70 0x7f9f300c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f30153ef0 con 0x7f9f300c6f60 2024-09-13T18:47:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f300c98d0 con 0x7f9f3006fa70 2024-09-13T18:47:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36c00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f300c7870 con 0x7f9f3015a1b0 2024-09-13T18:47:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f35800700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f9f300c6f60 0x7f9f3006c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52424/0 (socket says 172.21.15.32:52424) 2024-09-13T18:47:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f35800700 1 -- 172.21.15.32:0/1640831208 learned_addr learned my addr 172.21.15.32:0/1640831208 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f34e00700 1 --2- 172.21.15.32:0/1640831208 >> v2:172.21.15.86:3300/0 conn(0x7f9f3015a1b0 0x7f9f3006f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36200700 1 --2- 172.21.15.32:0/1640831208 >> v2:172.21.15.32:3300/0 conn(0x7f9f3006fa70 0x7f9f300c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36200700 1 -- 172.21.15.32:0/1640831208 >> v2:172.21.15.86:3300/0 conn(0x7f9f3015a1b0 msgr2=0x7f9f3006f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36200700 1 --2- 172.21.15.32:0/1640831208 >> v2:172.21.15.86:3300/0 conn(0x7f9f3015a1b0 0x7f9f3006f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36200700 1 -- 172.21.15.32:0/1640831208 >> v1:172.21.15.86:6789/0 conn(0x7f9f300c6f60 legacy=0x7f9f3006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f2fe00700 1 -- 172.21.15.32:0/1640831208 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80365972 0 0) 0x7f9f30153ef0 con 0x7f9f300c6f60 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36200700 1 -- 172.21.15.32:0/1640831208 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3006c920 con 0x7f9f3006fa70 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f34e00700 1 --2- 172.21.15.32:0/1640831208 >> v2:172.21.15.86:3300/0 conn(0x7f9f3015a1b0 0x7f9f3006f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:44.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.145+0000 7f9f36200700 1 --2- 172.21.15.32:0/1640831208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 0x7f9f300c8880 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9f3006e270 tx=0x7f9f2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e3043e08ccb61d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.159 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f2fe00700 1 -- 172.21.15.32:0/1640831208 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2800e070 con 0x7f9f3006fa70 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f2fe00700 1 -- 172.21.15.32:0/1640831208 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2800bb20 con 0x7f9f3006fa70 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f2fe00700 1 -- 172.21.15.32:0/1640831208 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28012430 con 0x7f9f3006fa70 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 -- 172.21.15.32:0/1640831208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 msgr2=0x7f9f300c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 --2- 172.21.15.32:0/1640831208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 0x7f9f300c8880 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9f3006e270 tx=0x7f9f2800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 -- 172.21.15.32:0/1640831208 shutdown_connections 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 --2- 172.21.15.32:0/1640831208 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 0x7f9f300c8880 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 --2- 172.21.15.32:0/1640831208 >> v2:172.21.15.86:3300/0 conn(0x7f9f3015a1b0 0x7f9f3006f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 -- 172.21.15.32:0/1640831208 >> 172.21.15.32:0/1640831208 conn(0x7f9f300ccf70 msgr2=0x7f9f300cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 -- 172.21.15.32:0/1640831208 shutdown_connections 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.149+0000 7f9f36c00700 1 -- 172.21.15.32:0/1640831208 wait complete. 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 Processor -- start 2024-09-13T18:47:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 -- start start 2024-09-13T18:47:44.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 0x7f9f300c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f300c6f60 0x7f9f300c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f3015a1b0 0x7f9f30150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3015ada0 con 0x7f9f3006fa70 2024-09-13T18:47:44.165 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c1ab0 con 0x7f9f3015a1b0 2024-09-13T18:47:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36c00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f301f27b0 con 0x7f9f300c6f60 2024-09-13T18:47:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f3015a1b0 0x7f9f30150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f3015a1b0 0x7f9f30150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:51908/0 (socket says 172.21.15.32:51908) 2024-09-13T18:47:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f35800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 0x7f9f300c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 -- 172.21.15.32:0/3887973991 learned_addr learned my addr 172.21.15.32:0/3887973991 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f34e00700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f300c6f60 0x7f9f300c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 -- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f300c6f60 msgr2=0x7f9f300c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f300c6f60 0x7f9f300c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 -- 172.21.15.32:0/3887973991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 msgr2=0x7f9f300c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f3006fa70 0x7f9f300c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 -- 172.21.15.32:0/3887973991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0094b0 con 0x7f9f3015a1b0 2024-09-13T18:47:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f36200700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f3015a1b0 0x7f9f30150380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9f3006e220 tx=0x7f9f28004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.153+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28012430 con 0x7f9f3015a1b0 2024-09-13T18:47:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.157+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f28020070 con 0x7f9f3015a1b0 2024-09-13T18:47:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.157+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28004280 con 0x7f9f3015a1b0 2024-09-13T18:47:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.157+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f28009a70 con 0x7f9f3015a1b0 2024-09-13T18:47:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.157+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f300c0f10 con 0x7f9f3015a1b0 2024-09-13T18:47:44.169 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.157+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f300cd500 con 0x7f9f3015a1b0 2024-09-13T18:47:44.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.157+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f280043e0 con 0x7f9f3015a1b0 2024-09-13T18:47:44.171 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f2d600700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f10066730 0x7f9f10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f9f28022070 con 0x7f9f3015a1b0 2024-09-13T18:47:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f2d600700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f9f1006fe90 0x7f9f10072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f10072a00 con 0x7f9f1006fe90 2024-09-13T18:47:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f280869a0 con 0x7f9f3015a1b0 2024-09-13T18:47:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f35800700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f10066730 0x7f9f10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.172 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f34e00700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f9f1006fe90 0x7f9f10072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f35800700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f10066730 0x7f9f10068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000f60 tx=0x7f9f24007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.161+0000 7f9f34e00700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f9f1006fe90 0x7f9f10072330 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.173 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.165+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== osd.7 v2:172.21.15.86:6809/943661157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9f10072a00 con 0x7f9f1006fe90 2024-09-13T18:47:44.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 --> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f300c8080 con 0x7f9f1006fe90 2024-09-13T18:47:44.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f2d600700 1 -- 172.21.15.32:0/3887973991 <== osd.7 v2:172.21.15.86:6809/943661157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9f1c009d70 con 0x7f9f1006fe90 2024-09-13T18:47:44.197 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-13T18:47:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:47:44.198 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f9f1006fe90 msgr2=0x7f9f10072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6809/943661157,v1:172.21.15.86:6812/943661157] conn(0x7f9f1006fe90 0x7f9f10072330 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f10066730 msgr2=0x7f9f10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f9f10066730 0x7f9f10068bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000f60 tx=0x7f9f24007e00 comp rx=0 tx=0).stop 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f3015a1b0 msgr2=0x7f9f30150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 --2- 172.21.15.32:0/3887973991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f3015a1b0 0x7f9f30150380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9f3006e220 tx=0x7f9f28004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36200700 1 -- 172.21.15.32:0/3887973991 reap_dead start 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.189+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 shutdown_connections 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.193+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 >> 172.21.15.32:0/3887973991 conn(0x7f9f300ccf70 msgr2=0x7f9f3006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.193+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 shutdown_connections 2024-09-13T18:47:44.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.193+0000 7f9f36c00700 1 -- 172.21.15.32:0/3887973991 wait complete. 2024-09-13T18:47:44.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:47:44.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.389+0000 7f5b5be00700 1 Processor -- start 2024-09-13T18:47:44.396 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.389+0000 7f5b5be00700 1 -- start start 2024-09-13T18:47:44.401 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5be00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b5c0724c0 0x7f5b5c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5be00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c15a6d0 con 0x7f5b5c159e40 2024-09-13T18:47:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5be00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0c9090 con 0x7f5b5c0724c0 2024-09-13T18:47:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c15dc20 con 0x7f5b5c15a240 2024-09-13T18:47:44.402 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5aa00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b5c0724c0 0x7f5b5c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5a000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f5b5c159e40 0x7f5b5c0c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52434/0 (socket says 172.21.15.32:52434) 2024-09-13T18:47:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5a000700 1 -- 172.21.15.32:0/3875006157 learned_addr learned my addr 172.21.15.32:0/3875006157 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5b400700 1 --2- 172.21.15.32:0/3875006157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5aa00700 1 -- 172.21.15.32:0/3875006157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 msgr2=0x7f5b5c163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:44.403 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5aa00700 1 --2- 172.21.15.32:0/3875006157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5aa00700 1 -- 172.21.15.32:0/3875006157 >> v1:172.21.15.86:6789/0 conn(0x7f5b5c159e40 legacy=0x7f5b5c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5aa00700 1 -- 172.21.15.32:0/3875006157 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c1599b0 con 0x7f5b5c0724c0 2024-09-13T18:47:44.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b59600700 1 -- 172.21.15.32:0/3875006157 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953250733 0 0) 0x7f5b48001110 con 0x7f5b5c159e40 2024-09-13T18:47:44.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b5aa00700 1 --2- 172.21.15.32:0/3875006157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c06fc10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009850 tx=0x7f5b4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa3146c7899cbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b59600700 1 -- 172.21.15.32:0/3875006157 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c011830 con 0x7f5b5c0724c0 2024-09-13T18:47:44.404 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b59600700 1 -- 172.21.15.32:0/3875006157 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c011990 con 0x7f5b5c0724c0 2024-09-13T18:47:44.405 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.393+0000 7f5b59600700 1 -- 172.21.15.32:0/3875006157 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c011d40 con 0x7f5b5c0724c0 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 -- 172.21.15.32:0/3875006157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c0724c0 msgr2=0x7f5b5c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 --2- 172.21.15.32:0/3875006157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c06fc10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009850 tx=0x7f5b4c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 -- 172.21.15.32:0/3875006157 shutdown_connections 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 --2- 172.21.15.32:0/3875006157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 --2- 172.21.15.32:0/3875006157 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c06fc10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 -- 172.21.15.32:0/3875006157 >> 172.21.15.32:0/3875006157 conn(0x7f5b5c0cac60 msgr2=0x7f5b5c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.406 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 -- 172.21.15.32:0/3875006157 shutdown_connections 2024-09-13T18:47:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 -- 172.21.15.32:0/3875006157 wait complete. 2024-09-13T18:47:44.407 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 Processor -- start 2024-09-13T18:47:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.397+0000 7f5b5be00700 1 -- start start 2024-09-13T18:47:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c1e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c159e40 0x7f5b5c0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.408 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c0bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c15c630 con 0x7f5b5c159e40 2024-09-13T18:47:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c15b0f0 con 0x7f5b5c0724c0 2024-09-13T18:47:44.409 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1ef460 con 0x7f5b5c15a240 2024-09-13T18:47:44.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c0bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5a000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c159e40 0x7f5b5c0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.411 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c0bfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:60096/0 (socket says 172.21.15.32:60096) 2024-09-13T18:47:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 -- 172.21.15.32:0/232956547 learned_addr learned my addr 172.21.15.32:0/232956547 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5aa00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c1e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 -- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b5c0724c0 msgr2=0x7f5b5c1e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c1e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 -- 172.21.15.32:0/232956547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c159e40 msgr2=0x7f5b5c0c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.412 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c159e40 0x7f5b5c0c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 -- 172.21.15.32:0/232956547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0094b0 con 0x7f5b5c15a240 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5a000700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c159e40 0x7f5b5c0c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5b400700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c0bfd80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400efc0 tx=0x7f5b5400c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400cad0 con 0x7f5b5c15a240 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5400f040 con 0x7f5b5c15a240 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.401+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c15a870 con 0x7f5b5c15a240 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.405+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400ce70 con 0x7f5b5c15a240 2024-09-13T18:47:44.413 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.405+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c15ab30 con 0x7f5b5c15a240 2024-09-13T18:47:44.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.405+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c15d660 con 0x7f5b5c15a240 2024-09-13T18:47:44.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.405+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b54014480 con 0x7f5b5c15a240 2024-09-13T18:47:44.415 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.409+0000 7f5b53400700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b3c066760 0x7f5b3c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.409+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f5b540850e0 con 0x7f5b5c15a240 2024-09-13T18:47:44.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.409+0000 7f5b5aa00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b3c066760 0x7f5b3c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.409+0000 7f5b5aa00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b3c066760 0x7f5b3c068c20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0090b0 tx=0x7f5b4c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.417+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b54052040 con 0x7f5b5c15a240 2024-09-13T18:47:44.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.597+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b5c0c6fa0 con 0x7f5b3c066760 2024-09-13T18:47:44.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.601+0000 7f5b53400700 1 -- 172.21.15.32:0/232956547 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5b4c011c00 con 0x7f5b3c066760 2024-09-13T18:47:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b3c066760 msgr2=0x7f5b3c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b3c066760 0x7f5b3c068c20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0090b0 tx=0x7f5b4c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:44.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 msgr2=0x7f5b5c0bfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c0bfd80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400efc0 tx=0x7f5b5400c0c0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 shutdown_connections 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5b3c066760 0x7f5b3c068c20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5b5c15a240 0x7f5b5c0bfd80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b5c159e40 0x7f5b5c0c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 --2- 172.21.15.32:0/232956547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5b5c0724c0 0x7f5b5c1e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 >> 172.21.15.32:0/232956547 conn(0x7f5b5c0cac60 msgr2=0x7f5b5c0c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 shutdown_connections 2024-09-13T18:47:44.612 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.605+0000 7f5b5be00700 1 -- 172.21.15.32:0/232956547 wait complete. 2024-09-13T18:47:44.614 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:47:44.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:44.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.801+0000 7fead8e00700 1 Processor -- start 2024-09-13T18:47:44.809 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.801+0000 7fead8e00700 1 -- start start 2024-09-13T18:47:44.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead8e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fead40c61b0 0x7fead4071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead8e00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead4070510 con 0x7fead40aa360 2024-09-13T18:47:44.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead8e00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead4157570 con 0x7fead40c6590 2024-09-13T18:47:44.811 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead8e00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40aa920 con 0x7fead40c61b0 2024-09-13T18:47:44.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fead40aa360 0x7fead41545a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52750/0 (socket says 172.21.15.32:52750) 2024-09-13T18:47:44.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2a00700 1 -- 172.21.15.32:0/4049077143 learned_addr learned my addr 172.21.15.32:0/4049077143 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:47:44.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead3400700 1 --2- 172.21.15.32:0/4049077143 >> v2:172.21.15.86:3300/0 conn(0x7fead40c61b0 0x7fead4071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.812 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2000700 1 -- 172.21.15.32:0/4049077143 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198722315 0 0) 0x7fead4157570 con 0x7fead40c6590 2024-09-13T18:47:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2000700 1 -- 172.21.15.32:0/4049077143 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab80035d0 con 0x7fead40c6590 2024-09-13T18:47:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2000700 1 -- 172.21.15.32:0/4049077143 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530697277 0 0) 0x7fead4070510 con 0x7fead40aa360 2024-09-13T18:47:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead3400700 1 -- 172.21.15.32:0/4049077143 >> v1:172.21.15.86:6789/0 conn(0x7fead40c6590 legacy=0x7fead4161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead3400700 1 -- 172.21.15.32:0/4049077143 >> v1:172.21.15.32:6789/0 conn(0x7fead40aa360 legacy=0x7fead41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead3400700 1 -- 172.21.15.32:0/4049077143 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4070760 con 0x7fead40c61b0 2024-09-13T18:47:44.813 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead3400700 1 --2- 172.21.15.32:0/4049077143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead4071960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feac4009d90 tx=0x7feac400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4897450be4106a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2000700 1 -- 172.21.15.32:0/4049077143 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400e070 con 0x7fead40c61b0 2024-09-13T18:47:44.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2000700 1 -- 172.21.15.32:0/4049077143 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac400bb20 con 0x7fead40c61b0 2024-09-13T18:47:44.814 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.805+0000 7fead2000700 1 -- 172.21.15.32:0/4049077143 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400bed0 con 0x7fead40c61b0 2024-09-13T18:47:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 -- 172.21.15.32:0/4049077143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 msgr2=0x7fead4071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 --2- 172.21.15.32:0/4049077143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead4071960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feac4009d90 tx=0x7feac400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 -- 172.21.15.32:0/4049077143 shutdown_connections 2024-09-13T18:47:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 --2- 172.21.15.32:0/4049077143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead4071960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 -- 172.21.15.32:0/4049077143 >> 172.21.15.32:0/4049077143 conn(0x7fead40cad40 msgr2=0x7fead40cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.816 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 -- 172.21.15.32:0/4049077143 shutdown_connections 2024-09-13T18:47:44.817 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.809+0000 7fead8e00700 1 -- 172.21.15.32:0/4049077143 wait complete. 2024-09-13T18:47:44.818 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 Processor -- start 2024-09-13T18:47:44.819 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 -- start start 2024-09-13T18:47:44.820 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fead40aa360 0x7fead415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead40c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 0x7fead40c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40b0840 con 0x7fead40c6590 2024-09-13T18:47:44.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead41f2f10 con 0x7fead40c61b0 2024-09-13T18:47:44.821 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead415b7e0 con 0x7fead40aa360 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 0x7fead40c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead2a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead40c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 0x7fead40c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34082/0 (socket says 172.21.15.32:34082) 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 -- 172.21.15.32:0/1445270263 learned_addr learned my addr 172.21.15.32:0/1445270263 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3400700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fead40aa360 0x7fead415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 -- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fead40aa360 msgr2=0x7fead415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fead40aa360 0x7fead415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 -- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 msgr2=0x7fead40c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead40c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 -- 172.21.15.32:0/1445270263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4009a70 con 0x7fead40c6590 2024-09-13T18:47:44.823 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead3e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 0x7fead40c0cf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feacc00c410 tx=0x7feacc00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0052d0 con 0x7fead40c6590 2024-09-13T18:47:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc005430 con 0x7fead40c6590 2024-09-13T18:47:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead40bfd60 con 0x7fead40c6590 2024-09-13T18:47:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.813+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0055a0 con 0x7fead40c6590 2024-09-13T18:47:44.824 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.817+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead40c1c20 con 0x7fead40c6590 2024-09-13T18:47:44.825 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.817+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead4158310 con 0x7fead40c6590 2024-09-13T18:47:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.817+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feacc0038e0 con 0x7fead40c6590 2024-09-13T18:47:44.829 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.821+0000 7feacb400700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feab4066730 0x7feab4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.821+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7feacc0838b0 con 0x7fead40c6590 2024-09-13T18:47:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.821+0000 7fead3400700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feab4066730 0x7feab4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.830 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.821+0000 7fead3400700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feab4066730 0x7feab4068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feac4014040 tx=0x7feac401e040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:44.825+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feacc0508d0 con 0x7fead40c6590 2024-09-13T18:47:45.025 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.017+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fead4157df0 con 0x7feab4066730 2024-09-13T18:47:45.043 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.037+0000 7feacb400700 1 -- 172.21.15.32:0/1445270263 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367344 (secure 0 0 0) 0x7feac40128e0 con 0x7feab4066730 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feab4066730 msgr2=0x7feab4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feab4066730 0x7feab4068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feac4014040 tx=0x7feac401e040 comp rx=0 tx=0).stop 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 msgr2=0x7fead40c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 0x7fead40c0cf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feacc00c410 tx=0x7feacc00c720 comp rx=0 tx=0).stop 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 shutdown_connections 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7feab4066730 0x7feab4068bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fead40c6590 0x7fead40c0cf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fead40c61b0 0x7fead40c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 --2- 172.21.15.32:0/1445270263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fead40aa360 0x7fead415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 >> 172.21.15.32:0/1445270263 conn(0x7fead40cad40 msgr2=0x7fead4155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 shutdown_connections 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:47:45.045+0000 7fead8e00700 1 -- 172.21.15.32:0/1445270263 wait complete. 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:47:45.075 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T18:47:44.120549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629278,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":248,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":700,"ondisk_log_size":700,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249400,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725320,"statfs":{"total":773094113280,"available":772838727680,"internally_reserved":0,"allocated":8904704,"data_stored":5130652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005253"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658843+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:26.658843+0000","last_peered":"2024-09-13T18:47:26.658843+0000","last_clean":"2024-09-13T18:47:26.658843+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:26.658843+0000","last_undegraded":"2024-09-13T18:47:26.658843+0000","last_fullsized":"2024-09-13T18:47:26.658843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.598924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.598214+0000","last_change":"2024-09-13T18:45:01.343047+0000","last_active":"2024-09-13T18:47:35.598214+0000","last_peered":"2024-09-13T18:47:35.598214+0000","last_clean":"2024-09-13T18:47:35.598214+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:35.598214+0000","last_undegraded":"2024-09-13T18:47:35.598214+0000","last_fullsized":"2024-09-13T18:47:35.598214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:31.259527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261007+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.261007+0000","last_peered":"2024-09-13T18:47:27.261007+0000","last_clean":"2024-09-13T18:47:27.261007+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.261007+0000","last_undegraded":"2024-09-13T18:47:27.261007+0000","last_fullsized":"2024-09-13T18:47:27.261007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:46.084608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.268242+0000","last_change":"2024-09-13T18:45:00.843746+0000","last_active":"2024-09-13T18:47:27.268242+0000","last_peered":"2024-09-13T18:47:27.268242+0000","last_clean":"2024-09-13T18:47:27.268242+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:27.268242+0000","last_undegraded":"2024-09-13T18:47:27.268242+0000","last_fullsized":"2024-09-13T18:47:27.268242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:21.434448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.580378+0000","last_change":"2024-09-13T18:45:01.339085+0000","last_active":"2024-09-13T18:47:35.580378+0000","last_peered":"2024-09-13T18:47:35.580378+0000","last_clean":"2024-09-13T18:47:35.580378+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:35.580378+0000","last_undegraded":"2024-09-13T18:47:35.580378+0000","last_fullsized":"2024-09-13T18:47:35.580378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:48.313531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899078+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:27.899078+0000","last_peered":"2024-09-13T18:47:27.899078+0000","last_clean":"2024-09-13T18:47:27.899078+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:27.899078+0000","last_undegraded":"2024-09-13T18:47:27.899078+0000","last_fullsized":"2024-09-13T18:47:27.899078+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.040082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"64'3","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:30.178357+0000","last_change":"2024-09-13T18:47:14.525177+0000","last_active":"2024-09-13T18:47:30.178357+0000","last_peered":"2024-09-13T18:47:30.178357+0000","last_clean":"2024-09-13T18:47:30.178357+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:30.178357+0000","last_undegraded":"2024-09-13T18:47:30.178357+0000","last_fullsized":"2024-09-13T18:47:30.178357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595826+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:35.595826+0000","last_peered":"2024-09-13T18:47:35.595826+0000","last_clean":"2024-09-13T18:47:35.595826+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:35.595826+0000","last_undegraded":"2024-09-13T18:47:35.595826+0000","last_fullsized":"2024-09-13T18:47:35.595826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:33.055052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900988+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:27.900988+0000","last_peered":"2024-09-13T18:47:27.900988+0000","last_clean":"2024-09-13T18:47:27.900988+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:27.900988+0000","last_undegraded":"2024-09-13T18:47:27.900988+0000","last_fullsized":"2024-09-13T18:47:27.900988+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:44.380261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:28.881852+0000","last_change":"2024-09-13T18:47:14.525584+0000","last_active":"2024-09-13T18:47:28.881852+0000","last_peered":"2024-09-13T18:47:28.881852+0000","last_clean":"2024-09-13T18:47:28.881852+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:28.881852+0000","last_undegraded":"2024-09-13T18:47:28.881852+0000","last_fullsized":"2024-09-13T18:47:28.881852+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.594481+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:35.594481+0000","last_peered":"2024-09-13T18:47:35.594481+0000","last_clean":"2024-09-13T18:47:35.594481+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:35.594481+0000","last_undegraded":"2024-09-13T18:47:35.594481+0000","last_fullsized":"2024-09-13T18:47:35.594481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:49.583825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900545+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:27.900545+0000","last_peered":"2024-09-13T18:47:27.900545+0000","last_clean":"2024-09-13T18:47:27.900545+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:27.900545+0000","last_undegraded":"2024-09-13T18:47:27.900545+0000","last_fullsized":"2024-09-13T18:47:27.900545+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:35.977293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.596502+0000","last_change":"2024-09-13T18:46:41.340300+0000","last_active":"2024-09-13T18:47:35.596502+0000","last_peered":"2024-09-13T18:47:35.596502+0000","last_clean":"2024-09-13T18:47:35.596502+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:35.596502+0000","last_undegraded":"2024-09-13T18:47:35.596502+0000","last_fullsized":"2024-09-13T18:47:35.596502+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:09.710973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"64'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266144+0000","last_change":"2024-09-13T18:46:41.365544+0000","last_active":"2024-09-13T18:47:27.266144+0000","last_peered":"2024-09-13T18:47:27.266144+0000","last_clean":"2024-09-13T18:47:27.266144+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:27.266144+0000","last_undegraded":"2024-09-13T18:47:27.266144+0000","last_fullsized":"2024-09-13T18:47:27.266144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:11.924521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266891+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.266891+0000","last_peered":"2024-09-13T18:47:27.266891+0000","last_clean":"2024-09-13T18:47:27.266891+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.266891+0000","last_undegraded":"2024-09-13T18:47:27.266891+0000","last_fullsized":"2024-09-13T18:47:27.266891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:52.412194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.560897+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:35.560897+0000","last_peered":"2024-09-13T18:47:35.560897+0000","last_clean":"2024-09-13T18:47:35.560897+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:35.560897+0000","last_undegraded":"2024-09-13T18:47:35.560897+0000","last_fullsized":"2024-09-13T18:47:35.560897+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:44.850190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263324+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.263324+0000","last_peered":"2024-09-13T18:47:27.263324+0000","last_clean":"2024-09-13T18:47:27.263324+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.263324+0000","last_undegraded":"2024-09-13T18:47:27.263324+0000","last_fullsized":"2024-09-13T18:47:27.263324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:52.957185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900470+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.900470+0000","last_peered":"2024-09-13T18:47:27.900470+0000","last_clean":"2024-09-13T18:47:27.900470+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.900470+0000","last_undegraded":"2024-09-13T18:47:27.900470+0000","last_fullsized":"2024-09-13T18:47:27.900470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.566029+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:35.566029+0000","last_peered":"2024-09-13T18:47:35.566029+0000","last_clean":"2024-09-13T18:47:35.566029+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:35.566029+0000","last_undegraded":"2024-09-13T18:47:35.566029+0000","last_fullsized":"2024-09-13T18:47:35.566029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:35.475600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657838+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:26.657838+0000","last_peered":"2024-09-13T18:47:26.657838+0000","last_clean":"2024-09-13T18:47:26.657838+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:26.657838+0000","last_undegraded":"2024-09-13T18:47:26.657838+0000","last_fullsized":"2024-09-13T18:47:26.657838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:32.323592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266878+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.266878+0000","last_peered":"2024-09-13T18:47:27.266878+0000","last_clean":"2024-09-13T18:47:27.266878+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.266878+0000","last_undegraded":"2024-09-13T18:47:27.266878+0000","last_fullsized":"2024-09-13T18:47:27.266878+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:26.455957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.548422+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:35.548422+0000","last_peered":"2024-09-13T18:47:35.548422+0000","last_clean":"2024-09-13T18:47:35.548422+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:35.548422+0000","last_undegraded":"2024-09-13T18:47:35.548422+0000","last_fullsized":"2024-09-13T18:47:35.548422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:57.100043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897583+0000","last_change":"2024-09-13T18:47:14.520002+0000","last_active":"2024-09-13T18:47:27.897583+0000","last_peered":"2024-09-13T18:47:27.897583+0000","last_clean":"2024-09-13T18:47:27.897583+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:27.897583+0000","last_undegraded":"2024-09-13T18:47:27.897583+0000","last_fullsized":"2024-09-13T18:47:27.897583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656294+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:26.656294+0000","last_peered":"2024-09-13T18:47:26.656294+0000","last_clean":"2024-09-13T18:47:26.656294+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:26.656294+0000","last_undegraded":"2024-09-13T18:47:26.656294+0000","last_fullsized":"2024-09-13T18:47:26.656294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:22.123050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.565471+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:35.565471+0000","last_peered":"2024-09-13T18:47:35.565471+0000","last_clean":"2024-09-13T18:47:35.565471+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:35.565471+0000","last_undegraded":"2024-09-13T18:47:35.565471+0000","last_fullsized":"2024-09-13T18:47:35.565471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:35.669330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266890+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.266890+0000","last_peered":"2024-09-13T18:47:27.266890+0000","last_clean":"2024-09-13T18:47:27.266890+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.266890+0000","last_undegraded":"2024-09-13T18:47:27.266890+0000","last_fullsized":"2024-09-13T18:47:27.266890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:32.875056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655511+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:26.655511+0000","last_peered":"2024-09-13T18:47:26.655511+0000","last_clean":"2024-09-13T18:47:26.655511+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:26.655511+0000","last_undegraded":"2024-09-13T18:47:26.655511+0000","last_fullsized":"2024-09-13T18:47:26.655511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:47.368411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.566569+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:35.566569+0000","last_peered":"2024-09-13T18:47:35.566569+0000","last_clean":"2024-09-13T18:47:35.566569+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:35.566569+0000","last_undegraded":"2024-09-13T18:47:35.566569+0000","last_fullsized":"2024-09-13T18:47:35.566569+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:31.149745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659520+0000","last_change":"2024-09-13T18:45:00.851852+0000","last_active":"2024-09-13T18:47:27.659520+0000","last_peered":"2024-09-13T18:47:27.659520+0000","last_clean":"2024-09-13T18:47:27.659520+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:27.659520+0000","last_undegraded":"2024-09-13T18:47:27.659520+0000","last_fullsized":"2024-09-13T18:47:27.659520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:19.567534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.656651+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:26.656651+0000","last_peered":"2024-09-13T18:47:26.656651+0000","last_clean":"2024-09-13T18:47:26.656651+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:26.656651+0000","last_undegraded":"2024-09-13T18:47:26.656651+0000","last_fullsized":"2024-09-13T18:47:26.656651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:51.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576453+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:35.576453+0000","last_peered":"2024-09-13T18:47:35.576453+0000","last_clean":"2024-09-13T18:47:35.576453+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:35.576453+0000","last_undegraded":"2024-09-13T18:47:35.576453+0000","last_fullsized":"2024-09-13T18:47:35.576453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.991581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266744+0000","last_change":"2024-09-13T18:46:41.332674+0000","last_active":"2024-09-13T18:47:27.266744+0000","last_peered":"2024-09-13T18:47:27.266744+0000","last_clean":"2024-09-13T18:47:27.266744+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:27.266744+0000","last_undegraded":"2024-09-13T18:47:27.266744+0000","last_fullsized":"2024-09-13T18:47:27.266744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:03.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264165+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.264165+0000","last_peered":"2024-09-13T18:47:27.264165+0000","last_clean":"2024-09-13T18:47:27.264165+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.264165+0000","last_undegraded":"2024-09-13T18:47:27.264165+0000","last_fullsized":"2024-09-13T18:47:27.264165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:37.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.605212+0000","last_change":"2024-09-13T18:46:17.882740+0000","last_active":"2024-09-13T18:47:35.605212+0000","last_peered":"2024-09-13T18:47:35.605212+0000","last_clean":"2024-09-13T18:47:35.605212+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:35.605212+0000","last_undegraded":"2024-09-13T18:47:35.605212+0000","last_fullsized":"2024-09-13T18:47:35.605212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:36.663084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266528+0000","last_change":"2024-09-13T18:46:17.889689+0000","last_active":"2024-09-13T18:47:27.266528+0000","last_peered":"2024-09-13T18:47:27.266528+0000","last_clean":"2024-09-13T18:47:27.266528+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:27.266528+0000","last_undegraded":"2024-09-13T18:47:27.266528+0000","last_fullsized":"2024-09-13T18:47:27.266528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:55.143739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263593+0000","last_change":"2024-09-13T18:46:41.332589+0000","last_active":"2024-09-13T18:47:27.263593+0000","last_peered":"2024-09-13T18:47:27.263593+0000","last_clean":"2024-09-13T18:47:27.263593+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:27.263593+0000","last_undegraded":"2024-09-13T18:47:27.263593+0000","last_fullsized":"2024-09-13T18:47:27.263593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.313166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.600041+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:35.600041+0000","last_peered":"2024-09-13T18:47:35.600041+0000","last_clean":"2024-09-13T18:47:35.600041+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:35.600041+0000","last_undegraded":"2024-09-13T18:47:35.600041+0000","last_fullsized":"2024-09-13T18:47:35.600041+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265891+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.265891+0000","last_peered":"2024-09-13T18:47:27.265891+0000","last_clean":"2024-09-13T18:47:27.265891+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.265891+0000","last_undegraded":"2024-09-13T18:47:27.265891+0000","last_fullsized":"2024-09-13T18:47:27.265891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:53.521040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263927+0000","last_change":"2024-09-13T18:46:41.332741+0000","last_active":"2024-09-13T18:47:27.263927+0000","last_peered":"2024-09-13T18:47:27.263927+0000","last_clean":"2024-09-13T18:47:27.263927+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:27.263927+0000","last_undegraded":"2024-09-13T18:47:27.263927+0000","last_fullsized":"2024-09-13T18:47:27.263927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:33.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.578876+0000","last_change":"2024-09-13T18:45:01.326971+0000","last_active":"2024-09-13T18:47:35.578876+0000","last_peered":"2024-09-13T18:47:35.578876+0000","last_clean":"2024-09-13T18:47:35.578876+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:35.578876+0000","last_undegraded":"2024-09-13T18:47:35.578876+0000","last_fullsized":"2024-09-13T18:47:35.578876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:05.243968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"67'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266493+0000","last_change":"2024-09-13T18:45:00.846779+0000","last_active":"2024-09-13T18:47:27.266493+0000","last_peered":"2024-09-13T18:47:27.266493+0000","last_clean":"2024-09-13T18:47:27.266493+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:27.266493+0000","last_undegraded":"2024-09-13T18:47:27.266493+0000","last_fullsized":"2024-09-13T18:47:27.266493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:01.280226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264888+0000","last_change":"2024-09-13T18:46:17.881891+0000","last_active":"2024-09-13T18:47:27.264888+0000","last_peered":"2024-09-13T18:47:27.264888+0000","last_clean":"2024-09-13T18:47:27.264888+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:27.264888+0000","last_undegraded":"2024-09-13T18:47:27.264888+0000","last_fullsized":"2024-09-13T18:47:27.264888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:58.610576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597686+0000","last_change":"2024-09-13T18:46:17.866341+0000","last_active":"2024-09-13T18:47:35.597686+0000","last_peered":"2024-09-13T18:47:35.597686+0000","last_clean":"2024-09-13T18:47:35.597686+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:35.597686+0000","last_undegraded":"2024-09-13T18:47:35.597686+0000","last_fullsized":"2024-09-13T18:47:35.597686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:09.544485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265583+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.265583+0000","last_peered":"2024-09-13T18:47:27.265583+0000","last_clean":"2024-09-13T18:47:27.265583+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.265583+0000","last_undegraded":"2024-09-13T18:47:27.265583+0000","last_fullsized":"2024-09-13T18:47:27.265583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.290109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267795+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.267795+0000","last_peered":"2024-09-13T18:47:27.267795+0000","last_clean":"2024-09-13T18:47:27.267795+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.267795+0000","last_undegraded":"2024-09-13T18:47:27.267795+0000","last_fullsized":"2024-09-13T18:47:27.267795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:09.785861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.588394+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:35.588394+0000","last_peered":"2024-09-13T18:47:35.588394+0000","last_clean":"2024-09-13T18:47:35.588394+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:35.588394+0000","last_undegraded":"2024-09-13T18:47:35.588394+0000","last_fullsized":"2024-09-13T18:47:35.588394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:37.024309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266055+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.266055+0000","last_peered":"2024-09-13T18:47:27.266055+0000","last_clean":"2024-09-13T18:47:27.266055+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.266055+0000","last_undegraded":"2024-09-13T18:47:27.266055+0000","last_fullsized":"2024-09-13T18:47:27.266055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:27.405534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261221+0000","last_change":"2024-09-13T18:44:52.314785+0000","last_active":"2024-09-13T18:47:27.261221+0000","last_peered":"2024-09-13T18:47:27.261221+0000","last_clean":"2024-09-13T18:47:27.261221+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:27.261221+0000","last_undegraded":"2024-09-13T18:47:27.261221+0000","last_fullsized":"2024-09-13T18:47:27.261221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:50.745858+0000","last_clean_scrub_stamp":"2024-09-13T18:44:50.745858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:20:30.364095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266732+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.266732+0000","last_peered":"2024-09-13T18:47:27.266732+0000","last_clean":"2024-09-13T18:47:27.266732+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.266732+0000","last_undegraded":"2024-09-13T18:47:27.266732+0000","last_fullsized":"2024-09-13T18:47:27.266732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:43.741754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.596376+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:35.596376+0000","last_peered":"2024-09-13T18:47:35.596376+0000","last_clean":"2024-09-13T18:47:35.596376+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:35.596376+0000","last_undegraded":"2024-09-13T18:47:35.596376+0000","last_fullsized":"2024-09-13T18:47:35.596376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:55.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263597+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.263597+0000","last_peered":"2024-09-13T18:47:27.263597+0000","last_clean":"2024-09-13T18:47:27.263597+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.263597+0000","last_undegraded":"2024-09-13T18:47:27.263597+0000","last_fullsized":"2024-09-13T18:47:27.263597+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:51.085685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655686+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:26.655686+0000","last_peered":"2024-09-13T18:47:26.655686+0000","last_clean":"2024-09-13T18:47:26.655686+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:26.655686+0000","last_undegraded":"2024-09-13T18:47:26.655686+0000","last_fullsized":"2024-09-13T18:47:26.655686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:33.052032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.581737+0000","last_change":"2024-09-13T18:47:14.709999+0000","last_active":"2024-09-13T18:47:35.581737+0000","last_peered":"2024-09-13T18:47:35.581737+0000","last_clean":"2024-09-13T18:47:35.581737+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:35.581737+0000","last_undegraded":"2024-09-13T18:47:35.581737+0000","last_fullsized":"2024-09-13T18:47:35.581737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267884+0000","last_change":"2024-09-13T18:45:00.854659+0000","last_active":"2024-09-13T18:47:27.267884+0000","last_peered":"2024-09-13T18:47:27.267884+0000","last_clean":"2024-09-13T18:47:27.267884+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:27.267884+0000","last_undegraded":"2024-09-13T18:47:27.267884+0000","last_fullsized":"2024-09-13T18:47:27.267884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:59.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267160+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.267160+0000","last_peered":"2024-09-13T18:47:27.267160+0000","last_clean":"2024-09-13T18:47:27.267160+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.267160+0000","last_undegraded":"2024-09-13T18:47:27.267160+0000","last_fullsized":"2024-09-13T18:47:27.267160+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:13.579188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.174420+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:36.174420+0000","last_peered":"2024-09-13T18:47:36.174420+0000","last_clean":"2024-09-13T18:47:36.174420+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:36.174420+0000","last_undegraded":"2024-09-13T18:47:36.174420+0000","last_fullsized":"2024-09-13T18:47:36.174420+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.658197+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:26.658197+0000","last_peered":"2024-09-13T18:47:26.658197+0000","last_clean":"2024-09-13T18:47:26.658197+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:26.658197+0000","last_undegraded":"2024-09-13T18:47:26.658197+0000","last_fullsized":"2024-09-13T18:47:26.658197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:35.064657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265409+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.265409+0000","last_peered":"2024-09-13T18:47:27.265409+0000","last_clean":"2024-09-13T18:47:27.265409+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.265409+0000","last_undegraded":"2024-09-13T18:47:27.265409+0000","last_fullsized":"2024-09-13T18:47:27.265409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:25.205553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.606410+0000","last_change":"2024-09-13T18:45:01.340066+0000","last_active":"2024-09-13T18:47:35.606410+0000","last_peered":"2024-09-13T18:47:35.606410+0000","last_clean":"2024-09-13T18:47:35.606410+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:35.606410+0000","last_undegraded":"2024-09-13T18:47:35.606410+0000","last_fullsized":"2024-09-13T18:47:35.606410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:36.124835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902973+0000","last_change":"2024-09-13T18:47:14.523024+0000","last_active":"2024-09-13T18:47:27.902973+0000","last_peered":"2024-09-13T18:47:27.902973+0000","last_clean":"2024-09-13T18:47:27.902973+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:27.902973+0000","last_undegraded":"2024-09-13T18:47:27.902973+0000","last_fullsized":"2024-09-13T18:47:27.902973+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.261242+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.261242+0000","last_peered":"2024-09-13T18:47:27.261242+0000","last_clean":"2024-09-13T18:47:27.261242+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.261242+0000","last_undegraded":"2024-09-13T18:47:27.261242+0000","last_fullsized":"2024-09-13T18:47:27.261242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:03.756636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.593209+0000","last_change":"2024-09-13T18:46:41.329603+0000","last_active":"2024-09-13T18:47:35.593209+0000","last_peered":"2024-09-13T18:47:35.593209+0000","last_clean":"2024-09-13T18:47:35.593209+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:35.593209+0000","last_undegraded":"2024-09-13T18:47:35.593209+0000","last_fullsized":"2024-09-13T18:47:35.593209+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:28.231817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657139+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:26.657139+0000","last_peered":"2024-09-13T18:47:26.657139+0000","last_clean":"2024-09-13T18:47:26.657139+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:26.657139+0000","last_undegraded":"2024-09-13T18:47:26.657139+0000","last_fullsized":"2024-09-13T18:47:26.657139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:55.119508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659005+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:27.659005+0000","last_peered":"2024-09-13T18:47:27.659005+0000","last_clean":"2024-09-13T18:47:27.659005+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:27.659005+0000","last_undegraded":"2024-09-13T18:47:27.659005+0000","last_fullsized":"2024-09-13T18:47:27.659005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:04.581160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.558392+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:35.558392+0000","last_peered":"2024-09-13T18:47:35.558392+0000","last_clean":"2024-09-13T18:47:35.558392+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:35.558392+0000","last_undegraded":"2024-09-13T18:47:35.558392+0000","last_fullsized":"2024-09-13T18:47:35.558392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:36.103946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897977+0000","last_change":"2024-09-13T18:47:14.654438+0000","last_active":"2024-09-13T18:47:27.897977+0000","last_peered":"2024-09-13T18:47:27.897977+0000","last_clean":"2024-09-13T18:47:27.897977+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:27.897977+0000","last_undegraded":"2024-09-13T18:47:27.897977+0000","last_fullsized":"2024-09-13T18:47:27.897977+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264617+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.264617+0000","last_peered":"2024-09-13T18:47:27.264617+0000","last_clean":"2024-09-13T18:47:27.264617+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.264617+0000","last_undegraded":"2024-09-13T18:47:27.264617+0000","last_fullsized":"2024-09-13T18:47:27.264617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:20.937800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597046+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:35.597046+0000","last_peered":"2024-09-13T18:47:35.597046+0000","last_clean":"2024-09-13T18:47:35.597046+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:35.597046+0000","last_undegraded":"2024-09-13T18:47:35.597046+0000","last_fullsized":"2024-09-13T18:47:35.597046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:17.935204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266196+0000","last_change":"2024-09-13T18:46:41.315588+0000","last_active":"2024-09-13T18:47:27.266196+0000","last_peered":"2024-09-13T18:47:27.266196+0000","last_clean":"2024-09-13T18:47:27.266196+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:27.266196+0000","last_undegraded":"2024-09-13T18:47:27.266196+0000","last_fullsized":"2024-09-13T18:47:27.266196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:07.304493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263761+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.263761+0000","last_peered":"2024-09-13T18:47:27.263761+0000","last_clean":"2024-09-13T18:47:27.263761+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.263761+0000","last_undegraded":"2024-09-13T18:47:27.263761+0000","last_fullsized":"2024-09-13T18:47:27.263761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:40.276428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.579082+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:35.579082+0000","last_peered":"2024-09-13T18:47:35.579082+0000","last_clean":"2024-09-13T18:47:35.579082+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:35.579082+0000","last_undegraded":"2024-09-13T18:47:35.579082+0000","last_fullsized":"2024-09-13T18:47:35.579082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:17.805655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.264479+0000","last_change":"2024-09-13T18:45:00.860542+0000","last_active":"2024-09-13T18:47:27.264479+0000","last_peered":"2024-09-13T18:47:27.264479+0000","last_clean":"2024-09-13T18:47:27.264479+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:27.264479+0000","last_undegraded":"2024-09-13T18:47:27.264479+0000","last_fullsized":"2024-09-13T18:47:27.264479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:11.262467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266569+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.266569+0000","last_peered":"2024-09-13T18:47:27.266569+0000","last_clean":"2024-09-13T18:47:27.266569+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.266569+0000","last_undegraded":"2024-09-13T18:47:27.266569+0000","last_fullsized":"2024-09-13T18:47:27.266569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:32.465017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.571483+0000","last_change":"2024-09-13T18:47:14.649751+0000","last_active":"2024-09-13T18:47:35.571483+0000","last_peered":"2024-09-13T18:47:35.571483+0000","last_clean":"2024-09-13T18:47:35.571483+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:35.571483+0000","last_undegraded":"2024-09-13T18:47:35.571483+0000","last_fullsized":"2024-09-13T18:47:35.571483+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.548471+0000","last_change":"2024-09-13T18:45:00.845804+0000","last_active":"2024-09-13T18:47:35.548471+0000","last_peered":"2024-09-13T18:47:35.548471+0000","last_clean":"2024-09-13T18:47:35.548471+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:35.548471+0000","last_undegraded":"2024-09-13T18:47:35.548471+0000","last_fullsized":"2024-09-13T18:47:35.548471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:03.592719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656411+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:27.656411+0000","last_peered":"2024-09-13T18:47:27.656411+0000","last_clean":"2024-09-13T18:47:27.656411+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:27.656411+0000","last_undegraded":"2024-09-13T18:47:27.656411+0000","last_fullsized":"2024-09-13T18:47:27.656411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:53.865425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.600376+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:35.600376+0000","last_peered":"2024-09-13T18:47:35.600376+0000","last_clean":"2024-09-13T18:47:35.600376+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:35.600376+0000","last_undegraded":"2024-09-13T18:47:35.600376+0000","last_fullsized":"2024-09-13T18:47:35.600376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.461090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"67'6","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898590+0000","last_change":"2024-09-13T18:45:00.846245+0000","last_active":"2024-09-13T18:47:27.898590+0000","last_peered":"2024-09-13T18:47:27.898590+0000","last_clean":"2024-09-13T18:47:27.898590+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:27.898590+0000","last_undegraded":"2024-09-13T18:47:27.898590+0000","last_fullsized":"2024-09-13T18:47:27.898590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:56.845042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.655745+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:26.655745+0000","last_peered":"2024-09-13T18:47:26.655745+0000","last_clean":"2024-09-13T18:47:26.655745+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:26.655745+0000","last_undegraded":"2024-09-13T18:47:26.655745+0000","last_fullsized":"2024-09-13T18:47:26.655745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:30.342913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.580575+0000","last_change":"2024-09-13T18:46:41.332343+0000","last_active":"2024-09-13T18:47:35.580575+0000","last_peered":"2024-09-13T18:47:35.580575+0000","last_clean":"2024-09-13T18:47:35.580575+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:35.580575+0000","last_undegraded":"2024-09-13T18:47:35.580575+0000","last_fullsized":"2024-09-13T18:47:35.580575+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:43.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902934+0000","last_change":"2024-09-13T18:45:00.855543+0000","last_active":"2024-09-13T18:47:27.902934+0000","last_peered":"2024-09-13T18:47:27.902934+0000","last_clean":"2024-09-13T18:47:27.902934+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:27.902934+0000","last_undegraded":"2024-09-13T18:47:27.902934+0000","last_fullsized":"2024-09-13T18:47:27.902934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.896644+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:27.896644+0000","last_peered":"2024-09-13T18:47:27.896644+0000","last_clean":"2024-09-13T18:47:27.896644+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:27.896644+0000","last_undegraded":"2024-09-13T18:47:27.896644+0000","last_fullsized":"2024-09-13T18:47:27.896644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:11.366707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.606598+0000","last_change":"2024-09-13T18:46:41.334055+0000","last_active":"2024-09-13T18:47:35.606598+0000","last_peered":"2024-09-13T18:47:35.606598+0000","last_clean":"2024-09-13T18:47:35.606598+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:47:35.606598+0000","last_undegraded":"2024-09-13T18:47:35.606598+0000","last_fullsized":"2024-09-13T18:47:35.606598+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:28.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.262272+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.262272+0000","last_peered":"2024-09-13T18:47:27.262272+0000","last_clean":"2024-09-13T18:47:27.262272+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.262272+0000","last_undegraded":"2024-09-13T18:47:27.262272+0000","last_fullsized":"2024-09-13T18:47:27.262272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:41.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657696+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:27.657696+0000","last_peered":"2024-09-13T18:47:27.657696+0000","last_clean":"2024-09-13T18:47:27.657696+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:27.657696+0000","last_undegraded":"2024-09-13T18:47:27.657696+0000","last_fullsized":"2024-09-13T18:47:27.657696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:47.512248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:26.657664+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:26.657664+0000","last_peered":"2024-09-13T18:47:26.657664+0000","last_clean":"2024-09-13T18:47:26.657664+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:26.657664+0000","last_undegraded":"2024-09-13T18:47:26.657664+0000","last_fullsized":"2024-09-13T18:47:26.657664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:01.272755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.579813+0000","last_change":"2024-09-13T18:45:01.327168+0000","last_active":"2024-09-13T18:47:35.579813+0000","last_peered":"2024-09-13T18:47:35.579813+0000","last_clean":"2024-09-13T18:47:35.579813+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:35.579813+0000","last_undegraded":"2024-09-13T18:47:35.579813+0000","last_fullsized":"2024-09-13T18:47:35.579813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:05.374451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.265110+0000","last_change":"2024-09-13T18:46:41.342014+0000","last_active":"2024-09-13T18:47:27.265110+0000","last_peered":"2024-09-13T18:47:27.265110+0000","last_clean":"2024-09-13T18:47:27.265110+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:27.265110+0000","last_undegraded":"2024-09-13T18:47:27.265110+0000","last_fullsized":"2024-09-13T18:47:27.265110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:37.649671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.267014+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.267014+0000","last_peered":"2024-09-13T18:47:27.267014+0000","last_clean":"2024-09-13T18:47:27.267014+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.267014+0000","last_undegraded":"2024-09-13T18:47:27.267014+0000","last_fullsized":"2024-09-13T18:47:27.267014+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:45.770789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.581808+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:35.581808+0000","last_peered":"2024-09-13T18:47:35.581808+0000","last_clean":"2024-09-13T18:47:35.581808+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:35.581808+0000","last_undegraded":"2024-09-13T18:47:35.581808+0000","last_fullsized":"2024-09-13T18:47:35.581808+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:45.956617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.263416+0000","last_change":"2024-09-13T18:46:17.870621+0000","last_active":"2024-09-13T18:47:27.263416+0000","last_peered":"2024-09-13T18:47:27.263416+0000","last_clean":"2024-09-13T18:47:27.263416+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:27.263416+0000","last_undegraded":"2024-09-13T18:47:27.263416+0000","last_fullsized":"2024-09-13T18:47:27.263416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:23.614086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.266250+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.266250+0000","last_peered":"2024-09-13T18:47:27.266250+0000","last_clean":"2024-09-13T18:47:27.266250+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.266250+0000","last_undegraded":"2024-09-13T18:47:27.266250+0000","last_fullsized":"2024-09-13T18:47:27.266250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:31.127352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.581154+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:35.581154+0000","last_peered":"2024-09-13T18:47:35.581154+0000","last_clean":"2024-09-13T18:47:35.581154+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:35.581154+0000","last_undegraded":"2024-09-13T18:47:35.581154+0000","last_fullsized":"2024-09-13T18:47:35.581154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:19.129415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.658680+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:27.658680+0000","last_peered":"2024-09-13T18:47:27.658680+0000","last_clean":"2024-09-13T18:47:27.658680+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:27.658680+0000","last_undegraded":"2024-09-13T18:47:27.658680+0000","last_fullsized":"2024-09-13T18:47:27.658680+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:20.213600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657724+0000","last_change":"2024-09-13T18:46:17.892289+0000","last_active":"2024-09-13T18:47:27.657724+0000","last_peered":"2024-09-13T18:47:27.657724+0000","last_clean":"2024-09-13T18:47:27.657724+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:27.657724+0000","last_undegraded":"2024-09-13T18:47:27.657724+0000","last_fullsized":"2024-09-13T18:47:27.657724+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:14.831358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.578539+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:35.578539+0000","last_peered":"2024-09-13T18:47:35.578539+0000","last_clean":"2024-09-13T18:47:35.578539+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:35.578539+0000","last_undegraded":"2024-09-13T18:47:35.578539+0000","last_fullsized":"2024-09-13T18:47:35.578539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:12.118050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898172+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:27.898172+0000","last_peered":"2024-09-13T18:47:27.898172+0000","last_clean":"2024-09-13T18:47:27.898172+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:27.898172+0000","last_undegraded":"2024-09-13T18:47:27.898172+0000","last_fullsized":"2024-09-13T18:47:27.898172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:10.047880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.609132+0000","last_change":"2024-09-13T18:46:17.875394+0000","last_active":"2024-09-13T18:47:35.609132+0000","last_peered":"2024-09-13T18:47:35.609132+0000","last_clean":"2024-09-13T18:47:35.609132+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:35.609132+0000","last_undegraded":"2024-09-13T18:47:35.609132+0000","last_fullsized":"2024-09-13T18:47:35.609132+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:10.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.573651+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:35.573651+0000","last_peered":"2024-09-13T18:47:35.573651+0000","last_clean":"2024-09-13T18:47:35.573651+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:35.573651+0000","last_undegraded":"2024-09-13T18:47:35.573651+0000","last_fullsized":"2024-09-13T18:47:35.573651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:19.468913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.578147+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:35.578147+0000","last_peered":"2024-09-13T18:47:35.578147+0000","last_clean":"2024-09-13T18:47:35.578147+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:35.578147+0000","last_undegraded":"2024-09-13T18:47:35.578147+0000","last_fullsized":"2024-09-13T18:47:35.578147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:55.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576243+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:35.576243+0000","last_peered":"2024-09-13T18:47:35.576243+0000","last_clean":"2024-09-13T18:47:35.576243+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:35.576243+0000","last_undegraded":"2024-09-13T18:47:35.576243+0000","last_fullsized":"2024-09-13T18:47:35.576243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:13.363208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.583459+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:35.583459+0000","last_peered":"2024-09-13T18:47:35.583459+0000","last_clean":"2024-09-13T18:47:35.583459+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:35.583459+0000","last_undegraded":"2024-09-13T18:47:35.583459+0000","last_fullsized":"2024-09-13T18:47:35.583459+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:20.577819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.565044+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:35.565044+0000","last_peered":"2024-09-13T18:47:35.565044+0000","last_clean":"2024-09-13T18:47:35.565044+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:35.565044+0000","last_undegraded":"2024-09-13T18:47:35.565044+0000","last_fullsized":"2024-09-13T18:47:35.565044+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:09.337746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.606495+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:35.606495+0000","last_peered":"2024-09-13T18:47:35.606495+0000","last_clean":"2024-09-13T18:47:35.606495+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:35.606495+0000","last_undegraded":"2024-09-13T18:47:35.606495+0000","last_fullsized":"2024-09-13T18:47:35.606495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.523187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.579681+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:35.579681+0000","last_peered":"2024-09-13T18:47:35.579681+0000","last_clean":"2024-09-13T18:47:35.579681+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:35.579681+0000","last_undegraded":"2024-09-13T18:47:35.579681+0000","last_fullsized":"2024-09-13T18:47:35.579681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:37.340964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.585859+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:35.585859+0000","last_peered":"2024-09-13T18:47:35.585859+0000","last_clean":"2024-09-13T18:47:35.585859+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:35.585859+0000","last_undegraded":"2024-09-13T18:47:35.585859+0000","last_fullsized":"2024-09-13T18:47:35.585859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:08.904302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.598363+0000","last_change":"2024-09-13T18:45:01.328628+0000","last_active":"2024-09-13T18:47:35.598363+0000","last_peered":"2024-09-13T18:47:35.598363+0000","last_clean":"2024-09-13T18:47:35.598363+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:35.598363+0000","last_undegraded":"2024-09-13T18:47:35.598363+0000","last_fullsized":"2024-09-13T18:47:35.598363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:11.650849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.589815+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:35.589815+0000","last_peered":"2024-09-13T18:47:35.589815+0000","last_clean":"2024-09-13T18:47:35.589815+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:35.589815+0000","last_undegraded":"2024-09-13T18:47:35.589815+0000","last_fullsized":"2024-09-13T18:47:35.589815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:58.435520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597686+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:35.597686+0000","last_peered":"2024-09-13T18:47:35.597686+0000","last_clean":"2024-09-13T18:47:35.597686+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:35.597686+0000","last_undegraded":"2024-09-13T18:47:35.597686+0000","last_fullsized":"2024-09-13T18:47:35.597686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:01.345161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595025+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:35.595025+0000","last_peered":"2024-09-13T18:47:35.595025+0000","last_clean":"2024-09-13T18:47:35.595025+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:35.595025+0000","last_undegraded":"2024-09-13T18:47:35.595025+0000","last_fullsized":"2024-09-13T18:47:35.595025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.580406+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:35.580406+0000","last_peered":"2024-09-13T18:47:35.580406+0000","last_clean":"2024-09-13T18:47:35.580406+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:35.580406+0000","last_undegraded":"2024-09-13T18:47:35.580406+0000","last_fullsized":"2024-09-13T18:47:35.580406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:43.187943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.588784+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:35.588784+0000","last_peered":"2024-09-13T18:47:35.588784+0000","last_clean":"2024-09-13T18:47:35.588784+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:35.588784+0000","last_undegraded":"2024-09-13T18:47:35.588784+0000","last_fullsized":"2024-09-13T18:47:35.588784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.235767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.594278+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:35.594278+0000","last_peered":"2024-09-13T18:47:35.594278+0000","last_clean":"2024-09-13T18:47:35.594278+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:35.594278+0000","last_undegraded":"2024-09-13T18:47:35.594278+0000","last_fullsized":"2024-09-13T18:47:35.594278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.797001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.603689+0000","last_change":"2024-09-13T18:46:41.342603+0000","last_active":"2024-09-13T18:47:35.603689+0000","last_peered":"2024-09-13T18:47:35.603689+0000","last_clean":"2024-09-13T18:47:35.603689+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:35.603689+0000","last_undegraded":"2024-09-13T18:47:35.603689+0000","last_fullsized":"2024-09-13T18:47:35.603689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:43.025183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.593590+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:35.593590+0000","last_peered":"2024-09-13T18:47:35.593590+0000","last_clean":"2024-09-13T18:47:35.593590+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:35.593590+0000","last_undegraded":"2024-09-13T18:47:35.593590+0000","last_fullsized":"2024-09-13T18:47:35.593590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:52.359752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.565398+0000","last_change":"2024-09-13T18:46:17.882599+0000","last_active":"2024-09-13T18:47:35.565398+0000","last_peered":"2024-09-13T18:47:35.565398+0000","last_clean":"2024-09-13T18:47:35.565398+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:35.565398+0000","last_undegraded":"2024-09-13T18:47:35.565398+0000","last_fullsized":"2024-09-13T18:47:35.565398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:57.096877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.574928+0000","last_change":"2024-09-13T18:46:17.870498+0000","last_active":"2024-09-13T18:47:35.574928+0000","last_peered":"2024-09-13T18:47:35.574928+0000","last_clean":"2024-09-13T18:47:35.574928+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:35.574928+0000","last_undegraded":"2024-09-13T18:47:35.574928+0000","last_fullsized":"2024-09-13T18:47:35.574928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:16.836528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.594997+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:35.594997+0000","last_peered":"2024-09-13T18:47:35.594997+0000","last_clean":"2024-09-13T18:47:35.594997+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:35.594997+0000","last_undegraded":"2024-09-13T18:47:35.594997+0000","last_fullsized":"2024-09-13T18:47:35.594997+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.586385+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:35.586385+0000","last_peered":"2024-09-13T18:47:35.586385+0000","last_clean":"2024-09-13T18:47:35.586385+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:35.586385+0000","last_undegraded":"2024-09-13T18:47:35.586385+0000","last_fullsized":"2024-09-13T18:47:35.586385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.276799+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:36.276799+0000","last_peered":"2024-09-13T18:47:36.276799+0000","last_clean":"2024-09-13T18:47:36.276799+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:36.276799+0000","last_undegraded":"2024-09-13T18:47:36.276799+0000","last_fullsized":"2024-09-13T18:47:36.276799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595305+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:35.595305+0000","last_peered":"2024-09-13T18:47:35.595305+0000","last_clean":"2024-09-13T18:47:35.595305+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:35.595305+0000","last_undegraded":"2024-09-13T18:47:35.595305+0000","last_fullsized":"2024-09-13T18:47:35.595305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:38.036152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.593683+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:35.593683+0000","last_peered":"2024-09-13T18:47:35.593683+0000","last_clean":"2024-09-13T18:47:35.593683+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:35.593683+0000","last_undegraded":"2024-09-13T18:47:35.593683+0000","last_fullsized":"2024-09-13T18:47:35.593683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.596045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.553917+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:35.553917+0000","last_peered":"2024-09-13T18:47:35.553917+0000","last_clean":"2024-09-13T18:47:35.553917+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:35.553917+0000","last_undegraded":"2024-09-13T18:47:35.553917+0000","last_fullsized":"2024-09-13T18:47:35.553917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:15.602133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.605529+0000","last_change":"2024-09-13T18:45:01.333498+0000","last_active":"2024-09-13T18:47:35.605529+0000","last_peered":"2024-09-13T18:47:35.605529+0000","last_clean":"2024-09-13T18:47:35.605529+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:35.605529+0000","last_undegraded":"2024-09-13T18:47:35.605529+0000","last_fullsized":"2024-09-13T18:47:35.605529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:26.834316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.591661+0000","last_change":"2024-09-13T18:47:14.522436+0000","last_active":"2024-09-13T18:47:35.591661+0000","last_peered":"2024-09-13T18:47:35.591661+0000","last_clean":"2024-09-13T18:47:35.591661+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:35.591661+0000","last_undegraded":"2024-09-13T18:47:35.591661+0000","last_fullsized":"2024-09-13T18:47:35.591661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.605901+0000","last_change":"2024-09-13T18:45:01.327975+0000","last_active":"2024-09-13T18:47:35.605901+0000","last_peered":"2024-09-13T18:47:35.605901+0000","last_clean":"2024-09-13T18:47:35.605901+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:35.605901+0000","last_undegraded":"2024-09-13T18:47:35.605901+0000","last_fullsized":"2024-09-13T18:47:35.605901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:42.480558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576750+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:35.576750+0000","last_peered":"2024-09-13T18:47:35.576750+0000","last_clean":"2024-09-13T18:47:35.576750+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:35.576750+0000","last_undegraded":"2024-09-13T18:47:35.576750+0000","last_fullsized":"2024-09-13T18:47:35.576750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:39.468907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.575936+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:35.575936+0000","last_peered":"2024-09-13T18:47:35.575936+0000","last_clean":"2024-09-13T18:47:35.575936+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:35.575936+0000","last_undegraded":"2024-09-13T18:47:35.575936+0000","last_fullsized":"2024-09-13T18:47:35.575936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:15.907964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.584720+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:35.584720+0000","last_peered":"2024-09-13T18:47:35.584720+0000","last_clean":"2024-09-13T18:47:35.584720+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:35.584720+0000","last_undegraded":"2024-09-13T18:47:35.584720+0000","last_fullsized":"2024-09-13T18:47:35.584720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":87,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2529999999999999,"5min":2.585,"15min":2.585},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.871,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7649999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.393,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.1000000000000001,"15min":1.1180000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.1439999999999999,"15min":1.1739999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.196,"15min":1.244},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5980000000000001,"5min":1.778,"15min":1.778},"last":1.1299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.1970000000000001,"15min":1.222},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5149999999999999,"5min":1.665,"15min":1.665},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.3080000000000001,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.0529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.2989999999999999,"15min":1.337},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.55,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.1839999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.3939999999999999,"15min":1.427},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.268},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.337,"15min":1.3560000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.159}]},{"osd":7,"last update":"Fri Sep 13 18:46:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.4059999999999999,"15min":1.4359999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.4470000000000001,"15min":1.5009999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5920000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.0960000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":995328,"data_stored":521813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.141,"15min":1.181},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.355,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.327}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0720000000000001,"15min":1.0960000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.94499999999999995,"15min":0.95899999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.1619999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.2949999999999999,"15min":1.347},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.609,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.2410000000000001,"15min":1.272},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.4039999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.254,"15min":1.28},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5649999999999999,"5min":1.788,"15min":1.788},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.2829999999999999,"15min":1.3169999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.3500000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.113}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.462,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.024},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.2789999999999999,"15min":1.3109999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.446,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3500000000000001,"15min":1.3839999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.504,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.26},{"interface":"front","average":{"1min":1.099,"5min":1.3680000000000001,"15min":1.413},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5660000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.2070000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.5309999999999999,"15min":1.587},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5609999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.228},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.4550000000000001,"15min":1.4990000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6120000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.357}]}]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":1.161},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.333}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":0.81699999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.212},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.0720000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.421},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":1.2270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.587},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.4950000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.542},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.377}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.96199999999999997,"15min":0.97099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.98699999999999999,"15min":1.034},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.6659999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1379999999999999,"15min":1.1519999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.212},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1299999999999999,"15min":1.1659999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.147}]},{"osd":3,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.014,"15min":1.006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":4.4630000000000001,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.581},{"interface":"front","average":{"1min":1.012,"5min":1.264,"15min":1.306},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.538}]},{"osd":4,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.2969999999999999,"15min":1.3420000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.1989999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.2350000000000001,"15min":1.2629999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.4089999999999998,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.496},{"interface":"front","average":{"1min":1.232,"5min":1.335,"15min":1.3520000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.716}]},{"osd":6,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.252,"15min":1.2809999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.411,"15min":1.4350000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.6379999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:54 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.4159999999999999,"15min":1.47},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.2360000000000002,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":2.484},{"interface":"front","average":{"1min":1.075,"5min":1.335,"15min":1.3779999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.4570000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0589999999999999,"15min":1.087},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.746},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0249999999999999,"15min":1.05},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.022},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0509999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2150000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2989999999999999,"5min":1.375,"15min":1.375},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.105,"15min":1.135},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.874},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.125,"15min":1.151},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2210000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.052}]},{"osd":4,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.86099999999999999},"min":{"1min":0.80700000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0409999999999999,"15min":1.0489999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2869999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0329999999999999,"15min":1.038},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.03,"5min":0.96399999999999997,"15min":0.95299999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.133,"15min":1.127},"min":{"1min":0.77200000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.91900000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3169999999999999,"5min":1.427,"15min":1.427},"last":1.02},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4139999999999999,"5min":1.532,"15min":1.532},"last":0.747}]},{"osd":1,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3300000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.341,"5min":1.349,"15min":1.349},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.91100000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2070000000000001,"5min":1.216,"15min":1.216},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90700000000000003,"15min":0.90100000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0760000000000001,"15min":1.1020000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3700000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.194,"5min":1.466,"15min":1.466},"last":1.04}]},{"osd":4,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90300000000000002,"15min":0.90200000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5169999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.46,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:46:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0429999999999999,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.103},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.999}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":0.85799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.099},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":1.02}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.05}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.997}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":1003520,"data_stored":522485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.94499999999999995,"15min":0.98499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1659999999999999,"5min":1.76,"15min":1.76},"last":1.048},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96599999999999997,"15min":0.97899999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.26}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.012,"15min":1.04},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.538,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.226},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0820000000000001,"15min":1.1040000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.45,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.63400000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.121,"15min":1.1519999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.611,"5min":2.032,"15min":2.032},"last":0.94499999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.403,"15min":1.4890000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.581,"15min":1.681},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3300000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.24}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.98999999999999999,"15min":0.99399999999999999},"min":{"1min":0.66300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3069999999999999,"5min":1.46,"15min":1.46},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0409999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4099999999999999,"5min":1.552,"15min":1.552},"last":1.024},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.1519999999999999,"15min":1.1679999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2729999999999999,"5min":1.597,"15min":1.597},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.552,"5min":1.694,"15min":1.694},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.089,"15min":1.0980000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.5680000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:45.084 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.084 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.085 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.086 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.087 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.088 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.089 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:44:50.745858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=50, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.090 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.091 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.091 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.091 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.091 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.091 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.092 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.093 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.094 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.095 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.096 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.097 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.098 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.098 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.098 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.098 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.098 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.099 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.100 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.100 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.100 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.100 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.100 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:47:45.100 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:47:53.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:53.569 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:05.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.281+0000 7f528ee00700 1 Processor -- start 2024-09-13T18:48:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.281+0000 7f528ee00700 1 -- start start 2024-09-13T18:48:05.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528ee00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f528806c2e0 0x7f52880c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528ee00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f52880c9530 0x7f5288153430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528ee00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52880c4230 con 0x7f528806c6c0 2024-09-13T18:48:05.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528ee00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528815a5b0 con 0x7f528806c2e0 2024-09-13T18:48:05.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528ee00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5288159670 con 0x7f52880c9530 2024-09-13T18:48:05.293 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528d000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f528806c6c0 0x7f528815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:52118/0 (socket says 172.21.15.32:52118) 2024-09-13T18:48:05.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528d000700 1 -- 172.21.15.32:0/787536200 learned_addr learned my addr 172.21.15.32:0/787536200 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:48:05.294 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528e400700 1 --2- 172.21.15.32:0/787536200 >> v2:172.21.15.86:3300/0 conn(0x7f52880c9530 0x7f5288153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528da00700 1 --2- 172.21.15.32:0/787536200 >> v2:172.21.15.32:3300/0 conn(0x7f528806c2e0 0x7f52880c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f5287e00700 1 -- 172.21.15.32:0/787536200 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249585417 0 0) 0x7f52880c4230 con 0x7f528806c6c0 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f5287e00700 1 -- 172.21.15.32:0/787536200 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52700035d0 con 0x7f528806c6c0 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528e400700 1 -- 172.21.15.32:0/787536200 >> v2:172.21.15.32:3300/0 conn(0x7f528806c2e0 msgr2=0x7f52880c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528e400700 1 --2- 172.21.15.32:0/787536200 >> v2:172.21.15.32:3300/0 conn(0x7f528806c2e0 0x7f52880c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528e400700 1 -- 172.21.15.32:0/787536200 >> v1:172.21.15.86:6789/0 conn(0x7f528806c6c0 legacy=0x7f528815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.285+0000 7f528e400700 1 -- 172.21.15.32:0/787536200 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288159930 con 0x7f52880c9530 2024-09-13T18:48:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528e400700 1 --2- 172.21.15.32:0/787536200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288153430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5280009d90 tx=0x7f528000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de2fea34beba612 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f5287e00700 1 -- 172.21.15.32:0/787536200 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528000e070 con 0x7f52880c9530 2024-09-13T18:48:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f5287e00700 1 -- 172.21.15.32:0/787536200 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528000bae0 con 0x7f52880c9530 2024-09-13T18:48:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f5287e00700 1 -- 172.21.15.32:0/787536200 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528000be90 con 0x7f52880c9530 2024-09-13T18:48:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 -- 172.21.15.32:0/787536200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 msgr2=0x7f5288153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 --2- 172.21.15.32:0/787536200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288153430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5280009d90 tx=0x7f528000b330 comp rx=0 tx=0).stop 2024-09-13T18:48:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 -- 172.21.15.32:0/787536200 shutdown_connections 2024-09-13T18:48:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 --2- 172.21.15.32:0/787536200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288153430 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 --2- 172.21.15.32:0/787536200 >> v2:172.21.15.32:3300/0 conn(0x7f528806c2e0 0x7f52880c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 -- 172.21.15.32:0/787536200 >> 172.21.15.32:0/787536200 conn(0x7f528806a390 msgr2=0x7f528806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 -- 172.21.15.32:0/787536200 shutdown_connections 2024-09-13T18:48:05.300 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 -- 172.21.15.32:0/787536200 wait complete. 2024-09-13T18:48:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.289+0000 7f528ee00700 1 Processor -- start 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 -- start start 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f528806c2e0 0x7f528806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 0x7f5288150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5288152640 con 0x7f528806c6c0 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5288149370 con 0x7f52880c9530 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5288149740 con 0x7f528806c2e0 2024-09-13T18:48:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 0x7f5288150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 0x7f5288150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52984/0 (socket says 172.21.15.32:52984) 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 -- 172.21.15.32:0/1304854443 learned_addr learned my addr 172.21.15.32:0/1304854443 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528e400700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528da00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f528806c2e0 0x7f528806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 -- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f528806c2e0 msgr2=0x7f528806f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f528806c2e0 0x7f528806f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 -- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 msgr2=0x7f5288150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 -- 172.21.15.32:0/1304854443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280009a70 con 0x7f528806c6c0 2024-09-13T18:48:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528d000700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 0x7f5288150400 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5274005930 tx=0x7f527400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274005d90 con 0x7f528806c6c0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740070d0 con 0x7f528806c6c0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274007480 con 0x7f528806c6c0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52881480e0 con 0x7f528806c6c0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.293+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5288152080 con 0x7f528806c6c0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.297+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5288147930 con 0x7f528806c6c0 2024-09-13T18:48:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.297+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52740075e0 con 0x7f528806c6c0 2024-09-13T18:48:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.297+0000 7f5285600700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5268066730 0x7f5268068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.301+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f52740839e0 con 0x7f528806c6c0 2024-09-13T18:48:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.301+0000 7f528da00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5268066730 0x7f5268068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.301+0000 7f528da00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5268066730 0x7f5268068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f527c009bf0 tx=0x7f527c009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.305+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5288147930 con 0x7f528806c6c0 2024-09-13T18:48:05.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.493+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f528815a1d0 con 0x7f5268066730 2024-09-13T18:48:05.520 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.513+0000 7f5285600700 1 -- 172.21.15.32:0/1304854443 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+365495 (secure 0 0 0) 0x7f527c0118c0 con 0x7f5268066730 2024-09-13T18:48:05.528 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:48:05.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5268066730 msgr2=0x7f5268068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5268066730 0x7f5268068bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f527c009bf0 tx=0x7f527c009240 comp rx=0 tx=0).stop 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 msgr2=0x7f5288150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 0x7f5288150400 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5274005930 tx=0x7f527400c9e0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 shutdown_connections 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f5268066730 0x7f5268068bf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52880c9530 0x7f5288150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528806c6c0 0x7f5288150400 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 --2- 172.21.15.32:0/1304854443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f528806c2e0 0x7f528806f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 >> 172.21.15.32:0/1304854443 conn(0x7f528806a390 msgr2=0x7f5288158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 shutdown_connections 2024-09-13T18:48:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:05.525+0000 7f528ee00700 1 -- 172.21.15.32:0/1304854443 wait complete. 2024-09-13T18:48:05.534 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:48:05.558 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-13T18:48:04.128836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629278,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":248,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":714,"ondisk_log_size":714,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249400,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725320,"statfs":{"total":773094113280,"available":772838727680,"internally_reserved":0,"allocated":8904704,"data_stored":5130652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005040"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659857+0000","last_change":"2024-09-13T18:46:41.366386+0000","last_active":"2024-09-13T18:47:27.659857+0000","last_peered":"2024-09-13T18:47:27.659857+0000","last_clean":"2024-09-13T18:47:27.659857+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:47:27.659857+0000","last_undegraded":"2024-09-13T18:47:27.659857+0000","last_fullsized":"2024-09-13T18:47:27.659857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:44.019867+0000","last_change":"2024-09-13T18:47:44.020185+0000","last_active":"2024-09-13T18:47:44.019867+0000","last_peered":"2024-09-13T18:47:44.019867+0000","last_clean":"2024-09-13T18:47:44.019867+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:44.019867+0000","last_undegraded":"2024-09-13T18:47:44.019867+0000","last_fullsized":"2024-09-13T18:47:44.019867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_clean_scrub_stamp":"2024-09-13T18:47:44.019755+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.693765+0000","scrub_duration":0.0035153290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897347+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.897347+0000","last_peered":"2024-09-13T18:47:27.897347+0000","last_clean":"2024-09-13T18:47:27.897347+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.897347+0000","last_undegraded":"2024-09-13T18:47:27.897347+0000","last_fullsized":"2024-09-13T18:47:27.897347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.263578+0000","last_change":"2024-09-13T18:47:53.263825+0000","last_active":"2024-09-13T18:47:53.263578+0000","last_peered":"2024-09-13T18:47:53.263578+0000","last_clean":"2024-09-13T18:47:53.263578+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:53.263578+0000","last_undegraded":"2024-09-13T18:47:53.263578+0000","last_fullsized":"2024-09-13T18:47:53.263578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.263522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:19.503992+0000","scrub_duration":0.0029422229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.084921+0000","last_change":"2024-09-13T18:47:48.085118+0000","last_active":"2024-09-13T18:47:48.084921+0000","last_peered":"2024-09-13T18:47:48.084921+0000","last_clean":"2024-09-13T18:47:48.084921+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:48.084921+0000","last_undegraded":"2024-09-13T18:47:48.084921+0000","last_fullsized":"2024-09-13T18:47:48.084921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.084867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:23.745245+0000","scrub_duration":0.0038812949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:30.173313+0000","last_change":"2024-09-13T18:46:17.874482+0000","last_active":"2024-09-13T18:47:30.173313+0000","last_peered":"2024-09-13T18:47:30.173313+0000","last_clean":"2024-09-13T18:47:30.173313+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:47:30.173313+0000","last_undegraded":"2024-09-13T18:47:30.173313+0000","last_fullsized":"2024-09-13T18:47:30.173313+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.561797+0000","last_change":"2024-09-13T18:47:52.561992+0000","last_active":"2024-09-13T18:47:52.561797+0000","last_peered":"2024-09-13T18:47:52.561797+0000","last_clean":"2024-09-13T18:47:52.561797+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:52.561797+0000","last_undegraded":"2024-09-13T18:47:52.561797+0000","last_fullsized":"2024-09-13T18:47:52.561797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.561757+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.865055+0000","scrub_duration":0.0060467489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595949+0000","last_change":"2024-09-13T18:45:01.341430+0000","last_active":"2024-09-13T18:47:35.595949+0000","last_peered":"2024-09-13T18:47:35.595949+0000","last_clean":"2024-09-13T18:47:35.595949+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:47:35.595949+0000","last_undegraded":"2024-09-13T18:47:35.595949+0000","last_fullsized":"2024-09-13T18:47:35.595949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.174265+0000","last_change":"2024-09-13T18:46:41.344150+0000","last_active":"2024-09-13T18:47:35.174265+0000","last_peered":"2024-09-13T18:47:35.174265+0000","last_clean":"2024-09-13T18:47:35.174265+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:47:35.174265+0000","last_undegraded":"2024-09-13T18:47:35.174265+0000","last_fullsized":"2024-09-13T18:47:35.174265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.559250+0000","last_change":"2024-09-13T18:47:43.559400+0000","last_active":"2024-09-13T18:47:43.559250+0000","last_peered":"2024-09-13T18:47:43.559250+0000","last_clean":"2024-09-13T18:47:43.559250+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:43.559250+0000","last_undegraded":"2024-09-13T18:47:43.559250+0000","last_fullsized":"2024-09-13T18:47:43.559250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.559220+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:12.079418+0000","scrub_duration":0.0058698689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.594620+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:35.594620+0000","last_peered":"2024-09-13T18:47:35.594620+0000","last_clean":"2024-09-13T18:47:35.594620+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:35.594620+0000","last_undegraded":"2024-09-13T18:47:35.594620+0000","last_fullsized":"2024-09-13T18:47:35.594620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.174218+0000","last_change":"2024-09-13T18:46:17.875664+0000","last_active":"2024-09-13T18:47:35.174218+0000","last_peered":"2024-09-13T18:47:35.174218+0000","last_clean":"2024-09-13T18:47:35.174218+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:47:35.174218+0000","last_undegraded":"2024-09-13T18:47:35.174218+0000","last_fullsized":"2024-09-13T18:47:35.174218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.568744+0000","last_change":"2024-09-13T18:47:43.568860+0000","last_active":"2024-09-13T18:47:43.568744+0000","last_peered":"2024-09-13T18:47:43.568744+0000","last_clean":"2024-09-13T18:47:43.568744+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:43.568744+0000","last_undegraded":"2024-09-13T18:47:43.568744+0000","last_fullsized":"2024-09-13T18:47:43.568744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.568716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:06.232320+0000","scrub_duration":0.0018263019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.405364+0000","last_change":"2024-09-13T18:47:55.405551+0000","last_active":"2024-09-13T18:47:55.405364+0000","last_peered":"2024-09-13T18:47:55.405364+0000","last_clean":"2024-09-13T18:47:55.405364+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:55.405364+0000","last_undegraded":"2024-09-13T18:47:55.405364+0000","last_fullsized":"2024-09-13T18:47:55.405364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.405321+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:00.336484+0000","scrub_duration":0.0060507419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902314+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.902314+0000","last_peered":"2024-09-13T18:47:27.902314+0000","last_clean":"2024-09-13T18:47:27.902314+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.902314+0000","last_undegraded":"2024-09-13T18:47:27.902314+0000","last_fullsized":"2024-09-13T18:47:27.902314+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.650784+0000","last_change":"2024-09-13T18:46:17.883647+0000","last_active":"2024-09-13T18:47:35.650784+0000","last_peered":"2024-09-13T18:47:35.650784+0000","last_clean":"2024-09-13T18:47:35.650784+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:47:35.650784+0000","last_undegraded":"2024-09-13T18:47:35.650784+0000","last_fullsized":"2024-09-13T18:47:35.650784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897092+0000","last_change":"2024-09-13T18:46:17.884725+0000","last_active":"2024-09-13T18:47:27.897092+0000","last_peered":"2024-09-13T18:47:27.897092+0000","last_clean":"2024-09-13T18:47:27.897092+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:47:27.897092+0000","last_undegraded":"2024-09-13T18:47:27.897092+0000","last_fullsized":"2024-09-13T18:47:27.897092+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900470+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.900470+0000","last_peered":"2024-09-13T18:47:27.900470+0000","last_clean":"2024-09-13T18:47:27.900470+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.900470+0000","last_undegraded":"2024-09-13T18:47:27.900470+0000","last_fullsized":"2024-09-13T18:47:27.900470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.566100+0000","last_change":"2024-09-13T18:45:01.326753+0000","last_active":"2024-09-13T18:47:35.566100+0000","last_peered":"2024-09-13T18:47:35.566100+0000","last_clean":"2024-09-13T18:47:35.566100+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:47:35.566100+0000","last_undegraded":"2024-09-13T18:47:35.566100+0000","last_fullsized":"2024-09-13T18:47:35.566100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.658130+0000","last_change":"2024-09-13T18:45:00.858689+0000","last_active":"2024-09-13T18:47:27.658130+0000","last_peered":"2024-09-13T18:47:27.658130+0000","last_clean":"2024-09-13T18:47:27.658130+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:47:27.658130+0000","last_undegraded":"2024-09-13T18:47:27.658130+0000","last_fullsized":"2024-09-13T18:47:27.658130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898841+0000","last_change":"2024-09-13T18:46:41.320874+0000","last_active":"2024-09-13T18:47:27.898841+0000","last_peered":"2024-09-13T18:47:27.898841+0000","last_clean":"2024-09-13T18:47:27.898841+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:47:27.898841+0000","last_undegraded":"2024-09-13T18:47:27.898841+0000","last_fullsized":"2024-09-13T18:47:27.898841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.580086+0000","last_change":"2024-09-13T18:46:41.332924+0000","last_active":"2024-09-13T18:47:35.580086+0000","last_peered":"2024-09-13T18:47:35.580086+0000","last_clean":"2024-09-13T18:47:35.580086+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:47:35.580086+0000","last_undegraded":"2024-09-13T18:47:35.580086+0000","last_fullsized":"2024-09-13T18:47:35.580086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.652989+0000","last_change":"2024-09-13T18:47:47.653251+0000","last_active":"2024-09-13T18:47:47.652989+0000","last_peered":"2024-09-13T18:47:47.652989+0000","last_clean":"2024-09-13T18:47:47.652989+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:47.652989+0000","last_undegraded":"2024-09-13T18:47:47.652989+0000","last_fullsized":"2024-09-13T18:47:47.652989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.652946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.344600+0000","scrub_duration":0.0030565380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901700+0000","last_change":"2024-09-13T18:46:41.349663+0000","last_active":"2024-09-13T18:47:27.901700+0000","last_peered":"2024-09-13T18:47:27.901700+0000","last_clean":"2024-09-13T18:47:27.901700+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:47:27.901700+0000","last_undegraded":"2024-09-13T18:47:27.901700+0000","last_fullsized":"2024-09-13T18:47:27.901700+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.568105+0000","last_change":"2024-09-13T18:45:01.330343+0000","last_active":"2024-09-13T18:47:35.568105+0000","last_peered":"2024-09-13T18:47:35.568105+0000","last_clean":"2024-09-13T18:47:35.568105+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:47:35.568105+0000","last_undegraded":"2024-09-13T18:47:35.568105+0000","last_fullsized":"2024-09-13T18:47:35.568105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899801+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.899801+0000","last_peered":"2024-09-13T18:47:27.899801+0000","last_clean":"2024-09-13T18:47:27.899801+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.899801+0000","last_undegraded":"2024-09-13T18:47:27.899801+0000","last_fullsized":"2024-09-13T18:47:27.899801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900099+0000","last_change":"2024-09-13T18:46:41.335022+0000","last_active":"2024-09-13T18:47:27.900099+0000","last_peered":"2024-09-13T18:47:27.900099+0000","last_clean":"2024-09-13T18:47:27.900099+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:47:27.900099+0000","last_undegraded":"2024-09-13T18:47:27.900099+0000","last_fullsized":"2024-09-13T18:47:27.900099+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.566669+0000","last_change":"2024-09-13T18:46:17.889766+0000","last_active":"2024-09-13T18:47:35.566669+0000","last_peered":"2024-09-13T18:47:35.566669+0000","last_clean":"2024-09-13T18:47:35.566669+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:47:35.566669+0000","last_undegraded":"2024-09-13T18:47:35.566669+0000","last_fullsized":"2024-09-13T18:47:35.566669+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.220942+0000","last_change":"2024-09-13T18:47:58.221241+0000","last_active":"2024-09-13T18:47:58.220942+0000","last_peered":"2024-09-13T18:47:58.220942+0000","last_clean":"2024-09-13T18:47:58.220942+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:58.220942+0000","last_undegraded":"2024-09-13T18:47:58.220942+0000","last_fullsized":"2024-09-13T18:47:58.220942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.220882+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:31.105081+0000","scrub_duration":0.004045735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656440+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:27.656440+0000","last_peered":"2024-09-13T18:47:27.656440+0000","last_clean":"2024-09-13T18:47:27.656440+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:27.656440+0000","last_undegraded":"2024-09-13T18:47:27.656440+0000","last_fullsized":"2024-09-13T18:47:27.656440+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576537+0000","last_change":"2024-09-13T18:46:17.885084+0000","last_active":"2024-09-13T18:47:35.576537+0000","last_peered":"2024-09-13T18:47:35.576537+0000","last_clean":"2024-09-13T18:47:35.576537+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:47:35.576537+0000","last_undegraded":"2024-09-13T18:47:35.576537+0000","last_fullsized":"2024-09-13T18:47:35.576537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.482595+0000","last_change":"2024-09-13T18:47:51.482767+0000","last_active":"2024-09-13T18:47:51.482595+0000","last_peered":"2024-09-13T18:47:51.482595+0000","last_clean":"2024-09-13T18:47:51.482595+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:51.482595+0000","last_undegraded":"2024-09-13T18:47:51.482595+0000","last_fullsized":"2024-09-13T18:47:51.482595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.482562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:34.558081+0000","scrub_duration":0.0034253259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897901+0000","last_change":"2024-09-13T18:46:17.876121+0000","last_active":"2024-09-13T18:47:27.897901+0000","last_peered":"2024-09-13T18:47:27.897901+0000","last_clean":"2024-09-13T18:47:27.897901+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:47:27.897901+0000","last_undegraded":"2024-09-13T18:47:27.897901+0000","last_fullsized":"2024-09-13T18:47:27.897901+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.051610+0000","last_change":"2024-09-13T18:47:49.051818+0000","last_active":"2024-09-13T18:47:49.051610+0000","last_peered":"2024-09-13T18:47:49.051610+0000","last_clean":"2024-09-13T18:47:49.051610+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:49.051610+0000","last_undegraded":"2024-09-13T18:47:49.051610+0000","last_fullsized":"2024-09-13T18:47:49.051610+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.051559+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.947582+0000","scrub_duration":0.0034011369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.132202+0000","last_change":"2024-09-13T18:47:49.132469+0000","last_active":"2024-09-13T18:47:49.132202+0000","last_peered":"2024-09-13T18:47:49.132202+0000","last_clean":"2024-09-13T18:47:49.132202+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:49.132202+0000","last_undegraded":"2024-09-13T18:47:49.132202+0000","last_fullsized":"2024-09-13T18:47:49.132202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.132146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.405895+0000","scrub_duration":0.0026213619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.433057+0000","last_change":"2024-09-13T18:47:52.433346+0000","last_active":"2024-09-13T18:47:52.433057+0000","last_peered":"2024-09-13T18:47:52.433057+0000","last_clean":"2024-09-13T18:47:52.433057+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:52.433057+0000","last_undegraded":"2024-09-13T18:47:52.433057+0000","last_fullsized":"2024-09-13T18:47:52.433057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.433008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.849816+0000","scrub_duration":0.003833234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.600041+0000","last_change":"2024-09-13T18:47:14.519310+0000","last_active":"2024-09-13T18:47:35.600041+0000","last_peered":"2024-09-13T18:47:35.600041+0000","last_clean":"2024-09-13T18:47:35.600041+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:47:35.600041+0000","last_undegraded":"2024-09-13T18:47:35.600041+0000","last_fullsized":"2024-09-13T18:47:35.600041+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898977+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.898977+0000","last_peered":"2024-09-13T18:47:27.898977+0000","last_clean":"2024-09-13T18:47:27.898977+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.898977+0000","last_undegraded":"2024-09-13T18:47:27.898977+0000","last_fullsized":"2024-09-13T18:47:27.898977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.469058+0000","last_change":"2024-09-13T18:47:53.469359+0000","last_active":"2024-09-13T18:47:53.469058+0000","last_peered":"2024-09-13T18:47:53.469058+0000","last_clean":"2024-09-13T18:47:53.469058+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:53.469058+0000","last_undegraded":"2024-09-13T18:47:53.469058+0000","last_fullsized":"2024-09-13T18:47:53.469058+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.469009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.549365+0000","scrub_duration":0.0034698680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:57.298151+0000","last_change":"2024-09-13T18:47:57.298346+0000","last_active":"2024-09-13T18:47:57.298151+0000","last_peered":"2024-09-13T18:47:57.298151+0000","last_clean":"2024-09-13T18:47:57.298151+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:57.298151+0000","last_undegraded":"2024-09-13T18:47:57.298151+0000","last_fullsized":"2024-09-13T18:47:57.298151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_clean_scrub_stamp":"2024-09-13T18:47:57.298101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:47.457258+0000","scrub_duration":0.0029362590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.334953+0000","last_change":"2024-09-13T18:47:50.335172+0000","last_active":"2024-09-13T18:47:50.334953+0000","last_peered":"2024-09-13T18:47:50.334953+0000","last_clean":"2024-09-13T18:47:50.334953+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:50.334953+0000","last_undegraded":"2024-09-13T18:47:50.334953+0000","last_fullsized":"2024-09-13T18:47:50.334953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.334901+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:43.474237+0000","scrub_duration":0.0055209919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.429439+0000","last_change":"2024-09-13T18:47:55.429800+0000","last_active":"2024-09-13T18:47:55.429439+0000","last_peered":"2024-09-13T18:47:55.429439+0000","last_clean":"2024-09-13T18:47:55.429439+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:55.429439+0000","last_undegraded":"2024-09-13T18:47:55.429439+0000","last_fullsized":"2024-09-13T18:47:55.429439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.429388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:13.248197+0000","scrub_duration":0.0035543609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.497954+0000","last_change":"2024-09-13T18:47:47.498180+0000","last_active":"2024-09-13T18:47:47.497954+0000","last_peered":"2024-09-13T18:47:47.497954+0000","last_clean":"2024-09-13T18:47:47.497954+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:47.497954+0000","last_undegraded":"2024-09-13T18:47:47.497954+0000","last_fullsized":"2024-09-13T18:47:47.497954+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.497898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:43.625983+0000","scrub_duration":0.0036756570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900868+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.900868+0000","last_peered":"2024-09-13T18:47:27.900868+0000","last_clean":"2024-09-13T18:47:27.900868+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.900868+0000","last_undegraded":"2024-09-13T18:47:27.900868+0000","last_fullsized":"2024-09-13T18:47:27.900868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.658565+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.658565+0000","last_peered":"2024-09-13T18:47:27.658565+0000","last_clean":"2024-09-13T18:47:27.658565+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.658565+0000","last_undegraded":"2024-09-13T18:47:27.658565+0000","last_fullsized":"2024-09-13T18:47:27.658565+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.588479+0000","last_change":"2024-09-13T18:45:01.334289+0000","last_active":"2024-09-13T18:47:35.588479+0000","last_peered":"2024-09-13T18:47:35.588479+0000","last_clean":"2024-09-13T18:47:35.588479+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:47:35.588479+0000","last_undegraded":"2024-09-13T18:47:35.588479+0000","last_fullsized":"2024-09-13T18:47:35.588479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901433+0000","last_change":"2024-09-13T18:46:41.343216+0000","last_active":"2024-09-13T18:47:27.901433+0000","last_peered":"2024-09-13T18:47:27.901433+0000","last_clean":"2024-09-13T18:47:27.901433+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:47:27.901433+0000","last_undegraded":"2024-09-13T18:47:27.901433+0000","last_fullsized":"2024-09-13T18:47:27.901433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"81'119","reported_seq":237,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.364193+0000","last_change":"2024-09-13T18:47:56.364342+0000","last_active":"2024-09-13T18:47:56.364193+0000","last_peered":"2024-09-13T18:47:56.364193+0000","last_clean":"2024-09-13T18:47:56.364193+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:56.364193+0000","last_undegraded":"2024-09-13T18:47:56.364193+0000","last_fullsized":"2024-09-13T18:47:56.364193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'119","last_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_deep_scrub":"81'119","last_deep_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.364169+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.913927+0000","scrub_duration":0.010342967999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902184+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.902184+0000","last_peered":"2024-09-13T18:47:27.902184+0000","last_clean":"2024-09-13T18:47:27.902184+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.902184+0000","last_undegraded":"2024-09-13T18:47:27.902184+0000","last_fullsized":"2024-09-13T18:47:27.902184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.078237+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:36.078237+0000","last_peered":"2024-09-13T18:47:36.078237+0000","last_clean":"2024-09-13T18:47:36.078237+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:36.078237+0000","last_undegraded":"2024-09-13T18:47:36.078237+0000","last_fullsized":"2024-09-13T18:47:36.078237+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897378+0000","last_change":"2024-09-13T18:46:17.882289+0000","last_active":"2024-09-13T18:47:27.897378+0000","last_peered":"2024-09-13T18:47:27.897378+0000","last_clean":"2024-09-13T18:47:27.897378+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:47:27.897378+0000","last_undegraded":"2024-09-13T18:47:27.897378+0000","last_fullsized":"2024-09-13T18:47:27.897378+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900644+0000","last_change":"2024-09-13T18:46:41.333987+0000","last_active":"2024-09-13T18:47:27.900644+0000","last_peered":"2024-09-13T18:47:27.900644+0000","last_clean":"2024-09-13T18:47:27.900644+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:47:27.900644+0000","last_undegraded":"2024-09-13T18:47:27.900644+0000","last_fullsized":"2024-09-13T18:47:27.900644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:40.530633+0000","last_change":"2024-09-13T18:47:40.530820+0000","last_active":"2024-09-13T18:47:40.530633+0000","last_peered":"2024-09-13T18:47:40.530633+0000","last_clean":"2024-09-13T18:47:40.530633+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:40.530633+0000","last_undegraded":"2024-09-13T18:47:40.530633+0000","last_fullsized":"2024-09-13T18:47:40.530633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_clean_scrub_stamp":"2024-09-13T18:47:40.530592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:33.146259+0000","scrub_duration":0.0031957550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.234604+0000","last_change":"2024-09-13T18:47:51.234842+0000","last_active":"2024-09-13T18:47:51.234604+0000","last_peered":"2024-09-13T18:47:51.234604+0000","last_clean":"2024-09-13T18:47:51.234604+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:51.234604+0000","last_undegraded":"2024-09-13T18:47:51.234604+0000","last_fullsized":"2024-09-13T18:47:51.234604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.234552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.835687+0000","scrub_duration":0.0096124350000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657444+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.657444+0000","last_peered":"2024-09-13T18:47:27.657444+0000","last_clean":"2024-09-13T18:47:27.657444+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.657444+0000","last_undegraded":"2024-09-13T18:47:27.657444+0000","last_fullsized":"2024-09-13T18:47:27.657444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.174420+0000","last_change":"2024-09-13T18:47:14.526288+0000","last_active":"2024-09-13T18:47:36.174420+0000","last_peered":"2024-09-13T18:47:36.174420+0000","last_clean":"2024-09-13T18:47:36.174420+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:47:36.174420+0000","last_undegraded":"2024-09-13T18:47:36.174420+0000","last_fullsized":"2024-09-13T18:47:36.174420+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.659512+0000","last_change":"2024-09-13T18:45:00.839181+0000","last_active":"2024-09-13T18:47:27.659512+0000","last_peered":"2024-09-13T18:47:27.659512+0000","last_clean":"2024-09-13T18:47:27.659512+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:47:27.659512+0000","last_undegraded":"2024-09-13T18:47:27.659512+0000","last_fullsized":"2024-09-13T18:47:27.659512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900776+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.900776+0000","last_peered":"2024-09-13T18:47:27.900776+0000","last_clean":"2024-09-13T18:47:27.900776+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.900776+0000","last_undegraded":"2024-09-13T18:47:27.900776+0000","last_fullsized":"2024-09-13T18:47:27.900776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.033407+0000","last_change":"2024-09-13T18:47:55.033619+0000","last_active":"2024-09-13T18:47:55.033407+0000","last_peered":"2024-09-13T18:47:55.033407+0000","last_clean":"2024-09-13T18:47:55.033407+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:55.033407+0000","last_undegraded":"2024-09-13T18:47:55.033407+0000","last_fullsized":"2024-09-13T18:47:55.033407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.033356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:27.430817+0000","scrub_duration":0.0033159650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.565941+0000","last_change":"2024-09-13T18:47:42.566061+0000","last_active":"2024-09-13T18:47:42.565941+0000","last_peered":"2024-09-13T18:47:42.565941+0000","last_clean":"2024-09-13T18:47:42.565941+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:42.565941+0000","last_undegraded":"2024-09-13T18:47:42.565941+0000","last_fullsized":"2024-09-13T18:47:42.565941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.565910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:50.152639+0000","scrub_duration":0.0063911790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897782+0000","last_change":"2024-09-13T18:45:05.366969+0000","last_active":"2024-09-13T18:47:27.897782+0000","last_peered":"2024-09-13T18:47:27.897782+0000","last_clean":"2024-09-13T18:47:27.897782+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:47:27.897782+0000","last_undegraded":"2024-09-13T18:47:27.897782+0000","last_fullsized":"2024-09-13T18:47:27.897782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.414535+0000","last_change":"2024-09-13T18:47:58.414789+0000","last_active":"2024-09-13T18:47:58.414535+0000","last_peered":"2024-09-13T18:47:58.414535+0000","last_clean":"2024-09-13T18:47:58.414535+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:58.414535+0000","last_undegraded":"2024-09-13T18:47:58.414535+0000","last_fullsized":"2024-09-13T18:47:58.414535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.414481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:59.349305+0000","scrub_duration":0.0035677840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656862+0000","last_change":"2024-09-13T18:45:00.842053+0000","last_active":"2024-09-13T18:47:27.656862+0000","last_peered":"2024-09-13T18:47:27.656862+0000","last_clean":"2024-09-13T18:47:27.656862+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:27.656862+0000","last_undegraded":"2024-09-13T18:47:27.656862+0000","last_fullsized":"2024-09-13T18:47:27.656862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:34.179157+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:34.179157+0000","last_peered":"2024-09-13T18:47:34.179157+0000","last_clean":"2024-09-13T18:47:34.179157+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:34.179157+0000","last_undegraded":"2024-09-13T18:47:34.179157+0000","last_fullsized":"2024-09-13T18:47:34.179157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.558452+0000","last_change":"2024-09-13T18:45:01.333053+0000","last_active":"2024-09-13T18:47:35.558452+0000","last_peered":"2024-09-13T18:47:35.558452+0000","last_clean":"2024-09-13T18:47:35.558452+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:47:35.558452+0000","last_undegraded":"2024-09-13T18:47:35.558452+0000","last_fullsized":"2024-09-13T18:47:35.558452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.633439+0000","last_change":"2024-09-13T18:47:46.633627+0000","last_active":"2024-09-13T18:47:46.633439+0000","last_peered":"2024-09-13T18:47:46.633439+0000","last_clean":"2024-09-13T18:47:46.633439+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:46.633439+0000","last_undegraded":"2024-09-13T18:47:46.633439+0000","last_fullsized":"2024-09-13T18:47:46.633439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_clean_scrub_stamp":"2024-09-13T18:47:46.633397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:40.331659+0000","scrub_duration":0.0034897349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898950+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.898950+0000","last_peered":"2024-09-13T18:47:27.898950+0000","last_clean":"2024-09-13T18:47:27.898950+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.898950+0000","last_undegraded":"2024-09-13T18:47:27.898950+0000","last_fullsized":"2024-09-13T18:47:27.898950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597542+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:35.597542+0000","last_peered":"2024-09-13T18:47:35.597542+0000","last_clean":"2024-09-13T18:47:35.597542+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:35.597542+0000","last_undegraded":"2024-09-13T18:47:35.597542+0000","last_fullsized":"2024-09-13T18:47:35.597542+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.585465+0000","last_change":"2024-09-13T18:47:42.585618+0000","last_active":"2024-09-13T18:47:42.585465+0000","last_peered":"2024-09-13T18:47:42.585465+0000","last_clean":"2024-09-13T18:47:42.585465+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:42.585465+0000","last_undegraded":"2024-09-13T18:47:42.585465+0000","last_fullsized":"2024-09-13T18:47:42.585465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.585429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:06.282715+0000","scrub_duration":0.002930406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897836+0000","last_change":"2024-09-13T18:46:17.882589+0000","last_active":"2024-09-13T18:47:27.897836+0000","last_peered":"2024-09-13T18:47:27.897836+0000","last_clean":"2024-09-13T18:47:27.897836+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:47:27.897836+0000","last_undegraded":"2024-09-13T18:47:27.897836+0000","last_fullsized":"2024-09-13T18:47:27.897836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.579203+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:35.579203+0000","last_peered":"2024-09-13T18:47:35.579203+0000","last_clean":"2024-09-13T18:47:35.579203+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:35.579203+0000","last_undegraded":"2024-09-13T18:47:35.579203+0000","last_fullsized":"2024-09-13T18:47:35.579203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.445887+0000","last_change":"2024-09-13T18:47:58.446093+0000","last_active":"2024-09-13T18:47:58.445887+0000","last_peered":"2024-09-13T18:47:58.445887+0000","last_clean":"2024-09-13T18:47:58.445887+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:58.445887+0000","last_undegraded":"2024-09-13T18:47:58.445887+0000","last_fullsized":"2024-09-13T18:47:58.445887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.445838+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:59.858545+0000","scrub_duration":0.0076105000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902106+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.902106+0000","last_peered":"2024-09-13T18:47:27.902106+0000","last_clean":"2024-09-13T18:47:27.902106+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.902106+0000","last_undegraded":"2024-09-13T18:47:27.902106+0000","last_fullsized":"2024-09-13T18:47:27.902106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.574729+0000","last_change":"2024-09-13T18:47:55.574935+0000","last_active":"2024-09-13T18:47:55.574729+0000","last_peered":"2024-09-13T18:47:55.574729+0000","last_clean":"2024-09-13T18:47:55.574729+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:55.574729+0000","last_undegraded":"2024-09-13T18:47:55.574729+0000","last_fullsized":"2024-09-13T18:47:55.574729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.574683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:25.940388+0000","scrub_duration":0.0033516209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.985117+0000","last_change":"2024-09-13T18:47:42.985266+0000","last_active":"2024-09-13T18:47:42.985117+0000","last_peered":"2024-09-13T18:47:42.985117+0000","last_clean":"2024-09-13T18:47:42.985117+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:42.985117+0000","last_undegraded":"2024-09-13T18:47:42.985117+0000","last_fullsized":"2024-09-13T18:47:42.985117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'29","last_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_deep_scrub":"81'29","last_deep_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.985080+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:03.523374+0000","scrub_duration":0.0074139399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:28.867289+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:28.867289+0000","last_peered":"2024-09-13T18:47:28.867289+0000","last_clean":"2024-09-13T18:47:28.867289+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:28.867289+0000","last_undegraded":"2024-09-13T18:47:28.867289+0000","last_fullsized":"2024-09-13T18:47:28.867289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.600534+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:35.600534+0000","last_peered":"2024-09-13T18:47:35.600534+0000","last_clean":"2024-09-13T18:47:35.600534+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:35.600534+0000","last_undegraded":"2024-09-13T18:47:35.600534+0000","last_fullsized":"2024-09-13T18:47:35.600534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.324050+0000","last_change":"2024-09-13T18:47:51.324261+0000","last_active":"2024-09-13T18:47:51.324050+0000","last_peered":"2024-09-13T18:47:51.324050+0000","last_clean":"2024-09-13T18:47:51.324050+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:51.324050+0000","last_undegraded":"2024-09-13T18:47:51.324050+0000","last_fullsized":"2024-09-13T18:47:51.324050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.323994+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:47.717548+0000","scrub_duration":0.0067899620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.901087+0000","last_change":"2024-09-13T18:46:41.334285+0000","last_active":"2024-09-13T18:47:27.901087+0000","last_peered":"2024-09-13T18:47:27.901087+0000","last_clean":"2024-09-13T18:47:27.901087+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:47:27.901087+0000","last_undegraded":"2024-09-13T18:47:27.901087+0000","last_fullsized":"2024-09-13T18:47:27.901087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.327704+0000","last_change":"2024-09-13T18:47:58.327922+0000","last_active":"2024-09-13T18:47:58.327704+0000","last_peered":"2024-09-13T18:47:58.327704+0000","last_clean":"2024-09-13T18:47:58.327704+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:58.327704+0000","last_undegraded":"2024-09-13T18:47:58.327704+0000","last_fullsized":"2024-09-13T18:47:58.327704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.327652+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:28.029362+0000","scrub_duration":0.0034717400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.610385+0000","last_change":"2024-09-13T18:47:45.610603+0000","last_active":"2024-09-13T18:47:45.610385+0000","last_peered":"2024-09-13T18:47:45.610385+0000","last_clean":"2024-09-13T18:47:45.610385+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:45.610385+0000","last_undegraded":"2024-09-13T18:47:45.610385+0000","last_fullsized":"2024-09-13T18:47:45.610385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.610340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:52.239335+0000","scrub_duration":0.003118698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:28.874290+0000","last_change":"2024-09-13T18:46:41.322950+0000","last_active":"2024-09-13T18:47:28.874290+0000","last_peered":"2024-09-13T18:47:28.874290+0000","last_clean":"2024-09-13T18:47:28.874290+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:47:28.874290+0000","last_undegraded":"2024-09-13T18:47:28.874290+0000","last_fullsized":"2024-09-13T18:47:28.874290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:00.018241+0000","last_change":"2024-09-13T18:48:00.018459+0000","last_active":"2024-09-13T18:48:00.018241+0000","last_peered":"2024-09-13T18:48:00.018241+0000","last_clean":"2024-09-13T18:48:00.018241+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:48:00.018241+0000","last_undegraded":"2024-09-13T18:48:00.018241+0000","last_fullsized":"2024-09-13T18:48:00.018241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_clean_scrub_stamp":"2024-09-13T18:48:00.018191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:44.339756+0000","scrub_duration":0.0031160409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899268+0000","last_change":"2024-09-13T18:45:00.860746+0000","last_active":"2024-09-13T18:47:27.899268+0000","last_peered":"2024-09-13T18:47:27.899268+0000","last_clean":"2024-09-13T18:47:27.899268+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:47:27.899268+0000","last_undegraded":"2024-09-13T18:47:27.899268+0000","last_fullsized":"2024-09-13T18:47:27.899268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:28.867230+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:28.867230+0000","last_peered":"2024-09-13T18:47:28.867230+0000","last_clean":"2024-09-13T18:47:28.867230+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:28.867230+0000","last_undegraded":"2024-09-13T18:47:28.867230+0000","last_fullsized":"2024-09-13T18:47:28.867230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656215+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:27.656215+0000","last_peered":"2024-09-13T18:47:27.656215+0000","last_clean":"2024-09-13T18:47:27.656215+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:27.656215+0000","last_undegraded":"2024-09-13T18:47:27.656215+0000","last_fullsized":"2024-09-13T18:47:27.656215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.216158+0000","last_change":"2024-09-13T18:47:50.216463+0000","last_active":"2024-09-13T18:47:50.216158+0000","last_peered":"2024-09-13T18:47:50.216158+0000","last_clean":"2024-09-13T18:47:50.216158+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:50.216158+0000","last_undegraded":"2024-09-13T18:47:50.216158+0000","last_fullsized":"2024-09-13T18:47:50.216158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.216108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:45.291203+0000","scrub_duration":0.0033895930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.366654+0000","last_change":"2024-09-13T18:47:56.366764+0000","last_active":"2024-09-13T18:47:56.366654+0000","last_peered":"2024-09-13T18:47:56.366654+0000","last_clean":"2024-09-13T18:47:56.366654+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:56.366654+0000","last_undegraded":"2024-09-13T18:47:56.366654+0000","last_fullsized":"2024-09-13T18:47:56.366654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.366630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:44.072446+0000","scrub_duration":0.0021094109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900251+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.900251+0000","last_peered":"2024-09-13T18:47:27.900251+0000","last_clean":"2024-09-13T18:47:27.900251+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.900251+0000","last_undegraded":"2024-09-13T18:47:27.900251+0000","last_fullsized":"2024-09-13T18:47:27.900251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.581884+0000","last_change":"2024-09-13T18:46:17.878016+0000","last_active":"2024-09-13T18:47:35.581884+0000","last_peered":"2024-09-13T18:47:35.581884+0000","last_clean":"2024-09-13T18:47:35.581884+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:47:35.581884+0000","last_undegraded":"2024-09-13T18:47:35.581884+0000","last_fullsized":"2024-09-13T18:47:35.581884+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.387507+0000","last_change":"2024-09-13T18:47:51.387734+0000","last_active":"2024-09-13T18:47:51.387507+0000","last_peered":"2024-09-13T18:47:51.387507+0000","last_clean":"2024-09-13T18:47:51.387507+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:51.387507+0000","last_undegraded":"2024-09-13T18:47:51.387507+0000","last_fullsized":"2024-09-13T18:47:51.387507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.387457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:25.705238+0000","scrub_duration":0.0035199530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899781+0000","last_change":"2024-09-13T18:46:41.333941+0000","last_active":"2024-09-13T18:47:27.899781+0000","last_peered":"2024-09-13T18:47:27.899781+0000","last_clean":"2024-09-13T18:47:27.899781+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:47:27.899781+0000","last_undegraded":"2024-09-13T18:47:27.899781+0000","last_fullsized":"2024-09-13T18:47:27.899781+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.581272+0000","last_change":"2024-09-13T18:45:01.345256+0000","last_active":"2024-09-13T18:47:35.581272+0000","last_peered":"2024-09-13T18:47:35.581272+0000","last_clean":"2024-09-13T18:47:35.581272+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:47:35.581272+0000","last_undegraded":"2024-09-13T18:47:35.581272+0000","last_fullsized":"2024-09-13T18:47:35.581272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:39.174762+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:39.174762+0000","last_peered":"2024-09-13T18:47:39.174762+0000","last_clean":"2024-09-13T18:47:39.174762+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:39.174762+0000","last_undegraded":"2024-09-13T18:47:39.174762+0000","last_fullsized":"2024-09-13T18:47:39.174762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.182656+0000","last_change":"2024-09-13T18:47:50.182974+0000","last_active":"2024-09-13T18:47:50.182656+0000","last_peered":"2024-09-13T18:47:50.182656+0000","last_clean":"2024-09-13T18:47:50.182656+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:50.182656+0000","last_undegraded":"2024-09-13T18:47:50.182656+0000","last_fullsized":"2024-09-13T18:47:50.182656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.182599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:16.387371+0000","scrub_duration":0.003287786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.583793+0000","last_change":"2024-09-13T18:45:01.324459+0000","last_active":"2024-09-13T18:47:35.583793+0000","last_peered":"2024-09-13T18:47:35.583793+0000","last_clean":"2024-09-13T18:47:35.583793+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:47:35.583793+0000","last_undegraded":"2024-09-13T18:47:35.583793+0000","last_fullsized":"2024-09-13T18:47:35.583793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:39.160272+0000","last_change":"2024-09-13T18:45:05.368798+0000","last_active":"2024-09-13T18:47:39.160272+0000","last_peered":"2024-09-13T18:47:39.160272+0000","last_clean":"2024-09-13T18:47:39.160272+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:47:39.160272+0000","last_undegraded":"2024-09-13T18:47:39.160272+0000","last_fullsized":"2024-09-13T18:47:39.160272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.051036+0000","last_change":"2024-09-13T18:47:45.051211+0000","last_active":"2024-09-13T18:47:45.051036+0000","last_peered":"2024-09-13T18:47:45.051036+0000","last_clean":"2024-09-13T18:47:45.051036+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:45.051036+0000","last_undegraded":"2024-09-13T18:47:45.051036+0000","last_fullsized":"2024-09-13T18:47:45.051036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.050997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:29.820112+0000","scrub_duration":0.002900452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.573782+0000","last_change":"2024-09-13T18:45:01.326432+0000","last_active":"2024-09-13T18:47:35.573782+0000","last_peered":"2024-09-13T18:47:35.573782+0000","last_clean":"2024-09-13T18:47:35.573782+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:47:35.573782+0000","last_undegraded":"2024-09-13T18:47:35.573782+0000","last_fullsized":"2024-09-13T18:47:35.573782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.586681+0000","last_change":"2024-09-13T18:46:41.331327+0000","last_active":"2024-09-13T18:47:35.586681+0000","last_peered":"2024-09-13T18:47:35.586681+0000","last_clean":"2024-09-13T18:47:35.586681+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:47:35.586681+0000","last_undegraded":"2024-09-13T18:47:35.586681+0000","last_fullsized":"2024-09-13T18:47:35.586681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576814+0000","last_change":"2024-09-13T18:45:01.329612+0000","last_active":"2024-09-13T18:47:35.576814+0000","last_peered":"2024-09-13T18:47:35.576814+0000","last_clean":"2024-09-13T18:47:35.576814+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:47:35.576814+0000","last_undegraded":"2024-09-13T18:47:35.576814+0000","last_fullsized":"2024-09-13T18:47:35.576814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.583542+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:35.583542+0000","last_peered":"2024-09-13T18:47:35.583542+0000","last_clean":"2024-09-13T18:47:35.583542+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:35.583542+0000","last_undegraded":"2024-09-13T18:47:35.583542+0000","last_fullsized":"2024-09-13T18:47:35.583542+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.565153+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:35.565153+0000","last_peered":"2024-09-13T18:47:35.565153+0000","last_clean":"2024-09-13T18:47:35.565153+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:35.565153+0000","last_undegraded":"2024-09-13T18:47:35.565153+0000","last_fullsized":"2024-09-13T18:47:35.565153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.606736+0000","last_change":"2024-09-13T18:46:41.347694+0000","last_active":"2024-09-13T18:47:35.606736+0000","last_peered":"2024-09-13T18:47:35.606736+0000","last_clean":"2024-09-13T18:47:35.606736+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:47:35.606736+0000","last_undegraded":"2024-09-13T18:47:35.606736+0000","last_fullsized":"2024-09-13T18:47:35.606736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.580370+0000","last_change":"2024-09-13T18:45:01.339416+0000","last_active":"2024-09-13T18:47:35.580370+0000","last_peered":"2024-09-13T18:47:35.580370+0000","last_clean":"2024-09-13T18:47:35.580370+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:47:35.580370+0000","last_undegraded":"2024-09-13T18:47:35.580370+0000","last_fullsized":"2024-09-13T18:47:35.580370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.585952+0000","last_change":"2024-09-13T18:46:41.331132+0000","last_active":"2024-09-13T18:47:35.585952+0000","last_peered":"2024-09-13T18:47:35.585952+0000","last_clean":"2024-09-13T18:47:35.585952+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:47:35.585952+0000","last_undegraded":"2024-09-13T18:47:35.585952+0000","last_fullsized":"2024-09-13T18:47:35.585952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.061803+0000","last_change":"2024-09-13T18:47:45.062044+0000","last_active":"2024-09-13T18:47:45.061803+0000","last_peered":"2024-09-13T18:47:45.061803+0000","last_clean":"2024-09-13T18:47:45.061803+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:45.061803+0000","last_undegraded":"2024-09-13T18:47:45.061803+0000","last_fullsized":"2024-09-13T18:47:45.061803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.061720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:57.256752+0000","scrub_duration":0.0031242209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.589902+0000","last_change":"2024-09-13T18:45:01.339112+0000","last_active":"2024-09-13T18:47:35.589902+0000","last_peered":"2024-09-13T18:47:35.589902+0000","last_clean":"2024-09-13T18:47:35.589902+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:47:35.589902+0000","last_undegraded":"2024-09-13T18:47:35.589902+0000","last_fullsized":"2024-09-13T18:47:35.589902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597814+0000","last_change":"2024-09-13T18:45:01.334327+0000","last_active":"2024-09-13T18:47:35.597814+0000","last_peered":"2024-09-13T18:47:35.597814+0000","last_clean":"2024-09-13T18:47:35.597814+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:47:35.597814+0000","last_undegraded":"2024-09-13T18:47:35.597814+0000","last_fullsized":"2024-09-13T18:47:35.597814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595025+0000","last_change":"2024-09-13T18:47:14.525907+0000","last_active":"2024-09-13T18:47:35.595025+0000","last_peered":"2024-09-13T18:47:35.595025+0000","last_clean":"2024-09-13T18:47:35.595025+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:47:35.595025+0000","last_undegraded":"2024-09-13T18:47:35.595025+0000","last_fullsized":"2024-09-13T18:47:35.595025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.588986+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:35.588986+0000","last_peered":"2024-09-13T18:47:35.588986+0000","last_clean":"2024-09-13T18:47:35.588986+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:35.588986+0000","last_undegraded":"2024-09-13T18:47:35.588986+0000","last_fullsized":"2024-09-13T18:47:35.588986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.589215+0000","last_change":"2024-09-13T18:45:01.329356+0000","last_active":"2024-09-13T18:47:35.589215+0000","last_peered":"2024-09-13T18:47:35.589215+0000","last_clean":"2024-09-13T18:47:35.589215+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:47:35.589215+0000","last_undegraded":"2024-09-13T18:47:35.589215+0000","last_fullsized":"2024-09-13T18:47:35.589215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595509+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:35.595509+0000","last_peered":"2024-09-13T18:47:35.595509+0000","last_clean":"2024-09-13T18:47:35.595509+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:35.595509+0000","last_undegraded":"2024-09-13T18:47:35.595509+0000","last_fullsized":"2024-09-13T18:47:35.595509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.561801+0000","last_change":"2024-09-13T18:47:47.562108+0000","last_active":"2024-09-13T18:47:47.561801+0000","last_peered":"2024-09-13T18:47:47.561801+0000","last_clean":"2024-09-13T18:47:47.561801+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:47.561801+0000","last_undegraded":"2024-09-13T18:47:47.561801+0000","last_fullsized":"2024-09-13T18:47:47.561801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.561735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:10.120901+0000","scrub_duration":0.0037975349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.593691+0000","last_change":"2024-09-13T18:45:01.337475+0000","last_active":"2024-09-13T18:47:35.593691+0000","last_peered":"2024-09-13T18:47:35.593691+0000","last_clean":"2024-09-13T18:47:35.593691+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:47:35.593691+0000","last_undegraded":"2024-09-13T18:47:35.593691+0000","last_fullsized":"2024-09-13T18:47:35.593691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.424315+0000","last_change":"2024-09-13T18:47:49.424537+0000","last_active":"2024-09-13T18:47:49.424315+0000","last_peered":"2024-09-13T18:47:49.424315+0000","last_clean":"2024-09-13T18:47:49.424315+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:49.424315+0000","last_undegraded":"2024-09-13T18:47:49.424315+0000","last_fullsized":"2024-09-13T18:47:49.424315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.424264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:14.286009+0000","scrub_duration":0.00282059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:54.464900+0000","last_change":"2024-09-13T18:47:54.465116+0000","last_active":"2024-09-13T18:47:54.464900+0000","last_peered":"2024-09-13T18:47:54.464900+0000","last_clean":"2024-09-13T18:47:54.464900+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:54.464900+0000","last_undegraded":"2024-09-13T18:47:54.464900+0000","last_fullsized":"2024-09-13T18:47:54.464900+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_clean_scrub_stamp":"2024-09-13T18:47:54.464839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:40.461015+0000","scrub_duration":0.0036862280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.594997+0000","last_change":"2024-09-13T18:47:14.525814+0000","last_active":"2024-09-13T18:47:35.594997+0000","last_peered":"2024-09-13T18:47:35.594997+0000","last_clean":"2024-09-13T18:47:35.594997+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:47:35.594997+0000","last_undegraded":"2024-09-13T18:47:35.594997+0000","last_fullsized":"2024-09-13T18:47:35.594997+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.586385+0000","last_change":"2024-09-13T18:47:14.654647+0000","last_active":"2024-09-13T18:47:35.586385+0000","last_peered":"2024-09-13T18:47:35.586385+0000","last_clean":"2024-09-13T18:47:35.586385+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:47:35.586385+0000","last_undegraded":"2024-09-13T18:47:35.586385+0000","last_fullsized":"2024-09-13T18:47:35.586385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.276799+0000","last_change":"2024-09-13T18:47:14.520335+0000","last_active":"2024-09-13T18:47:36.276799+0000","last_peered":"2024-09-13T18:47:36.276799+0000","last_clean":"2024-09-13T18:47:36.276799+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:47:36.276799+0000","last_undegraded":"2024-09-13T18:47:36.276799+0000","last_fullsized":"2024-09-13T18:47:36.276799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595368+0000","last_change":"2024-09-13T18:46:41.326388+0000","last_active":"2024-09-13T18:47:35.595368+0000","last_peered":"2024-09-13T18:47:35.595368+0000","last_clean":"2024-09-13T18:47:35.595368+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:47:35.595368+0000","last_undegraded":"2024-09-13T18:47:35.595368+0000","last_fullsized":"2024-09-13T18:47:35.595368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.593756+0000","last_change":"2024-09-13T18:45:01.332434+0000","last_active":"2024-09-13T18:47:35.593756+0000","last_peered":"2024-09-13T18:47:35.593756+0000","last_clean":"2024-09-13T18:47:35.593756+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:47:35.593756+0000","last_undegraded":"2024-09-13T18:47:35.593756+0000","last_fullsized":"2024-09-13T18:47:35.593756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.566677+0000","last_change":"2024-09-13T18:45:45.660969+0000","last_active":"2024-09-13T18:47:35.566677+0000","last_peered":"2024-09-13T18:47:35.566677+0000","last_clean":"2024-09-13T18:47:35.566677+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:47:35.566677+0000","last_undegraded":"2024-09-13T18:47:35.566677+0000","last_fullsized":"2024-09-13T18:47:35.566677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.122072+0000","last_change":"2024-09-13T18:47:53.122354+0000","last_active":"2024-09-13T18:47:53.122072+0000","last_peered":"2024-09-13T18:47:53.122072+0000","last_clean":"2024-09-13T18:47:53.122072+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:53.122072+0000","last_undegraded":"2024-09-13T18:47:53.122072+0000","last_fullsized":"2024-09-13T18:47:53.122072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.122017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:58.006765+0000","scrub_duration":0.003838228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.591872+0000","last_change":"2024-09-13T18:47:53.592321+0000","last_active":"2024-09-13T18:47:53.591872+0000","last_peered":"2024-09-13T18:47:53.591872+0000","last_clean":"2024-09-13T18:47:53.591872+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:53.591872+0000","last_undegraded":"2024-09-13T18:47:53.591872+0000","last_fullsized":"2024-09-13T18:47:53.591872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.591804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:03.584134+0000","scrub_duration":0.0026496750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.037967+0000","last_change":"2024-09-13T18:47:48.038206+0000","last_active":"2024-09-13T18:47:48.037967+0000","last_peered":"2024-09-13T18:47:48.037967+0000","last_clean":"2024-09-13T18:47:48.037967+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:48.037967+0000","last_undegraded":"2024-09-13T18:47:48.037967+0000","last_fullsized":"2024-09-13T18:47:48.037967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.037918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:34.291038+0000","scrub_duration":0.0034905460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576817+0000","last_change":"2024-09-13T18:45:01.328071+0000","last_active":"2024-09-13T18:47:35.576817+0000","last_peered":"2024-09-13T18:47:35.576817+0000","last_clean":"2024-09-13T18:47:35.576817+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:47:35.576817+0000","last_undegraded":"2024-09-13T18:47:35.576817+0000","last_fullsized":"2024-09-13T18:47:35.576817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.576909+0000","last_change":"2024-09-13T18:46:17.892047+0000","last_active":"2024-09-13T18:47:35.576909+0000","last_peered":"2024-09-13T18:47:35.576909+0000","last_clean":"2024-09-13T18:47:35.576909+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:47:35.576909+0000","last_undegraded":"2024-09-13T18:47:35.576909+0000","last_fullsized":"2024-09-13T18:47:35.576909+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.584720+0000","last_change":"2024-09-13T18:47:14.655184+0000","last_active":"2024-09-13T18:47:35.584720+0000","last_peered":"2024-09-13T18:47:35.584720+0000","last_clean":"2024-09-13T18:47:35.584720+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:47:35.584720+0000","last_undegraded":"2024-09-13T18:47:35.584720+0000","last_fullsized":"2024-09-13T18:47:35.584720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":87,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91700000000000004,"15min":0.96099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0569999999999999,"5min":2.585,"15min":2.585},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.99299999999999999,"15min":1.0329999999999999},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.736,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.0389999999999999},"min":{"1min":0.60499999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3300000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.115,"15min":1.123},"min":{"1min":0.72599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.238}]},{"osd":2,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.143,"15min":1.1739999999999999},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.052},{"interface":"front","average":{"1min":1.242,"5min":1.1910000000000001,"15min":1.2430000000000001},"min":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3520000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.163,"15min":1.2110000000000001},"min":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5609999999999999,"5min":1.665,"15min":1.665},"last":1.02},{"interface":"front","average":{"1min":1.373,"5min":1.3129999999999999,"15min":1.337},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4370000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.254,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.677,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.466},{"interface":"front","average":{"1min":1.49,"5min":1.3340000000000001,"15min":1.3440000000000001},"min":{"1min":0.98399999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.589}]},{"osd":6,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.3999999999999999,"15min":1.429},"min":{"1min":0.79100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.296,"15min":1.3420000000000001},"min":{"1min":0.75800000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.544,"5min":2.355,"15min":2.355},"last":1.089}]},{"osd":7,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.367,"15min":1.423},"min":{"1min":0.81399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.6859999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.395},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.484},"min":{"1min":0.83799999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.931,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.1950000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":995328,"data_stored":521813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.58899999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.3390000000000004,"5min":4.3390000000000004,"15min":4.3390000000000004},"last":1.099},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1160000000000001,"15min":1.1719999999999999},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.874}]},{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.085,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":0.997,"15min":0.97599999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.337},"min":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.353},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.2609999999999999,"15min":1.2789999999999999},"min":{"1min":0.58499999999999996,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":1.1559999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.2889999999999999,"15min":1.2909999999999999},"min":{"1min":0.876,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":4.5869999999999997,"5min":4.5869999999999997,"15min":4.5869999999999997},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.278,"15min":1.3149999999999999},"min":{"1min":0.88100000000000001,"5min":0.752,"15min":0.752},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.446}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.4379999999999999},"min":{"1min":0.80400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.3129999999999999,"15min":1.3220000000000001},"min":{"1min":0.874,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.0620000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.365,"15min":1.389},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":1.226},{"interface":"front","average":{"1min":1.573,"5min":1.3959999999999999,"15min":1.4219999999999999},"min":{"1min":0.91400000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.506,"15min":1.579},"min":{"1min":0.755,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.472,"15min":1.5049999999999999},"min":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.6639999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":1.323}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.97599999999999998,"15min":0.99399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3819999999999999,"5min":1.413,"15min":1.413},"last":0.876},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.145,"15min":1.181},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4330000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.0069999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.036,"15min":1.048},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.508,"5min":1.544,"15min":1.544},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.125,"15min":1.129},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.5980000000000001,"5min":2.121,"15min":2.121},"last":1.4970000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.222,"15min":1.2609999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.577,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.22},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":0.91200000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.321,"15min":1.363},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.357,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":1.119},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3740000000000001,"15min":1.4279999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.512,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.4350000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.444,"15min":1.4970000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.657,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4770000000000001,"15min":1.5249999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8500000000000001,"5min":2.911,"15min":2.911},"last":1.3700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.454,"15min":1.512},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.637,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.135,"5min":1.5820000000000001,"15min":1.6559999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.631,"5min":3.5979999999999999,"15min":3.5979999999999999},"last":1.1850000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.607,"15min":1.675},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.6799999999999999,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.607,"15min":1.655},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.0539999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.216}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3460000000000001,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.996,"5min":0.97399999999999998,"15min":1.03},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6659999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1459999999999999},"min":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.405,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.105,"15min":1.157},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7769999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.048,"15min":1.018},"min":{"1min":0.57599999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.2430000000000001,"15min":1.2989999999999999},"min":{"1min":0.68999999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9039999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.401}]},{"osd":4,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2749999999999999,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.819,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.216},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.2509999999999999},"min":{"1min":0.83499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3759999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.95099999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.875,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":0.997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3300000000000001,"15min":1.3500000000000001},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9910000000000001,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.1679999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.228,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.778,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.3979999999999999,"15min":1.4299999999999999},"min":{"1min":0.89400000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.982,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.091}]},{"osd":7,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3939999999999999,"15min":1.462},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.319,"15min":1.373},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9299999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.206}]}]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0429999999999999,"15min":1.081},"min":{"1min":0.63700000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.425,"5min":2.798,"15min":2.798},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.0569999999999999,"15min":1.0900000000000001},"min":{"1min":0.59999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5429999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":0.998}]},{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.046},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.008,"15min":1.05},"min":{"1min":0.65700000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.044}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0580000000000001,"15min":1.0780000000000001},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":2.105,"5min":2.593,"15min":2.593},"last":0.752},{"interface":"front","average":{"1min":1.133,"5min":1.0660000000000001,"15min":1.0860000000000001},"min":{"1min":0.67600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.0229999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0860000000000001,"15min":1.1279999999999999},"min":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4039999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1120000000000001,"15min":1.147},"min":{"1min":0.68400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0840000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.873,"15min":0.85899999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2569999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0309999999999999,"15min":1.0369999999999999},"min":{"1min":0.66300000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.462,"5min":1.573,"15min":1.573},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96499999999999997,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2769999999999999,"5min":1.619,"15min":1.619},"last":0.88}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.034},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.375,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.999,"5min":1.1080000000000001,"15min":1.119},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4410000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.72899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.64300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.115},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.747,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4830000000000001,"5min":1.532,"15min":1.532},"last":0.82499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95499999999999996,"15min":0.98099999999999998},"min":{"1min":0.69599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1479999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.86899999999999999,"15min":0.84699999999999998},"min":{"1min":0.64100000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.139}]},{"osd":2,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92100000000000004,"15min":0.91700000000000004},"min":{"1min":0.66400000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.91300000000000003,"15min":0.90300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.034}]},{"osd":3,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0600000000000001,"15min":1.0960000000000001},"min":{"1min":0.65900000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5669999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.85299999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.052}]},{"osd":4,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.876,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.077,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1699999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.046,"15min":1.081},"min":{"1min":0.67900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1799999999999999,"5min":1.76,"15min":1.76},"last":0.76000000000000001},{"interface":"front","average":{"1min":1,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.745,"5min":0.629,"15min":0.629},"max":{"1min":1.4259999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0409999999999999,"15min":1.0309999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3700000000000001,"5min":1.677,"15min":1.677},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.86099999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.135,"15min":1.0109999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":25.111999999999998,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.843,"5min":1.2,"15min":1.093},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":24.834,"5min":24.834,"15min":24.834},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95599999999999996,"15min":0.96799999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.022},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2050000000000001,"5min":1.415,"15min":1.415},"last":1.1399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.087,"15min":1.119},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2350000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0900000000000001,"15min":1.115},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.97899999999999998,"15min":0.999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.877,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1799999999999999,"5min":1.468,"15min":1.468},"last":0.86099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0960000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":1.0029999999999999,"15min":1.02},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.248,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.0509999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.036,"15min":1.056},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.325,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0640000000000001,"15min":1.0820000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.294},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:46:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.004,"15min":1.014},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4370000000000001,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.143,"15min":1.159},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3720000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.077}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":1003520,"data_stored":522485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93899999999999995,"15min":0.98299999999999998},"min":{"1min":0.72299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.202,"5min":1.76,"15min":1.76},"last":0.996},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95099999999999996,"15min":0.97399999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.26,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0069999999999999,"15min":1.0389999999999999},"min":{"1min":0.749,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.466,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.874},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0720000000000001,"15min":1.101},"min":{"1min":0.93000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.292,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.046}]},{"osd":2,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68400000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3919999999999999,"5min":1.508,"15min":1.508},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1000000000000001,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.23,"5min":2.032,"15min":2.032},"last":1.1060000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.296,"15min":1.454},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.371,"5min":10.058999999999999,"15min":10.058999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.4570000000000001,"15min":1.6399999999999999},"min":{"1min":0.80000000000000004,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.02}]},{"osd":5,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.89500000000000002},"min":{"1min":0.61199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.96399999999999997,"15min":0.98599999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0800000000000001,"5min":1.46,"15min":1.46},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.02,"15min":1.0349999999999999},"min":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.339,"5min":1.552,"15min":1.552},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.111,"15min":1.1539999999999999},"min":{"1min":0.67000000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.288,"5min":1.597,"15min":1.597},"last":0.624}]},{"osd":7,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.121,"15min":1.1399999999999999},"min":{"1min":0.70599999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.224,"5min":1.694,"15min":1.694},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.997,"5min":1.0669999999999999,"15min":1.091},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3180000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:48:05.566 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.566 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.566 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.567 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.568 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.568 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.568 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.569 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.569 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.570 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.571 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.572 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.573 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.574 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.575 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.576 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.577 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.578 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.578 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.578 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.578 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:05.578 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:48:23.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:23.763 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:25.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:25.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 Processor -- start 2024-09-13T18:48:25.756 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 -- start start 2024-09-13T18:48:25.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ef80c8120 0x7f4ef80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4ef80cb690 0x7f4ef80719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef815a7e0 con 0x7f4ef80c92c0 2024-09-13T18:48:25.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80c8960 con 0x7f4ef80cb690 2024-09-13T18:48:25.758 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4f00000700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef8159810 con 0x7f4ef80c8120 2024-09-13T18:48:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4efcc00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f4ef80c8120 0x7f4ef80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4efd600700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f4ef80c92c0 0x7f4ef815cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:39760/0 (socket says 172.21.15.32:39760) 2024-09-13T18:48:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4efd600700 1 -- 172.21.15.32:0/895674897 learned_addr learned my addr 172.21.15.32:0/895674897 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:48:25.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.752+0000 7f4efe000700 1 --2- 172.21.15.32:0/895674897 >> v2:172.21.15.32:3300/0 conn(0x7f4ef80cb690 0x7f4ef80719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4efcc00700 1 -- 172.21.15.32:0/895674897 >> v2:172.21.15.32:3300/0 conn(0x7f4ef80cb690 msgr2=0x7f4ef80719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4efcc00700 1 --2- 172.21.15.32:0/895674897 >> v2:172.21.15.32:3300/0 conn(0x7f4ef80cb690 0x7f4ef80719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4ef7e00700 1 -- 172.21.15.32:0/895674897 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150670568 0 0) 0x7f4ef815a7e0 con 0x7f4ef80c92c0 2024-09-13T18:48:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4efcc00700 1 -- 172.21.15.32:0/895674897 >> v1:172.21.15.86:6789/0 conn(0x7f4ef80c92c0 legacy=0x7f4ef815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4efcc00700 1 -- 172.21.15.32:0/895674897 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef815a350 con 0x7f4ef80c8120 2024-09-13T18:48:25.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4efcc00700 1 --2- 172.21.15.32:0/895674897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c8120 0x7f4ef80c76d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80c8ac0 tx=0x7f4ee4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17bf04479c682d2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4ef7e00700 1 -- 172.21.15.32:0/895674897 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4011830 con 0x7f4ef80c8120 2024-09-13T18:48:25.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4ef7e00700 1 -- 172.21.15.32:0/895674897 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4011990 con 0x7f4ef80c8120 2024-09-13T18:48:25.761 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4ef7e00700 1 -- 172.21.15.32:0/895674897 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4011d40 con 0x7f4ef80c8120 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 -- 172.21.15.32:0/895674897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c8120 msgr2=0x7f4ef80c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 --2- 172.21.15.32:0/895674897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c8120 0x7f4ef80c76d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80c8ac0 tx=0x7f4ee4009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 -- 172.21.15.32:0/895674897 shutdown_connections 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 --2- 172.21.15.32:0/895674897 >> v2:172.21.15.32:3300/0 conn(0x7f4ef80cb690 0x7f4ef80719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 --2- 172.21.15.32:0/895674897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c8120 0x7f4ef80c76d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 -- 172.21.15.32:0/895674897 >> 172.21.15.32:0/895674897 conn(0x7f4ef8071240 msgr2=0x7f4ef806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 -- 172.21.15.32:0/895674897 shutdown_connections 2024-09-13T18:48:25.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.756+0000 7f4f00000700 1 -- 172.21.15.32:0/895674897 wait complete. 2024-09-13T18:48:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 Processor -- start 2024-09-13T18:48:25.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 -- start start 2024-09-13T18:48:25.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ef80c8120 0x7f4ef815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 0x7f4ef815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ef80cb690 0x7f4ef8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c5fb0 con 0x7f4ef80cb690 2024-09-13T18:48:25.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c6150 con 0x7f4ef80c92c0 2024-09-13T18:48:25.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4f00000700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c5750 con 0x7f4ef80c8120 2024-09-13T18:48:25.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4efe000700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ef80cb690 0x7f4ef8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4efcc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 0x7f4ef815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4efcc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 0x7f4ef815b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:54546/0 (socket says 172.21.15.32:54546) 2024-09-13T18:48:25.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4efcc00700 1 -- 172.21.15.32:0/1783019227 learned_addr learned my addr 172.21.15.32:0/1783019227 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:48:25.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.760+0000 7f4efd600700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ef80c8120 0x7f4ef815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efcc00700 1 -- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ef80c8120 msgr2=0x7f4ef815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efcc00700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ef80c8120 0x7f4ef815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efcc00700 1 -- 172.21.15.32:0/1783019227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ef80cb690 msgr2=0x7f4ef8153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efcc00700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ef80cb690 0x7f4ef8153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efcc00700 1 -- 172.21.15.32:0/1783019227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40094b0 con 0x7f4ef80c92c0 2024-09-13T18:48:25.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efe000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ef80cb690 0x7f4ef8153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4efcc00700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 0x7f4ef815b120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80cb110 tx=0x7f4ee4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401a990 con 0x7f4ef80c92c0 2024-09-13T18:48:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee401f070 con 0x7f4ef80c92c0 2024-09-13T18:48:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80c3100 con 0x7f4ef80c92c0 2024-09-13T18:48:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401ad50 con 0x7f4ef80c92c0 2024-09-13T18:48:25.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80c59f0 con 0x7f4ef80c92c0 2024-09-13T18:48:25.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.764+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8067c30 con 0x7f4ef80c92c0 2024-09-13T18:48:25.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.768+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ee401b430 con 0x7f4ef80c92c0 2024-09-13T18:48:25.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.768+0000 7f4ef5600700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ed8066730 0x7f4ed8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.768+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f4ee40855e0 con 0x7f4ef80c92c0 2024-09-13T18:48:25.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.768+0000 7f4efd600700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ed8066730 0x7f4ed8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.772+0000 7f4efd600700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ed8066730 0x7f4ed8068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4eec000f60 tx=0x7f4eec007e00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.780+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ee40525d0 con 0x7f4ef80c92c0 2024-09-13T18:48:25.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.968+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ef8159a20 con 0x7f4ed8066730 2024-09-13T18:48:25.993 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:25.988+0000 7f4ef5600700 1 -- 172.21.15.32:0/1783019227 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368799 (secure 0 0 0) 0x7f4eec001370 con 0x7f4ed8066730 2024-09-13T18:48:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ed8066730 msgr2=0x7f4ed8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ed8066730 0x7f4ed8068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4eec000f60 tx=0x7f4eec007e00 comp rx=0 tx=0).stop 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 msgr2=0x7f4ef815b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 0x7f4ef815b120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80cb110 tx=0x7f4ee4004770 comp rx=0 tx=0).stop 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 shutdown_connections 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f4ed8066730 0x7f4ed8068bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ef80cb690 0x7f4ef8153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ef80c92c0 0x7f4ef815b120 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 --2- 172.21.15.32:0/1783019227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4ef80c8120 0x7f4ef815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 >> 172.21.15.32:0/1783019227 conn(0x7f4ef8071240 msgr2=0x7f4ef80add80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 shutdown_connections 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:26.000+0000 7f4f00000700 1 -- 172.21.15.32:0/1783019227 wait complete. 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:48:26.030 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-13T18:48:24.137237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629278,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":248,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249400,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725320,"statfs":{"total":773094113280,"available":772838727680,"internally_reserved":0,"allocated":8904704,"data_stored":5130652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005190"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":115,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.291771+0000","last_change":"2024-09-13T18:48:01.291999+0000","last_active":"2024-09-13T18:48:01.291771+0000","last_peered":"2024-09-13T18:48:01.291771+0000","last_clean":"2024-09-13T18:48:01.291771+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:48:01.291771+0000","last_undegraded":"2024-09-13T18:48:01.291771+0000","last_fullsized":"2024-09-13T18:48:01.291771+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:01.291712+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:01.291712+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.291712+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:42.194295+0000","scrub_duration":0.0091402229999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:44.019867+0000","last_change":"2024-09-13T18:47:44.020185+0000","last_active":"2024-09-13T18:47:44.019867+0000","last_peered":"2024-09-13T18:47:44.019867+0000","last_clean":"2024-09-13T18:47:44.019867+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:44.019867+0000","last_undegraded":"2024-09-13T18:47:44.019867+0000","last_fullsized":"2024-09-13T18:47:44.019867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_clean_scrub_stamp":"2024-09-13T18:47:44.019755+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.693765+0000","scrub_duration":0.0035153290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.897347+0000","last_change":"2024-09-13T18:46:49.001961+0000","last_active":"2024-09-13T18:47:27.897347+0000","last_peered":"2024-09-13T18:47:27.897347+0000","last_clean":"2024-09-13T18:47:27.897347+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:47:27.897347+0000","last_undegraded":"2024-09-13T18:47:27.897347+0000","last_fullsized":"2024-09-13T18:47:27.897347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.263578+0000","last_change":"2024-09-13T18:47:53.263825+0000","last_active":"2024-09-13T18:47:53.263578+0000","last_peered":"2024-09-13T18:47:53.263578+0000","last_clean":"2024-09-13T18:47:53.263578+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:53.263578+0000","last_undegraded":"2024-09-13T18:47:53.263578+0000","last_fullsized":"2024-09-13T18:47:53.263578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.263522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:19.503992+0000","scrub_duration":0.0029422229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.084921+0000","last_change":"2024-09-13T18:47:48.085118+0000","last_active":"2024-09-13T18:47:48.084921+0000","last_peered":"2024-09-13T18:47:48.084921+0000","last_clean":"2024-09-13T18:47:48.084921+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:48.084921+0000","last_undegraded":"2024-09-13T18:47:48.084921+0000","last_fullsized":"2024-09-13T18:47:48.084921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.084867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:23.745245+0000","scrub_duration":0.0038812949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:03.011301+0000","last_change":"2024-09-13T18:48:03.011508+0000","last_active":"2024-09-13T18:48:03.011301+0000","last_peered":"2024-09-13T18:48:03.011301+0000","last_clean":"2024-09-13T18:48:03.011301+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:48:03.011301+0000","last_undegraded":"2024-09-13T18:48:03.011301+0000","last_fullsized":"2024-09-13T18:48:03.011301+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:03.011262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:03.011262+0000","last_clean_scrub_stamp":"2024-09-13T18:48:03.011262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:50.572656+0000","scrub_duration":0.003772119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.561797+0000","last_change":"2024-09-13T18:47:52.561992+0000","last_active":"2024-09-13T18:47:52.561797+0000","last_peered":"2024-09-13T18:47:52.561797+0000","last_clean":"2024-09-13T18:47:52.561797+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:52.561797+0000","last_undegraded":"2024-09-13T18:47:52.561797+0000","last_fullsized":"2024-09-13T18:47:52.561797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.561757+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.865055+0000","scrub_duration":0.0060467489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.406557+0000","last_change":"2024-09-13T18:48:16.406727+0000","last_active":"2024-09-13T18:48:16.406557+0000","last_peered":"2024-09-13T18:48:16.406557+0000","last_clean":"2024-09-13T18:48:16.406557+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:48:16.406557+0000","last_undegraded":"2024-09-13T18:48:16.406557+0000","last_fullsized":"2024-09-13T18:48:16.406557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:16.406515+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:16.406515+0000","last_clean_scrub_stamp":"2024-09-13T18:48:16.406515+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:35.413712+0000","scrub_duration":0.0032610600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.979227+0000","last_change":"2024-09-13T18:48:07.979468+0000","last_active":"2024-09-13T18:48:07.979227+0000","last_peered":"2024-09-13T18:48:07.979227+0000","last_clean":"2024-09-13T18:48:07.979227+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:48:07.979227+0000","last_undegraded":"2024-09-13T18:48:07.979227+0000","last_fullsized":"2024-09-13T18:48:07.979227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:07.979180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:07.979180+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.979180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:23.491421+0000","scrub_duration":0.0036606949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.559250+0000","last_change":"2024-09-13T18:47:43.559400+0000","last_active":"2024-09-13T18:47:43.559250+0000","last_peered":"2024-09-13T18:47:43.559250+0000","last_clean":"2024-09-13T18:47:43.559250+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:43.559250+0000","last_undegraded":"2024-09-13T18:47:43.559250+0000","last_fullsized":"2024-09-13T18:47:43.559250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.559220+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:12.079418+0000","scrub_duration":0.0058698689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.594620+0000","last_change":"2024-09-13T18:46:41.342675+0000","last_active":"2024-09-13T18:47:35.594620+0000","last_peered":"2024-09-13T18:47:35.594620+0000","last_clean":"2024-09-13T18:47:35.594620+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:47:35.594620+0000","last_undegraded":"2024-09-13T18:47:35.594620+0000","last_fullsized":"2024-09-13T18:47:35.594620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:06.985326+0000","last_change":"2024-09-13T18:48:06.985598+0000","last_active":"2024-09-13T18:48:06.985326+0000","last_peered":"2024-09-13T18:48:06.985326+0000","last_clean":"2024-09-13T18:48:06.985326+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:48:06.985326+0000","last_undegraded":"2024-09-13T18:48:06.985326+0000","last_fullsized":"2024-09-13T18:48:06.985326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:06.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:06.985275+0000","last_clean_scrub_stamp":"2024-09-13T18:48:06.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:30.581866+0000","scrub_duration":0.0038033839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.568744+0000","last_change":"2024-09-13T18:47:43.568860+0000","last_active":"2024-09-13T18:47:43.568744+0000","last_peered":"2024-09-13T18:47:43.568744+0000","last_clean":"2024-09-13T18:47:43.568744+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:43.568744+0000","last_undegraded":"2024-09-13T18:47:43.568744+0000","last_fullsized":"2024-09-13T18:47:43.568744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.568716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:06.232320+0000","scrub_duration":0.0018263019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.405364+0000","last_change":"2024-09-13T18:47:55.405551+0000","last_active":"2024-09-13T18:47:55.405364+0000","last_peered":"2024-09-13T18:47:55.405364+0000","last_clean":"2024-09-13T18:47:55.405364+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:55.405364+0000","last_undegraded":"2024-09-13T18:47:55.405364+0000","last_fullsized":"2024-09-13T18:47:55.405364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.405321+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:00.336484+0000","scrub_duration":0.0060507419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902314+0000","last_change":"2024-09-13T18:46:41.350524+0000","last_active":"2024-09-13T18:47:27.902314+0000","last_peered":"2024-09-13T18:47:27.902314+0000","last_clean":"2024-09-13T18:47:27.902314+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:47:27.902314+0000","last_undegraded":"2024-09-13T18:47:27.902314+0000","last_fullsized":"2024-09-13T18:47:27.902314+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.455876+0000","last_change":"2024-09-13T18:48:01.456191+0000","last_active":"2024-09-13T18:48:01.455876+0000","last_peered":"2024-09-13T18:48:01.455876+0000","last_clean":"2024-09-13T18:48:01.455876+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:48:01.455876+0000","last_undegraded":"2024-09-13T18:48:01.455876+0000","last_fullsized":"2024-09-13T18:48:01.455876+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:01.455761+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:01.455761+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.455761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:43.734731+0000","scrub_duration":0.0029792400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:09.481218+0000","last_change":"2024-09-13T18:48:09.481422+0000","last_active":"2024-09-13T18:48:09.481218+0000","last_peered":"2024-09-13T18:48:09.481218+0000","last_clean":"2024-09-13T18:48:09.481218+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:48:09.481218+0000","last_undegraded":"2024-09-13T18:48:09.481218+0000","last_fullsized":"2024-09-13T18:48:09.481218+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:09.481172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:09.481172+0000","last_clean_scrub_stamp":"2024-09-13T18:48:09.481172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:06.077418+0000","scrub_duration":0.0039577529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900470+0000","last_change":"2024-09-13T18:47:14.649923+0000","last_active":"2024-09-13T18:47:27.900470+0000","last_peered":"2024-09-13T18:47:27.900470+0000","last_clean":"2024-09-13T18:47:27.900470+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:47:27.900470+0000","last_undegraded":"2024-09-13T18:47:27.900470+0000","last_fullsized":"2024-09-13T18:47:27.900470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:13.351867+0000","last_change":"2024-09-13T18:48:13.352149+0000","last_active":"2024-09-13T18:48:13.351867+0000","last_peered":"2024-09-13T18:48:13.351867+0000","last_clean":"2024-09-13T18:48:13.351867+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:48:13.351867+0000","last_undegraded":"2024-09-13T18:48:13.351867+0000","last_fullsized":"2024-09-13T18:48:13.351867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:13.351768+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:13.351768+0000","last_clean_scrub_stamp":"2024-09-13T18:48:13.351768+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.326683+0000","scrub_duration":0.0025088380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.319041+0000","last_change":"2024-09-13T18:48:02.319225+0000","last_active":"2024-09-13T18:48:02.319041+0000","last_peered":"2024-09-13T18:48:02.319041+0000","last_clean":"2024-09-13T18:48:02.319041+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:48:02.319041+0000","last_undegraded":"2024-09-13T18:48:02.319041+0000","last_fullsized":"2024-09-13T18:48:02.319041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:02.318994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:02.318994+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.318994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:13.580074+0000","scrub_duration":0.0038020279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.416022+0000","last_change":"2024-09-13T18:48:14.416312+0000","last_active":"2024-09-13T18:48:14.416022+0000","last_peered":"2024-09-13T18:48:14.416022+0000","last_clean":"2024-09-13T18:48:14.416022+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:48:14.416022+0000","last_undegraded":"2024-09-13T18:48:14.416022+0000","last_fullsized":"2024-09-13T18:48:14.416022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:14.415970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:14.415970+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.415970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.431347+0000","scrub_duration":0.0039507550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.451206+0000","last_change":"2024-09-13T18:48:14.451413+0000","last_active":"2024-09-13T18:48:14.451206+0000","last_peered":"2024-09-13T18:48:14.451206+0000","last_clean":"2024-09-13T18:48:14.451206+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:48:14.451206+0000","last_undegraded":"2024-09-13T18:48:14.451206+0000","last_fullsized":"2024-09-13T18:48:14.451206+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:48:14.451155+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:48:14.451155+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.451155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:35.419012+0000","scrub_duration":0.0027847140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.652989+0000","last_change":"2024-09-13T18:47:47.653251+0000","last_active":"2024-09-13T18:47:47.652989+0000","last_peered":"2024-09-13T18:47:47.652989+0000","last_clean":"2024-09-13T18:47:47.652989+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:47.652989+0000","last_undegraded":"2024-09-13T18:47:47.652989+0000","last_fullsized":"2024-09-13T18:47:47.652989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.652946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.344600+0000","scrub_duration":0.0030565380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.008098+0000","last_change":"2024-09-13T18:48:18.008287+0000","last_active":"2024-09-13T18:48:18.008098+0000","last_peered":"2024-09-13T18:48:18.008098+0000","last_clean":"2024-09-13T18:48:18.008098+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:48:18.008098+0000","last_undegraded":"2024-09-13T18:48:18.008098+0000","last_fullsized":"2024-09-13T18:48:18.008098+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:18.008062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:18.008062+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.008062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:26.866426+0000","scrub_duration":0.0060362790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.317626+0000","last_change":"2024-09-13T18:48:15.317798+0000","last_active":"2024-09-13T18:48:15.317626+0000","last_peered":"2024-09-13T18:48:15.317626+0000","last_clean":"2024-09-13T18:48:15.317626+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:48:15.317626+0000","last_undegraded":"2024-09-13T18:48:15.317626+0000","last_fullsized":"2024-09-13T18:48:15.317626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:15.317586+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:15.317586+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.317586+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:21.647472+0000","scrub_duration":0.002498049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'3","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.899801+0000","last_change":"2024-09-13T18:46:41.361839+0000","last_active":"2024-09-13T18:47:27.899801+0000","last_peered":"2024-09-13T18:47:27.899801+0000","last_clean":"2024-09-13T18:47:27.899801+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:47:27.899801+0000","last_undegraded":"2024-09-13T18:47:27.899801+0000","last_fullsized":"2024-09-13T18:47:27.899801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.012842+0000","last_change":"2024-09-13T18:48:04.013010+0000","last_active":"2024-09-13T18:48:04.012842+0000","last_peered":"2024-09-13T18:48:04.012842+0000","last_clean":"2024-09-13T18:48:04.012842+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:48:04.012842+0000","last_undegraded":"2024-09-13T18:48:04.012842+0000","last_fullsized":"2024-09-13T18:48:04.012842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:04.012810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:04.012810+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.012810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.515395+0000","scrub_duration":0.0063472049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:09.382293+0000","last_change":"2024-09-13T18:48:09.382541+0000","last_active":"2024-09-13T18:48:09.382293+0000","last_peered":"2024-09-13T18:48:09.382293+0000","last_clean":"2024-09-13T18:48:09.382293+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:48:09.382293+0000","last_undegraded":"2024-09-13T18:48:09.382293+0000","last_fullsized":"2024-09-13T18:48:09.382293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:48:09.382230+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:48:09.382230+0000","last_clean_scrub_stamp":"2024-09-13T18:48:09.382230+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:05.501947+0000","scrub_duration":0.0026682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.220942+0000","last_change":"2024-09-13T18:47:58.221241+0000","last_active":"2024-09-13T18:47:58.220942+0000","last_peered":"2024-09-13T18:47:58.220942+0000","last_clean":"2024-09-13T18:47:58.220942+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:58.220942+0000","last_undegraded":"2024-09-13T18:47:58.220942+0000","last_fullsized":"2024-09-13T18:47:58.220942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.220882+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:31.105081+0000","scrub_duration":0.004045735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656440+0000","last_change":"2024-09-13T18:46:41.325369+0000","last_active":"2024-09-13T18:47:27.656440+0000","last_peered":"2024-09-13T18:47:27.656440+0000","last_clean":"2024-09-13T18:47:27.656440+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:47:27.656440+0000","last_undegraded":"2024-09-13T18:47:27.656440+0000","last_fullsized":"2024-09-13T18:47:27.656440+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.499004+0000","last_change":"2024-09-13T18:48:04.499292+0000","last_active":"2024-09-13T18:48:04.499004+0000","last_peered":"2024-09-13T18:48:04.499004+0000","last_clean":"2024-09-13T18:48:04.499004+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:48:04.499004+0000","last_undegraded":"2024-09-13T18:48:04.499004+0000","last_fullsized":"2024-09-13T18:48:04.499004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:04.498906+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:04.498906+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.498906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:52.223800+0000","scrub_duration":0.00343589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.482595+0000","last_change":"2024-09-13T18:47:51.482767+0000","last_active":"2024-09-13T18:47:51.482595+0000","last_peered":"2024-09-13T18:47:51.482595+0000","last_clean":"2024-09-13T18:47:51.482595+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:51.482595+0000","last_undegraded":"2024-09-13T18:47:51.482595+0000","last_fullsized":"2024-09-13T18:47:51.482595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.482562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:34.558081+0000","scrub_duration":0.0034253259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.502915+0000","last_change":"2024-09-13T18:48:14.503170+0000","last_active":"2024-09-13T18:48:14.502915+0000","last_peered":"2024-09-13T18:48:14.502915+0000","last_clean":"2024-09-13T18:48:14.502915+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:48:14.502915+0000","last_undegraded":"2024-09-13T18:48:14.502915+0000","last_fullsized":"2024-09-13T18:48:14.502915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:14.502866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:14.502866+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.502866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:56.838327+0000","scrub_duration":0.0040653399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.051610+0000","last_change":"2024-09-13T18:47:49.051818+0000","last_active":"2024-09-13T18:47:49.051610+0000","last_peered":"2024-09-13T18:47:49.051610+0000","last_clean":"2024-09-13T18:47:49.051610+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:49.051610+0000","last_undegraded":"2024-09-13T18:47:49.051610+0000","last_fullsized":"2024-09-13T18:47:49.051610+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.051559+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.947582+0000","scrub_duration":0.0034011369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.132202+0000","last_change":"2024-09-13T18:47:49.132469+0000","last_active":"2024-09-13T18:47:49.132202+0000","last_peered":"2024-09-13T18:47:49.132202+0000","last_clean":"2024-09-13T18:47:49.132202+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:49.132202+0000","last_undegraded":"2024-09-13T18:47:49.132202+0000","last_fullsized":"2024-09-13T18:47:49.132202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.132146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.405895+0000","scrub_duration":0.0026213619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.433057+0000","last_change":"2024-09-13T18:47:52.433346+0000","last_active":"2024-09-13T18:47:52.433057+0000","last_peered":"2024-09-13T18:47:52.433057+0000","last_clean":"2024-09-13T18:47:52.433057+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:52.433057+0000","last_undegraded":"2024-09-13T18:47:52.433057+0000","last_fullsized":"2024-09-13T18:47:52.433057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.433008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.849816+0000","scrub_duration":0.003833234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:03.537032+0000","last_change":"2024-09-13T18:48:03.537343+0000","last_active":"2024-09-13T18:48:03.537032+0000","last_peered":"2024-09-13T18:48:03.537032+0000","last_clean":"2024-09-13T18:48:03.537032+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:48:03.537032+0000","last_undegraded":"2024-09-13T18:48:03.537032+0000","last_fullsized":"2024-09-13T18:48:03.537032+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:03.536979+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:03.536979+0000","last_clean_scrub_stamp":"2024-09-13T18:48:03.536979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:02.205018+0000","scrub_duration":0.0037624360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898977+0000","last_change":"2024-09-13T18:46:41.317390+0000","last_active":"2024-09-13T18:47:27.898977+0000","last_peered":"2024-09-13T18:47:27.898977+0000","last_clean":"2024-09-13T18:47:27.898977+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:47:27.898977+0000","last_undegraded":"2024-09-13T18:47:27.898977+0000","last_fullsized":"2024-09-13T18:47:27.898977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.469058+0000","last_change":"2024-09-13T18:47:53.469359+0000","last_active":"2024-09-13T18:47:53.469058+0000","last_peered":"2024-09-13T18:47:53.469058+0000","last_clean":"2024-09-13T18:47:53.469058+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:53.469058+0000","last_undegraded":"2024-09-13T18:47:53.469058+0000","last_fullsized":"2024-09-13T18:47:53.469058+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.469009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.549365+0000","scrub_duration":0.0034698680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:57.298151+0000","last_change":"2024-09-13T18:47:57.298346+0000","last_active":"2024-09-13T18:47:57.298151+0000","last_peered":"2024-09-13T18:47:57.298151+0000","last_clean":"2024-09-13T18:47:57.298151+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:57.298151+0000","last_undegraded":"2024-09-13T18:47:57.298151+0000","last_fullsized":"2024-09-13T18:47:57.298151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_clean_scrub_stamp":"2024-09-13T18:47:57.298101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:47.457258+0000","scrub_duration":0.0029362590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.334953+0000","last_change":"2024-09-13T18:47:50.335172+0000","last_active":"2024-09-13T18:47:50.334953+0000","last_peered":"2024-09-13T18:47:50.334953+0000","last_clean":"2024-09-13T18:47:50.334953+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:50.334953+0000","last_undegraded":"2024-09-13T18:47:50.334953+0000","last_fullsized":"2024-09-13T18:47:50.334953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.334901+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:43.474237+0000","scrub_duration":0.0055209919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.429439+0000","last_change":"2024-09-13T18:47:55.429800+0000","last_active":"2024-09-13T18:47:55.429439+0000","last_peered":"2024-09-13T18:47:55.429439+0000","last_clean":"2024-09-13T18:47:55.429439+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:55.429439+0000","last_undegraded":"2024-09-13T18:47:55.429439+0000","last_fullsized":"2024-09-13T18:47:55.429439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.429388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:13.248197+0000","scrub_duration":0.0035543609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.497954+0000","last_change":"2024-09-13T18:47:47.498180+0000","last_active":"2024-09-13T18:47:47.497954+0000","last_peered":"2024-09-13T18:47:47.497954+0000","last_clean":"2024-09-13T18:47:47.497954+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:47.497954+0000","last_undegraded":"2024-09-13T18:47:47.497954+0000","last_fullsized":"2024-09-13T18:47:47.497954+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.497898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:43.625983+0000","scrub_duration":0.0036756570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900868+0000","last_change":"2024-09-13T18:46:41.336021+0000","last_active":"2024-09-13T18:47:27.900868+0000","last_peered":"2024-09-13T18:47:27.900868+0000","last_clean":"2024-09-13T18:47:27.900868+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:47:27.900868+0000","last_undegraded":"2024-09-13T18:47:27.900868+0000","last_fullsized":"2024-09-13T18:47:27.900868+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:44:59.812539+0000","last_clean_scrub_stamp":"2024-09-13T18:44:59.812539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.658565+0000","last_change":"2024-09-13T18:46:17.878416+0000","last_active":"2024-09-13T18:47:27.658565+0000","last_peered":"2024-09-13T18:47:27.658565+0000","last_clean":"2024-09-13T18:47:27.658565+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:47:27.658565+0000","last_undegraded":"2024-09-13T18:47:27.658565+0000","last_fullsized":"2024-09-13T18:47:27.658565+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.360722+0000","last_change":"2024-09-13T18:48:05.360900+0000","last_active":"2024-09-13T18:48:05.360722+0000","last_peered":"2024-09-13T18:48:05.360722+0000","last_clean":"2024-09-13T18:48:05.360722+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:48:05.360722+0000","last_undegraded":"2024-09-13T18:48:05.360722+0000","last_fullsized":"2024-09-13T18:48:05.360722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:05.360667+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:05.360667+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.360667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:37.843562+0000","scrub_duration":0.0033082490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.514815+0000","last_change":"2024-09-13T18:48:10.515008+0000","last_active":"2024-09-13T18:48:10.514815+0000","last_peered":"2024-09-13T18:48:10.514815+0000","last_clean":"2024-09-13T18:48:10.514815+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:48:10.514815+0000","last_undegraded":"2024-09-13T18:48:10.514815+0000","last_fullsized":"2024-09-13T18:48:10.514815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:10.514771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:10.514771+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.514771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:19.193364+0000","scrub_duration":0.0031935050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"81'119","reported_seq":237,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.364193+0000","last_change":"2024-09-13T18:47:56.364342+0000","last_active":"2024-09-13T18:47:56.364193+0000","last_peered":"2024-09-13T18:47:56.364193+0000","last_clean":"2024-09-13T18:47:56.364193+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:56.364193+0000","last_undegraded":"2024-09-13T18:47:56.364193+0000","last_fullsized":"2024-09-13T18:47:56.364193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'119","last_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_deep_scrub":"81'119","last_deep_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.364169+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.913927+0000","scrub_duration":0.010342967999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902184+0000","last_change":"2024-09-13T18:46:41.344561+0000","last_active":"2024-09-13T18:47:27.902184+0000","last_peered":"2024-09-13T18:47:27.902184+0000","last_clean":"2024-09-13T18:47:27.902184+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:47:27.902184+0000","last_undegraded":"2024-09-13T18:47:27.902184+0000","last_fullsized":"2024-09-13T18:47:27.902184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.078237+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:36.078237+0000","last_peered":"2024-09-13T18:47:36.078237+0000","last_clean":"2024-09-13T18:47:36.078237+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:36.078237+0000","last_undegraded":"2024-09-13T18:47:36.078237+0000","last_fullsized":"2024-09-13T18:47:36.078237+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.508131+0000","last_change":"2024-09-13T18:48:15.508414+0000","last_active":"2024-09-13T18:48:15.508131+0000","last_peered":"2024-09-13T18:48:15.508131+0000","last_clean":"2024-09-13T18:48:15.508131+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:48:15.508131+0000","last_undegraded":"2024-09-13T18:48:15.508131+0000","last_fullsized":"2024-09-13T18:48:15.508131+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:15.508045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:15.508045+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.508045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:00.970795+0000","scrub_duration":0.0038577519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.974166+0000","last_change":"2024-09-13T18:48:04.974493+0000","last_active":"2024-09-13T18:48:04.974166+0000","last_peered":"2024-09-13T18:48:04.974166+0000","last_clean":"2024-09-13T18:48:04.974166+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:48:04.974166+0000","last_undegraded":"2024-09-13T18:48:04.974166+0000","last_fullsized":"2024-09-13T18:48:04.974166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:04.974118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:04.974118+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.974118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:50.337427+0000","scrub_duration":0.0037389459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:40.530633+0000","last_change":"2024-09-13T18:47:40.530820+0000","last_active":"2024-09-13T18:47:40.530633+0000","last_peered":"2024-09-13T18:47:40.530633+0000","last_clean":"2024-09-13T18:47:40.530633+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:40.530633+0000","last_undegraded":"2024-09-13T18:47:40.530633+0000","last_fullsized":"2024-09-13T18:47:40.530633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_clean_scrub_stamp":"2024-09-13T18:47:40.530592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:33.146259+0000","scrub_duration":0.0031957550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.234604+0000","last_change":"2024-09-13T18:47:51.234842+0000","last_active":"2024-09-13T18:47:51.234604+0000","last_peered":"2024-09-13T18:47:51.234604+0000","last_clean":"2024-09-13T18:47:51.234604+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:51.234604+0000","last_undegraded":"2024-09-13T18:47:51.234604+0000","last_fullsized":"2024-09-13T18:47:51.234604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.234552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.835687+0000","scrub_duration":0.0096124350000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.657444+0000","last_change":"2024-09-13T18:46:41.332699+0000","last_active":"2024-09-13T18:47:27.657444+0000","last_peered":"2024-09-13T18:47:27.657444+0000","last_clean":"2024-09-13T18:47:27.657444+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:47:27.657444+0000","last_undegraded":"2024-09-13T18:47:27.657444+0000","last_fullsized":"2024-09-13T18:47:27.657444+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:11.624536+0000","last_change":"2024-09-13T18:48:11.624728+0000","last_active":"2024-09-13T18:48:11.624536+0000","last_peered":"2024-09-13T18:48:11.624536+0000","last_clean":"2024-09-13T18:48:11.624536+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:48:11.624536+0000","last_undegraded":"2024-09-13T18:48:11.624536+0000","last_fullsized":"2024-09-13T18:48:11.624536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:11.624492+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:11.624492+0000","last_clean_scrub_stamp":"2024-09-13T18:48:11.624492+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:12.141467+0000","scrub_duration":0.0031213069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.362683+0000","last_change":"2024-09-13T18:48:04.362881+0000","last_active":"2024-09-13T18:48:04.362683+0000","last_peered":"2024-09-13T18:48:04.362683+0000","last_clean":"2024-09-13T18:48:04.362683+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:48:04.362683+0000","last_undegraded":"2024-09-13T18:48:04.362683+0000","last_fullsized":"2024-09-13T18:48:04.362683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:48:04.362627+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:48:04.362627+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.362627+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:58.244178+0000","scrub_duration":0.0053930799999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900776+0000","last_change":"2024-09-13T18:46:41.342265+0000","last_active":"2024-09-13T18:47:27.900776+0000","last_peered":"2024-09-13T18:47:27.900776+0000","last_clean":"2024-09-13T18:47:27.900776+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:47:27.900776+0000","last_undegraded":"2024-09-13T18:47:27.900776+0000","last_fullsized":"2024-09-13T18:47:27.900776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.033407+0000","last_change":"2024-09-13T18:47:55.033619+0000","last_active":"2024-09-13T18:47:55.033407+0000","last_peered":"2024-09-13T18:47:55.033407+0000","last_clean":"2024-09-13T18:47:55.033407+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:55.033407+0000","last_undegraded":"2024-09-13T18:47:55.033407+0000","last_fullsized":"2024-09-13T18:47:55.033407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.033356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:27.430817+0000","scrub_duration":0.0033159650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.565941+0000","last_change":"2024-09-13T18:47:42.566061+0000","last_active":"2024-09-13T18:47:42.565941+0000","last_peered":"2024-09-13T18:47:42.565941+0000","last_clean":"2024-09-13T18:47:42.565941+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:42.565941+0000","last_undegraded":"2024-09-13T18:47:42.565941+0000","last_fullsized":"2024-09-13T18:47:42.565941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.565910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:50.152639+0000","scrub_duration":0.0063911790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.377660+0000","last_change":"2024-09-13T18:48:18.377919+0000","last_active":"2024-09-13T18:48:18.377660+0000","last_peered":"2024-09-13T18:48:18.377660+0000","last_clean":"2024-09-13T18:48:18.377660+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:48:18.377660+0000","last_undegraded":"2024-09-13T18:48:18.377660+0000","last_fullsized":"2024-09-13T18:48:18.377660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:18.377611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:18.377611+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.377611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:14.207959+0000","scrub_duration":0.0039362679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.414535+0000","last_change":"2024-09-13T18:47:58.414789+0000","last_active":"2024-09-13T18:47:58.414535+0000","last_peered":"2024-09-13T18:47:58.414535+0000","last_clean":"2024-09-13T18:47:58.414535+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:58.414535+0000","last_undegraded":"2024-09-13T18:47:58.414535+0000","last_fullsized":"2024-09-13T18:47:58.414535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.414481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:59.349305+0000","scrub_duration":0.0035677840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"81'12","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:59.231731+0000","last_change":"2024-09-13T18:47:59.231990+0000","last_active":"2024-09-13T18:47:59.231731+0000","last_peered":"2024-09-13T18:47:59.231731+0000","last_clean":"2024-09-13T18:47:59.231731+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:59.231731+0000","last_undegraded":"2024-09-13T18:47:59.231731+0000","last_fullsized":"2024-09-13T18:47:59.231731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-13T18:47:59.231673+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-13T18:47:59.231673+0000","last_clean_scrub_stamp":"2024-09-13T18:47:59.231673+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:47.851506+0000","scrub_duration":0.009267773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:34.179157+0000","last_change":"2024-09-13T18:46:17.892954+0000","last_active":"2024-09-13T18:47:34.179157+0000","last_peered":"2024-09-13T18:47:34.179157+0000","last_clean":"2024-09-13T18:47:34.179157+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:47:34.179157+0000","last_undegraded":"2024-09-13T18:47:34.179157+0000","last_fullsized":"2024-09-13T18:47:34.179157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.406089+0000","last_change":"2024-09-13T18:48:05.406213+0000","last_active":"2024-09-13T18:48:05.406089+0000","last_peered":"2024-09-13T18:48:05.406089+0000","last_clean":"2024-09-13T18:48:05.406089+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:48:05.406089+0000","last_undegraded":"2024-09-13T18:48:05.406089+0000","last_fullsized":"2024-09-13T18:48:05.406089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:05.406053+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:05.406053+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.406053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.046957+0000","scrub_duration":0.0030831119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.633439+0000","last_change":"2024-09-13T18:47:46.633627+0000","last_active":"2024-09-13T18:47:46.633439+0000","last_peered":"2024-09-13T18:47:46.633439+0000","last_clean":"2024-09-13T18:47:46.633439+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:46.633439+0000","last_undegraded":"2024-09-13T18:47:46.633439+0000","last_fullsized":"2024-09-13T18:47:46.633439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_clean_scrub_stamp":"2024-09-13T18:47:46.633397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:40.331659+0000","scrub_duration":0.0034897349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.898950+0000","last_change":"2024-09-13T18:46:35.425800+0000","last_active":"2024-09-13T18:47:27.898950+0000","last_peered":"2024-09-13T18:47:27.898950+0000","last_clean":"2024-09-13T18:47:27.898950+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:47:27.898950+0000","last_undegraded":"2024-09-13T18:47:27.898950+0000","last_fullsized":"2024-09-13T18:47:27.898950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597542+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:35.597542+0000","last_peered":"2024-09-13T18:47:35.597542+0000","last_clean":"2024-09-13T18:47:35.597542+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:35.597542+0000","last_undegraded":"2024-09-13T18:47:35.597542+0000","last_fullsized":"2024-09-13T18:47:35.597542+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.585465+0000","last_change":"2024-09-13T18:47:42.585618+0000","last_active":"2024-09-13T18:47:42.585465+0000","last_peered":"2024-09-13T18:47:42.585465+0000","last_clean":"2024-09-13T18:47:42.585465+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:42.585465+0000","last_undegraded":"2024-09-13T18:47:42.585465+0000","last_fullsized":"2024-09-13T18:47:42.585465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.585429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:06.282715+0000","scrub_duration":0.002930406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.504314+0000","last_change":"2024-09-13T18:48:05.504637+0000","last_active":"2024-09-13T18:48:05.504314+0000","last_peered":"2024-09-13T18:48:05.504314+0000","last_clean":"2024-09-13T18:48:05.504314+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:48:05.504314+0000","last_undegraded":"2024-09-13T18:48:05.504314+0000","last_fullsized":"2024-09-13T18:48:05.504314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:05.504260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:05.504260+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.504260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:59.575884+0000","scrub_duration":0.0039666019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.579203+0000","last_change":"2024-09-13T18:46:41.332285+0000","last_active":"2024-09-13T18:47:35.579203+0000","last_peered":"2024-09-13T18:47:35.579203+0000","last_clean":"2024-09-13T18:47:35.579203+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:47:35.579203+0000","last_undegraded":"2024-09-13T18:47:35.579203+0000","last_fullsized":"2024-09-13T18:47:35.579203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.445887+0000","last_change":"2024-09-13T18:47:58.446093+0000","last_active":"2024-09-13T18:47:58.445887+0000","last_peered":"2024-09-13T18:47:58.445887+0000","last_clean":"2024-09-13T18:47:58.445887+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:58.445887+0000","last_undegraded":"2024-09-13T18:47:58.445887+0000","last_fullsized":"2024-09-13T18:47:58.445887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.445838+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:59.858545+0000","scrub_duration":0.0076105000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.902106+0000","last_change":"2024-09-13T18:46:41.342495+0000","last_active":"2024-09-13T18:47:27.902106+0000","last_peered":"2024-09-13T18:47:27.902106+0000","last_clean":"2024-09-13T18:47:27.902106+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:47:27.902106+0000","last_undegraded":"2024-09-13T18:47:27.902106+0000","last_fullsized":"2024-09-13T18:47:27.902106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.574729+0000","last_change":"2024-09-13T18:47:55.574935+0000","last_active":"2024-09-13T18:47:55.574729+0000","last_peered":"2024-09-13T18:47:55.574729+0000","last_clean":"2024-09-13T18:47:55.574729+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:55.574729+0000","last_undegraded":"2024-09-13T18:47:55.574729+0000","last_fullsized":"2024-09-13T18:47:55.574729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.574683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:25.940388+0000","scrub_duration":0.0033516209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.985117+0000","last_change":"2024-09-13T18:47:42.985266+0000","last_active":"2024-09-13T18:47:42.985117+0000","last_peered":"2024-09-13T18:47:42.985117+0000","last_clean":"2024-09-13T18:47:42.985117+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:42.985117+0000","last_undegraded":"2024-09-13T18:47:42.985117+0000","last_fullsized":"2024-09-13T18:47:42.985117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'29","last_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_deep_scrub":"81'29","last_deep_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.985080+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:03.523374+0000","scrub_duration":0.0074139399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:28.867289+0000","last_change":"2024-09-13T18:46:41.325444+0000","last_active":"2024-09-13T18:47:28.867289+0000","last_peered":"2024-09-13T18:47:28.867289+0000","last_clean":"2024-09-13T18:47:28.867289+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:47:28.867289+0000","last_undegraded":"2024-09-13T18:47:28.867289+0000","last_fullsized":"2024-09-13T18:47:28.867289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.600534+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:35.600534+0000","last_peered":"2024-09-13T18:47:35.600534+0000","last_clean":"2024-09-13T18:47:35.600534+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:35.600534+0000","last_undegraded":"2024-09-13T18:47:35.600534+0000","last_fullsized":"2024-09-13T18:47:35.600534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.324050+0000","last_change":"2024-09-13T18:47:51.324261+0000","last_active":"2024-09-13T18:47:51.324050+0000","last_peered":"2024-09-13T18:47:51.324050+0000","last_clean":"2024-09-13T18:47:51.324050+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:51.324050+0000","last_undegraded":"2024-09-13T18:47:51.324050+0000","last_fullsized":"2024-09-13T18:47:51.324050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.323994+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:47.717548+0000","scrub_duration":0.0067899620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.974074+0000","last_change":"2024-09-13T18:48:05.974304+0000","last_active":"2024-09-13T18:48:05.974074+0000","last_peered":"2024-09-13T18:48:05.974074+0000","last_clean":"2024-09-13T18:48:05.974074+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:48:05.974074+0000","last_undegraded":"2024-09-13T18:48:05.974074+0000","last_fullsized":"2024-09-13T18:48:05.974074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:05.974038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:05.974038+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.974038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:54.593726+0000","scrub_duration":0.0042173189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.327704+0000","last_change":"2024-09-13T18:47:58.327922+0000","last_active":"2024-09-13T18:47:58.327704+0000","last_peered":"2024-09-13T18:47:58.327704+0000","last_clean":"2024-09-13T18:47:58.327704+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:58.327704+0000","last_undegraded":"2024-09-13T18:47:58.327704+0000","last_fullsized":"2024-09-13T18:47:58.327704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.327652+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:28.029362+0000","scrub_duration":0.0034717400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.610385+0000","last_change":"2024-09-13T18:47:45.610603+0000","last_active":"2024-09-13T18:47:45.610385+0000","last_peered":"2024-09-13T18:47:45.610385+0000","last_clean":"2024-09-13T18:47:45.610385+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:45.610385+0000","last_undegraded":"2024-09-13T18:47:45.610385+0000","last_fullsized":"2024-09-13T18:47:45.610385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.610340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:52.239335+0000","scrub_duration":0.003118698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.342009+0000","last_change":"2024-09-13T18:48:12.342312+0000","last_active":"2024-09-13T18:48:12.342009+0000","last_peered":"2024-09-13T18:48:12.342009+0000","last_clean":"2024-09-13T18:48:12.342009+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:48:12.342009+0000","last_undegraded":"2024-09-13T18:48:12.342009+0000","last_fullsized":"2024-09-13T18:48:12.342009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:12.341957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:12.341957+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.341957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:32.100030+0000","scrub_duration":0.0041679810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:00.018241+0000","last_change":"2024-09-13T18:48:00.018459+0000","last_active":"2024-09-13T18:48:00.018241+0000","last_peered":"2024-09-13T18:48:00.018241+0000","last_clean":"2024-09-13T18:48:00.018241+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:48:00.018241+0000","last_undegraded":"2024-09-13T18:48:00.018241+0000","last_fullsized":"2024-09-13T18:48:00.018241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_clean_scrub_stamp":"2024-09-13T18:48:00.018191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:44.339756+0000","scrub_duration":0.0031160409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.414358+0000","last_change":"2024-09-13T18:48:02.414512+0000","last_active":"2024-09-13T18:48:02.414358+0000","last_peered":"2024-09-13T18:48:02.414358+0000","last_clean":"2024-09-13T18:48:02.414358+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:48:02.414358+0000","last_undegraded":"2024-09-13T18:48:02.414358+0000","last_fullsized":"2024-09-13T18:48:02.414358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:48:02.414323+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:48:02.414323+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.414323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:32.607454+0000","scrub_duration":0.0032787039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:28.867230+0000","last_change":"2024-09-13T18:46:41.325582+0000","last_active":"2024-09-13T18:47:28.867230+0000","last_peered":"2024-09-13T18:47:28.867230+0000","last_clean":"2024-09-13T18:47:28.867230+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:47:28.867230+0000","last_undegraded":"2024-09-13T18:47:28.867230+0000","last_fullsized":"2024-09-13T18:47:28.867230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.656215+0000","last_change":"2024-09-13T18:46:41.326057+0000","last_active":"2024-09-13T18:47:27.656215+0000","last_peered":"2024-09-13T18:47:27.656215+0000","last_clean":"2024-09-13T18:47:27.656215+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:47:27.656215+0000","last_undegraded":"2024-09-13T18:47:27.656215+0000","last_fullsized":"2024-09-13T18:47:27.656215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.216158+0000","last_change":"2024-09-13T18:47:50.216463+0000","last_active":"2024-09-13T18:47:50.216158+0000","last_peered":"2024-09-13T18:47:50.216158+0000","last_clean":"2024-09-13T18:47:50.216158+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:50.216158+0000","last_undegraded":"2024-09-13T18:47:50.216158+0000","last_fullsized":"2024-09-13T18:47:50.216158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.216108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:45.291203+0000","scrub_duration":0.0033895930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.366654+0000","last_change":"2024-09-13T18:47:56.366764+0000","last_active":"2024-09-13T18:47:56.366654+0000","last_peered":"2024-09-13T18:47:56.366654+0000","last_clean":"2024-09-13T18:47:56.366654+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:56.366654+0000","last_undegraded":"2024-09-13T18:47:56.366654+0000","last_fullsized":"2024-09-13T18:47:56.366654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.366630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:44.072446+0000","scrub_duration":0.0021094109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:27.900251+0000","last_change":"2024-09-13T18:46:41.339385+0000","last_active":"2024-09-13T18:47:27.900251+0000","last_peered":"2024-09-13T18:47:27.900251+0000","last_clean":"2024-09-13T18:47:27.900251+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:47:27.900251+0000","last_undegraded":"2024-09-13T18:47:27.900251+0000","last_fullsized":"2024-09-13T18:47:27.900251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.263795+0000","last_change":"2024-09-13T18:48:02.264013+0000","last_active":"2024-09-13T18:48:02.263795+0000","last_peered":"2024-09-13T18:48:02.263795+0000","last_clean":"2024-09-13T18:48:02.263795+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:48:02.263795+0000","last_undegraded":"2024-09-13T18:48:02.263795+0000","last_fullsized":"2024-09-13T18:48:02.263795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:02.263745+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:02.263745+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.263745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:36.178805+0000","scrub_duration":0.0030334060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.387507+0000","last_change":"2024-09-13T18:47:51.387734+0000","last_active":"2024-09-13T18:47:51.387507+0000","last_peered":"2024-09-13T18:47:51.387507+0000","last_clean":"2024-09-13T18:47:51.387507+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:51.387507+0000","last_undegraded":"2024-09-13T18:47:51.387507+0000","last_fullsized":"2024-09-13T18:47:51.387507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.387457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:25.705238+0000","scrub_duration":0.0035199530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.469046+0000","last_change":"2024-09-13T18:48:07.469270+0000","last_active":"2024-09-13T18:48:07.469046+0000","last_peered":"2024-09-13T18:48:07.469046+0000","last_clean":"2024-09-13T18:48:07.469046+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:48:07.469046+0000","last_undegraded":"2024-09-13T18:48:07.469046+0000","last_fullsized":"2024-09-13T18:48:07.469046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:48:07.469001+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:48:07.469001+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.469001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:15.308587+0000","scrub_duration":0.0033549579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.369829+0000","last_change":"2024-09-13T18:48:08.370025+0000","last_active":"2024-09-13T18:48:08.369829+0000","last_peered":"2024-09-13T18:48:08.369829+0000","last_clean":"2024-09-13T18:48:08.369829+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:48:08.369829+0000","last_undegraded":"2024-09-13T18:48:08.369829+0000","last_fullsized":"2024-09-13T18:48:08.369829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:08.369773+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:08.369773+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.369773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:53.502092+0000","scrub_duration":0.0039096199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:39.174762+0000","last_change":"2024-09-13T18:46:17.887291+0000","last_active":"2024-09-13T18:47:39.174762+0000","last_peered":"2024-09-13T18:47:39.174762+0000","last_clean":"2024-09-13T18:47:39.174762+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:47:39.174762+0000","last_undegraded":"2024-09-13T18:47:39.174762+0000","last_fullsized":"2024-09-13T18:47:39.174762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:04.314230+0000","last_clean_scrub_stamp":"2024-09-13T18:45:04.314230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.182656+0000","last_change":"2024-09-13T18:47:50.182974+0000","last_active":"2024-09-13T18:47:50.182656+0000","last_peered":"2024-09-13T18:47:50.182656+0000","last_clean":"2024-09-13T18:47:50.182656+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:50.182656+0000","last_undegraded":"2024-09-13T18:47:50.182656+0000","last_fullsized":"2024-09-13T18:47:50.182656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.182599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:16.387371+0000","scrub_duration":0.003287786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.388376+0000","last_change":"2024-09-13T18:48:10.388592+0000","last_active":"2024-09-13T18:48:10.388376+0000","last_peered":"2024-09-13T18:48:10.388376+0000","last_clean":"2024-09-13T18:48:10.388376+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:48:10.388376+0000","last_undegraded":"2024-09-13T18:48:10.388376+0000","last_fullsized":"2024-09-13T18:48:10.388376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:10.388326+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:10.388326+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.388326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:31.106755+0000","scrub_duration":0.0033930879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.414682+0000","last_change":"2024-09-13T18:48:15.415003+0000","last_active":"2024-09-13T18:48:15.414682+0000","last_peered":"2024-09-13T18:48:15.414682+0000","last_clean":"2024-09-13T18:48:15.414682+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:48:15.414682+0000","last_undegraded":"2024-09-13T18:48:15.414682+0000","last_fullsized":"2024-09-13T18:48:15.414682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:15.414635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:15.414635+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.414635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:31.574931+0000","scrub_duration":0.0049695829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.051036+0000","last_change":"2024-09-13T18:47:45.051211+0000","last_active":"2024-09-13T18:47:45.051036+0000","last_peered":"2024-09-13T18:47:45.051036+0000","last_clean":"2024-09-13T18:47:45.051036+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:45.051036+0000","last_undegraded":"2024-09-13T18:47:45.051036+0000","last_fullsized":"2024-09-13T18:47:45.051036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.050997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:29.820112+0000","scrub_duration":0.002900452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.264766+0000","last_change":"2024-09-13T18:48:07.264959+0000","last_active":"2024-09-13T18:48:07.264766+0000","last_peered":"2024-09-13T18:48:07.264766+0000","last_clean":"2024-09-13T18:48:07.264766+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:48:07.264766+0000","last_undegraded":"2024-09-13T18:48:07.264766+0000","last_fullsized":"2024-09-13T18:48:07.264766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-13T18:48:07.264719+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-13T18:48:07.264719+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.264719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.565222+0000","scrub_duration":0.003409207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.377977+0000","last_change":"2024-09-13T18:48:02.378193+0000","last_active":"2024-09-13T18:48:02.377977+0000","last_peered":"2024-09-13T18:48:02.377977+0000","last_clean":"2024-09-13T18:48:02.377977+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:48:02.377977+0000","last_undegraded":"2024-09-13T18:48:02.377977+0000","last_fullsized":"2024-09-13T18:48:02.377977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:02.377931+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:02.377931+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.377931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:12.494537+0000","scrub_duration":0.0034649160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.306492+0000","last_change":"2024-09-13T18:48:04.306747+0000","last_active":"2024-09-13T18:48:04.306492+0000","last_peered":"2024-09-13T18:48:04.306492+0000","last_clean":"2024-09-13T18:48:04.306492+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:48:04.306492+0000","last_undegraded":"2024-09-13T18:48:04.306492+0000","last_fullsized":"2024-09-13T18:48:04.306492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:04.306444+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:04.306444+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.306444+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:35.956818+0000","scrub_duration":0.0034513159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.583542+0000","last_change":"2024-09-13T18:46:17.878993+0000","last_active":"2024-09-13T18:47:35.583542+0000","last_peered":"2024-09-13T18:47:35.583542+0000","last_clean":"2024-09-13T18:47:35.583542+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:47:35.583542+0000","last_undegraded":"2024-09-13T18:47:35.583542+0000","last_fullsized":"2024-09-13T18:47:35.583542+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.565153+0000","last_change":"2024-09-13T18:46:17.872178+0000","last_active":"2024-09-13T18:47:35.565153+0000","last_peered":"2024-09-13T18:47:35.565153+0000","last_clean":"2024-09-13T18:47:35.565153+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:47:35.565153+0000","last_undegraded":"2024-09-13T18:47:35.565153+0000","last_fullsized":"2024-09-13T18:47:35.565153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.039013+0000","last_change":"2024-09-13T18:48:01.039156+0000","last_active":"2024-09-13T18:48:01.039013+0000","last_peered":"2024-09-13T18:48:01.039013+0000","last_clean":"2024-09-13T18:48:01.039013+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:48:01.039013+0000","last_undegraded":"2024-09-13T18:48:01.039013+0000","last_fullsized":"2024-09-13T18:48:01.039013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-13T18:48:01.038975+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-13T18:48:01.038975+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.038975+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:45.129654+0000","scrub_duration":0.0050254219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.265232+0000","last_change":"2024-09-13T18:48:07.265466+0000","last_active":"2024-09-13T18:48:07.265232+0000","last_peered":"2024-09-13T18:48:07.265232+0000","last_clean":"2024-09-13T18:48:07.265232+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:48:07.265232+0000","last_undegraded":"2024-09-13T18:48:07.265232+0000","last_fullsized":"2024-09-13T18:48:07.265232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:48:07.265153+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:48:07.265153+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.265153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:01.884698+0000","scrub_duration":0.0034868730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:11.490586+0000","last_change":"2024-09-13T18:48:11.490789+0000","last_active":"2024-09-13T18:48:11.490586+0000","last_peered":"2024-09-13T18:48:11.490586+0000","last_clean":"2024-09-13T18:48:11.490586+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:48:11.490586+0000","last_undegraded":"2024-09-13T18:48:11.490586+0000","last_fullsized":"2024-09-13T18:48:11.490586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:11.490538+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:11.490538+0000","last_clean_scrub_stamp":"2024-09-13T18:48:11.490538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:35.858696+0000","scrub_duration":0.0038395500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.061803+0000","last_change":"2024-09-13T18:47:45.062044+0000","last_active":"2024-09-13T18:47:45.061803+0000","last_peered":"2024-09-13T18:47:45.061803+0000","last_clean":"2024-09-13T18:47:45.061803+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:45.061803+0000","last_undegraded":"2024-09-13T18:47:45.061803+0000","last_fullsized":"2024-09-13T18:47:45.061803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.061720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:57.256752+0000","scrub_duration":0.0031242209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.418863+0000","last_change":"2024-09-13T18:48:14.419173+0000","last_active":"2024-09-13T18:48:14.418863+0000","last_peered":"2024-09-13T18:48:14.418863+0000","last_clean":"2024-09-13T18:48:14.418863+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:48:14.418863+0000","last_undegraded":"2024-09-13T18:48:14.418863+0000","last_fullsized":"2024-09-13T18:48:14.418863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:14.418765+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:14.418765+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.418765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:46.627229+0000","scrub_duration":0.0042173879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.337521+0000","last_change":"2024-09-13T18:48:12.337765+0000","last_active":"2024-09-13T18:48:12.337521+0000","last_peered":"2024-09-13T18:48:12.337521+0000","last_clean":"2024-09-13T18:48:12.337521+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:48:12.337521+0000","last_undegraded":"2024-09-13T18:48:12.337521+0000","last_fullsized":"2024-09-13T18:48:12.337521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:12.337472+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:12.337472+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.337472+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:41.399961+0000","scrub_duration":0.0036942479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.605617+0000","last_change":"2024-09-13T18:48:18.605993+0000","last_active":"2024-09-13T18:48:18.605617+0000","last_peered":"2024-09-13T18:48:18.605617+0000","last_clean":"2024-09-13T18:48:18.605617+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:48:18.605617+0000","last_undegraded":"2024-09-13T18:48:18.605617+0000","last_fullsized":"2024-09-13T18:48:18.605617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:18.605565+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:18.605565+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.605565+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:29.357925+0000","scrub_duration":0.003275994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.588986+0000","last_change":"2024-09-13T18:46:41.332843+0000","last_active":"2024-09-13T18:47:35.588986+0000","last_peered":"2024-09-13T18:47:35.588986+0000","last_clean":"2024-09-13T18:47:35.588986+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:47:35.588986+0000","last_undegraded":"2024-09-13T18:47:35.588986+0000","last_fullsized":"2024-09-13T18:47:35.588986+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.271885+0000","last_change":"2024-09-13T18:48:08.272117+0000","last_active":"2024-09-13T18:48:08.271885+0000","last_peered":"2024-09-13T18:48:08.271885+0000","last_clean":"2024-09-13T18:48:08.271885+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:48:08.271885+0000","last_undegraded":"2024-09-13T18:48:08.271885+0000","last_fullsized":"2024-09-13T18:48:08.271885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:08.271828+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:08.271828+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.271828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.037826+0000","scrub_duration":0.0036946520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.595509+0000","last_change":"2024-09-13T18:46:41.335200+0000","last_active":"2024-09-13T18:47:35.595509+0000","last_peered":"2024-09-13T18:47:35.595509+0000","last_clean":"2024-09-13T18:47:35.595509+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:47:35.595509+0000","last_undegraded":"2024-09-13T18:47:35.595509+0000","last_fullsized":"2024-09-13T18:47:35.595509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.561801+0000","last_change":"2024-09-13T18:47:47.562108+0000","last_active":"2024-09-13T18:47:47.561801+0000","last_peered":"2024-09-13T18:47:47.561801+0000","last_clean":"2024-09-13T18:47:47.561801+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:47.561801+0000","last_undegraded":"2024-09-13T18:47:47.561801+0000","last_fullsized":"2024-09-13T18:47:47.561801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.561735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:10.120901+0000","scrub_duration":0.0037975349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.286758+0000","last_change":"2024-09-13T18:48:08.287051+0000","last_active":"2024-09-13T18:48:08.286758+0000","last_peered":"2024-09-13T18:48:08.286758+0000","last_clean":"2024-09-13T18:48:08.286758+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:48:08.286758+0000","last_undegraded":"2024-09-13T18:48:08.286758+0000","last_fullsized":"2024-09-13T18:48:08.286758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:08.286639+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:08.286639+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.286639+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:11.439457+0000","scrub_duration":0.0035090690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.424315+0000","last_change":"2024-09-13T18:47:49.424537+0000","last_active":"2024-09-13T18:47:49.424315+0000","last_peered":"2024-09-13T18:47:49.424315+0000","last_clean":"2024-09-13T18:47:49.424315+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:49.424315+0000","last_undegraded":"2024-09-13T18:47:49.424315+0000","last_fullsized":"2024-09-13T18:47:49.424315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.424264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:14.286009+0000","scrub_duration":0.00282059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:54.464900+0000","last_change":"2024-09-13T18:47:54.465116+0000","last_active":"2024-09-13T18:47:54.464900+0000","last_peered":"2024-09-13T18:47:54.464900+0000","last_clean":"2024-09-13T18:47:54.464900+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:54.464900+0000","last_undegraded":"2024-09-13T18:47:54.464900+0000","last_fullsized":"2024-09-13T18:47:54.464900+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_clean_scrub_stamp":"2024-09-13T18:47:54.464839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:40.461015+0000","scrub_duration":0.0036862280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.600237+0000","last_change":"2024-09-13T18:48:19.600433+0000","last_active":"2024-09-13T18:48:19.600237+0000","last_peered":"2024-09-13T18:48:19.600237+0000","last_clean":"2024-09-13T18:48:19.600237+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:48:19.600237+0000","last_undegraded":"2024-09-13T18:48:19.600237+0000","last_fullsized":"2024-09-13T18:48:19.600237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:19.600199+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:19.600199+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.600199+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.889071+0000","scrub_duration":0.0034096209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:13.707104+0000","last_change":"2024-09-13T18:48:13.707330+0000","last_active":"2024-09-13T18:48:13.707104+0000","last_peered":"2024-09-13T18:48:13.707104+0000","last_clean":"2024-09-13T18:48:13.707104+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:48:13.707104+0000","last_undegraded":"2024-09-13T18:48:13.707104+0000","last_fullsized":"2024-09-13T18:48:13.707104+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:13.707051+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:13.707051+0000","last_clean_scrub_stamp":"2024-09-13T18:48:13.707051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:38.728586+0000","scrub_duration":0.003750878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.569635+0000","last_change":"2024-09-13T18:48:08.569878+0000","last_active":"2024-09-13T18:48:08.569635+0000","last_peered":"2024-09-13T18:48:08.569635+0000","last_clean":"2024-09-13T18:48:08.569635+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:48:08.569635+0000","last_undegraded":"2024-09-13T18:48:08.569635+0000","last_fullsized":"2024-09-13T18:48:08.569635+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-13T18:48:08.569584+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-13T18:48:08.569584+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.569584+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:32.966173+0000","scrub_duration":0.0033504580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.382405+0000","last_change":"2024-09-13T18:48:17.382543+0000","last_active":"2024-09-13T18:48:17.382405+0000","last_peered":"2024-09-13T18:48:17.382405+0000","last_clean":"2024-09-13T18:48:17.382405+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:48:17.382405+0000","last_undegraded":"2024-09-13T18:48:17.382405+0000","last_fullsized":"2024-09-13T18:48:17.382405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:17.382376+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:17.382376+0000","last_clean_scrub_stamp":"2024-09-13T18:48:17.382376+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:50.307359+0000","scrub_duration":0.0021748319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.344070+0000","last_change":"2024-09-13T18:48:10.344274+0000","last_active":"2024-09-13T18:48:10.344070+0000","last_peered":"2024-09-13T18:48:10.344070+0000","last_clean":"2024-09-13T18:48:10.344070+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:48:10.344070+0000","last_undegraded":"2024-09-13T18:48:10.344070+0000","last_fullsized":"2024-09-13T18:48:10.344070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:10.344011+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:10.344011+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.344011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:10.725176+0000","scrub_duration":0.0038631820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.396898+0000","last_change":"2024-09-13T18:48:17.396898+0000","last_active":"2024-09-13T18:48:17.396898+0000","last_peered":"2024-09-13T18:48:17.396898+0000","last_clean":"2024-09-13T18:48:17.396898+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:48:17.396898+0000","last_undegraded":"2024-09-13T18:48:17.396898+0000","last_fullsized":"2024-09-13T18:48:17.396898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:48:17.396643+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:48:17.396643+0000","last_clean_scrub_stamp":"2024-09-13T18:48:17.396643+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:57.359618+0000","scrub_duration":0.0033315160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.122072+0000","last_change":"2024-09-13T18:47:53.122354+0000","last_active":"2024-09-13T18:47:53.122072+0000","last_peered":"2024-09-13T18:47:53.122072+0000","last_clean":"2024-09-13T18:47:53.122072+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:53.122072+0000","last_undegraded":"2024-09-13T18:47:53.122072+0000","last_fullsized":"2024-09-13T18:47:53.122072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.122017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:58.006765+0000","scrub_duration":0.003838228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.591872+0000","last_change":"2024-09-13T18:47:53.592321+0000","last_active":"2024-09-13T18:47:53.591872+0000","last_peered":"2024-09-13T18:47:53.591872+0000","last_clean":"2024-09-13T18:47:53.591872+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:53.591872+0000","last_undegraded":"2024-09-13T18:47:53.591872+0000","last_fullsized":"2024-09-13T18:47:53.591872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.591804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:03.584134+0000","scrub_duration":0.0026496750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.037967+0000","last_change":"2024-09-13T18:47:48.038206+0000","last_active":"2024-09-13T18:47:48.037967+0000","last_peered":"2024-09-13T18:47:48.037967+0000","last_clean":"2024-09-13T18:47:48.037967+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:48.037967+0000","last_undegraded":"2024-09-13T18:47:48.037967+0000","last_fullsized":"2024-09-13T18:47:48.037967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.037918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:34.291038+0000","scrub_duration":0.0034905460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.396738+0000","last_change":"2024-09-13T18:48:12.396935+0000","last_active":"2024-09-13T18:48:12.396738+0000","last_peered":"2024-09-13T18:48:12.396738+0000","last_clean":"2024-09-13T18:48:12.396738+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:48:12.396738+0000","last_undegraded":"2024-09-13T18:48:12.396738+0000","last_fullsized":"2024-09-13T18:48:12.396738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:12.396677+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:12.396677+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.396677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:12.749724+0000","scrub_duration":0.002876043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.355816+0000","last_change":"2024-09-13T18:48:18.355988+0000","last_active":"2024-09-13T18:48:18.355816+0000","last_peered":"2024-09-13T18:48:18.355816+0000","last_clean":"2024-09-13T18:48:18.355816+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:48:18.355816+0000","last_undegraded":"2024-09-13T18:48:18.355816+0000","last_fullsized":"2024-09-13T18:48:18.355816+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:18.355774+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:18.355774+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.355774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:31.217712+0000","scrub_duration":0.0028712759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.670022+0000","last_change":"2024-09-13T18:48:12.670192+0000","last_active":"2024-09-13T18:48:12.670022+0000","last_peered":"2024-09-13T18:48:12.670022+0000","last_clean":"2024-09-13T18:48:12.670022+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:48:12.670022+0000","last_undegraded":"2024-09-13T18:48:12.670022+0000","last_fullsized":"2024-09-13T18:48:12.670022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:12.669968+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:12.669968+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.669968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:35.629738+0000","scrub_duration":0.0033964870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":87,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91700000000000004,"15min":0.96099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0569999999999999,"5min":2.585,"15min":2.585},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.99299999999999999,"15min":1.0329999999999999},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.736,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.0389999999999999},"min":{"1min":0.60499999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3300000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.115,"15min":1.123},"min":{"1min":0.72599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.292}]},{"osd":2,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.143,"15min":1.1739999999999999},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.169},{"interface":"front","average":{"1min":1.242,"5min":1.1910000000000001,"15min":1.2430000000000001},"min":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.579}]},{"osd":4,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.163,"15min":1.2110000000000001},"min":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5609999999999999,"5min":1.665,"15min":1.665},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.3129999999999999,"15min":1.337},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.421}]},{"osd":5,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.254,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.677,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.3340000000000001,"15min":1.3440000000000001},"min":{"1min":0.98399999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.49}]},{"osd":6,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.3999999999999999,"15min":1.429},"min":{"1min":0.79100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.296,"15min":1.3420000000000001},"min":{"1min":0.75800000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.544,"5min":2.355,"15min":2.355},"last":1.097}]},{"osd":7,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.367,"15min":1.423},"min":{"1min":0.81399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.6859999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.22},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.484},"min":{"1min":0.83799999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.931,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.25}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":995328,"data_stored":521813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.58899999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.3390000000000004,"5min":4.3390000000000004,"15min":4.3390000000000004},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1160000000000001,"15min":1.1719999999999999},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":1.4470000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.085,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":0.997,"15min":0.97599999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.337},"min":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.625},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.2609999999999999,"15min":1.2789999999999999},"min":{"1min":0.58499999999999996,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":1.3919999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.2889999999999999,"15min":1.2909999999999999},"min":{"1min":0.876,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":4.5869999999999997,"5min":4.5869999999999997,"15min":4.5869999999999997},"last":1.097},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.278,"15min":1.3149999999999999},"min":{"1min":0.88100000000000001,"5min":0.752,"15min":0.752},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.149}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.4379999999999999},"min":{"1min":0.80400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.3129999999999999,"15min":1.3220000000000001},"min":{"1min":0.874,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.264}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.365,"15min":1.389},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":1.498},{"interface":"front","average":{"1min":1.573,"5min":1.3959999999999999,"15min":1.4219999999999999},"min":{"1min":0.91400000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":1.423}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.506,"15min":1.579},"min":{"1min":0.755,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.472,"15min":1.5049999999999999},"min":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.6639999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":1.595}]}]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.52300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.292,"5min":1.1639999999999999,"15min":1.1870000000000001},"min":{"1min":0.59199999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":4.4729999999999999,"5min":4.4729999999999999,"15min":4.4729999999999999},"last":1.29}]},{"osd":2,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.1739999999999999,"15min":1.145},"min":{"1min":0.63100000000000001,"5min":0.628,"15min":0.628},"max":{"1min":4.7409999999999997,"5min":4.7409999999999997,"15min":4.7409999999999997},"last":1.411}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2030000000000001,"15min":1.2549999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.0129999999999999,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":1.351},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.1879999999999999,"15min":1.2250000000000001},"min":{"1min":0.73899999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":5.1950000000000003,"5min":5.1950000000000003,"15min":5.1950000000000003},"last":1.7549999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3180000000000001,"15min":1.3620000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.569,"5min":1.397,"15min":1.4350000000000001},"min":{"1min":0.88200000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.8220000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":1.5600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.423,"15min":1.49},"min":{"1min":0.89700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":1.153},{"interface":"front","average":{"1min":1.542,"5min":1.4750000000000001,"15min":1.524},"min":{"1min":0.98399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":4.7869999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"last":1.232}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4319999999999999,"15min":1.5049999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.532},{"interface":"front","average":{"1min":1.571,"5min":1.5569999999999999,"15min":1.6479999999999999},"min":{"1min":1.0780000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":4.9459999999999997,"5min":4.9459999999999997,"15min":4.9459999999999997},"last":1.611}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.579,"15min":1.665},"min":{"1min":0.97499999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":1.667},{"interface":"front","average":{"1min":1.669,"5min":1.605,"15min":1.655},"min":{"1min":1.0820000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":4.8600000000000003,"5min":4.8600000000000003,"15min":4.8600000000000003},"last":1.698}]}]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3460000000000001,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.996,"5min":0.97399999999999998,"15min":1.03},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6659999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1459999999999999},"min":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.405,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.619},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.105,"15min":1.157},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7769999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.6679999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.048,"15min":1.018},"min":{"1min":0.57599999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.224,"5min":1.2430000000000001,"15min":1.2989999999999999},"min":{"1min":0.68999999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9039999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2749999999999999,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.819,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.046},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.2509999999999999},"min":{"1min":0.83499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3759999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.1899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.95099999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.875,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3300000000000001,"15min":1.3500000000000001},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9910000000000001,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.135}]},{"osd":6,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.228,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.778,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.282},{"interface":"front","average":{"1min":1.381,"5min":1.3979999999999999,"15min":1.4299999999999999},"min":{"1min":0.89400000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.982,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.2450000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3939999999999999,"15min":1.462},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.339},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.319,"15min":1.373},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9299999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.448}]}]},{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0429999999999999,"15min":1.081},"min":{"1min":0.63700000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.425,"5min":2.798,"15min":2.798},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0569999999999999,"15min":1.0900000000000001},"min":{"1min":0.59999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5429999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.079}]},{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.046},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.008,"15min":1.05},"min":{"1min":0.65700000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0580000000000001,"15min":1.0780000000000001},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":2.105,"5min":2.593,"15min":2.593},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.133,"5min":1.0660000000000001,"15min":1.0860000000000001},"min":{"1min":0.67600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1879999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0860000000000001,"15min":1.1279999999999999},"min":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4039999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.026},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1120000000000001,"15min":1.147},"min":{"1min":0.68400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.1299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.873,"15min":0.85899999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2569999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0309999999999999,"15min":1.0369999999999999},"min":{"1min":0.66300000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.462,"5min":1.573,"15min":1.573},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96499999999999997,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2769999999999999,"5min":1.619,"15min":1.619},"last":0.92000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.034},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.375,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.046},{"interface":"front","average":{"1min":0.999,"5min":1.1080000000000001,"15min":1.119},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4410000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.99099999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.64300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.747,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4830000000000001,"5min":1.532,"15min":1.532},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95499999999999996,"15min":0.98099999999999998},"min":{"1min":0.69599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1479999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.86899999999999999,"15min":0.84699999999999998},"min":{"1min":0.64100000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.0780000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92100000000000004,"15min":0.91700000000000004},"min":{"1min":0.66400000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.91300000000000003,"15min":0.90300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0600000000000001,"15min":1.0960000000000001},"min":{"1min":0.65900000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5669999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.85299999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.95299999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.876,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.077,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1699999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.046,"15min":1.081},"min":{"1min":0.67900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1799999999999999,"5min":1.76,"15min":1.76},"last":0.84899999999999998},{"interface":"front","average":{"1min":1,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.745,"5min":0.629,"15min":0.629},"max":{"1min":1.4259999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0409999999999999,"15min":1.0309999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3700000000000001,"5min":1.677,"15min":1.677},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":1.119,"15min":1.006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.276,"5min":25.111999999999998,"15min":25.111999999999998},"last":1.111},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.1659999999999999,"15min":1.0820000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5009999999999999,"5min":24.834,"15min":24.834},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.69099999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.304,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0589999999999999,"15min":1.109},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.234,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.006},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.079,"15min":1.111},"min":{"1min":0.71599999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.879}]},{"osd":3,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.999,"15min":1.036},"min":{"1min":0.65200000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4019999999999999,"5min":1.468,"15min":1.468},"last":0.752}]},{"osd":4,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.622,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.036,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.997,"15min":1.0429999999999999},"min":{"1min":0.58799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1080000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0609999999999999,"15min":1.081},"min":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.012},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3169999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1220000000000001,"15min":1.1519999999999999},"min":{"1min":0.67900000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.081}]}]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":1003520,"data_stored":522485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93899999999999995,"15min":0.98299999999999998},"min":{"1min":0.72299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.202,"5min":1.76,"15min":1.76},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95099999999999996,"15min":0.97399999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.26,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.96599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0069999999999999,"15min":1.0389999999999999},"min":{"1min":0.749,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.466,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0720000000000001,"15min":1.101},"min":{"1min":0.93000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.292,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68400000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3919999999999999,"5min":1.508,"15min":1.508},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1000000000000001,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.23,"5min":2.032,"15min":2.032},"last":1.0760000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.296,"15min":1.454},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.371,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.4570000000000001,"15min":1.6399999999999999},"min":{"1min":0.80000000000000004,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.202}]},{"osd":5,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.89500000000000002},"min":{"1min":0.61199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.115},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.96399999999999997,"15min":0.98599999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0800000000000001,"5min":1.46,"15min":1.46},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.02,"15min":1.0349999999999999},"min":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.339,"5min":1.552,"15min":1.552},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.111,"15min":1.1539999999999999},"min":{"1min":0.67000000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.288,"5min":1.597,"15min":1.597},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.121,"15min":1.1399999999999999},"min":{"1min":0.70599999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.224,"5min":1.694,"15min":1.694},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.0669999999999999,"15min":1.091},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3180000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:48:26.038 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.038 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.038 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.039 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.039 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.039 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.039 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:44:59.812539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.040 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.041 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.041 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.041 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.041 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.041 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.041 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.042 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.042 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.042 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.042 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T18:45:04.314230+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.042 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.042 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.043 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.043 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:26.043 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:48:46.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11bcc00700 1 Processor -- start 2024-09-13T18:48:46.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11bcc00700 1 -- start start 2024-09-13T18:48:46.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11bcc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b8156b00 0x7f11b8156f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.222 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11bcc00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b8072370 con 0x7f11b815cfd0 2024-09-13T18:48:46.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11bcc00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b80aa1a0 con 0x7f11b80cb860 2024-09-13T18:48:46.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11bcc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8157470 con 0x7f11b8156b00 2024-09-13T18:48:46.223 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11b7400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f11b815cfd0 0x7f11b815d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43946/0 (socket says 172.21.15.32:43946) 2024-09-13T18:48:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.216+0000 7f11b7400700 1 -- 172.21.15.32:0/3158794139 learned_addr learned my addr 172.21.15.32:0/3158794139 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:48:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b7e00700 1 --2- 172.21.15.32:0/3158794139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b8156b00 0x7f11b8156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815957671 0 0) 0x7f11b80aa1a0 con 0x7f11b80cb860 2024-09-13T18:48:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f119c0035d0 con 0x7f11b80cb860 2024-09-13T18:48:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383010018 0 0) 0x7f11b8072370 con 0x7f11b815cfd0 2024-09-13T18:48:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b80aa1a0 con 0x7f11b815cfd0 2024-09-13T18:48:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b7e00700 1 -- 172.21.15.32:0/3158794139 >> v1:172.21.15.86:6789/0 conn(0x7f11b80cb860 legacy=0x7f11b80c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b7e00700 1 -- 172.21.15.32:0/3158794139 >> v1:172.21.15.32:6789/0 conn(0x7f11b815cfd0 legacy=0x7f11b815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b7e00700 1 -- 172.21.15.32:0/3158794139 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80a9d00 con 0x7f11b8156b00 2024-09-13T18:48:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b7e00700 1 --2- 172.21.15.32:0/3158794139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b8156b00 0x7f11b8156f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009880 tx=0x7f11b0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4b7207f52ce130 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0011830 con 0x7f11b8156b00 2024-09-13T18:48:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0011990 con 0x7f11b8156b00 2024-09-13T18:48:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11b6a00700 1 -- 172.21.15.32:0/3158794139 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0011d20 con 0x7f11b8156b00 2024-09-13T18:48:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11bcc00700 1 -- 172.21.15.32:0/3158794139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b8156b00 msgr2=0x7f11b8156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11bcc00700 1 --2- 172.21.15.32:0/3158794139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b8156b00 0x7f11b8156f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009880 tx=0x7f11b0009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11bcc00700 1 -- 172.21.15.32:0/3158794139 shutdown_connections 2024-09-13T18:48:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11bcc00700 1 --2- 172.21.15.32:0/3158794139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b8156b00 0x7f11b8156f30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.220+0000 7f11bcc00700 1 -- 172.21.15.32:0/3158794139 >> 172.21.15.32:0/3158794139 conn(0x7f11b80cad40 msgr2=0x7f11b80cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.224+0000 7f11bcc00700 1 -- 172.21.15.32:0/3158794139 shutdown_connections 2024-09-13T18:48:46.227 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.224+0000 7f11bcc00700 1 -- 172.21.15.32:0/3158794139 wait complete. 2024-09-13T18:48:46.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.224+0000 7f11bcc00700 1 Processor -- start 2024-09-13T18:48:46.230 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.224+0000 7f11bcc00700 1 -- start start 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11b80cb860 0x7f11b81258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b8156b00 0x7f11b8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 0x7f11b81271a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b815b600 con 0x7f11b8156b00 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b815b3b0 con 0x7f11b80cb860 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8159790 con 0x7f11b815cfd0 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 0x7f11b81271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11b80cb860 0x7f11b81258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11aea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b8156b00 0x7f11b8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 0x7f11b81271a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:40350/0 (socket says 172.21.15.32:40350) 2024-09-13T18:48:46.233 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7e00700 1 -- 172.21.15.32:0/1419721385 learned_addr learned my addr 172.21.15.32:0/1419721385 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 -- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 msgr2=0x7f11b81271a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 0x7f11b81271a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 -- 172.21.15.32:0/1419721385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b8156b00 msgr2=0x7f11b8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b8156b00 0x7f11b8155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 -- 172.21.15.32:0/1419721385 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00094b0 con 0x7f11b80cb860 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7e00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 0x7f11b81271a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:46.235 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11aea00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b8156b00 0x7f11b8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11b7400700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11b80cb860 0x7f11b81258b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f11a800c560 tx=0x7f11a800c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8005d90 con 0x7f11b80cb860 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a80070d0 con 0x7f11b80cb860 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b815a030 con 0x7f11b80cb860 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.228+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8007440 con 0x7f11b80cb860 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.232+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b8125df0 con 0x7f11b80cb860 2024-09-13T18:48:46.236 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.232+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b80a9950 con 0x7f11b80cb860 2024-09-13T18:48:46.238 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.232+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11a80075a0 con 0x7f11b80cb860 2024-09-13T18:48:46.239 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.236+0000 7f11afe00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1194066730 0x7f1194068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.236+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f11a8083510 con 0x7f11b80cb860 2024-09-13T18:48:46.240 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.236+0000 7f11aea00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1194066730 0x7f1194068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.241 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.236+0000 7f11aea00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1194066730 0x7f1194068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f11b8125310 tx=0x7f11a0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.251 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.244+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11a80504a0 con 0x7f11b80cb860 2024-09-13T18:48:46.443 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.440+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b80c5f30 con 0x7f1194066730 2024-09-13T18:48:46.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.456+0000 7f11afe00700 1 -- 172.21.15.32:0/1419721385 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370224 (secure 0 0 0) 0x7f11b80c5f30 con 0x7f1194066730 2024-09-13T18:48:46.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1194066730 msgr2=0x7f1194068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1194066730 0x7f1194068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f11b8125310 tx=0x7f11a0009040 comp rx=0 tx=0).stop 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11b80cb860 msgr2=0x7f11b81258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11b80cb860 0x7f11b81258b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f11a800c560 tx=0x7f11a800c870 comp rx=0 tx=0).stop 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 shutdown_connections 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f1194066730 0x7f1194068bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11b815cfd0 0x7f11b81271a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.472 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f11b8156b00 0x7f11b8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 --2- 172.21.15.32:0/1419721385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11b80cb860 0x7f11b81258b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 >> 172.21.15.32:0/1419721385 conn(0x7f11b80cad40 msgr2=0x7f11b80cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 shutdown_connections 2024-09-13T18:48:46.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:48:46.468+0000 7f11bcc00700 1 -- 172.21.15.32:0/1419721385 wait complete. 2024-09-13T18:48:46.474 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:48:46.494 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-13T18:48:46.146314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629278,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":248,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":722,"ondisk_log_size":722,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249400,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725320,"statfs":{"total":773094113280,"available":772838727680,"internally_reserved":0,"allocated":8904704,"data_stored":5130652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004878"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":115,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.291771+0000","last_change":"2024-09-13T18:48:01.291999+0000","last_active":"2024-09-13T18:48:01.291771+0000","last_peered":"2024-09-13T18:48:01.291771+0000","last_clean":"2024-09-13T18:48:01.291771+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:48:01.291771+0000","last_undegraded":"2024-09-13T18:48:01.291771+0000","last_fullsized":"2024-09-13T18:48:01.291771+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:01.291712+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:01.291712+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.291712+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:42.194295+0000","scrub_duration":0.0091402229999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:44.019867+0000","last_change":"2024-09-13T18:47:44.020185+0000","last_active":"2024-09-13T18:47:44.019867+0000","last_peered":"2024-09-13T18:47:44.019867+0000","last_clean":"2024-09-13T18:47:44.019867+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:44.019867+0000","last_undegraded":"2024-09-13T18:47:44.019867+0000","last_fullsized":"2024-09-13T18:47:44.019867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_clean_scrub_stamp":"2024-09-13T18:47:44.019755+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.693765+0000","scrub_duration":0.0035153290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.437125+0000","last_change":"2024-09-13T18:48:20.437325+0000","last_active":"2024-09-13T18:48:20.437125+0000","last_peered":"2024-09-13T18:48:20.437125+0000","last_clean":"2024-09-13T18:48:20.437125+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:48:20.437125+0000","last_undegraded":"2024-09-13T18:48:20.437125+0000","last_fullsized":"2024-09-13T18:48:20.437125+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.437094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.437094+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.437094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:22.347631+0000","scrub_duration":0.002801408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.263578+0000","last_change":"2024-09-13T18:47:53.263825+0000","last_active":"2024-09-13T18:47:53.263578+0000","last_peered":"2024-09-13T18:47:53.263578+0000","last_clean":"2024-09-13T18:47:53.263578+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:53.263578+0000","last_undegraded":"2024-09-13T18:47:53.263578+0000","last_fullsized":"2024-09-13T18:47:53.263578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.263522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:19.503992+0000","scrub_duration":0.0029422229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.084921+0000","last_change":"2024-09-13T18:47:48.085118+0000","last_active":"2024-09-13T18:47:48.084921+0000","last_peered":"2024-09-13T18:47:48.084921+0000","last_clean":"2024-09-13T18:47:48.084921+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:48.084921+0000","last_undegraded":"2024-09-13T18:47:48.084921+0000","last_fullsized":"2024-09-13T18:47:48.084921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.084867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:23.745245+0000","scrub_duration":0.0038812949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:03.011301+0000","last_change":"2024-09-13T18:48:03.011508+0000","last_active":"2024-09-13T18:48:03.011301+0000","last_peered":"2024-09-13T18:48:03.011301+0000","last_clean":"2024-09-13T18:48:03.011301+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:48:03.011301+0000","last_undegraded":"2024-09-13T18:48:03.011301+0000","last_fullsized":"2024-09-13T18:48:03.011301+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:03.011262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:03.011262+0000","last_clean_scrub_stamp":"2024-09-13T18:48:03.011262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:50.572656+0000","scrub_duration":0.003772119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.561797+0000","last_change":"2024-09-13T18:47:52.561992+0000","last_active":"2024-09-13T18:47:52.561797+0000","last_peered":"2024-09-13T18:47:52.561797+0000","last_clean":"2024-09-13T18:47:52.561797+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:52.561797+0000","last_undegraded":"2024-09-13T18:47:52.561797+0000","last_fullsized":"2024-09-13T18:47:52.561797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.561757+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.865055+0000","scrub_duration":0.0060467489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.406557+0000","last_change":"2024-09-13T18:48:16.406727+0000","last_active":"2024-09-13T18:48:16.406557+0000","last_peered":"2024-09-13T18:48:16.406557+0000","last_clean":"2024-09-13T18:48:16.406557+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:48:16.406557+0000","last_undegraded":"2024-09-13T18:48:16.406557+0000","last_fullsized":"2024-09-13T18:48:16.406557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:16.406515+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:16.406515+0000","last_clean_scrub_stamp":"2024-09-13T18:48:16.406515+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:35.413712+0000","scrub_duration":0.0032610600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.979227+0000","last_change":"2024-09-13T18:48:07.979468+0000","last_active":"2024-09-13T18:48:07.979227+0000","last_peered":"2024-09-13T18:48:07.979227+0000","last_clean":"2024-09-13T18:48:07.979227+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:48:07.979227+0000","last_undegraded":"2024-09-13T18:48:07.979227+0000","last_fullsized":"2024-09-13T18:48:07.979227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:07.979180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:07.979180+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.979180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:23.491421+0000","scrub_duration":0.0036606949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.559250+0000","last_change":"2024-09-13T18:47:43.559400+0000","last_active":"2024-09-13T18:47:43.559250+0000","last_peered":"2024-09-13T18:47:43.559250+0000","last_clean":"2024-09-13T18:47:43.559250+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:43.559250+0000","last_undegraded":"2024-09-13T18:47:43.559250+0000","last_fullsized":"2024-09-13T18:47:43.559250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.559220+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:12.079418+0000","scrub_duration":0.0058698689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:37.682470+0000","last_change":"2024-09-13T18:48:37.682731+0000","last_active":"2024-09-13T18:48:37.682470+0000","last_peered":"2024-09-13T18:48:37.682470+0000","last_clean":"2024-09-13T18:48:37.682470+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:48:37.682470+0000","last_undegraded":"2024-09-13T18:48:37.682470+0000","last_fullsized":"2024-09-13T18:48:37.682470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-13T18:48:37.682418+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-13T18:48:37.682418+0000","last_clean_scrub_stamp":"2024-09-13T18:48:37.682418+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:52.974916+0000","scrub_duration":0.003599877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:06.985326+0000","last_change":"2024-09-13T18:48:06.985598+0000","last_active":"2024-09-13T18:48:06.985326+0000","last_peered":"2024-09-13T18:48:06.985326+0000","last_clean":"2024-09-13T18:48:06.985326+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:48:06.985326+0000","last_undegraded":"2024-09-13T18:48:06.985326+0000","last_fullsized":"2024-09-13T18:48:06.985326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:06.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:06.985275+0000","last_clean_scrub_stamp":"2024-09-13T18:48:06.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:30.581866+0000","scrub_duration":0.0038033839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.568744+0000","last_change":"2024-09-13T18:47:43.568860+0000","last_active":"2024-09-13T18:47:43.568744+0000","last_peered":"2024-09-13T18:47:43.568744+0000","last_clean":"2024-09-13T18:47:43.568744+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:43.568744+0000","last_undegraded":"2024-09-13T18:47:43.568744+0000","last_fullsized":"2024-09-13T18:47:43.568744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.568716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:06.232320+0000","scrub_duration":0.0018263019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.405364+0000","last_change":"2024-09-13T18:47:55.405551+0000","last_active":"2024-09-13T18:47:55.405364+0000","last_peered":"2024-09-13T18:47:55.405364+0000","last_clean":"2024-09-13T18:47:55.405364+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:55.405364+0000","last_undegraded":"2024-09-13T18:47:55.405364+0000","last_fullsized":"2024-09-13T18:47:55.405364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.405321+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:00.336484+0000","scrub_duration":0.0060507419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:23.391270+0000","last_change":"2024-09-13T18:48:23.391521+0000","last_active":"2024-09-13T18:48:23.391270+0000","last_peered":"2024-09-13T18:48:23.391270+0000","last_clean":"2024-09-13T18:48:23.391270+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:48:23.391270+0000","last_undegraded":"2024-09-13T18:48:23.391270+0000","last_fullsized":"2024-09-13T18:48:23.391270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:23.391226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:23.391226+0000","last_clean_scrub_stamp":"2024-09-13T18:48:23.391226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:37.214414+0000","scrub_duration":0.003641863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.455876+0000","last_change":"2024-09-13T18:48:01.456191+0000","last_active":"2024-09-13T18:48:01.455876+0000","last_peered":"2024-09-13T18:48:01.455876+0000","last_clean":"2024-09-13T18:48:01.455876+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:48:01.455876+0000","last_undegraded":"2024-09-13T18:48:01.455876+0000","last_fullsized":"2024-09-13T18:48:01.455876+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:01.455761+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:01.455761+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.455761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:43.734731+0000","scrub_duration":0.0029792400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:09.481422+0000","last_change":"2024-09-13T18:48:09.481422+0000","last_active":"2024-09-13T18:48:09.481422+0000","last_peered":"2024-09-13T18:48:09.481422+0000","last_clean":"2024-09-13T18:48:09.481422+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:48:09.481422+0000","last_undegraded":"2024-09-13T18:48:09.481422+0000","last_fullsized":"2024-09-13T18:48:09.481422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:09.481172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:09.481172+0000","last_clean_scrub_stamp":"2024-09-13T18:48:09.481172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:06.077418+0000","scrub_duration":0.0039577529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.633696+0000","last_change":"2024-09-13T18:48:22.633914+0000","last_active":"2024-09-13T18:48:22.633696+0000","last_peered":"2024-09-13T18:48:22.633696+0000","last_clean":"2024-09-13T18:48:22.633696+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:48:22.633696+0000","last_undegraded":"2024-09-13T18:48:22.633696+0000","last_fullsized":"2024-09-13T18:48:22.633696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:22.633653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:22.633653+0000","last_clean_scrub_stamp":"2024-09-13T18:48:22.633653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:18.950993+0000","scrub_duration":0.0041859640000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:13.351867+0000","last_change":"2024-09-13T18:48:13.352149+0000","last_active":"2024-09-13T18:48:13.351867+0000","last_peered":"2024-09-13T18:48:13.351867+0000","last_clean":"2024-09-13T18:48:13.351867+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:48:13.351867+0000","last_undegraded":"2024-09-13T18:48:13.351867+0000","last_fullsized":"2024-09-13T18:48:13.351867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:13.351768+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:13.351768+0000","last_clean_scrub_stamp":"2024-09-13T18:48:13.351768+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.326683+0000","scrub_duration":0.0025088380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.319041+0000","last_change":"2024-09-13T18:48:02.319225+0000","last_active":"2024-09-13T18:48:02.319041+0000","last_peered":"2024-09-13T18:48:02.319041+0000","last_clean":"2024-09-13T18:48:02.319041+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:48:02.319041+0000","last_undegraded":"2024-09-13T18:48:02.319041+0000","last_fullsized":"2024-09-13T18:48:02.319041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:02.318994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:02.318994+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.318994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:13.580074+0000","scrub_duration":0.0038020279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.416022+0000","last_change":"2024-09-13T18:48:14.416312+0000","last_active":"2024-09-13T18:48:14.416022+0000","last_peered":"2024-09-13T18:48:14.416022+0000","last_clean":"2024-09-13T18:48:14.416022+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:48:14.416022+0000","last_undegraded":"2024-09-13T18:48:14.416022+0000","last_fullsized":"2024-09-13T18:48:14.416022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:14.415970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:14.415970+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.415970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.431347+0000","scrub_duration":0.0039507550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.451206+0000","last_change":"2024-09-13T18:48:14.451413+0000","last_active":"2024-09-13T18:48:14.451206+0000","last_peered":"2024-09-13T18:48:14.451206+0000","last_clean":"2024-09-13T18:48:14.451206+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:48:14.451206+0000","last_undegraded":"2024-09-13T18:48:14.451206+0000","last_fullsized":"2024-09-13T18:48:14.451206+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:48:14.451155+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:48:14.451155+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.451155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:35.419012+0000","scrub_duration":0.0027847140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.652989+0000","last_change":"2024-09-13T18:47:47.653251+0000","last_active":"2024-09-13T18:47:47.652989+0000","last_peered":"2024-09-13T18:47:47.652989+0000","last_clean":"2024-09-13T18:47:47.652989+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:47.652989+0000","last_undegraded":"2024-09-13T18:47:47.652989+0000","last_fullsized":"2024-09-13T18:47:47.652989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.652946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.344600+0000","scrub_duration":0.0030565380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.008098+0000","last_change":"2024-09-13T18:48:18.008287+0000","last_active":"2024-09-13T18:48:18.008098+0000","last_peered":"2024-09-13T18:48:18.008098+0000","last_clean":"2024-09-13T18:48:18.008098+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:48:18.008098+0000","last_undegraded":"2024-09-13T18:48:18.008098+0000","last_fullsized":"2024-09-13T18:48:18.008098+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:18.008062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:18.008062+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.008062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:26.866426+0000","scrub_duration":0.0060362790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.317626+0000","last_change":"2024-09-13T18:48:15.317798+0000","last_active":"2024-09-13T18:48:15.317626+0000","last_peered":"2024-09-13T18:48:15.317626+0000","last_clean":"2024-09-13T18:48:15.317626+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:48:15.317626+0000","last_undegraded":"2024-09-13T18:48:15.317626+0000","last_fullsized":"2024-09-13T18:48:15.317626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:15.317586+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:15.317586+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.317586+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:21.647472+0000","scrub_duration":0.002498049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:44.717516+0000","last_change":"2024-09-13T18:48:44.717723+0000","last_active":"2024-09-13T18:48:44.717516+0000","last_peered":"2024-09-13T18:48:44.717516+0000","last_clean":"2024-09-13T18:48:44.717516+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:48:44.717516+0000","last_undegraded":"2024-09-13T18:48:44.717516+0000","last_fullsized":"2024-09-13T18:48:44.717516+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:44.717463+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:44.717463+0000","last_clean_scrub_stamp":"2024-09-13T18:48:44.717463+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:47.655599+0000","scrub_duration":0.0059987180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.012842+0000","last_change":"2024-09-13T18:48:04.013010+0000","last_active":"2024-09-13T18:48:04.012842+0000","last_peered":"2024-09-13T18:48:04.012842+0000","last_clean":"2024-09-13T18:48:04.012842+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:48:04.012842+0000","last_undegraded":"2024-09-13T18:48:04.012842+0000","last_fullsized":"2024-09-13T18:48:04.012842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:04.012810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:04.012810+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.012810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.515395+0000","scrub_duration":0.0063472049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:09.382293+0000","last_change":"2024-09-13T18:48:09.382541+0000","last_active":"2024-09-13T18:48:09.382293+0000","last_peered":"2024-09-13T18:48:09.382293+0000","last_clean":"2024-09-13T18:48:09.382293+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:48:09.382293+0000","last_undegraded":"2024-09-13T18:48:09.382293+0000","last_fullsized":"2024-09-13T18:48:09.382293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:48:09.382230+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:48:09.382230+0000","last_clean_scrub_stamp":"2024-09-13T18:48:09.382230+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:05.501947+0000","scrub_duration":0.0026682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.220942+0000","last_change":"2024-09-13T18:47:58.221241+0000","last_active":"2024-09-13T18:47:58.220942+0000","last_peered":"2024-09-13T18:47:58.220942+0000","last_clean":"2024-09-13T18:47:58.220942+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:58.220942+0000","last_undegraded":"2024-09-13T18:47:58.220942+0000","last_fullsized":"2024-09-13T18:47:58.220942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.220882+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:31.105081+0000","scrub_duration":0.004045735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:24.408799+0000","last_change":"2024-09-13T18:48:24.409139+0000","last_active":"2024-09-13T18:48:24.408799+0000","last_peered":"2024-09-13T18:48:24.408799+0000","last_clean":"2024-09-13T18:48:24.408799+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:48:24.408799+0000","last_undegraded":"2024-09-13T18:48:24.408799+0000","last_fullsized":"2024-09-13T18:48:24.408799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:24.408748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:24.408748+0000","last_clean_scrub_stamp":"2024-09-13T18:48:24.408748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:40.915694+0000","scrub_duration":0.0039121570000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.499292+0000","last_change":"2024-09-13T18:48:04.499292+0000","last_active":"2024-09-13T18:48:04.499292+0000","last_peered":"2024-09-13T18:48:04.499292+0000","last_clean":"2024-09-13T18:48:04.499292+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:48:04.499292+0000","last_undegraded":"2024-09-13T18:48:04.499292+0000","last_fullsized":"2024-09-13T18:48:04.499292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:04.498906+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:04.498906+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.498906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:52.223800+0000","scrub_duration":0.00343589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.482595+0000","last_change":"2024-09-13T18:47:51.482767+0000","last_active":"2024-09-13T18:47:51.482595+0000","last_peered":"2024-09-13T18:47:51.482595+0000","last_clean":"2024-09-13T18:47:51.482595+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:51.482595+0000","last_undegraded":"2024-09-13T18:47:51.482595+0000","last_fullsized":"2024-09-13T18:47:51.482595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.482562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:34.558081+0000","scrub_duration":0.0034253259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.503170+0000","last_change":"2024-09-13T18:48:14.503170+0000","last_active":"2024-09-13T18:48:14.503170+0000","last_peered":"2024-09-13T18:48:14.503170+0000","last_clean":"2024-09-13T18:48:14.503170+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:48:14.503170+0000","last_undegraded":"2024-09-13T18:48:14.503170+0000","last_fullsized":"2024-09-13T18:48:14.503170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:14.502866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:14.502866+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.502866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:56.838327+0000","scrub_duration":0.0040653399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.051610+0000","last_change":"2024-09-13T18:47:49.051818+0000","last_active":"2024-09-13T18:47:49.051610+0000","last_peered":"2024-09-13T18:47:49.051610+0000","last_clean":"2024-09-13T18:47:49.051610+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:49.051610+0000","last_undegraded":"2024-09-13T18:47:49.051610+0000","last_fullsized":"2024-09-13T18:47:49.051610+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.051559+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.947582+0000","scrub_duration":0.0034011369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.132202+0000","last_change":"2024-09-13T18:47:49.132469+0000","last_active":"2024-09-13T18:47:49.132202+0000","last_peered":"2024-09-13T18:47:49.132202+0000","last_clean":"2024-09-13T18:47:49.132202+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:49.132202+0000","last_undegraded":"2024-09-13T18:47:49.132202+0000","last_fullsized":"2024-09-13T18:47:49.132202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.132146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.405895+0000","scrub_duration":0.0026213619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.433346+0000","last_change":"2024-09-13T18:47:52.433346+0000","last_active":"2024-09-13T18:47:52.433346+0000","last_peered":"2024-09-13T18:47:52.433346+0000","last_clean":"2024-09-13T18:47:52.433346+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:52.433346+0000","last_undegraded":"2024-09-13T18:47:52.433346+0000","last_fullsized":"2024-09-13T18:47:52.433346+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.433008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.849816+0000","scrub_duration":0.003833234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:03.537032+0000","last_change":"2024-09-13T18:48:03.537343+0000","last_active":"2024-09-13T18:48:03.537032+0000","last_peered":"2024-09-13T18:48:03.537032+0000","last_clean":"2024-09-13T18:48:03.537032+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:48:03.537032+0000","last_undegraded":"2024-09-13T18:48:03.537032+0000","last_fullsized":"2024-09-13T18:48:03.537032+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:03.536979+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:03.536979+0000","last_clean_scrub_stamp":"2024-09-13T18:48:03.536979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:02.205018+0000","scrub_duration":0.0037624360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:38.695196+0000","last_change":"2024-09-13T18:48:38.695442+0000","last_active":"2024-09-13T18:48:38.695196+0000","last_peered":"2024-09-13T18:48:38.695196+0000","last_clean":"2024-09-13T18:48:38.695196+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:48:38.695196+0000","last_undegraded":"2024-09-13T18:48:38.695196+0000","last_fullsized":"2024-09-13T18:48:38.695196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:38.695150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:38.695150+0000","last_clean_scrub_stamp":"2024-09-13T18:48:38.695150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:24.464909+0000","scrub_duration":0.003177849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.469359+0000","last_change":"2024-09-13T18:47:53.469359+0000","last_active":"2024-09-13T18:47:53.469359+0000","last_peered":"2024-09-13T18:47:53.469359+0000","last_clean":"2024-09-13T18:47:53.469359+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:53.469359+0000","last_undegraded":"2024-09-13T18:47:53.469359+0000","last_fullsized":"2024-09-13T18:47:53.469359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.469009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.549365+0000","scrub_duration":0.0034698680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:57.298151+0000","last_change":"2024-09-13T18:47:57.298346+0000","last_active":"2024-09-13T18:47:57.298151+0000","last_peered":"2024-09-13T18:47:57.298151+0000","last_clean":"2024-09-13T18:47:57.298151+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:57.298151+0000","last_undegraded":"2024-09-13T18:47:57.298151+0000","last_fullsized":"2024-09-13T18:47:57.298151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_clean_scrub_stamp":"2024-09-13T18:47:57.298101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:47.457258+0000","scrub_duration":0.0029362590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.334953+0000","last_change":"2024-09-13T18:47:50.335172+0000","last_active":"2024-09-13T18:47:50.334953+0000","last_peered":"2024-09-13T18:47:50.334953+0000","last_clean":"2024-09-13T18:47:50.334953+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:50.334953+0000","last_undegraded":"2024-09-13T18:47:50.334953+0000","last_fullsized":"2024-09-13T18:47:50.334953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.334901+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:43.474237+0000","scrub_duration":0.0055209919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.429800+0000","last_change":"2024-09-13T18:47:55.429800+0000","last_active":"2024-09-13T18:47:55.429800+0000","last_peered":"2024-09-13T18:47:55.429800+0000","last_clean":"2024-09-13T18:47:55.429800+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:55.429800+0000","last_undegraded":"2024-09-13T18:47:55.429800+0000","last_fullsized":"2024-09-13T18:47:55.429800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.429388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:13.248197+0000","scrub_duration":0.0035543609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.498180+0000","last_change":"2024-09-13T18:47:47.498180+0000","last_active":"2024-09-13T18:47:47.498180+0000","last_peered":"2024-09-13T18:47:47.498180+0000","last_clean":"2024-09-13T18:47:47.498180+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:47.498180+0000","last_undegraded":"2024-09-13T18:47:47.498180+0000","last_fullsized":"2024-09-13T18:47:47.498180+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.497898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:43.625983+0000","scrub_duration":0.0036756570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.394735+0000","last_change":"2024-09-13T18:48:20.394735+0000","last_active":"2024-09-13T18:48:20.394735+0000","last_peered":"2024-09-13T18:48:20.394735+0000","last_clean":"2024-09-13T18:48:20.394735+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:48:20.394735+0000","last_undegraded":"2024-09-13T18:48:20.394735+0000","last_fullsized":"2024-09-13T18:48:20.394735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.394478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.394478+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.394478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:19.970817+0000","scrub_duration":0.0031325900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.270447+0000","last_change":"2024-09-13T18:48:22.270845+0000","last_active":"2024-09-13T18:48:22.270447+0000","last_peered":"2024-09-13T18:48:22.270447+0000","last_clean":"2024-09-13T18:48:22.270447+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:48:22.270447+0000","last_undegraded":"2024-09-13T18:48:22.270447+0000","last_fullsized":"2024-09-13T18:48:22.270447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:22.270344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:22.270344+0000","last_clean_scrub_stamp":"2024-09-13T18:48:22.270344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.608724+0000","scrub_duration":0.0058798319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.360722+0000","last_change":"2024-09-13T18:48:05.360900+0000","last_active":"2024-09-13T18:48:05.360722+0000","last_peered":"2024-09-13T18:48:05.360722+0000","last_clean":"2024-09-13T18:48:05.360722+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:48:05.360722+0000","last_undegraded":"2024-09-13T18:48:05.360722+0000","last_fullsized":"2024-09-13T18:48:05.360722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:05.360667+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:05.360667+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.360667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:37.843562+0000","scrub_duration":0.0033082490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.514815+0000","last_change":"2024-09-13T18:48:10.515008+0000","last_active":"2024-09-13T18:48:10.514815+0000","last_peered":"2024-09-13T18:48:10.514815+0000","last_clean":"2024-09-13T18:48:10.514815+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:48:10.514815+0000","last_undegraded":"2024-09-13T18:48:10.514815+0000","last_fullsized":"2024-09-13T18:48:10.514815+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:10.514771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:10.514771+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.514771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:19.193364+0000","scrub_duration":0.0031935050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"81'119","reported_seq":237,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.364193+0000","last_change":"2024-09-13T18:47:56.364342+0000","last_active":"2024-09-13T18:47:56.364193+0000","last_peered":"2024-09-13T18:47:56.364193+0000","last_clean":"2024-09-13T18:47:56.364193+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:56.364193+0000","last_undegraded":"2024-09-13T18:47:56.364193+0000","last_fullsized":"2024-09-13T18:47:56.364193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'119","last_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_deep_scrub":"81'119","last_deep_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.364169+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.913927+0000","scrub_duration":0.010342967999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:41.727362+0000","last_change":"2024-09-13T18:48:41.727689+0000","last_active":"2024-09-13T18:48:41.727362+0000","last_peered":"2024-09-13T18:48:41.727362+0000","last_clean":"2024-09-13T18:48:41.727362+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:48:41.727362+0000","last_undegraded":"2024-09-13T18:48:41.727362+0000","last_fullsized":"2024-09-13T18:48:41.727362+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.727310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.727310+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.727310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:08.873789+0000","scrub_duration":0.0039628859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.078237+0000","last_change":"2024-09-13T18:46:41.344901+0000","last_active":"2024-09-13T18:47:36.078237+0000","last_peered":"2024-09-13T18:47:36.078237+0000","last_clean":"2024-09-13T18:47:36.078237+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:47:36.078237+0000","last_undegraded":"2024-09-13T18:47:36.078237+0000","last_fullsized":"2024-09-13T18:47:36.078237+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.508414+0000","last_change":"2024-09-13T18:48:15.508414+0000","last_active":"2024-09-13T18:48:15.508414+0000","last_peered":"2024-09-13T18:48:15.508414+0000","last_clean":"2024-09-13T18:48:15.508414+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:48:15.508414+0000","last_undegraded":"2024-09-13T18:48:15.508414+0000","last_fullsized":"2024-09-13T18:48:15.508414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:15.508045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:15.508045+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.508045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:00.970795+0000","scrub_duration":0.0038577519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.974166+0000","last_change":"2024-09-13T18:48:04.974493+0000","last_active":"2024-09-13T18:48:04.974166+0000","last_peered":"2024-09-13T18:48:04.974166+0000","last_clean":"2024-09-13T18:48:04.974166+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:48:04.974166+0000","last_undegraded":"2024-09-13T18:48:04.974166+0000","last_fullsized":"2024-09-13T18:48:04.974166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:04.974118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:04.974118+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.974118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:50.337427+0000","scrub_duration":0.0037389459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:40.530633+0000","last_change":"2024-09-13T18:47:40.530820+0000","last_active":"2024-09-13T18:47:40.530633+0000","last_peered":"2024-09-13T18:47:40.530633+0000","last_clean":"2024-09-13T18:47:40.530633+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:40.530633+0000","last_undegraded":"2024-09-13T18:47:40.530633+0000","last_fullsized":"2024-09-13T18:47:40.530633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_clean_scrub_stamp":"2024-09-13T18:47:40.530592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:33.146259+0000","scrub_duration":0.0031957550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.234604+0000","last_change":"2024-09-13T18:47:51.234842+0000","last_active":"2024-09-13T18:47:51.234604+0000","last_peered":"2024-09-13T18:47:51.234604+0000","last_clean":"2024-09-13T18:47:51.234604+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:51.234604+0000","last_undegraded":"2024-09-13T18:47:51.234604+0000","last_fullsized":"2024-09-13T18:47:51.234604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.234552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.835687+0000","scrub_duration":0.0096124350000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.315759+0000","last_change":"2024-09-13T18:48:19.315989+0000","last_active":"2024-09-13T18:48:19.315759+0000","last_peered":"2024-09-13T18:48:19.315759+0000","last_clean":"2024-09-13T18:48:19.315759+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:48:19.315759+0000","last_undegraded":"2024-09-13T18:48:19.315759+0000","last_fullsized":"2024-09-13T18:48:19.315759+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:19.315681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:19.315681+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.315681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:17.146656+0000","scrub_duration":0.0043501210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:11.624536+0000","last_change":"2024-09-13T18:48:11.624728+0000","last_active":"2024-09-13T18:48:11.624536+0000","last_peered":"2024-09-13T18:48:11.624536+0000","last_clean":"2024-09-13T18:48:11.624536+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:48:11.624536+0000","last_undegraded":"2024-09-13T18:48:11.624536+0000","last_fullsized":"2024-09-13T18:48:11.624536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:11.624492+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:11.624492+0000","last_clean_scrub_stamp":"2024-09-13T18:48:11.624492+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:12.141467+0000","scrub_duration":0.0031213069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.362683+0000","last_change":"2024-09-13T18:48:04.362881+0000","last_active":"2024-09-13T18:48:04.362683+0000","last_peered":"2024-09-13T18:48:04.362683+0000","last_clean":"2024-09-13T18:48:04.362683+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:48:04.362683+0000","last_undegraded":"2024-09-13T18:48:04.362683+0000","last_fullsized":"2024-09-13T18:48:04.362683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:48:04.362627+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:48:04.362627+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.362627+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:58.244178+0000","scrub_duration":0.0053930799999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.358917+0000","last_change":"2024-09-13T18:48:22.359181+0000","last_active":"2024-09-13T18:48:22.358917+0000","last_peered":"2024-09-13T18:48:22.358917+0000","last_clean":"2024-09-13T18:48:22.358917+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:48:22.358917+0000","last_undegraded":"2024-09-13T18:48:22.358917+0000","last_fullsized":"2024-09-13T18:48:22.358917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:22.358877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:22.358877+0000","last_clean_scrub_stamp":"2024-09-13T18:48:22.358877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:07.815084+0000","scrub_duration":0.0036706439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.033407+0000","last_change":"2024-09-13T18:47:55.033619+0000","last_active":"2024-09-13T18:47:55.033407+0000","last_peered":"2024-09-13T18:47:55.033407+0000","last_clean":"2024-09-13T18:47:55.033407+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:55.033407+0000","last_undegraded":"2024-09-13T18:47:55.033407+0000","last_fullsized":"2024-09-13T18:47:55.033407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.033356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:27.430817+0000","scrub_duration":0.0033159650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.565941+0000","last_change":"2024-09-13T18:47:42.566061+0000","last_active":"2024-09-13T18:47:42.565941+0000","last_peered":"2024-09-13T18:47:42.565941+0000","last_clean":"2024-09-13T18:47:42.565941+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:42.565941+0000","last_undegraded":"2024-09-13T18:47:42.565941+0000","last_fullsized":"2024-09-13T18:47:42.565941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.565910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:50.152639+0000","scrub_duration":0.0063911790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.377660+0000","last_change":"2024-09-13T18:48:18.377919+0000","last_active":"2024-09-13T18:48:18.377660+0000","last_peered":"2024-09-13T18:48:18.377660+0000","last_clean":"2024-09-13T18:48:18.377660+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:48:18.377660+0000","last_undegraded":"2024-09-13T18:48:18.377660+0000","last_fullsized":"2024-09-13T18:48:18.377660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:18.377611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:18.377611+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.377611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:14.207959+0000","scrub_duration":0.0039362679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.414535+0000","last_change":"2024-09-13T18:47:58.414789+0000","last_active":"2024-09-13T18:47:58.414535+0000","last_peered":"2024-09-13T18:47:58.414535+0000","last_clean":"2024-09-13T18:47:58.414535+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:58.414535+0000","last_undegraded":"2024-09-13T18:47:58.414535+0000","last_fullsized":"2024-09-13T18:47:58.414535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.414481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:59.349305+0000","scrub_duration":0.0035677840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"81'12","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:59.231731+0000","last_change":"2024-09-13T18:47:59.231990+0000","last_active":"2024-09-13T18:47:59.231731+0000","last_peered":"2024-09-13T18:47:59.231731+0000","last_clean":"2024-09-13T18:47:59.231731+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:59.231731+0000","last_undegraded":"2024-09-13T18:47:59.231731+0000","last_fullsized":"2024-09-13T18:47:59.231731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-13T18:47:59.231673+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-13T18:47:59.231673+0000","last_clean_scrub_stamp":"2024-09-13T18:47:59.231673+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:47.851506+0000","scrub_duration":0.009267773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.301789+0000","last_change":"2024-09-13T18:48:20.302045+0000","last_active":"2024-09-13T18:48:20.301789+0000","last_peered":"2024-09-13T18:48:20.301789+0000","last_clean":"2024-09-13T18:48:20.301789+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:48:20.301789+0000","last_undegraded":"2024-09-13T18:48:20.301789+0000","last_fullsized":"2024-09-13T18:48:20.301789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.301737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.301737+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.301737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.860008+0000","scrub_duration":0.0036640150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.406089+0000","last_change":"2024-09-13T18:48:05.406213+0000","last_active":"2024-09-13T18:48:05.406089+0000","last_peered":"2024-09-13T18:48:05.406089+0000","last_clean":"2024-09-13T18:48:05.406089+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:48:05.406089+0000","last_undegraded":"2024-09-13T18:48:05.406089+0000","last_fullsized":"2024-09-13T18:48:05.406089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:05.406053+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:05.406053+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.406053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.046957+0000","scrub_duration":0.0030831119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.633439+0000","last_change":"2024-09-13T18:47:46.633627+0000","last_active":"2024-09-13T18:47:46.633439+0000","last_peered":"2024-09-13T18:47:46.633439+0000","last_clean":"2024-09-13T18:47:46.633439+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:46.633439+0000","last_undegraded":"2024-09-13T18:47:46.633439+0000","last_fullsized":"2024-09-13T18:47:46.633439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_clean_scrub_stamp":"2024-09-13T18:47:46.633397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:40.331659+0000","scrub_duration":0.0034897349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:24.471147+0000","last_change":"2024-09-13T18:48:24.471528+0000","last_active":"2024-09-13T18:48:24.471147+0000","last_peered":"2024-09-13T18:48:24.471147+0000","last_clean":"2024-09-13T18:48:24.471147+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:48:24.471147+0000","last_undegraded":"2024-09-13T18:48:24.471147+0000","last_fullsized":"2024-09-13T18:48:24.471147+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:24.471097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:24.471097+0000","last_clean_scrub_stamp":"2024-09-13T18:48:24.471097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:07.803531+0000","scrub_duration":0.0032780249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.597542+0000","last_change":"2024-09-13T18:46:41.335547+0000","last_active":"2024-09-13T18:47:35.597542+0000","last_peered":"2024-09-13T18:47:35.597542+0000","last_clean":"2024-09-13T18:47:35.597542+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:47:35.597542+0000","last_undegraded":"2024-09-13T18:47:35.597542+0000","last_fullsized":"2024-09-13T18:47:35.597542+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.585465+0000","last_change":"2024-09-13T18:47:42.585618+0000","last_active":"2024-09-13T18:47:42.585465+0000","last_peered":"2024-09-13T18:47:42.585465+0000","last_clean":"2024-09-13T18:47:42.585465+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:42.585465+0000","last_undegraded":"2024-09-13T18:47:42.585465+0000","last_fullsized":"2024-09-13T18:47:42.585465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.585429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:06.282715+0000","scrub_duration":0.002930406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.504637+0000","last_change":"2024-09-13T18:48:05.504637+0000","last_active":"2024-09-13T18:48:05.504637+0000","last_peered":"2024-09-13T18:48:05.504637+0000","last_clean":"2024-09-13T18:48:05.504637+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:48:05.504637+0000","last_undegraded":"2024-09-13T18:48:05.504637+0000","last_fullsized":"2024-09-13T18:48:05.504637+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:05.504260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:05.504260+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.504260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:59.575884+0000","scrub_duration":0.0039666019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.447529+0000","last_change":"2024-09-13T18:48:21.447529+0000","last_active":"2024-09-13T18:48:21.447529+0000","last_peered":"2024-09-13T18:48:21.447529+0000","last_clean":"2024-09-13T18:48:21.447529+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:48:21.447529+0000","last_undegraded":"2024-09-13T18:48:21.447529+0000","last_fullsized":"2024-09-13T18:48:21.447529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:21.447243+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:21.447243+0000","last_clean_scrub_stamp":"2024-09-13T18:48:21.447243+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:48.133724+0000","scrub_duration":0.0032702880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.445887+0000","last_change":"2024-09-13T18:47:58.446093+0000","last_active":"2024-09-13T18:47:58.445887+0000","last_peered":"2024-09-13T18:47:58.445887+0000","last_clean":"2024-09-13T18:47:58.445887+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:58.445887+0000","last_undegraded":"2024-09-13T18:47:58.445887+0000","last_fullsized":"2024-09-13T18:47:58.445887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.445838+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:59.858545+0000","scrub_duration":0.0076105000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:35.609305+0000","last_change":"2024-09-13T18:48:35.609475+0000","last_active":"2024-09-13T18:48:35.609305+0000","last_peered":"2024-09-13T18:48:35.609305+0000","last_clean":"2024-09-13T18:48:35.609305+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:48:35.609305+0000","last_undegraded":"2024-09-13T18:48:35.609305+0000","last_fullsized":"2024-09-13T18:48:35.609305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:35.609268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:35.609268+0000","last_clean_scrub_stamp":"2024-09-13T18:48:35.609268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:28.183086+0000","scrub_duration":0.0037434999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.574729+0000","last_change":"2024-09-13T18:47:55.574935+0000","last_active":"2024-09-13T18:47:55.574729+0000","last_peered":"2024-09-13T18:47:55.574729+0000","last_clean":"2024-09-13T18:47:55.574729+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:55.574729+0000","last_undegraded":"2024-09-13T18:47:55.574729+0000","last_fullsized":"2024-09-13T18:47:55.574729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.574683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:25.940388+0000","scrub_duration":0.0033516209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.985117+0000","last_change":"2024-09-13T18:47:42.985266+0000","last_active":"2024-09-13T18:47:42.985117+0000","last_peered":"2024-09-13T18:47:42.985117+0000","last_clean":"2024-09-13T18:47:42.985117+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:42.985117+0000","last_undegraded":"2024-09-13T18:47:42.985117+0000","last_fullsized":"2024-09-13T18:47:42.985117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'29","last_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_deep_scrub":"81'29","last_deep_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.985080+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:03.523374+0000","scrub_duration":0.0074139399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.371527+0000","last_change":"2024-09-13T18:48:21.371872+0000","last_active":"2024-09-13T18:48:21.371527+0000","last_peered":"2024-09-13T18:48:21.371527+0000","last_clean":"2024-09-13T18:48:21.371527+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:48:21.371527+0000","last_undegraded":"2024-09-13T18:48:21.371527+0000","last_fullsized":"2024-09-13T18:48:21.371527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'3","last_scrub_stamp":"2024-09-13T18:48:21.371462+0000","last_deep_scrub":"64'3","last_deep_scrub_stamp":"2024-09-13T18:48:21.371462+0000","last_clean_scrub_stamp":"2024-09-13T18:48:21.371462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:27.227188+0000","scrub_duration":0.0037063980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:35.600534+0000","last_change":"2024-09-13T18:46:41.328985+0000","last_active":"2024-09-13T18:47:35.600534+0000","last_peered":"2024-09-13T18:47:35.600534+0000","last_clean":"2024-09-13T18:47:35.600534+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:47:35.600534+0000","last_undegraded":"2024-09-13T18:47:35.600534+0000","last_fullsized":"2024-09-13T18:47:35.600534+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:00.817368+0000","last_clean_scrub_stamp":"2024-09-13T18:45:00.817368+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.324050+0000","last_change":"2024-09-13T18:47:51.324261+0000","last_active":"2024-09-13T18:47:51.324050+0000","last_peered":"2024-09-13T18:47:51.324050+0000","last_clean":"2024-09-13T18:47:51.324050+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:51.324050+0000","last_undegraded":"2024-09-13T18:47:51.324050+0000","last_fullsized":"2024-09-13T18:47:51.324050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.323994+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:47.717548+0000","scrub_duration":0.0067899620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.974074+0000","last_change":"2024-09-13T18:48:05.974304+0000","last_active":"2024-09-13T18:48:05.974074+0000","last_peered":"2024-09-13T18:48:05.974074+0000","last_clean":"2024-09-13T18:48:05.974074+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:48:05.974074+0000","last_undegraded":"2024-09-13T18:48:05.974074+0000","last_fullsized":"2024-09-13T18:48:05.974074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:05.974038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:05.974038+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.974038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:54.593726+0000","scrub_duration":0.0042173189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.327704+0000","last_change":"2024-09-13T18:47:58.327922+0000","last_active":"2024-09-13T18:47:58.327704+0000","last_peered":"2024-09-13T18:47:58.327704+0000","last_clean":"2024-09-13T18:47:58.327704+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:58.327704+0000","last_undegraded":"2024-09-13T18:47:58.327704+0000","last_fullsized":"2024-09-13T18:47:58.327704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.327652+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:28.029362+0000","scrub_duration":0.0034717400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.610385+0000","last_change":"2024-09-13T18:47:45.610603+0000","last_active":"2024-09-13T18:47:45.610385+0000","last_peered":"2024-09-13T18:47:45.610385+0000","last_clean":"2024-09-13T18:47:45.610385+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:45.610385+0000","last_undegraded":"2024-09-13T18:47:45.610385+0000","last_fullsized":"2024-09-13T18:47:45.610385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.610340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:52.239335+0000","scrub_duration":0.003118698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.342009+0000","last_change":"2024-09-13T18:48:12.342312+0000","last_active":"2024-09-13T18:48:12.342009+0000","last_peered":"2024-09-13T18:48:12.342009+0000","last_clean":"2024-09-13T18:48:12.342009+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:48:12.342009+0000","last_undegraded":"2024-09-13T18:48:12.342009+0000","last_fullsized":"2024-09-13T18:48:12.342009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:12.341957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:12.341957+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.341957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:32.100030+0000","scrub_duration":0.0041679810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:00.018241+0000","last_change":"2024-09-13T18:48:00.018459+0000","last_active":"2024-09-13T18:48:00.018241+0000","last_peered":"2024-09-13T18:48:00.018241+0000","last_clean":"2024-09-13T18:48:00.018241+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:48:00.018241+0000","last_undegraded":"2024-09-13T18:48:00.018241+0000","last_fullsized":"2024-09-13T18:48:00.018241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_clean_scrub_stamp":"2024-09-13T18:48:00.018191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:44.339756+0000","scrub_duration":0.0031160409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.414358+0000","last_change":"2024-09-13T18:48:02.414512+0000","last_active":"2024-09-13T18:48:02.414358+0000","last_peered":"2024-09-13T18:48:02.414358+0000","last_clean":"2024-09-13T18:48:02.414358+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:48:02.414358+0000","last_undegraded":"2024-09-13T18:48:02.414358+0000","last_fullsized":"2024-09-13T18:48:02.414358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:48:02.414323+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:48:02.414323+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.414323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:32.607454+0000","scrub_duration":0.0032787039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:29.341629+0000","last_change":"2024-09-13T18:48:29.341889+0000","last_active":"2024-09-13T18:48:29.341629+0000","last_peered":"2024-09-13T18:48:29.341629+0000","last_clean":"2024-09-13T18:48:29.341629+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:48:29.341629+0000","last_undegraded":"2024-09-13T18:48:29.341629+0000","last_fullsized":"2024-09-13T18:48:29.341629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:29.341576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:29.341576+0000","last_clean_scrub_stamp":"2024-09-13T18:48:29.341576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.665289+0000","scrub_duration":0.003896544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:26.428215+0000","last_change":"2024-09-13T18:48:26.428480+0000","last_active":"2024-09-13T18:48:26.428215+0000","last_peered":"2024-09-13T18:48:26.428215+0000","last_clean":"2024-09-13T18:48:26.428215+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:48:26.428215+0000","last_undegraded":"2024-09-13T18:48:26.428215+0000","last_fullsized":"2024-09-13T18:48:26.428215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:26.428163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:26.428163+0000","last_clean_scrub_stamp":"2024-09-13T18:48:26.428163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:39.295285+0000","scrub_duration":0.0039464529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.216158+0000","last_change":"2024-09-13T18:47:50.216463+0000","last_active":"2024-09-13T18:47:50.216158+0000","last_peered":"2024-09-13T18:47:50.216158+0000","last_clean":"2024-09-13T18:47:50.216158+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:50.216158+0000","last_undegraded":"2024-09-13T18:47:50.216158+0000","last_fullsized":"2024-09-13T18:47:50.216158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.216108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:45.291203+0000","scrub_duration":0.0033895930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.366654+0000","last_change":"2024-09-13T18:47:56.366764+0000","last_active":"2024-09-13T18:47:56.366654+0000","last_peered":"2024-09-13T18:47:56.366654+0000","last_clean":"2024-09-13T18:47:56.366654+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:56.366654+0000","last_undegraded":"2024-09-13T18:47:56.366654+0000","last_fullsized":"2024-09-13T18:47:56.366654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.366630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:44.072446+0000","scrub_duration":0.0021094109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:31.580705+0000","last_change":"2024-09-13T18:48:31.580905+0000","last_active":"2024-09-13T18:48:31.580705+0000","last_peered":"2024-09-13T18:48:31.580705+0000","last_clean":"2024-09-13T18:48:31.580705+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:48:31.580705+0000","last_undegraded":"2024-09-13T18:48:31.580705+0000","last_fullsized":"2024-09-13T18:48:31.580705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:31.580666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:31.580666+0000","last_clean_scrub_stamp":"2024-09-13T18:48:31.580666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:50.804717+0000","scrub_duration":0.0036818720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.263795+0000","last_change":"2024-09-13T18:48:02.264013+0000","last_active":"2024-09-13T18:48:02.263795+0000","last_peered":"2024-09-13T18:48:02.263795+0000","last_clean":"2024-09-13T18:48:02.263795+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:48:02.263795+0000","last_undegraded":"2024-09-13T18:48:02.263795+0000","last_fullsized":"2024-09-13T18:48:02.263795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:02.263745+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:02.263745+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.263745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:36.178805+0000","scrub_duration":0.0030334060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.387734+0000","last_change":"2024-09-13T18:47:51.387734+0000","last_active":"2024-09-13T18:47:51.387734+0000","last_peered":"2024-09-13T18:47:51.387734+0000","last_clean":"2024-09-13T18:47:51.387734+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:51.387734+0000","last_undegraded":"2024-09-13T18:47:51.387734+0000","last_fullsized":"2024-09-13T18:47:51.387734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.387457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:25.705238+0000","scrub_duration":0.0035199530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.469046+0000","last_change":"2024-09-13T18:48:07.469270+0000","last_active":"2024-09-13T18:48:07.469046+0000","last_peered":"2024-09-13T18:48:07.469046+0000","last_clean":"2024-09-13T18:48:07.469046+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:48:07.469046+0000","last_undegraded":"2024-09-13T18:48:07.469046+0000","last_fullsized":"2024-09-13T18:48:07.469046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:48:07.469001+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:48:07.469001+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.469001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:15.308587+0000","scrub_duration":0.0033549579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.369829+0000","last_change":"2024-09-13T18:48:08.370025+0000","last_active":"2024-09-13T18:48:08.369829+0000","last_peered":"2024-09-13T18:48:08.369829+0000","last_clean":"2024-09-13T18:48:08.369829+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:48:08.369829+0000","last_undegraded":"2024-09-13T18:48:08.369829+0000","last_fullsized":"2024-09-13T18:48:08.369829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:08.369773+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:08.369773+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.369773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:53.502092+0000","scrub_duration":0.0039096199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.336525+0000","last_change":"2024-09-13T18:48:20.336806+0000","last_active":"2024-09-13T18:48:20.336525+0000","last_peered":"2024-09-13T18:48:20.336525+0000","last_clean":"2024-09-13T18:48:20.336525+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:48:20.336525+0000","last_undegraded":"2024-09-13T18:48:20.336525+0000","last_fullsized":"2024-09-13T18:48:20.336525+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.336467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.336467+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.336467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:20.853442+0000","scrub_duration":0.0033162529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.182656+0000","last_change":"2024-09-13T18:47:50.182974+0000","last_active":"2024-09-13T18:47:50.182656+0000","last_peered":"2024-09-13T18:47:50.182656+0000","last_clean":"2024-09-13T18:47:50.182656+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:50.182656+0000","last_undegraded":"2024-09-13T18:47:50.182656+0000","last_fullsized":"2024-09-13T18:47:50.182656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.182599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:16.387371+0000","scrub_duration":0.003287786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.388376+0000","last_change":"2024-09-13T18:48:10.388592+0000","last_active":"2024-09-13T18:48:10.388376+0000","last_peered":"2024-09-13T18:48:10.388376+0000","last_clean":"2024-09-13T18:48:10.388376+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:48:10.388376+0000","last_undegraded":"2024-09-13T18:48:10.388376+0000","last_fullsized":"2024-09-13T18:48:10.388376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:10.388326+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:10.388326+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.388326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:31.106755+0000","scrub_duration":0.0033930879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.414682+0000","last_change":"2024-09-13T18:48:15.415003+0000","last_active":"2024-09-13T18:48:15.414682+0000","last_peered":"2024-09-13T18:48:15.414682+0000","last_clean":"2024-09-13T18:48:15.414682+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:48:15.414682+0000","last_undegraded":"2024-09-13T18:48:15.414682+0000","last_fullsized":"2024-09-13T18:48:15.414682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:15.414635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:15.414635+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.414635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:31.574931+0000","scrub_duration":0.0049695829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.051036+0000","last_change":"2024-09-13T18:47:45.051211+0000","last_active":"2024-09-13T18:47:45.051036+0000","last_peered":"2024-09-13T18:47:45.051036+0000","last_clean":"2024-09-13T18:47:45.051036+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:45.051036+0000","last_undegraded":"2024-09-13T18:47:45.051036+0000","last_fullsized":"2024-09-13T18:47:45.051036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.050997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:29.820112+0000","scrub_duration":0.002900452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.264766+0000","last_change":"2024-09-13T18:48:07.264959+0000","last_active":"2024-09-13T18:48:07.264766+0000","last_peered":"2024-09-13T18:48:07.264766+0000","last_clean":"2024-09-13T18:48:07.264766+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:48:07.264766+0000","last_undegraded":"2024-09-13T18:48:07.264766+0000","last_fullsized":"2024-09-13T18:48:07.264766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-13T18:48:07.264719+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-13T18:48:07.264719+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.264719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.565222+0000","scrub_duration":0.003409207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.377977+0000","last_change":"2024-09-13T18:48:02.378193+0000","last_active":"2024-09-13T18:48:02.377977+0000","last_peered":"2024-09-13T18:48:02.377977+0000","last_clean":"2024-09-13T18:48:02.377977+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:48:02.377977+0000","last_undegraded":"2024-09-13T18:48:02.377977+0000","last_fullsized":"2024-09-13T18:48:02.377977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:02.377931+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:02.377931+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.377931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:12.494537+0000","scrub_duration":0.0034649160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.306492+0000","last_change":"2024-09-13T18:48:04.306747+0000","last_active":"2024-09-13T18:48:04.306492+0000","last_peered":"2024-09-13T18:48:04.306492+0000","last_clean":"2024-09-13T18:48:04.306492+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:48:04.306492+0000","last_undegraded":"2024-09-13T18:48:04.306492+0000","last_fullsized":"2024-09-13T18:48:04.306492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:04.306444+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:04.306444+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.306444+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:35.956818+0000","scrub_duration":0.0034513159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:23.480140+0000","last_change":"2024-09-13T18:48:23.480140+0000","last_active":"2024-09-13T18:48:23.480140+0000","last_peered":"2024-09-13T18:48:23.480140+0000","last_clean":"2024-09-13T18:48:23.480140+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:48:23.480140+0000","last_undegraded":"2024-09-13T18:48:23.480140+0000","last_fullsized":"2024-09-13T18:48:23.480140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:23.479886+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:23.479886+0000","last_clean_scrub_stamp":"2024-09-13T18:48:23.479886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:46.217936+0000","scrub_duration":0.0035382450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.503627+0000","last_change":"2024-09-13T18:48:19.503627+0000","last_active":"2024-09-13T18:48:19.503627+0000","last_peered":"2024-09-13T18:48:19.503627+0000","last_clean":"2024-09-13T18:48:19.503627+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:48:19.503627+0000","last_undegraded":"2024-09-13T18:48:19.503627+0000","last_fullsized":"2024-09-13T18:48:19.503627+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:19.503350+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:19.503350+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.503350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:10.912704+0000","scrub_duration":0.003191176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.039013+0000","last_change":"2024-09-13T18:48:01.039156+0000","last_active":"2024-09-13T18:48:01.039013+0000","last_peered":"2024-09-13T18:48:01.039013+0000","last_clean":"2024-09-13T18:48:01.039013+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:48:01.039013+0000","last_undegraded":"2024-09-13T18:48:01.039013+0000","last_fullsized":"2024-09-13T18:48:01.039013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-13T18:48:01.038975+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-13T18:48:01.038975+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.038975+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:45.129654+0000","scrub_duration":0.0050254219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.265232+0000","last_change":"2024-09-13T18:48:07.265466+0000","last_active":"2024-09-13T18:48:07.265232+0000","last_peered":"2024-09-13T18:48:07.265232+0000","last_clean":"2024-09-13T18:48:07.265232+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:48:07.265232+0000","last_undegraded":"2024-09-13T18:48:07.265232+0000","last_fullsized":"2024-09-13T18:48:07.265232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:48:07.265153+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:48:07.265153+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.265153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:01.884698+0000","scrub_duration":0.0034868730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:11.490586+0000","last_change":"2024-09-13T18:48:11.490789+0000","last_active":"2024-09-13T18:48:11.490586+0000","last_peered":"2024-09-13T18:48:11.490586+0000","last_clean":"2024-09-13T18:48:11.490586+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:48:11.490586+0000","last_undegraded":"2024-09-13T18:48:11.490586+0000","last_fullsized":"2024-09-13T18:48:11.490586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:11.490538+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:11.490538+0000","last_clean_scrub_stamp":"2024-09-13T18:48:11.490538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:35.858696+0000","scrub_duration":0.0038395500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.061803+0000","last_change":"2024-09-13T18:47:45.062044+0000","last_active":"2024-09-13T18:47:45.061803+0000","last_peered":"2024-09-13T18:47:45.061803+0000","last_clean":"2024-09-13T18:47:45.061803+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:45.061803+0000","last_undegraded":"2024-09-13T18:47:45.061803+0000","last_fullsized":"2024-09-13T18:47:45.061803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.061720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:57.256752+0000","scrub_duration":0.0031242209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.418863+0000","last_change":"2024-09-13T18:48:14.419173+0000","last_active":"2024-09-13T18:48:14.418863+0000","last_peered":"2024-09-13T18:48:14.418863+0000","last_clean":"2024-09-13T18:48:14.418863+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:48:14.418863+0000","last_undegraded":"2024-09-13T18:48:14.418863+0000","last_fullsized":"2024-09-13T18:48:14.418863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:14.418765+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:14.418765+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.418765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:46.627229+0000","scrub_duration":0.0042173879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.337521+0000","last_change":"2024-09-13T18:48:12.337765+0000","last_active":"2024-09-13T18:48:12.337521+0000","last_peered":"2024-09-13T18:48:12.337521+0000","last_clean":"2024-09-13T18:48:12.337521+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:48:12.337521+0000","last_undegraded":"2024-09-13T18:48:12.337521+0000","last_fullsized":"2024-09-13T18:48:12.337521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:12.337472+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:12.337472+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.337472+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:41.399961+0000","scrub_duration":0.0036942479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.605617+0000","last_change":"2024-09-13T18:48:18.605993+0000","last_active":"2024-09-13T18:48:18.605617+0000","last_peered":"2024-09-13T18:48:18.605617+0000","last_clean":"2024-09-13T18:48:18.605617+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:48:18.605617+0000","last_undegraded":"2024-09-13T18:48:18.605617+0000","last_fullsized":"2024-09-13T18:48:18.605617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:18.605565+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:18.605565+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.605565+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:29.357925+0000","scrub_duration":0.003275994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:24.429576+0000","last_change":"2024-09-13T18:48:24.429759+0000","last_active":"2024-09-13T18:48:24.429576+0000","last_peered":"2024-09-13T18:48:24.429576+0000","last_clean":"2024-09-13T18:48:24.429576+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:48:24.429576+0000","last_undegraded":"2024-09-13T18:48:24.429576+0000","last_fullsized":"2024-09-13T18:48:24.429576+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:24.429529+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:24.429529+0000","last_clean_scrub_stamp":"2024-09-13T18:48:24.429529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:01.724113+0000","scrub_duration":0.0037295129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.271885+0000","last_change":"2024-09-13T18:48:08.272117+0000","last_active":"2024-09-13T18:48:08.271885+0000","last_peered":"2024-09-13T18:48:08.271885+0000","last_clean":"2024-09-13T18:48:08.271885+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:48:08.271885+0000","last_undegraded":"2024-09-13T18:48:08.271885+0000","last_fullsized":"2024-09-13T18:48:08.271885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:08.271828+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:08.271828+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.271828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.037826+0000","scrub_duration":0.0036946520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:40.754834+0000","last_change":"2024-09-13T18:48:40.755044+0000","last_active":"2024-09-13T18:48:40.754834+0000","last_peered":"2024-09-13T18:48:40.754834+0000","last_clean":"2024-09-13T18:48:40.754834+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:48:40.754834+0000","last_undegraded":"2024-09-13T18:48:40.754834+0000","last_fullsized":"2024-09-13T18:48:40.754834+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:40.754784+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:40.754784+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.754784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:53.718152+0000","scrub_duration":0.0037398039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.561801+0000","last_change":"2024-09-13T18:47:47.562108+0000","last_active":"2024-09-13T18:47:47.561801+0000","last_peered":"2024-09-13T18:47:47.561801+0000","last_clean":"2024-09-13T18:47:47.561801+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:47.561801+0000","last_undegraded":"2024-09-13T18:47:47.561801+0000","last_fullsized":"2024-09-13T18:47:47.561801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.561735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:10.120901+0000","scrub_duration":0.0037975349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.286758+0000","last_change":"2024-09-13T18:48:08.287051+0000","last_active":"2024-09-13T18:48:08.286758+0000","last_peered":"2024-09-13T18:48:08.286758+0000","last_clean":"2024-09-13T18:48:08.286758+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:48:08.286758+0000","last_undegraded":"2024-09-13T18:48:08.286758+0000","last_fullsized":"2024-09-13T18:48:08.286758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:08.286639+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:08.286639+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.286639+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:11.439457+0000","scrub_duration":0.0035090690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.424537+0000","last_change":"2024-09-13T18:47:49.424537+0000","last_active":"2024-09-13T18:47:49.424537+0000","last_peered":"2024-09-13T18:47:49.424537+0000","last_clean":"2024-09-13T18:47:49.424537+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:49.424537+0000","last_undegraded":"2024-09-13T18:47:49.424537+0000","last_fullsized":"2024-09-13T18:47:49.424537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.424264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:14.286009+0000","scrub_duration":0.00282059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:54.465116+0000","last_change":"2024-09-13T18:47:54.465116+0000","last_active":"2024-09-13T18:47:54.465116+0000","last_peered":"2024-09-13T18:47:54.465116+0000","last_clean":"2024-09-13T18:47:54.465116+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:54.465116+0000","last_undegraded":"2024-09-13T18:47:54.465116+0000","last_fullsized":"2024-09-13T18:47:54.465116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_clean_scrub_stamp":"2024-09-13T18:47:54.464839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:40.461015+0000","scrub_duration":0.0036862280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.600237+0000","last_change":"2024-09-13T18:48:19.600433+0000","last_active":"2024-09-13T18:48:19.600237+0000","last_peered":"2024-09-13T18:48:19.600237+0000","last_clean":"2024-09-13T18:48:19.600237+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:48:19.600237+0000","last_undegraded":"2024-09-13T18:48:19.600237+0000","last_fullsized":"2024-09-13T18:48:19.600237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:19.600199+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:19.600199+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.600199+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.889071+0000","scrub_duration":0.0034096209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:13.707104+0000","last_change":"2024-09-13T18:48:13.707330+0000","last_active":"2024-09-13T18:48:13.707104+0000","last_peered":"2024-09-13T18:48:13.707104+0000","last_clean":"2024-09-13T18:48:13.707104+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:48:13.707104+0000","last_undegraded":"2024-09-13T18:48:13.707104+0000","last_fullsized":"2024-09-13T18:48:13.707104+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:13.707051+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:13.707051+0000","last_clean_scrub_stamp":"2024-09-13T18:48:13.707051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:38.728586+0000","scrub_duration":0.003750878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.569635+0000","last_change":"2024-09-13T18:48:08.569878+0000","last_active":"2024-09-13T18:48:08.569635+0000","last_peered":"2024-09-13T18:48:08.569635+0000","last_clean":"2024-09-13T18:48:08.569635+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:48:08.569635+0000","last_undegraded":"2024-09-13T18:48:08.569635+0000","last_fullsized":"2024-09-13T18:48:08.569635+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-13T18:48:08.569584+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-13T18:48:08.569584+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.569584+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:32.966173+0000","scrub_duration":0.0033504580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.382405+0000","last_change":"2024-09-13T18:48:17.382543+0000","last_active":"2024-09-13T18:48:17.382405+0000","last_peered":"2024-09-13T18:48:17.382405+0000","last_clean":"2024-09-13T18:48:17.382405+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:48:17.382405+0000","last_undegraded":"2024-09-13T18:48:17.382405+0000","last_fullsized":"2024-09-13T18:48:17.382405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:17.382376+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:17.382376+0000","last_clean_scrub_stamp":"2024-09-13T18:48:17.382376+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:50.307359+0000","scrub_duration":0.0021748319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.344070+0000","last_change":"2024-09-13T18:48:10.344274+0000","last_active":"2024-09-13T18:48:10.344070+0000","last_peered":"2024-09-13T18:48:10.344070+0000","last_clean":"2024-09-13T18:48:10.344070+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:48:10.344070+0000","last_undegraded":"2024-09-13T18:48:10.344070+0000","last_fullsized":"2024-09-13T18:48:10.344070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:10.344011+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:10.344011+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.344011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:10.725176+0000","scrub_duration":0.0038631820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.396898+0000","last_change":"2024-09-13T18:48:17.396898+0000","last_active":"2024-09-13T18:48:17.396898+0000","last_peered":"2024-09-13T18:48:17.396898+0000","last_clean":"2024-09-13T18:48:17.396898+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:48:17.396898+0000","last_undegraded":"2024-09-13T18:48:17.396898+0000","last_fullsized":"2024-09-13T18:48:17.396898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:48:17.396643+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:48:17.396643+0000","last_clean_scrub_stamp":"2024-09-13T18:48:17.396643+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:57.359618+0000","scrub_duration":0.0033315160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.122072+0000","last_change":"2024-09-13T18:47:53.122354+0000","last_active":"2024-09-13T18:47:53.122072+0000","last_peered":"2024-09-13T18:47:53.122072+0000","last_clean":"2024-09-13T18:47:53.122072+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:53.122072+0000","last_undegraded":"2024-09-13T18:47:53.122072+0000","last_fullsized":"2024-09-13T18:47:53.122072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.122017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:58.006765+0000","scrub_duration":0.003838228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.591872+0000","last_change":"2024-09-13T18:47:53.592321+0000","last_active":"2024-09-13T18:47:53.591872+0000","last_peered":"2024-09-13T18:47:53.591872+0000","last_clean":"2024-09-13T18:47:53.591872+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:53.591872+0000","last_undegraded":"2024-09-13T18:47:53.591872+0000","last_fullsized":"2024-09-13T18:47:53.591872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.591804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:03.584134+0000","scrub_duration":0.0026496750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.037967+0000","last_change":"2024-09-13T18:47:48.038206+0000","last_active":"2024-09-13T18:47:48.037967+0000","last_peered":"2024-09-13T18:47:48.037967+0000","last_clean":"2024-09-13T18:47:48.037967+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:48.037967+0000","last_undegraded":"2024-09-13T18:47:48.037967+0000","last_fullsized":"2024-09-13T18:47:48.037967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.037918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:34.291038+0000","scrub_duration":0.0034905460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.396738+0000","last_change":"2024-09-13T18:48:12.396935+0000","last_active":"2024-09-13T18:48:12.396738+0000","last_peered":"2024-09-13T18:48:12.396738+0000","last_clean":"2024-09-13T18:48:12.396738+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:48:12.396738+0000","last_undegraded":"2024-09-13T18:48:12.396738+0000","last_fullsized":"2024-09-13T18:48:12.396738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:12.396677+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:12.396677+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.396677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:12.749724+0000","scrub_duration":0.002876043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.355816+0000","last_change":"2024-09-13T18:48:18.355988+0000","last_active":"2024-09-13T18:48:18.355816+0000","last_peered":"2024-09-13T18:48:18.355816+0000","last_clean":"2024-09-13T18:48:18.355816+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:48:18.355816+0000","last_undegraded":"2024-09-13T18:48:18.355816+0000","last_fullsized":"2024-09-13T18:48:18.355816+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:18.355774+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:18.355774+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.355774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:31.217712+0000","scrub_duration":0.0028712759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.670022+0000","last_change":"2024-09-13T18:48:12.670192+0000","last_active":"2024-09-13T18:48:12.670022+0000","last_peered":"2024-09-13T18:48:12.670022+0000","last_clean":"2024-09-13T18:48:12.670022+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:48:12.670022+0000","last_undegraded":"2024-09-13T18:48:12.670022+0000","last_fullsized":"2024-09-13T18:48:12.670022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:12.669968+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:12.669968+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.669968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:35.629738+0000","scrub_duration":0.0033964870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":87,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91700000000000004,"15min":0.96099999999999997},"min":{"1min":0.45400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.0569999999999999,"5min":2.585,"15min":2.585},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.99299999999999999,"15min":1.0329999999999999},"min":{"1min":0.40600000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.736,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.113}]},{"osd":1,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.0389999999999999},"min":{"1min":0.60499999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3300000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.258},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.115,"15min":1.123},"min":{"1min":0.72599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.143,"15min":1.1739999999999999},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.1910000000000001,"15min":1.2430000000000001},"min":{"1min":0.51300000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.2849999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.163,"15min":1.2110000000000001},"min":{"1min":0.66600000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5609999999999999,"5min":1.665,"15min":1.665},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.3129999999999999,"15min":1.337},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.3899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.254,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.677,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.075},{"interface":"front","average":{"1min":1.49,"5min":1.3340000000000001,"15min":1.3440000000000001},"min":{"1min":0.98399999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.3999999999999999,"15min":1.429},"min":{"1min":0.79100000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.296,"15min":1.3420000000000001},"min":{"1min":0.75800000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.544,"5min":2.355,"15min":2.355},"last":1.492}]},{"osd":7,"last update":"Fri Sep 13 18:47:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.367,"15min":1.423},"min":{"1min":0.81399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.6859999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.373},{"interface":"front","average":{"1min":1.262,"5min":1.3939999999999999,"15min":1.484},"min":{"1min":0.83799999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.931,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.1830000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":995328,"data_stored":521813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.58899999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.3390000000000004,"5min":4.3390000000000004,"15min":4.3390000000000004},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1160000000000001,"15min":1.1719999999999999},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.94299999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.085,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":0.997,"15min":0.97599999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.81499999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.266,"15min":1.337},"min":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.2609999999999999,"15min":1.2789999999999999},"min":{"1min":0.58499999999999996,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":1.5089999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.2889999999999999,"15min":1.2909999999999999},"min":{"1min":0.876,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":4.5869999999999997,"5min":4.5869999999999997,"15min":4.5869999999999997},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.278,"15min":1.3149999999999999},"min":{"1min":0.88100000000000001,"5min":0.752,"15min":0.752},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.3320000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.4379999999999999},"min":{"1min":0.80400000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.3129999999999999,"15min":1.3220000000000001},"min":{"1min":0.874,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.6269999999999998,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.083}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.365,"15min":1.389},"min":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":4.7320000000000002,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.573,"5min":1.3959999999999999,"15min":1.4219999999999999},"min":{"1min":0.91400000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":1.28}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.506,"15min":1.579},"min":{"1min":0.755,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.9750000000000001,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.556},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.472,"15min":1.5049999999999999},"min":{"1min":0.84299999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":4.6639999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":1.175}]}]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.52300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.1639999999999999,"15min":1.1870000000000001},"min":{"1min":0.59199999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":4.4729999999999999,"5min":4.4729999999999999,"15min":4.4729999999999999},"last":1.5209999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.57699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.6879999999999997,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":1.151},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.1739999999999999,"15min":1.145},"min":{"1min":0.63100000000000001,"5min":0.628,"15min":0.628},"max":{"1min":4.7409999999999997,"5min":4.7409999999999997,"15min":4.7409999999999997},"last":1.0509999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2030000000000001,"15min":1.2549999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.0129999999999999,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.1879999999999999,"15min":1.2250000000000001},"min":{"1min":0.73899999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":5.1950000000000003,"5min":5.1950000000000003,"15min":5.1950000000000003},"last":1.298}]},{"osd":4,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3180000000000001,"15min":1.3620000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.569,"5min":1.397,"15min":1.4350000000000001},"min":{"1min":0.88200000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.8220000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":1.468}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.423,"15min":1.49},"min":{"1min":0.89700000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.4750000000000001,"15min":1.524},"min":{"1min":0.98399999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":4.7869999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"last":1.343}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4319999999999999,"15min":1.5049999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.202},{"interface":"front","average":{"1min":1.571,"5min":1.5569999999999999,"15min":1.6479999999999999},"min":{"1min":1.0780000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":4.9459999999999997,"5min":4.9459999999999997,"15min":4.9459999999999997},"last":1.3759999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.579,"15min":1.665},"min":{"1min":0.97499999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":5.0380000000000003,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":1.113},{"interface":"front","average":{"1min":1.669,"5min":1.605,"15min":1.655},"min":{"1min":1.0820000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":4.8600000000000003,"5min":4.8600000000000003,"15min":4.8600000000000003},"last":1.395}]}]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3460000000000001,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.996,"5min":0.97399999999999998,"15min":1.03},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6659999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1180000000000001,"15min":1.1459999999999999},"min":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.405,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.105,"15min":1.157},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.7769999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.206}]},{"osd":3,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.048,"15min":1.018},"min":{"1min":0.57599999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.097,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.524},{"interface":"front","average":{"1min":1.224,"5min":1.2430000000000001,"15min":1.2989999999999999},"min":{"1min":0.68999999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.9039999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.054}]},{"osd":4,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2749999999999999,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.819,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.2509999999999999},"min":{"1min":0.83499999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3759999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.365}]},{"osd":5,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3320000000000001,"15min":1.3460000000000001},"min":{"1min":0.95099999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.875,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3300000000000001,"15min":1.3500000000000001},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9910000000000001,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.3859999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.228,"15min":1.2729999999999999},"min":{"1min":0.82999999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.778,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.23},{"interface":"front","average":{"1min":1.381,"5min":1.3979999999999999,"15min":1.4299999999999999},"min":{"1min":0.89400000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.982,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.27}]},{"osd":7,"last update":"Fri Sep 13 18:48:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3939999999999999,"15min":1.462},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.319,"15min":1.373},"min":{"1min":0.89600000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9299999999999999,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.3360000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0429999999999999,"15min":1.081},"min":{"1min":0.63700000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.425,"5min":2.798,"15min":2.798},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0569999999999999,"15min":1.0900000000000001},"min":{"1min":0.59999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5429999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.0369999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.046},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.008,"15min":1.05},"min":{"1min":0.65700000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.1579999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0580000000000001,"15min":1.0780000000000001},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":2.105,"5min":2.593,"15min":2.593},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.133,"5min":1.0660000000000001,"15min":1.0860000000000001},"min":{"1min":0.67600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0860000000000001,"15min":1.1279999999999999},"min":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4039999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1120000000000001,"15min":1.147},"min":{"1min":0.68400000000000005,"5min":0.63,"15min":0.63},"max":{"1min":1.8029999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.016}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.873,"15min":0.85899999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2569999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0169999999999999,"15min":1.0409999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.248,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.91000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0309999999999999,"15min":1.0369999999999999},"min":{"1min":0.66300000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.462,"5min":1.573,"15min":1.573},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96499999999999997,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2769999999999999,"5min":1.619,"15min":1.619},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.034},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.375,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.999,"5min":1.1080000000000001,"15min":1.119},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.4410000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.84699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.92800000000000005},"min":{"1min":0.64300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.747,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.4830000000000001,"5min":1.532,"15min":1.532},"last":0.876}]},{"osd":1,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95499999999999996,"15min":0.98099999999999998},"min":{"1min":0.69599999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1479999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.86899999999999999,"15min":0.84699999999999998},"min":{"1min":0.64100000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.04}]},{"osd":2,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92100000000000004,"15min":0.91700000000000004},"min":{"1min":0.66400000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.91300000000000003,"15min":0.90300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.085}]},{"osd":3,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0600000000000001,"15min":1.0960000000000001},"min":{"1min":0.65900000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5669999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0309999999999999,"15min":1.0389999999999999},"min":{"1min":0.85299999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.1479999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.876,"15min":0.89300000000000002},"min":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.077,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1699999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.046,"15min":1.081},"min":{"1min":0.67900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1799999999999999,"5min":1.76,"15min":1.76},"last":1.054},{"interface":"front","average":{"1min":1,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.745,"5min":0.629,"15min":0.629},"max":{"1min":1.4259999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0209999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:47:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0409999999999999,"15min":1.0309999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3700000000000001,"5min":1.677,"15min":1.677},"last":0.998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0609999999999999,"15min":1.044},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":1.119,"15min":1.006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.276,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.1659999999999999,"15min":1.0820000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5009999999999999,"5min":24.834,"15min":24.834},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.69099999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.304,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.871},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0589999999999999,"15min":1.109},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.234,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.079,"15min":1.111},"min":{"1min":0.71599999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.204}]},{"osd":3,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.999,"15min":1.036},"min":{"1min":0.65200000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4019999999999999,"5min":1.468,"15min":1.468},"last":1.014}]},{"osd":4,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.622,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.1799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.997,"15min":1.0429999999999999},"min":{"1min":0.58799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1080000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0609999999999999,"15min":1.081},"min":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.137}]},{"osd":7,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.012},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3169999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.28},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1220000000000001,"15min":1.1519999999999999},"min":{"1min":0.67900000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1619999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":1003520,"data_stored":522485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.93899999999999995,"15min":0.98299999999999998},"min":{"1min":0.72299999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.202,"5min":1.76,"15min":1.76},"last":1.157},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95099999999999996,"15min":0.97399999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.26,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0069999999999999,"15min":1.0389999999999999},"min":{"1min":0.749,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.466,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":1.179},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0720000000000001,"15min":1.101},"min":{"1min":0.93000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.292,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68400000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3919999999999999,"5min":1.508,"15min":1.508},"last":1.069},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1000000000000001,"15min":1.145},"min":{"1min":0.71499999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.23,"5min":2.032,"15min":2.032},"last":1.1200000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.296,"15min":1.454},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.371,"5min":10.058999999999999,"15min":10.058999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.4570000000000001,"15min":1.6399999999999999},"min":{"1min":0.80000000000000004,"5min":0.63,"15min":0.63},"max":{"1min":1.5189999999999999,"5min":10.223000000000001,"15min":10.223000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.89500000000000002},"min":{"1min":0.61199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.96399999999999997,"15min":0.98599999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0800000000000001,"5min":1.46,"15min":1.46},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.02,"15min":1.0349999999999999},"min":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.339,"5min":1.552,"15min":1.552},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.111,"15min":1.1539999999999999},"min":{"1min":0.67000000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.288,"5min":1.597,"15min":1.597},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:47:52 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.121,"15min":1.1399999999999999},"min":{"1min":0.70599999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.224,"5min":1.694,"15min":1.694},"last":1.105},{"interface":"front","average":{"1min":0.997,"5min":1.0669999999999999,"15min":1.091},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3180000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.0189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:48:46.502 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:46.503 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:46.503 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:45:00.817368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=45, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:48:46.504 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:48:53.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:53.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:06.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:49:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 Processor -- start 2024-09-13T18:49:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 -- start start 2024-09-13T18:49:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe4f80c8db0 0x7fe4f8070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f8153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80c7570 con 0x7fe4f80c9190 2024-09-13T18:49:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80c5b50 con 0x7fe4f80c8db0 2024-09-13T18:49:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.683+0000 7fe4f7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80cbbe0 con 0x7fe4f806ee10 2024-09-13T18:49:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4ed400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe4f80c9190 0x7fe4f80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45218/0 (socket says 172.21.15.32:45218) 2024-09-13T18:49:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4ed400700 1 -- 172.21.15.32:0/904105506 learned_addr learned my addr 172.21.15.32:0/904105506 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f5e00700 1 --2- 172.21.15.32:0/904105506 >> v2:172.21.15.32:3300/0 conn(0x7fe4f80c8db0 0x7fe4f8070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f6800700 1 --2- 172.21.15.32:0/904105506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f8153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f6800700 1 -- 172.21.15.32:0/904105506 >> v2:172.21.15.32:3300/0 conn(0x7fe4f80c8db0 msgr2=0x7fe4f8070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f6800700 1 --2- 172.21.15.32:0/904105506 >> v2:172.21.15.32:3300/0 conn(0x7fe4f80c8db0 0x7fe4f8070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f6800700 1 -- 172.21.15.32:0/904105506 >> v1:172.21.15.32:6789/0 conn(0x7fe4f80c9190 legacy=0x7fe4f80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f6800700 1 -- 172.21.15.32:0/904105506 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80c7290 con 0x7fe4f806ee10 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f5400700 1 -- 172.21.15.32:0/904105506 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080806643 0 0) 0x7fe4f80c7570 con 0x7fe4f80c9190 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f6800700 1 --2- 172.21.15.32:0/904105506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f8153100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009d90 tx=0x7fe4f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec7e525d00e760d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f5400700 1 -- 172.21.15.32:0/904105506 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000e070 con 0x7fe4f806ee10 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f5400700 1 -- 172.21.15.32:0/904105506 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000bb20 con 0x7fe4f806ee10 2024-09-13T18:49:06.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f5400700 1 -- 172.21.15.32:0/904105506 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0012430 con 0x7fe4f806ee10 2024-09-13T18:49:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 -- 172.21.15.32:0/904105506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 msgr2=0x7fe4f8153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 --2- 172.21.15.32:0/904105506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f8153100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009d90 tx=0x7fe4f000b330 comp rx=0 tx=0).stop 2024-09-13T18:49:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 -- 172.21.15.32:0/904105506 shutdown_connections 2024-09-13T18:49:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 --2- 172.21.15.32:0/904105506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f8153100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.694 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 --2- 172.21.15.32:0/904105506 >> v2:172.21.15.32:3300/0 conn(0x7fe4f80c8db0 0x7fe4f8070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 -- 172.21.15.32:0/904105506 >> 172.21.15.32:0/904105506 conn(0x7fe4f80cad40 msgr2=0x7fe4f80cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 -- 172.21.15.32:0/904105506 shutdown_connections 2024-09-13T18:49:06.695 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.687+0000 7fe4f7200700 1 -- 172.21.15.32:0/904105506 wait complete. 2024-09-13T18:49:06.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.691+0000 7fe4f7200700 1 Processor -- start 2024-09-13T18:49:06.698 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.691+0000 7fe4f7200700 1 -- start start 2024-09-13T18:49:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.691+0000 7fe4f7200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f80b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.691+0000 7fe4f7200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f80c8db0 0x7fe4f80c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f7200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 0x7fe4f80c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f7200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f814d6b0 con 0x7fe4f80c9190 2024-09-13T18:49:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f7200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80c2d50 con 0x7fe4f80c8db0 2024-09-13T18:49:06.699 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f7200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80c3310 con 0x7fe4f806ee10 2024-09-13T18:49:06.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 0x7fe4f80c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:06.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f80b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:06.700 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f80b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:55288/0 (socket says 172.21.15.32:55288) 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f5e00700 1 -- 172.21.15.32:0/3491382384 learned_addr learned my addr 172.21.15.32:0/3491382384 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 0x7fe4f80c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53636/0 (socket says 172.21.15.32:53636) 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4ed400700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f80c8db0 0x7fe4f80c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 -- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 msgr2=0x7fe4f80b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f80b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 -- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f80c8db0 msgr2=0x7fe4f80c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f80c8db0 0x7fe4f80c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 -- 172.21.15.32:0/3491382384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0009a70 con 0x7fe4f80c9190 2024-09-13T18:49:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f5e00700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f80b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f6800700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 0x7fe4f80c3ce0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0016000 tx=0x7fe4f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0012430 con 0x7fe4f80c9190 2024-09-13T18:49:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0020070 con 0x7fe4f80c9190 2024-09-13T18:49:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0004280 con 0x7fe4f80c9190 2024-09-13T18:49:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f80b10b0 con 0x7fe4f80c9190 2024-09-13T18:49:06.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.695+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f81ef8d0 con 0x7fe4f80c9190 2024-09-13T18:49:06.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.699+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f80c6d40 con 0x7fe4f80c9190 2024-09-13T18:49:06.705 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.699+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4f00043e0 con 0x7fe4f80c9190 2024-09-13T18:49:06.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.703+0000 7fe4eea00700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe4d4066730 0x7fe4d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:06.707 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.703+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fe4f0022070 con 0x7fe4f80c9190 2024-09-13T18:49:06.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.703+0000 7fe4f5e00700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe4d4066730 0x7fe4d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:06.708 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.703+0000 7fe4f5e00700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe4d4066730 0x7fe4d4068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80112c0 tx=0x7fe4e8009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:06.716 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.711+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4f0053080 con 0x7fe4f80c9190 2024-09-13T18:49:06.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.895+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 --> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4f80c57e0 con 0x7fe4d4066730 2024-09-13T18:49:06.923 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.919+0000 7fe4eea00700 1 -- 172.21.15.32:0/3491382384 <== mgr.4109 v2:172.21.15.86:6832/184658639 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370260 (secure 0 0 0) 0x7fe4e8011c80 con 0x7fe4d4066730 2024-09-13T18:49:06.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:49:06.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe4d4066730 msgr2=0x7fe4d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:06.932 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe4d4066730 0x7fe4d4068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80112c0 tx=0x7fe4e8009240 comp rx=0 tx=0).stop 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 msgr2=0x7fe4f80c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 0x7fe4f80c3ce0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0016000 tx=0x7fe4f0004af0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 shutdown_connections 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fe4d4066730 0x7fe4d4068bf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe4f80c9190 0x7fe4f80c3ce0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f80c8db0 0x7fe4f80c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.923+0000 7fe4f7200700 1 --2- 172.21.15.32:0/3491382384 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4f806ee10 0x7fe4f80b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.927+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 >> 172.21.15.32:0/3491382384 conn(0x7fe4f80cad40 msgr2=0x7fe4f8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.927+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 shutdown_connections 2024-09-13T18:49:06.933 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:06.927+0000 7fe4f7200700 1 -- 172.21.15.32:0/3491382384 wait complete. 2024-09-13T18:49:06.934 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-13T18:49:06.955 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-13T18:49:06.154559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629278,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":248,"num_write_kb":2490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":722,"ondisk_log_size":722,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249400,"kb_used_data":8696,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754725320,"statfs":{"total":773094113280,"available":772838727680,"internally_reserved":0,"allocated":8904704,"data_stored":5130652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":246402617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004679"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":115,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.291771+0000","last_change":"2024-09-13T18:48:01.291999+0000","last_active":"2024-09-13T18:48:01.291771+0000","last_peered":"2024-09-13T18:48:01.291771+0000","last_clean":"2024-09-13T18:48:01.291771+0000","last_became_active":"2024-09-13T18:46:41.339314+0000","last_became_peered":"2024-09-13T18:46:41.339314+0000","last_unstale":"2024-09-13T18:48:01.291771+0000","last_undegraded":"2024-09-13T18:48:01.291771+0000","last_fullsized":"2024-09-13T18:48:01.291771+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:01.291712+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:01.291712+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.291712+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:42.194295+0000","scrub_duration":0.0091402229999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:44.020185+0000","last_change":"2024-09-13T18:47:44.020185+0000","last_active":"2024-09-13T18:47:44.020185+0000","last_peered":"2024-09-13T18:47:44.020185+0000","last_clean":"2024-09-13T18:47:44.020185+0000","last_became_active":"2024-09-13T18:45:01.342742+0000","last_became_peered":"2024-09-13T18:45:01.342742+0000","last_unstale":"2024-09-13T18:47:44.020185+0000","last_undegraded":"2024-09-13T18:47:44.020185+0000","last_fullsized":"2024-09-13T18:47:44.020185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:44.019755+0000","last_clean_scrub_stamp":"2024-09-13T18:47:44.019755+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.693765+0000","scrub_duration":0.0035153290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.437125+0000","last_change":"2024-09-13T18:48:20.437325+0000","last_active":"2024-09-13T18:48:20.437125+0000","last_peered":"2024-09-13T18:48:20.437125+0000","last_clean":"2024-09-13T18:48:20.437125+0000","last_became_active":"2024-09-13T18:46:49.001420+0000","last_became_peered":"2024-09-13T18:46:49.001420+0000","last_unstale":"2024-09-13T18:48:20.437125+0000","last_undegraded":"2024-09-13T18:48:20.437125+0000","last_fullsized":"2024-09-13T18:48:20.437125+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.437094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.437094+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.437094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:22.347631+0000","scrub_duration":0.002801408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,6],"acting":[1,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.263825+0000","last_change":"2024-09-13T18:47:53.263825+0000","last_active":"2024-09-13T18:47:53.263825+0000","last_peered":"2024-09-13T18:47:53.263825+0000","last_clean":"2024-09-13T18:47:53.263825+0000","last_became_active":"2024-09-13T18:45:00.843452+0000","last_became_peered":"2024-09-13T18:45:00.843452+0000","last_unstale":"2024-09-13T18:47:53.263825+0000","last_undegraded":"2024-09-13T18:47:53.263825+0000","last_fullsized":"2024-09-13T18:47:53.263825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:53.263522+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.263522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:19.503992+0000","scrub_duration":0.0029422229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.084921+0000","last_change":"2024-09-13T18:47:48.085118+0000","last_active":"2024-09-13T18:47:48.084921+0000","last_peered":"2024-09-13T18:47:48.084921+0000","last_clean":"2024-09-13T18:47:48.084921+0000","last_became_active":"2024-09-13T18:45:01.338924+0000","last_became_peered":"2024-09-13T18:45:01.338924+0000","last_unstale":"2024-09-13T18:47:48.084921+0000","last_undegraded":"2024-09-13T18:47:48.084921+0000","last_fullsized":"2024-09-13T18:47:48.084921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:48.084867+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.084867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:23.745245+0000","scrub_duration":0.0038812949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:03.011301+0000","last_change":"2024-09-13T18:48:03.011508+0000","last_active":"2024-09-13T18:48:03.011301+0000","last_peered":"2024-09-13T18:48:03.011301+0000","last_clean":"2024-09-13T18:48:03.011301+0000","last_became_active":"2024-09-13T18:46:17.874121+0000","last_became_peered":"2024-09-13T18:46:17.874121+0000","last_unstale":"2024-09-13T18:48:03.011301+0000","last_undegraded":"2024-09-13T18:48:03.011301+0000","last_fullsized":"2024-09-13T18:48:03.011301+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:03.011262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:03.011262+0000","last_clean_scrub_stamp":"2024-09-13T18:48:03.011262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:50.572656+0000","scrub_duration":0.003772119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4,6],"acting":[2,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.561797+0000","last_change":"2024-09-13T18:47:52.561992+0000","last_active":"2024-09-13T18:47:52.561797+0000","last_peered":"2024-09-13T18:47:52.561797+0000","last_clean":"2024-09-13T18:47:52.561797+0000","last_became_active":"2024-09-13T18:47:14.524862+0000","last_became_peered":"2024-09-13T18:47:14.524862+0000","last_unstale":"2024-09-13T18:47:52.561797+0000","last_undegraded":"2024-09-13T18:47:52.561797+0000","last_fullsized":"2024-09-13T18:47:52.561797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:52.561757+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.561757+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.865055+0000","scrub_duration":0.0060467489999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.406557+0000","last_change":"2024-09-13T18:48:16.406727+0000","last_active":"2024-09-13T18:48:16.406557+0000","last_peered":"2024-09-13T18:48:16.406557+0000","last_clean":"2024-09-13T18:48:16.406557+0000","last_became_active":"2024-09-13T18:45:01.341079+0000","last_became_peered":"2024-09-13T18:45:01.341079+0000","last_unstale":"2024-09-13T18:48:16.406557+0000","last_undegraded":"2024-09-13T18:48:16.406557+0000","last_fullsized":"2024-09-13T18:48:16.406557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:16.406515+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:16.406515+0000","last_clean_scrub_stamp":"2024-09-13T18:48:16.406515+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:35.413712+0000","scrub_duration":0.0032610600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.979227+0000","last_change":"2024-09-13T18:48:07.979468+0000","last_active":"2024-09-13T18:48:07.979227+0000","last_peered":"2024-09-13T18:48:07.979227+0000","last_clean":"2024-09-13T18:48:07.979227+0000","last_became_active":"2024-09-13T18:46:41.343734+0000","last_became_peered":"2024-09-13T18:46:41.343734+0000","last_unstale":"2024-09-13T18:48:07.979227+0000","last_undegraded":"2024-09-13T18:48:07.979227+0000","last_fullsized":"2024-09-13T18:48:07.979227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:07.979180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:07.979180+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.979180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:23.491421+0000","scrub_duration":0.0036606949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.559250+0000","last_change":"2024-09-13T18:47:43.559400+0000","last_active":"2024-09-13T18:47:43.559250+0000","last_peered":"2024-09-13T18:47:43.559250+0000","last_clean":"2024-09-13T18:47:43.559250+0000","last_became_active":"2024-09-13T18:47:14.524728+0000","last_became_peered":"2024-09-13T18:47:14.524728+0000","last_unstale":"2024-09-13T18:47:43.559250+0000","last_undegraded":"2024-09-13T18:47:43.559250+0000","last_fullsized":"2024-09-13T18:47:43.559250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:47:43.559220+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.559220+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:12.079418+0000","scrub_duration":0.0058698689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:37.682470+0000","last_change":"2024-09-13T18:48:37.682731+0000","last_active":"2024-09-13T18:48:37.682470+0000","last_peered":"2024-09-13T18:48:37.682470+0000","last_clean":"2024-09-13T18:48:37.682470+0000","last_became_active":"2024-09-13T18:46:41.336447+0000","last_became_peered":"2024-09-13T18:46:41.336447+0000","last_unstale":"2024-09-13T18:48:37.682470+0000","last_undegraded":"2024-09-13T18:48:37.682470+0000","last_fullsized":"2024-09-13T18:48:37.682470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-13T18:48:37.682418+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-13T18:48:37.682418+0000","last_clean_scrub_stamp":"2024-09-13T18:48:37.682418+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:52.974916+0000","scrub_duration":0.003599877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:06.985326+0000","last_change":"2024-09-13T18:48:06.985598+0000","last_active":"2024-09-13T18:48:06.985326+0000","last_peered":"2024-09-13T18:48:06.985326+0000","last_clean":"2024-09-13T18:48:06.985326+0000","last_became_active":"2024-09-13T18:46:17.875271+0000","last_became_peered":"2024-09-13T18:46:17.875271+0000","last_unstale":"2024-09-13T18:48:06.985326+0000","last_undegraded":"2024-09-13T18:48:06.985326+0000","last_fullsized":"2024-09-13T18:48:06.985326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:06.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:06.985275+0000","last_clean_scrub_stamp":"2024-09-13T18:48:06.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:30.581866+0000","scrub_duration":0.0038033839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:43.568860+0000","last_change":"2024-09-13T18:47:43.568860+0000","last_active":"2024-09-13T18:47:43.568860+0000","last_peered":"2024-09-13T18:47:43.568860+0000","last_clean":"2024-09-13T18:47:43.568860+0000","last_became_active":"2024-09-13T18:46:41.339989+0000","last_became_peered":"2024-09-13T18:46:41.339989+0000","last_unstale":"2024-09-13T18:47:43.568860+0000","last_undegraded":"2024-09-13T18:47:43.568860+0000","last_fullsized":"2024-09-13T18:47:43.568860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:43.568716+0000","last_clean_scrub_stamp":"2024-09-13T18:47:43.568716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:06.232320+0000","scrub_duration":0.0018263019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.405551+0000","last_change":"2024-09-13T18:47:55.405551+0000","last_active":"2024-09-13T18:47:55.405551+0000","last_peered":"2024-09-13T18:47:55.405551+0000","last_clean":"2024-09-13T18:47:55.405551+0000","last_became_active":"2024-09-13T18:46:41.342748+0000","last_became_peered":"2024-09-13T18:46:41.342748+0000","last_unstale":"2024-09-13T18:47:55.405551+0000","last_undegraded":"2024-09-13T18:47:55.405551+0000","last_fullsized":"2024-09-13T18:47:55.405551+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:55.405321+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.405321+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:00.336484+0000","scrub_duration":0.0060507419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:23.391521+0000","last_change":"2024-09-13T18:48:23.391521+0000","last_active":"2024-09-13T18:48:23.391521+0000","last_peered":"2024-09-13T18:48:23.391521+0000","last_clean":"2024-09-13T18:48:23.391521+0000","last_became_active":"2024-09-13T18:46:41.350140+0000","last_became_peered":"2024-09-13T18:46:41.350140+0000","last_unstale":"2024-09-13T18:48:23.391521+0000","last_undegraded":"2024-09-13T18:48:23.391521+0000","last_fullsized":"2024-09-13T18:48:23.391521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:23.391226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:23.391226+0000","last_clean_scrub_stamp":"2024-09-13T18:48:23.391226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:37.214414+0000","scrub_duration":0.003641863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.455876+0000","last_change":"2024-09-13T18:48:01.456191+0000","last_active":"2024-09-13T18:48:01.455876+0000","last_peered":"2024-09-13T18:48:01.455876+0000","last_clean":"2024-09-13T18:48:01.455876+0000","last_became_active":"2024-09-13T18:46:17.883293+0000","last_became_peered":"2024-09-13T18:46:17.883293+0000","last_unstale":"2024-09-13T18:48:01.455876+0000","last_undegraded":"2024-09-13T18:48:01.455876+0000","last_fullsized":"2024-09-13T18:48:01.455876+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:01.455761+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:01.455761+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.455761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:43.734731+0000","scrub_duration":0.0029792400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:09.481422+0000","last_change":"2024-09-13T18:48:09.481422+0000","last_active":"2024-09-13T18:48:09.481422+0000","last_peered":"2024-09-13T18:48:09.481422+0000","last_clean":"2024-09-13T18:48:09.481422+0000","last_became_active":"2024-09-13T18:46:17.882000+0000","last_became_peered":"2024-09-13T18:46:17.882000+0000","last_unstale":"2024-09-13T18:48:09.481422+0000","last_undegraded":"2024-09-13T18:48:09.481422+0000","last_fullsized":"2024-09-13T18:48:09.481422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:09.481172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:09.481172+0000","last_clean_scrub_stamp":"2024-09-13T18:48:09.481172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:06.077418+0000","scrub_duration":0.0039577529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.633696+0000","last_change":"2024-09-13T18:48:22.633914+0000","last_active":"2024-09-13T18:48:22.633696+0000","last_peered":"2024-09-13T18:48:22.633696+0000","last_clean":"2024-09-13T18:48:22.633696+0000","last_became_active":"2024-09-13T18:47:14.648918+0000","last_became_peered":"2024-09-13T18:47:14.648918+0000","last_unstale":"2024-09-13T18:48:22.633696+0000","last_undegraded":"2024-09-13T18:48:22.633696+0000","last_fullsized":"2024-09-13T18:48:22.633696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:22.633653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:22.633653+0000","last_clean_scrub_stamp":"2024-09-13T18:48:22.633653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:18.950993+0000","scrub_duration":0.0041859640000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:13.351867+0000","last_change":"2024-09-13T18:48:13.352149+0000","last_active":"2024-09-13T18:48:13.351867+0000","last_peered":"2024-09-13T18:48:13.351867+0000","last_clean":"2024-09-13T18:48:13.351867+0000","last_became_active":"2024-09-13T18:45:01.326449+0000","last_became_peered":"2024-09-13T18:45:01.326449+0000","last_unstale":"2024-09-13T18:48:13.351867+0000","last_undegraded":"2024-09-13T18:48:13.351867+0000","last_fullsized":"2024-09-13T18:48:13.351867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:13.351768+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:13.351768+0000","last_clean_scrub_stamp":"2024-09-13T18:48:13.351768+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:07.326683+0000","scrub_duration":0.0025088380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.319041+0000","last_change":"2024-09-13T18:48:02.319225+0000","last_active":"2024-09-13T18:48:02.319041+0000","last_peered":"2024-09-13T18:48:02.319041+0000","last_clean":"2024-09-13T18:48:02.319041+0000","last_became_active":"2024-09-13T18:45:00.858427+0000","last_became_peered":"2024-09-13T18:45:00.858427+0000","last_unstale":"2024-09-13T18:48:02.319041+0000","last_undegraded":"2024-09-13T18:48:02.319041+0000","last_fullsized":"2024-09-13T18:48:02.319041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:02.318994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:02.318994+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.318994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:13.580074+0000","scrub_duration":0.0038020279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.416022+0000","last_change":"2024-09-13T18:48:14.416312+0000","last_active":"2024-09-13T18:48:14.416022+0000","last_peered":"2024-09-13T18:48:14.416022+0000","last_clean":"2024-09-13T18:48:14.416022+0000","last_became_active":"2024-09-13T18:46:41.320399+0000","last_became_peered":"2024-09-13T18:46:41.320399+0000","last_unstale":"2024-09-13T18:48:14.416022+0000","last_undegraded":"2024-09-13T18:48:14.416022+0000","last_fullsized":"2024-09-13T18:48:14.416022+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:14.415970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:14.415970+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.415970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.431347+0000","scrub_duration":0.0039507550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.451413+0000","last_change":"2024-09-13T18:48:14.451413+0000","last_active":"2024-09-13T18:48:14.451413+0000","last_peered":"2024-09-13T18:48:14.451413+0000","last_clean":"2024-09-13T18:48:14.451413+0000","last_became_active":"2024-09-13T18:46:41.332574+0000","last_became_peered":"2024-09-13T18:46:41.332574+0000","last_unstale":"2024-09-13T18:48:14.451413+0000","last_undegraded":"2024-09-13T18:48:14.451413+0000","last_fullsized":"2024-09-13T18:48:14.451413+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:48:14.451155+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:48:14.451155+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.451155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:35.419012+0000","scrub_duration":0.0027847140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.652989+0000","last_change":"2024-09-13T18:47:47.653251+0000","last_active":"2024-09-13T18:47:47.652989+0000","last_peered":"2024-09-13T18:47:47.652989+0000","last_clean":"2024-09-13T18:47:47.652989+0000","last_became_active":"2024-09-13T18:47:14.519627+0000","last_became_peered":"2024-09-13T18:47:14.519627+0000","last_unstale":"2024-09-13T18:47:47.652989+0000","last_undegraded":"2024-09-13T18:47:47.652989+0000","last_fullsized":"2024-09-13T18:47:47.652989+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:47.652946+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.652946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:32.344600+0000","scrub_duration":0.0030565380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.008098+0000","last_change":"2024-09-13T18:48:18.008287+0000","last_active":"2024-09-13T18:48:18.008098+0000","last_peered":"2024-09-13T18:48:18.008098+0000","last_clean":"2024-09-13T18:48:18.008098+0000","last_became_active":"2024-09-13T18:46:41.347298+0000","last_became_peered":"2024-09-13T18:46:41.347298+0000","last_unstale":"2024-09-13T18:48:18.008098+0000","last_undegraded":"2024-09-13T18:48:18.008098+0000","last_fullsized":"2024-09-13T18:48:18.008098+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:18.008062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:18.008062+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.008062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:26.866426+0000","scrub_duration":0.0060362790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.317626+0000","last_change":"2024-09-13T18:48:15.317798+0000","last_active":"2024-09-13T18:48:15.317626+0000","last_peered":"2024-09-13T18:48:15.317626+0000","last_clean":"2024-09-13T18:48:15.317626+0000","last_became_active":"2024-09-13T18:45:01.329974+0000","last_became_peered":"2024-09-13T18:45:01.329974+0000","last_unstale":"2024-09-13T18:48:15.317626+0000","last_undegraded":"2024-09-13T18:48:15.317626+0000","last_fullsized":"2024-09-13T18:48:15.317626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:15.317586+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:15.317586+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.317586+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:21.647472+0000","scrub_duration":0.002498049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:44.717723+0000","last_change":"2024-09-13T18:48:44.717723+0000","last_active":"2024-09-13T18:48:44.717723+0000","last_peered":"2024-09-13T18:48:44.717723+0000","last_clean":"2024-09-13T18:48:44.717723+0000","last_became_active":"2024-09-13T18:46:41.335194+0000","last_became_peered":"2024-09-13T18:46:41.335194+0000","last_unstale":"2024-09-13T18:48:44.717723+0000","last_undegraded":"2024-09-13T18:48:44.717723+0000","last_fullsized":"2024-09-13T18:48:44.717723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:44.717463+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:44.717463+0000","last_clean_scrub_stamp":"2024-09-13T18:48:44.717463+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:47.655599+0000","scrub_duration":0.0059987180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.012842+0000","last_change":"2024-09-13T18:48:04.013010+0000","last_active":"2024-09-13T18:48:04.012842+0000","last_peered":"2024-09-13T18:48:04.012842+0000","last_clean":"2024-09-13T18:48:04.012842+0000","last_became_active":"2024-09-13T18:46:41.333944+0000","last_became_peered":"2024-09-13T18:46:41.333944+0000","last_unstale":"2024-09-13T18:48:04.012842+0000","last_undegraded":"2024-09-13T18:48:04.012842+0000","last_fullsized":"2024-09-13T18:48:04.012842+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:04.012810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:04.012810+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.012810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:42.515395+0000","scrub_duration":0.0063472049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:09.382293+0000","last_change":"2024-09-13T18:48:09.382541+0000","last_active":"2024-09-13T18:48:09.382293+0000","last_peered":"2024-09-13T18:48:09.382293+0000","last_clean":"2024-09-13T18:48:09.382293+0000","last_became_active":"2024-09-13T18:46:17.889437+0000","last_became_peered":"2024-09-13T18:46:17.889437+0000","last_unstale":"2024-09-13T18:48:09.382293+0000","last_undegraded":"2024-09-13T18:48:09.382293+0000","last_fullsized":"2024-09-13T18:48:09.382293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:48:09.382230+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:48:09.382230+0000","last_clean_scrub_stamp":"2024-09-13T18:48:09.382230+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:05.501947+0000","scrub_duration":0.0026682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.220942+0000","last_change":"2024-09-13T18:47:58.221241+0000","last_active":"2024-09-13T18:47:58.220942+0000","last_peered":"2024-09-13T18:47:58.220942+0000","last_clean":"2024-09-13T18:47:58.220942+0000","last_became_active":"2024-09-13T18:45:00.851555+0000","last_became_peered":"2024-09-13T18:45:00.851555+0000","last_unstale":"2024-09-13T18:47:58.220942+0000","last_undegraded":"2024-09-13T18:47:58.220942+0000","last_fullsized":"2024-09-13T18:47:58.220942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.220882+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.220882+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:31.105081+0000","scrub_duration":0.004045735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":118,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:24.408799+0000","last_change":"2024-09-13T18:48:24.409139+0000","last_active":"2024-09-13T18:48:24.408799+0000","last_peered":"2024-09-13T18:48:24.408799+0000","last_clean":"2024-09-13T18:48:24.408799+0000","last_became_active":"2024-09-13T18:46:41.324765+0000","last_became_peered":"2024-09-13T18:46:41.324765+0000","last_unstale":"2024-09-13T18:48:24.408799+0000","last_undegraded":"2024-09-13T18:48:24.408799+0000","last_fullsized":"2024-09-13T18:48:24.408799+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:24.408748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:24.408748+0000","last_clean_scrub_stamp":"2024-09-13T18:48:24.408748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:40.915694+0000","scrub_duration":0.0039121570000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.499292+0000","last_change":"2024-09-13T18:48:04.499292+0000","last_active":"2024-09-13T18:48:04.499292+0000","last_peered":"2024-09-13T18:48:04.499292+0000","last_clean":"2024-09-13T18:48:04.499292+0000","last_became_active":"2024-09-13T18:46:17.884781+0000","last_became_peered":"2024-09-13T18:46:17.884781+0000","last_unstale":"2024-09-13T18:48:04.499292+0000","last_undegraded":"2024-09-13T18:48:04.499292+0000","last_fullsized":"2024-09-13T18:48:04.499292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:04.498906+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:04.498906+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.498906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:52.223800+0000","scrub_duration":0.00343589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.482767+0000","last_change":"2024-09-13T18:47:51.482767+0000","last_active":"2024-09-13T18:47:51.482767+0000","last_peered":"2024-09-13T18:47:51.482767+0000","last_clean":"2024-09-13T18:47:51.482767+0000","last_became_active":"2024-09-13T18:46:41.332013+0000","last_became_peered":"2024-09-13T18:46:41.332013+0000","last_unstale":"2024-09-13T18:47:51.482767+0000","last_undegraded":"2024-09-13T18:47:51.482767+0000","last_fullsized":"2024-09-13T18:47:51.482767+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.482562+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.482562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:34.558081+0000","scrub_duration":0.0034253259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.503170+0000","last_change":"2024-09-13T18:48:14.503170+0000","last_active":"2024-09-13T18:48:14.503170+0000","last_peered":"2024-09-13T18:48:14.503170+0000","last_clean":"2024-09-13T18:48:14.503170+0000","last_became_active":"2024-09-13T18:46:17.875710+0000","last_became_peered":"2024-09-13T18:46:17.875710+0000","last_unstale":"2024-09-13T18:48:14.503170+0000","last_undegraded":"2024-09-13T18:48:14.503170+0000","last_fullsized":"2024-09-13T18:48:14.503170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:14.502866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:14.502866+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.502866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:56.838327+0000","scrub_duration":0.0040653399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.051610+0000","last_change":"2024-09-13T18:47:49.051818+0000","last_active":"2024-09-13T18:47:49.051610+0000","last_peered":"2024-09-13T18:47:49.051610+0000","last_clean":"2024-09-13T18:47:49.051610+0000","last_became_active":"2024-09-13T18:46:17.882468+0000","last_became_peered":"2024-09-13T18:46:17.882468+0000","last_unstale":"2024-09-13T18:47:49.051610+0000","last_undegraded":"2024-09-13T18:47:49.051610+0000","last_fullsized":"2024-09-13T18:47:49.051610+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:49.051559+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.051559+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.947582+0000","scrub_duration":0.0034011369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.132202+0000","last_change":"2024-09-13T18:47:49.132469+0000","last_active":"2024-09-13T18:47:49.132202+0000","last_peered":"2024-09-13T18:47:49.132202+0000","last_clean":"2024-09-13T18:47:49.132202+0000","last_became_active":"2024-09-13T18:46:17.889380+0000","last_became_peered":"2024-09-13T18:46:17.889380+0000","last_unstale":"2024-09-13T18:47:49.132202+0000","last_undegraded":"2024-09-13T18:47:49.132202+0000","last_fullsized":"2024-09-13T18:47:49.132202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:49.132146+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.132146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:39.405895+0000","scrub_duration":0.0026213619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:52.433346+0000","last_change":"2024-09-13T18:47:52.433346+0000","last_active":"2024-09-13T18:47:52.433346+0000","last_peered":"2024-09-13T18:47:52.433346+0000","last_clean":"2024-09-13T18:47:52.433346+0000","last_became_active":"2024-09-13T18:46:41.331616+0000","last_became_peered":"2024-09-13T18:46:41.331616+0000","last_unstale":"2024-09-13T18:47:52.433346+0000","last_undegraded":"2024-09-13T18:47:52.433346+0000","last_fullsized":"2024-09-13T18:47:52.433346+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:52.433008+0000","last_clean_scrub_stamp":"2024-09-13T18:47:52.433008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:23.849816+0000","scrub_duration":0.003833234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:03.537032+0000","last_change":"2024-09-13T18:48:03.537343+0000","last_active":"2024-09-13T18:48:03.537032+0000","last_peered":"2024-09-13T18:48:03.537032+0000","last_clean":"2024-09-13T18:48:03.537032+0000","last_became_active":"2024-09-13T18:47:14.518992+0000","last_became_peered":"2024-09-13T18:47:14.518992+0000","last_unstale":"2024-09-13T18:48:03.537032+0000","last_undegraded":"2024-09-13T18:48:03.537032+0000","last_fullsized":"2024-09-13T18:48:03.537032+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:03.536979+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:03.536979+0000","last_clean_scrub_stamp":"2024-09-13T18:48:03.536979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:02.205018+0000","scrub_duration":0.0037624360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:38.695442+0000","last_change":"2024-09-13T18:48:38.695442+0000","last_active":"2024-09-13T18:48:38.695442+0000","last_peered":"2024-09-13T18:48:38.695442+0000","last_clean":"2024-09-13T18:48:38.695442+0000","last_became_active":"2024-09-13T18:46:41.317097+0000","last_became_peered":"2024-09-13T18:46:41.317097+0000","last_unstale":"2024-09-13T18:48:38.695442+0000","last_undegraded":"2024-09-13T18:48:38.695442+0000","last_fullsized":"2024-09-13T18:48:38.695442+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:38.695150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:38.695150+0000","last_clean_scrub_stamp":"2024-09-13T18:48:38.695150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:24.464909+0000","scrub_duration":0.003177849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.469359+0000","last_change":"2024-09-13T18:47:53.469359+0000","last_active":"2024-09-13T18:47:53.469359+0000","last_peered":"2024-09-13T18:47:53.469359+0000","last_clean":"2024-09-13T18:47:53.469359+0000","last_became_active":"2024-09-13T18:46:41.331901+0000","last_became_peered":"2024-09-13T18:46:41.331901+0000","last_unstale":"2024-09-13T18:47:53.469359+0000","last_undegraded":"2024-09-13T18:47:53.469359+0000","last_fullsized":"2024-09-13T18:47:53.469359+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:53.469009+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.469009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.549365+0000","scrub_duration":0.0034698680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:57.298346+0000","last_change":"2024-09-13T18:47:57.298346+0000","last_active":"2024-09-13T18:47:57.298346+0000","last_peered":"2024-09-13T18:47:57.298346+0000","last_clean":"2024-09-13T18:47:57.298346+0000","last_became_active":"2024-09-13T18:45:01.326607+0000","last_became_peered":"2024-09-13T18:45:01.326607+0000","last_unstale":"2024-09-13T18:47:57.298346+0000","last_undegraded":"2024-09-13T18:47:57.298346+0000","last_fullsized":"2024-09-13T18:47:57.298346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:57.298101+0000","last_clean_scrub_stamp":"2024-09-13T18:47:57.298101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:47.457258+0000","scrub_duration":0.0029362590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.334953+0000","last_change":"2024-09-13T18:47:50.335172+0000","last_active":"2024-09-13T18:47:50.334953+0000","last_peered":"2024-09-13T18:47:50.334953+0000","last_clean":"2024-09-13T18:47:50.334953+0000","last_became_active":"2024-09-13T18:45:00.846510+0000","last_became_peered":"2024-09-13T18:45:00.846510+0000","last_unstale":"2024-09-13T18:47:50.334953+0000","last_undegraded":"2024-09-13T18:47:50.334953+0000","last_fullsized":"2024-09-13T18:47:50.334953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:50.334901+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.334901+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:43.474237+0000","scrub_duration":0.0055209919999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.429800+0000","last_change":"2024-09-13T18:47:55.429800+0000","last_active":"2024-09-13T18:47:55.429800+0000","last_peered":"2024-09-13T18:47:55.429800+0000","last_clean":"2024-09-13T18:47:55.429800+0000","last_became_active":"2024-09-13T18:46:17.878623+0000","last_became_peered":"2024-09-13T18:46:17.878623+0000","last_unstale":"2024-09-13T18:47:55.429800+0000","last_undegraded":"2024-09-13T18:47:55.429800+0000","last_fullsized":"2024-09-13T18:47:55.429800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:55.429388+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.429388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:13.248197+0000","scrub_duration":0.0035543609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.498180+0000","last_change":"2024-09-13T18:47:47.498180+0000","last_active":"2024-09-13T18:47:47.498180+0000","last_peered":"2024-09-13T18:47:47.498180+0000","last_clean":"2024-09-13T18:47:47.498180+0000","last_became_active":"2024-09-13T18:46:17.865109+0000","last_became_peered":"2024-09-13T18:46:17.865109+0000","last_unstale":"2024-09-13T18:47:47.498180+0000","last_undegraded":"2024-09-13T18:47:47.498180+0000","last_fullsized":"2024-09-13T18:47:47.498180+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:47.497898+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.497898+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:43.625983+0000","scrub_duration":0.0036756570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.394735+0000","last_change":"2024-09-13T18:48:20.394735+0000","last_active":"2024-09-13T18:48:20.394735+0000","last_peered":"2024-09-13T18:48:20.394735+0000","last_clean":"2024-09-13T18:48:20.394735+0000","last_became_active":"2024-09-13T18:46:41.335774+0000","last_became_peered":"2024-09-13T18:46:41.335774+0000","last_unstale":"2024-09-13T18:48:20.394735+0000","last_undegraded":"2024-09-13T18:48:20.394735+0000","last_fullsized":"2024-09-13T18:48:20.394735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.394478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.394478+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.394478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:19.970817+0000","scrub_duration":0.0031325900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.270447+0000","last_change":"2024-09-13T18:48:22.270845+0000","last_active":"2024-09-13T18:48:22.270447+0000","last_peered":"2024-09-13T18:48:22.270447+0000","last_clean":"2024-09-13T18:48:22.270447+0000","last_became_active":"2024-09-13T18:46:17.877811+0000","last_became_peered":"2024-09-13T18:46:17.877811+0000","last_unstale":"2024-09-13T18:48:22.270447+0000","last_undegraded":"2024-09-13T18:48:22.270447+0000","last_fullsized":"2024-09-13T18:48:22.270447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:22.270344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:22.270344+0000","last_clean_scrub_stamp":"2024-09-13T18:48:22.270344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.608724+0000","scrub_duration":0.0058798319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.360722+0000","last_change":"2024-09-13T18:48:05.360900+0000","last_active":"2024-09-13T18:48:05.360722+0000","last_peered":"2024-09-13T18:48:05.360722+0000","last_clean":"2024-09-13T18:48:05.360722+0000","last_became_active":"2024-09-13T18:45:01.333900+0000","last_became_peered":"2024-09-13T18:45:01.333900+0000","last_unstale":"2024-09-13T18:48:05.360722+0000","last_undegraded":"2024-09-13T18:48:05.360722+0000","last_fullsized":"2024-09-13T18:48:05.360722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:05.360667+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:05.360667+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.360667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:37.843562+0000","scrub_duration":0.0033082490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.515008+0000","last_change":"2024-09-13T18:48:10.515008+0000","last_active":"2024-09-13T18:48:10.515008+0000","last_peered":"2024-09-13T18:48:10.515008+0000","last_clean":"2024-09-13T18:48:10.515008+0000","last_became_active":"2024-09-13T18:46:41.342993+0000","last_became_peered":"2024-09-13T18:46:41.342993+0000","last_unstale":"2024-09-13T18:48:10.515008+0000","last_undegraded":"2024-09-13T18:48:10.515008+0000","last_fullsized":"2024-09-13T18:48:10.515008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:10.514771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:10.514771+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.514771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:19.193364+0000","scrub_duration":0.0031935050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"81'119","reported_seq":238,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.364342+0000","last_change":"2024-09-13T18:47:56.364342+0000","last_active":"2024-09-13T18:47:56.364342+0000","last_peered":"2024-09-13T18:47:56.364342+0000","last_clean":"2024-09-13T18:47:56.364342+0000","last_became_active":"2024-09-13T18:44:52.313042+0000","last_became_peered":"2024-09-13T18:44:52.313042+0000","last_unstale":"2024-09-13T18:47:56.364342+0000","last_undegraded":"2024-09-13T18:47:56.364342+0000","last_fullsized":"2024-09-13T18:47:56.364342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'119","last_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_deep_scrub":"81'119","last_deep_scrub_stamp":"2024-09-13T18:47:56.364169+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.364169+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.913927+0000","scrub_duration":0.010342967999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:41.727689+0000","last_change":"2024-09-13T18:48:41.727689+0000","last_active":"2024-09-13T18:48:41.727689+0000","last_peered":"2024-09-13T18:48:41.727689+0000","last_clean":"2024-09-13T18:48:41.727689+0000","last_became_active":"2024-09-13T18:46:41.343058+0000","last_became_peered":"2024-09-13T18:46:41.343058+0000","last_unstale":"2024-09-13T18:48:41.727689+0000","last_undegraded":"2024-09-13T18:48:41.727689+0000","last_fullsized":"2024-09-13T18:48:41.727689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.727310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.727310+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.727310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:08.873789+0000","scrub_duration":0.0039628859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:45.670886+0000","last_change":"2024-09-13T18:48:45.670886+0000","last_active":"2024-09-13T18:48:45.670886+0000","last_peered":"2024-09-13T18:48:45.670886+0000","last_clean":"2024-09-13T18:48:45.670886+0000","last_became_active":"2024-09-13T18:46:41.343417+0000","last_became_peered":"2024-09-13T18:46:41.343417+0000","last_unstale":"2024-09-13T18:48:45.670886+0000","last_undegraded":"2024-09-13T18:48:45.670886+0000","last_fullsized":"2024-09-13T18:48:45.670886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:45.670654+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:45.670654+0000","last_clean_scrub_stamp":"2024-09-13T18:48:45.670654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:57.368383+0000","scrub_duration":0.0032618009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.508414+0000","last_change":"2024-09-13T18:48:15.508414+0000","last_active":"2024-09-13T18:48:15.508414+0000","last_peered":"2024-09-13T18:48:15.508414+0000","last_clean":"2024-09-13T18:48:15.508414+0000","last_became_active":"2024-09-13T18:46:17.876070+0000","last_became_peered":"2024-09-13T18:46:17.876070+0000","last_unstale":"2024-09-13T18:48:15.508414+0000","last_undegraded":"2024-09-13T18:48:15.508414+0000","last_fullsized":"2024-09-13T18:48:15.508414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:15.508045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:15.508045+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.508045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:00.970795+0000","scrub_duration":0.0038577519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.974166+0000","last_change":"2024-09-13T18:48:04.974493+0000","last_active":"2024-09-13T18:48:04.974166+0000","last_peered":"2024-09-13T18:48:04.974166+0000","last_clean":"2024-09-13T18:48:04.974166+0000","last_became_active":"2024-09-13T18:46:41.333588+0000","last_became_peered":"2024-09-13T18:46:41.333588+0000","last_unstale":"2024-09-13T18:48:04.974166+0000","last_undegraded":"2024-09-13T18:48:04.974166+0000","last_fullsized":"2024-09-13T18:48:04.974166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:04.974118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:04.974118+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.974118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:50.337427+0000","scrub_duration":0.0037389459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:40.530633+0000","last_change":"2024-09-13T18:47:40.530820+0000","last_active":"2024-09-13T18:47:40.530633+0000","last_peered":"2024-09-13T18:47:40.530633+0000","last_clean":"2024-09-13T18:47:40.530633+0000","last_became_active":"2024-09-13T18:47:14.709428+0000","last_became_peered":"2024-09-13T18:47:14.709428+0000","last_unstale":"2024-09-13T18:47:40.530633+0000","last_undegraded":"2024-09-13T18:47:40.530633+0000","last_fullsized":"2024-09-13T18:47:40.530633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:40.530592+0000","last_clean_scrub_stamp":"2024-09-13T18:47:40.530592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:33.146259+0000","scrub_duration":0.0031957550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.234604+0000","last_change":"2024-09-13T18:47:51.234842+0000","last_active":"2024-09-13T18:47:51.234604+0000","last_peered":"2024-09-13T18:47:51.234604+0000","last_clean":"2024-09-13T18:47:51.234604+0000","last_became_active":"2024-09-13T18:45:00.854403+0000","last_became_peered":"2024-09-13T18:45:00.854403+0000","last_unstale":"2024-09-13T18:47:51.234604+0000","last_undegraded":"2024-09-13T18:47:51.234604+0000","last_fullsized":"2024-09-13T18:47:51.234604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:51.234552+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.234552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:38.835687+0000","scrub_duration":0.0096124350000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.315759+0000","last_change":"2024-09-13T18:48:19.315989+0000","last_active":"2024-09-13T18:48:19.315759+0000","last_peered":"2024-09-13T18:48:19.315759+0000","last_clean":"2024-09-13T18:48:19.315759+0000","last_became_active":"2024-09-13T18:46:41.331952+0000","last_became_peered":"2024-09-13T18:46:41.331952+0000","last_unstale":"2024-09-13T18:48:19.315759+0000","last_undegraded":"2024-09-13T18:48:19.315759+0000","last_fullsized":"2024-09-13T18:48:19.315759+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:19.315681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:19.315681+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.315681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:17.146656+0000","scrub_duration":0.0043501210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:11.624536+0000","last_change":"2024-09-13T18:48:11.624728+0000","last_active":"2024-09-13T18:48:11.624536+0000","last_peered":"2024-09-13T18:48:11.624536+0000","last_clean":"2024-09-13T18:48:11.624536+0000","last_became_active":"2024-09-13T18:47:14.525609+0000","last_became_peered":"2024-09-13T18:47:14.525609+0000","last_unstale":"2024-09-13T18:48:11.624536+0000","last_undegraded":"2024-09-13T18:48:11.624536+0000","last_fullsized":"2024-09-13T18:48:11.624536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:11.624492+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:11.624492+0000","last_clean_scrub_stamp":"2024-09-13T18:48:11.624492+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:12.141467+0000","scrub_duration":0.0031213069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.362683+0000","last_change":"2024-09-13T18:48:04.362881+0000","last_active":"2024-09-13T18:48:04.362683+0000","last_peered":"2024-09-13T18:48:04.362683+0000","last_clean":"2024-09-13T18:48:04.362683+0000","last_became_active":"2024-09-13T18:45:00.838917+0000","last_became_peered":"2024-09-13T18:45:00.838917+0000","last_unstale":"2024-09-13T18:48:04.362683+0000","last_undegraded":"2024-09-13T18:48:04.362683+0000","last_fullsized":"2024-09-13T18:48:04.362683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-13T18:48:04.362627+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-13T18:48:04.362627+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.362627+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:58.244178+0000","scrub_duration":0.0053930799999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:22.359181+0000","last_change":"2024-09-13T18:48:22.359181+0000","last_active":"2024-09-13T18:48:22.359181+0000","last_peered":"2024-09-13T18:48:22.359181+0000","last_clean":"2024-09-13T18:48:22.359181+0000","last_became_active":"2024-09-13T18:46:41.341804+0000","last_became_peered":"2024-09-13T18:46:41.341804+0000","last_unstale":"2024-09-13T18:48:22.359181+0000","last_undegraded":"2024-09-13T18:48:22.359181+0000","last_fullsized":"2024-09-13T18:48:22.359181+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:22.358877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:22.358877+0000","last_clean_scrub_stamp":"2024-09-13T18:48:22.358877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:07.815084+0000","scrub_duration":0.0036706439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.033407+0000","last_change":"2024-09-13T18:47:55.033619+0000","last_active":"2024-09-13T18:47:55.033407+0000","last_peered":"2024-09-13T18:47:55.033407+0000","last_clean":"2024-09-13T18:47:55.033407+0000","last_became_active":"2024-09-13T18:45:01.339800+0000","last_became_peered":"2024-09-13T18:45:01.339800+0000","last_unstale":"2024-09-13T18:47:55.033407+0000","last_undegraded":"2024-09-13T18:47:55.033407+0000","last_fullsized":"2024-09-13T18:47:55.033407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:47:55.033356+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.033356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:27.430817+0000","scrub_duration":0.0033159650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.565941+0000","last_change":"2024-09-13T18:47:42.566061+0000","last_active":"2024-09-13T18:47:42.565941+0000","last_peered":"2024-09-13T18:47:42.565941+0000","last_clean":"2024-09-13T18:47:42.565941+0000","last_became_active":"2024-09-13T18:47:14.522038+0000","last_became_peered":"2024-09-13T18:47:14.522038+0000","last_unstale":"2024-09-13T18:47:42.565941+0000","last_undegraded":"2024-09-13T18:47:42.565941+0000","last_fullsized":"2024-09-13T18:47:42.565941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:47:42.565910+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.565910+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:50.152639+0000","scrub_duration":0.0063911790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.377660+0000","last_change":"2024-09-13T18:48:18.377919+0000","last_active":"2024-09-13T18:48:18.377660+0000","last_peered":"2024-09-13T18:48:18.377660+0000","last_clean":"2024-09-13T18:48:18.377660+0000","last_became_active":"2024-09-13T18:45:05.362400+0000","last_became_peered":"2024-09-13T18:45:05.362400+0000","last_unstale":"2024-09-13T18:48:18.377660+0000","last_undegraded":"2024-09-13T18:48:18.377660+0000","last_fullsized":"2024-09-13T18:48:18.377660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:18.377611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:18.377611+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.377611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:14.207959+0000","scrub_duration":0.0039362679999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.414789+0000","last_change":"2024-09-13T18:47:58.414789+0000","last_active":"2024-09-13T18:47:58.414789+0000","last_peered":"2024-09-13T18:47:58.414789+0000","last_clean":"2024-09-13T18:47:58.414789+0000","last_became_active":"2024-09-13T18:46:41.329358+0000","last_became_peered":"2024-09-13T18:46:41.329358+0000","last_unstale":"2024-09-13T18:47:58.414789+0000","last_undegraded":"2024-09-13T18:47:58.414789+0000","last_fullsized":"2024-09-13T18:47:58.414789+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:58.414481+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.414481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:59.349305+0000","scrub_duration":0.0035677840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"81'12","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:59.231731+0000","last_change":"2024-09-13T18:47:59.231990+0000","last_active":"2024-09-13T18:47:59.231731+0000","last_peered":"2024-09-13T18:47:59.231731+0000","last_clean":"2024-09-13T18:47:59.231731+0000","last_became_active":"2024-09-13T18:45:00.841699+0000","last_became_peered":"2024-09-13T18:45:00.841699+0000","last_unstale":"2024-09-13T18:47:59.231731+0000","last_undegraded":"2024-09-13T18:47:59.231731+0000","last_fullsized":"2024-09-13T18:47:59.231731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-13T18:47:59.231673+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-13T18:47:59.231673+0000","last_clean_scrub_stamp":"2024-09-13T18:47:59.231673+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:47.851506+0000","scrub_duration":0.009267773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.301789+0000","last_change":"2024-09-13T18:48:20.302045+0000","last_active":"2024-09-13T18:48:20.301789+0000","last_peered":"2024-09-13T18:48:20.301789+0000","last_clean":"2024-09-13T18:48:20.301789+0000","last_became_active":"2024-09-13T18:46:17.892452+0000","last_became_peered":"2024-09-13T18:46:17.892452+0000","last_unstale":"2024-09-13T18:48:20.301789+0000","last_undegraded":"2024-09-13T18:48:20.301789+0000","last_fullsized":"2024-09-13T18:48:20.301789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.301737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.301737+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.301737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:20.860008+0000","scrub_duration":0.0036640150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.406089+0000","last_change":"2024-09-13T18:48:05.406213+0000","last_active":"2024-09-13T18:48:05.406089+0000","last_peered":"2024-09-13T18:48:05.406089+0000","last_clean":"2024-09-13T18:48:05.406089+0000","last_became_active":"2024-09-13T18:45:01.332712+0000","last_became_peered":"2024-09-13T18:45:01.332712+0000","last_unstale":"2024-09-13T18:48:05.406089+0000","last_undegraded":"2024-09-13T18:48:05.406089+0000","last_fullsized":"2024-09-13T18:48:05.406089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:05.406053+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:05.406053+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.406053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.046957+0000","scrub_duration":0.0030831119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:46.633439+0000","last_change":"2024-09-13T18:47:46.633627+0000","last_active":"2024-09-13T18:47:46.633439+0000","last_peered":"2024-09-13T18:47:46.633439+0000","last_clean":"2024-09-13T18:47:46.633439+0000","last_became_active":"2024-09-13T18:47:14.653971+0000","last_became_peered":"2024-09-13T18:47:14.653971+0000","last_unstale":"2024-09-13T18:47:46.633439+0000","last_undegraded":"2024-09-13T18:47:46.633439+0000","last_fullsized":"2024-09-13T18:47:46.633439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:46.633397+0000","last_clean_scrub_stamp":"2024-09-13T18:47:46.633397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:40.331659+0000","scrub_duration":0.0034897349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:24.471528+0000","last_change":"2024-09-13T18:48:24.471528+0000","last_active":"2024-09-13T18:48:24.471528+0000","last_peered":"2024-09-13T18:48:24.471528+0000","last_clean":"2024-09-13T18:48:24.471528+0000","last_became_active":"2024-09-13T18:46:35.425298+0000","last_became_peered":"2024-09-13T18:46:35.425298+0000","last_unstale":"2024-09-13T18:48:24.471528+0000","last_undegraded":"2024-09-13T18:48:24.471528+0000","last_fullsized":"2024-09-13T18:48:24.471528+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:24.471097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:24.471097+0000","last_clean_scrub_stamp":"2024-09-13T18:48:24.471097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:07.803531+0000","scrub_duration":0.0032780249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,5],"acting":[6,4,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:51.610004+0000","last_change":"2024-09-13T18:48:51.610004+0000","last_active":"2024-09-13T18:48:51.610004+0000","last_peered":"2024-09-13T18:48:51.610004+0000","last_clean":"2024-09-13T18:48:51.610004+0000","last_became_active":"2024-09-13T18:46:41.334704+0000","last_became_peered":"2024-09-13T18:46:41.334704+0000","last_unstale":"2024-09-13T18:48:51.610004+0000","last_undegraded":"2024-09-13T18:48:51.610004+0000","last_fullsized":"2024-09-13T18:48:51.610004+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-13T18:48:51.609765+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-13T18:48:51.609765+0000","last_clean_scrub_stamp":"2024-09-13T18:48:51.609765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:20.836871+0000","scrub_duration":0.0033878139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"64'1","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.585618+0000","last_change":"2024-09-13T18:47:42.585618+0000","last_active":"2024-09-13T18:47:42.585618+0000","last_peered":"2024-09-13T18:47:42.585618+0000","last_clean":"2024-09-13T18:47:42.585618+0000","last_became_active":"2024-09-13T18:46:41.315295+0000","last_became_peered":"2024-09-13T18:46:41.315295+0000","last_unstale":"2024-09-13T18:47:42.585618+0000","last_undegraded":"2024-09-13T18:47:42.585618+0000","last_fullsized":"2024-09-13T18:47:42.585618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:47:42.585429+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.585429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:06.282715+0000","scrub_duration":0.002930406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.504637+0000","last_change":"2024-09-13T18:48:05.504637+0000","last_active":"2024-09-13T18:48:05.504637+0000","last_peered":"2024-09-13T18:48:05.504637+0000","last_clean":"2024-09-13T18:48:05.504637+0000","last_became_active":"2024-09-13T18:46:17.878620+0000","last_became_peered":"2024-09-13T18:46:17.878620+0000","last_unstale":"2024-09-13T18:48:05.504637+0000","last_undegraded":"2024-09-13T18:48:05.504637+0000","last_fullsized":"2024-09-13T18:48:05.504637+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:05.504260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:05.504260+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.504260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:59.575884+0000","scrub_duration":0.0039666019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.447529+0000","last_change":"2024-09-13T18:48:21.447529+0000","last_active":"2024-09-13T18:48:21.447529+0000","last_peered":"2024-09-13T18:48:21.447529+0000","last_clean":"2024-09-13T18:48:21.447529+0000","last_became_active":"2024-09-13T18:46:41.331796+0000","last_became_peered":"2024-09-13T18:46:41.331796+0000","last_unstale":"2024-09-13T18:48:21.447529+0000","last_undegraded":"2024-09-13T18:48:21.447529+0000","last_fullsized":"2024-09-13T18:48:21.447529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:21.447243+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:21.447243+0000","last_clean_scrub_stamp":"2024-09-13T18:48:21.447243+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:48.133724+0000","scrub_duration":0.0032702880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.445887+0000","last_change":"2024-09-13T18:47:58.446093+0000","last_active":"2024-09-13T18:47:58.445887+0000","last_peered":"2024-09-13T18:47:58.445887+0000","last_clean":"2024-09-13T18:47:58.445887+0000","last_became_active":"2024-09-13T18:45:00.860013+0000","last_became_peered":"2024-09-13T18:45:00.860013+0000","last_unstale":"2024-09-13T18:47:58.445887+0000","last_undegraded":"2024-09-13T18:47:58.445887+0000","last_fullsized":"2024-09-13T18:47:58.445887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:58.445838+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.445838+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:59.858545+0000","scrub_duration":0.0076105000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:35.609305+0000","last_change":"2024-09-13T18:48:35.609475+0000","last_active":"2024-09-13T18:48:35.609305+0000","last_peered":"2024-09-13T18:48:35.609305+0000","last_clean":"2024-09-13T18:48:35.609305+0000","last_became_active":"2024-09-13T18:46:41.336066+0000","last_became_peered":"2024-09-13T18:46:41.336066+0000","last_unstale":"2024-09-13T18:48:35.609305+0000","last_undegraded":"2024-09-13T18:48:35.609305+0000","last_fullsized":"2024-09-13T18:48:35.609305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:35.609268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:35.609268+0000","last_clean_scrub_stamp":"2024-09-13T18:48:35.609268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:28.183086+0000","scrub_duration":0.0037434999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:55.574729+0000","last_change":"2024-09-13T18:47:55.574935+0000","last_active":"2024-09-13T18:47:55.574729+0000","last_peered":"2024-09-13T18:47:55.574729+0000","last_clean":"2024-09-13T18:47:55.574729+0000","last_became_active":"2024-09-13T18:47:14.648414+0000","last_became_peered":"2024-09-13T18:47:14.648414+0000","last_unstale":"2024-09-13T18:47:55.574729+0000","last_undegraded":"2024-09-13T18:47:55.574729+0000","last_fullsized":"2024-09-13T18:47:55.574729+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:55.574683+0000","last_clean_scrub_stamp":"2024-09-13T18:47:55.574683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:25.940388+0000","scrub_duration":0.0033516209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:42.985117+0000","last_change":"2024-09-13T18:47:42.985266+0000","last_active":"2024-09-13T18:47:42.985117+0000","last_peered":"2024-09-13T18:47:42.985117+0000","last_clean":"2024-09-13T18:47:42.985117+0000","last_became_active":"2024-09-13T18:45:00.845502+0000","last_became_peered":"2024-09-13T18:45:00.845502+0000","last_unstale":"2024-09-13T18:47:42.985117+0000","last_undegraded":"2024-09-13T18:47:42.985117+0000","last_fullsized":"2024-09-13T18:47:42.985117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'29","last_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_deep_scrub":"81'29","last_deep_scrub_stamp":"2024-09-13T18:47:42.985080+0000","last_clean_scrub_stamp":"2024-09-13T18:47:42.985080+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:03.523374+0000","scrub_duration":0.0074139399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'3","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:21.371527+0000","last_change":"2024-09-13T18:48:21.371872+0000","last_active":"2024-09-13T18:48:21.371527+0000","last_peered":"2024-09-13T18:48:21.371527+0000","last_clean":"2024-09-13T18:48:21.371527+0000","last_became_active":"2024-09-13T18:46:41.324776+0000","last_became_peered":"2024-09-13T18:46:41.324776+0000","last_unstale":"2024-09-13T18:48:21.371527+0000","last_undegraded":"2024-09-13T18:48:21.371527+0000","last_fullsized":"2024-09-13T18:48:21.371527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'3","last_scrub_stamp":"2024-09-13T18:48:21.371462+0000","last_deep_scrub":"64'3","last_deep_scrub_stamp":"2024-09-13T18:48:21.371462+0000","last_clean_scrub_stamp":"2024-09-13T18:48:21.371462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:27.227188+0000","scrub_duration":0.0037063980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:49.687618+0000","last_change":"2024-09-13T18:48:49.687618+0000","last_active":"2024-09-13T18:48:49.687618+0000","last_peered":"2024-09-13T18:48:49.687618+0000","last_clean":"2024-09-13T18:48:49.687618+0000","last_became_active":"2024-09-13T18:46:41.328746+0000","last_became_peered":"2024-09-13T18:46:41.328746+0000","last_unstale":"2024-09-13T18:48:49.687618+0000","last_undegraded":"2024-09-13T18:48:49.687618+0000","last_fullsized":"2024-09-13T18:48:49.687618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:49.687356+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:49.687356+0000","last_clean_scrub_stamp":"2024-09-13T18:48:49.687356+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:27.792647+0000","scrub_duration":0.0033596120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.324050+0000","last_change":"2024-09-13T18:47:51.324261+0000","last_active":"2024-09-13T18:47:51.324050+0000","last_peered":"2024-09-13T18:47:51.324050+0000","last_clean":"2024-09-13T18:47:51.324050+0000","last_became_active":"2024-09-13T18:45:00.845968+0000","last_became_peered":"2024-09-13T18:45:00.845968+0000","last_unstale":"2024-09-13T18:47:51.324050+0000","last_undegraded":"2024-09-13T18:47:51.324050+0000","last_fullsized":"2024-09-13T18:47:51.324050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:51.323994+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.323994+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:47.717548+0000","scrub_duration":0.0067899620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:05.974074+0000","last_change":"2024-09-13T18:48:05.974304+0000","last_active":"2024-09-13T18:48:05.974074+0000","last_peered":"2024-09-13T18:48:05.974074+0000","last_clean":"2024-09-13T18:48:05.974074+0000","last_became_active":"2024-09-13T18:46:41.333878+0000","last_became_peered":"2024-09-13T18:46:41.333878+0000","last_unstale":"2024-09-13T18:48:05.974074+0000","last_undegraded":"2024-09-13T18:48:05.974074+0000","last_fullsized":"2024-09-13T18:48:05.974074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:05.974038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:05.974038+0000","last_clean_scrub_stamp":"2024-09-13T18:48:05.974038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:54.593726+0000","scrub_duration":0.0042173189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:58.327704+0000","last_change":"2024-09-13T18:47:58.327922+0000","last_active":"2024-09-13T18:47:58.327704+0000","last_peered":"2024-09-13T18:47:58.327704+0000","last_clean":"2024-09-13T18:47:58.327704+0000","last_became_active":"2024-09-13T18:46:41.331848+0000","last_became_peered":"2024-09-13T18:46:41.331848+0000","last_unstale":"2024-09-13T18:47:58.327704+0000","last_undegraded":"2024-09-13T18:47:58.327704+0000","last_fullsized":"2024-09-13T18:47:58.327704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:58.327652+0000","last_clean_scrub_stamp":"2024-09-13T18:47:58.327652+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:28.029362+0000","scrub_duration":0.0034717400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.610385+0000","last_change":"2024-09-13T18:47:45.610603+0000","last_active":"2024-09-13T18:47:45.610385+0000","last_peered":"2024-09-13T18:47:45.610385+0000","last_clean":"2024-09-13T18:47:45.610385+0000","last_became_active":"2024-09-13T18:45:00.855402+0000","last_became_peered":"2024-09-13T18:45:00.855402+0000","last_unstale":"2024-09-13T18:47:45.610385+0000","last_undegraded":"2024-09-13T18:47:45.610385+0000","last_fullsized":"2024-09-13T18:47:45.610385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:45.610340+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.610340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:52.239335+0000","scrub_duration":0.003118698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.342009+0000","last_change":"2024-09-13T18:48:12.342312+0000","last_active":"2024-09-13T18:48:12.342009+0000","last_peered":"2024-09-13T18:48:12.342009+0000","last_clean":"2024-09-13T18:48:12.342009+0000","last_became_active":"2024-09-13T18:46:41.322329+0000","last_became_peered":"2024-09-13T18:46:41.322329+0000","last_unstale":"2024-09-13T18:48:12.342009+0000","last_undegraded":"2024-09-13T18:48:12.342009+0000","last_fullsized":"2024-09-13T18:48:12.342009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:12.341957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:12.341957+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.341957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:32.100030+0000","scrub_duration":0.0041679810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:00.018241+0000","last_change":"2024-09-13T18:48:00.018459+0000","last_active":"2024-09-13T18:48:00.018241+0000","last_peered":"2024-09-13T18:48:00.018241+0000","last_clean":"2024-09-13T18:48:00.018241+0000","last_became_active":"2024-09-13T18:46:41.333761+0000","last_became_peered":"2024-09-13T18:46:41.333761+0000","last_unstale":"2024-09-13T18:48:00.018241+0000","last_undegraded":"2024-09-13T18:48:00.018241+0000","last_fullsized":"2024-09-13T18:48:00.018241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:00.018191+0000","last_clean_scrub_stamp":"2024-09-13T18:48:00.018191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:44.339756+0000","scrub_duration":0.0031160409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"64'1","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.414358+0000","last_change":"2024-09-13T18:48:02.414512+0000","last_active":"2024-09-13T18:48:02.414358+0000","last_peered":"2024-09-13T18:48:02.414358+0000","last_clean":"2024-09-13T18:48:02.414358+0000","last_became_active":"2024-09-13T18:45:00.860467+0000","last_became_peered":"2024-09-13T18:45:00.860467+0000","last_unstale":"2024-09-13T18:48:02.414358+0000","last_undegraded":"2024-09-13T18:48:02.414358+0000","last_fullsized":"2024-09-13T18:48:02.414358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'1","last_scrub_stamp":"2024-09-13T18:48:02.414323+0000","last_deep_scrub":"64'1","last_deep_scrub_stamp":"2024-09-13T18:48:02.414323+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.414323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:32.607454+0000","scrub_duration":0.0032787039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:29.341629+0000","last_change":"2024-09-13T18:48:29.341889+0000","last_active":"2024-09-13T18:48:29.341629+0000","last_peered":"2024-09-13T18:48:29.341629+0000","last_clean":"2024-09-13T18:48:29.341629+0000","last_became_active":"2024-09-13T18:46:41.324763+0000","last_became_peered":"2024-09-13T18:46:41.324763+0000","last_unstale":"2024-09-13T18:48:29.341629+0000","last_undegraded":"2024-09-13T18:48:29.341629+0000","last_fullsized":"2024-09-13T18:48:29.341629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:29.341576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:29.341576+0000","last_clean_scrub_stamp":"2024-09-13T18:48:29.341576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.665289+0000","scrub_duration":0.003896544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:26.428215+0000","last_change":"2024-09-13T18:48:26.428480+0000","last_active":"2024-09-13T18:48:26.428215+0000","last_peered":"2024-09-13T18:48:26.428215+0000","last_clean":"2024-09-13T18:48:26.428215+0000","last_became_active":"2024-09-13T18:46:41.324658+0000","last_became_peered":"2024-09-13T18:46:41.324658+0000","last_unstale":"2024-09-13T18:48:26.428215+0000","last_undegraded":"2024-09-13T18:48:26.428215+0000","last_fullsized":"2024-09-13T18:48:26.428215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:26.428163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:26.428163+0000","last_clean_scrub_stamp":"2024-09-13T18:48:26.428163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:39.295285+0000","scrub_duration":0.0039464529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.216158+0000","last_change":"2024-09-13T18:47:50.216463+0000","last_active":"2024-09-13T18:47:50.216158+0000","last_peered":"2024-09-13T18:47:50.216158+0000","last_clean":"2024-09-13T18:47:50.216158+0000","last_became_active":"2024-09-13T18:45:01.326192+0000","last_became_peered":"2024-09-13T18:45:01.326192+0000","last_unstale":"2024-09-13T18:47:50.216158+0000","last_undegraded":"2024-09-13T18:47:50.216158+0000","last_fullsized":"2024-09-13T18:47:50.216158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:50.216108+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.216108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:45.291203+0000","scrub_duration":0.0033895930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:56.366654+0000","last_change":"2024-09-13T18:47:56.366764+0000","last_active":"2024-09-13T18:47:56.366654+0000","last_peered":"2024-09-13T18:47:56.366654+0000","last_clean":"2024-09-13T18:47:56.366654+0000","last_became_active":"2024-09-13T18:46:41.341678+0000","last_became_peered":"2024-09-13T18:46:41.341678+0000","last_unstale":"2024-09-13T18:47:56.366654+0000","last_undegraded":"2024-09-13T18:47:56.366654+0000","last_fullsized":"2024-09-13T18:47:56.366654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:56.366630+0000","last_clean_scrub_stamp":"2024-09-13T18:47:56.366630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:44.072446+0000","scrub_duration":0.0021094109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:31.580905+0000","last_change":"2024-09-13T18:48:31.580905+0000","last_active":"2024-09-13T18:48:31.580905+0000","last_peered":"2024-09-13T18:48:31.580905+0000","last_clean":"2024-09-13T18:48:31.580905+0000","last_became_active":"2024-09-13T18:46:41.339014+0000","last_became_peered":"2024-09-13T18:46:41.339014+0000","last_unstale":"2024-09-13T18:48:31.580905+0000","last_undegraded":"2024-09-13T18:48:31.580905+0000","last_fullsized":"2024-09-13T18:48:31.580905+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:31.580666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:31.580666+0000","last_clean_scrub_stamp":"2024-09-13T18:48:31.580666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:50.804717+0000","scrub_duration":0.0036818720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.263795+0000","last_change":"2024-09-13T18:48:02.264013+0000","last_active":"2024-09-13T18:48:02.263795+0000","last_peered":"2024-09-13T18:48:02.263795+0000","last_clean":"2024-09-13T18:48:02.263795+0000","last_became_active":"2024-09-13T18:46:17.877680+0000","last_became_peered":"2024-09-13T18:46:17.877680+0000","last_unstale":"2024-09-13T18:48:02.263795+0000","last_undegraded":"2024-09-13T18:48:02.263795+0000","last_fullsized":"2024-09-13T18:48:02.263795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:02.263745+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:02.263745+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.263745+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:36.178805+0000","scrub_duration":0.0030334060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:51.387734+0000","last_change":"2024-09-13T18:47:51.387734+0000","last_active":"2024-09-13T18:47:51.387734+0000","last_peered":"2024-09-13T18:47:51.387734+0000","last_clean":"2024-09-13T18:47:51.387734+0000","last_became_active":"2024-09-13T18:46:17.870333+0000","last_became_peered":"2024-09-13T18:46:17.870333+0000","last_unstale":"2024-09-13T18:47:51.387734+0000","last_undegraded":"2024-09-13T18:47:51.387734+0000","last_fullsized":"2024-09-13T18:47:51.387734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:51.387457+0000","last_clean_scrub_stamp":"2024-09-13T18:47:51.387457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:25.705238+0000","scrub_duration":0.0035199530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.469046+0000","last_change":"2024-09-13T18:48:07.469270+0000","last_active":"2024-09-13T18:48:07.469046+0000","last_peered":"2024-09-13T18:48:07.469046+0000","last_clean":"2024-09-13T18:48:07.469046+0000","last_became_active":"2024-09-13T18:46:41.333663+0000","last_became_peered":"2024-09-13T18:46:41.333663+0000","last_unstale":"2024-09-13T18:48:07.469046+0000","last_undegraded":"2024-09-13T18:48:07.469046+0000","last_fullsized":"2024-09-13T18:48:07.469046+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:48:07.469001+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:48:07.469001+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.469001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:15.308587+0000","scrub_duration":0.0033549579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.369829+0000","last_change":"2024-09-13T18:48:08.370025+0000","last_active":"2024-09-13T18:48:08.369829+0000","last_peered":"2024-09-13T18:48:08.369829+0000","last_clean":"2024-09-13T18:48:08.369829+0000","last_became_active":"2024-09-13T18:45:01.344924+0000","last_became_peered":"2024-09-13T18:45:01.344924+0000","last_unstale":"2024-09-13T18:48:08.369829+0000","last_undegraded":"2024-09-13T18:48:08.369829+0000","last_fullsized":"2024-09-13T18:48:08.369829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:08.369773+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:08.369773+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.369773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:53.502092+0000","scrub_duration":0.0039096199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:20.336525+0000","last_change":"2024-09-13T18:48:20.336806+0000","last_active":"2024-09-13T18:48:20.336525+0000","last_peered":"2024-09-13T18:48:20.336525+0000","last_clean":"2024-09-13T18:48:20.336525+0000","last_became_active":"2024-09-13T18:46:17.886871+0000","last_became_peered":"2024-09-13T18:46:17.886871+0000","last_unstale":"2024-09-13T18:48:20.336525+0000","last_undegraded":"2024-09-13T18:48:20.336525+0000","last_fullsized":"2024-09-13T18:48:20.336525+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:20.336467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:20.336467+0000","last_clean_scrub_stamp":"2024-09-13T18:48:20.336467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:20.853442+0000","scrub_duration":0.0033162529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:50.182656+0000","last_change":"2024-09-13T18:47:50.182974+0000","last_active":"2024-09-13T18:47:50.182656+0000","last_peered":"2024-09-13T18:47:50.182656+0000","last_clean":"2024-09-13T18:47:50.182656+0000","last_became_active":"2024-09-13T18:46:17.891840+0000","last_became_peered":"2024-09-13T18:46:17.891840+0000","last_unstale":"2024-09-13T18:47:50.182656+0000","last_undegraded":"2024-09-13T18:47:50.182656+0000","last_fullsized":"2024-09-13T18:47:50.182656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-13T18:47:50.182599+0000","last_clean_scrub_stamp":"2024-09-13T18:47:50.182599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:16.387371+0000","scrub_duration":0.003287786,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.388376+0000","last_change":"2024-09-13T18:48:10.388592+0000","last_active":"2024-09-13T18:48:10.388376+0000","last_peered":"2024-09-13T18:48:10.388376+0000","last_clean":"2024-09-13T18:48:10.388376+0000","last_became_active":"2024-09-13T18:45:01.324141+0000","last_became_peered":"2024-09-13T18:45:01.324141+0000","last_unstale":"2024-09-13T18:48:10.388376+0000","last_undegraded":"2024-09-13T18:48:10.388376+0000","last_fullsized":"2024-09-13T18:48:10.388376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:10.388326+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:10.388326+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.388326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:31.106755+0000","scrub_duration":0.0033930879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:15.414682+0000","last_change":"2024-09-13T18:48:15.415003+0000","last_active":"2024-09-13T18:48:15.414682+0000","last_peered":"2024-09-13T18:48:15.414682+0000","last_clean":"2024-09-13T18:48:15.414682+0000","last_became_active":"2024-09-13T18:45:05.368486+0000","last_became_peered":"2024-09-13T18:45:05.368486+0000","last_unstale":"2024-09-13T18:48:15.414682+0000","last_undegraded":"2024-09-13T18:48:15.414682+0000","last_fullsized":"2024-09-13T18:48:15.414682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:15.414635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:15.414635+0000","last_clean_scrub_stamp":"2024-09-13T18:48:15.414635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:31.574931+0000","scrub_duration":0.0049695829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.051036+0000","last_change":"2024-09-13T18:47:45.051211+0000","last_active":"2024-09-13T18:47:45.051036+0000","last_peered":"2024-09-13T18:47:45.051036+0000","last_clean":"2024-09-13T18:47:45.051036+0000","last_became_active":"2024-09-13T18:46:17.875126+0000","last_became_peered":"2024-09-13T18:46:17.875126+0000","last_unstale":"2024-09-13T18:47:45.051036+0000","last_undegraded":"2024-09-13T18:47:45.051036+0000","last_fullsized":"2024-09-13T18:47:45.051036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:45.050997+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.050997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:29.820112+0000","scrub_duration":0.002900452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.264766+0000","last_change":"2024-09-13T18:48:07.264959+0000","last_active":"2024-09-13T18:48:07.264766+0000","last_peered":"2024-09-13T18:48:07.264766+0000","last_clean":"2024-09-13T18:48:07.264766+0000","last_became_active":"2024-09-13T18:45:01.326098+0000","last_became_peered":"2024-09-13T18:45:01.326098+0000","last_unstale":"2024-09-13T18:48:07.264766+0000","last_undegraded":"2024-09-13T18:48:07.264766+0000","last_fullsized":"2024-09-13T18:48:07.264766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-13T18:48:07.264719+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-13T18:48:07.264719+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.264719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:23.565222+0000","scrub_duration":0.003409207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:02.378193+0000","last_change":"2024-09-13T18:48:02.378193+0000","last_active":"2024-09-13T18:48:02.378193+0000","last_peered":"2024-09-13T18:48:02.378193+0000","last_clean":"2024-09-13T18:48:02.378193+0000","last_became_active":"2024-09-13T18:46:41.331007+0000","last_became_peered":"2024-09-13T18:46:41.331007+0000","last_unstale":"2024-09-13T18:48:02.378193+0000","last_undegraded":"2024-09-13T18:48:02.378193+0000","last_fullsized":"2024-09-13T18:48:02.378193+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:02.377931+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:02.377931+0000","last_clean_scrub_stamp":"2024-09-13T18:48:02.377931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:12.494537+0000","scrub_duration":0.0034649160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:04.306492+0000","last_change":"2024-09-13T18:48:04.306747+0000","last_active":"2024-09-13T18:48:04.306492+0000","last_peered":"2024-09-13T18:48:04.306492+0000","last_clean":"2024-09-13T18:48:04.306492+0000","last_became_active":"2024-09-13T18:45:01.329284+0000","last_became_peered":"2024-09-13T18:45:01.329284+0000","last_unstale":"2024-09-13T18:48:04.306492+0000","last_undegraded":"2024-09-13T18:48:04.306492+0000","last_fullsized":"2024-09-13T18:48:04.306492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:04.306444+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:04.306444+0000","last_clean_scrub_stamp":"2024-09-13T18:48:04.306444+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:35.956818+0000","scrub_duration":0.0034513159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:23.480140+0000","last_change":"2024-09-13T18:48:23.480140+0000","last_active":"2024-09-13T18:48:23.480140+0000","last_peered":"2024-09-13T18:48:23.480140+0000","last_clean":"2024-09-13T18:48:23.480140+0000","last_became_active":"2024-09-13T18:46:17.875630+0000","last_became_peered":"2024-09-13T18:46:17.875630+0000","last_unstale":"2024-09-13T18:48:23.480140+0000","last_undegraded":"2024-09-13T18:48:23.480140+0000","last_fullsized":"2024-09-13T18:48:23.480140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:23.479886+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:23.479886+0000","last_clean_scrub_stamp":"2024-09-13T18:48:23.479886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:46.217936+0000","scrub_duration":0.0035382450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.503627+0000","last_change":"2024-09-13T18:48:19.503627+0000","last_active":"2024-09-13T18:48:19.503627+0000","last_peered":"2024-09-13T18:48:19.503627+0000","last_clean":"2024-09-13T18:48:19.503627+0000","last_became_active":"2024-09-13T18:46:17.871043+0000","last_became_peered":"2024-09-13T18:46:17.871043+0000","last_unstale":"2024-09-13T18:48:19.503627+0000","last_undegraded":"2024-09-13T18:48:19.503627+0000","last_fullsized":"2024-09-13T18:48:19.503627+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:19.503350+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:19.503350+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.503350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:10.912704+0000","scrub_duration":0.003191176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:01.039013+0000","last_change":"2024-09-13T18:48:01.039156+0000","last_active":"2024-09-13T18:48:01.039013+0000","last_peered":"2024-09-13T18:48:01.039013+0000","last_clean":"2024-09-13T18:48:01.039013+0000","last_became_active":"2024-09-13T18:46:41.347231+0000","last_became_peered":"2024-09-13T18:46:41.347231+0000","last_unstale":"2024-09-13T18:48:01.039013+0000","last_undegraded":"2024-09-13T18:48:01.039013+0000","last_fullsized":"2024-09-13T18:48:01.039013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-13T18:48:01.038975+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-13T18:48:01.038975+0000","last_clean_scrub_stamp":"2024-09-13T18:48:01.038975+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:45.129654+0000","scrub_duration":0.0050254219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:07.265232+0000","last_change":"2024-09-13T18:48:07.265466+0000","last_active":"2024-09-13T18:48:07.265232+0000","last_peered":"2024-09-13T18:48:07.265232+0000","last_clean":"2024-09-13T18:48:07.265232+0000","last_became_active":"2024-09-13T18:45:01.339163+0000","last_became_peered":"2024-09-13T18:45:01.339163+0000","last_unstale":"2024-09-13T18:48:07.265232+0000","last_undegraded":"2024-09-13T18:48:07.265232+0000","last_fullsized":"2024-09-13T18:48:07.265232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-13T18:48:07.265153+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-13T18:48:07.265153+0000","last_clean_scrub_stamp":"2024-09-13T18:48:07.265153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:01.884698+0000","scrub_duration":0.0034868730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:11.490789+0000","last_change":"2024-09-13T18:48:11.490789+0000","last_active":"2024-09-13T18:48:11.490789+0000","last_peered":"2024-09-13T18:48:11.490789+0000","last_clean":"2024-09-13T18:48:11.490789+0000","last_became_active":"2024-09-13T18:46:41.330739+0000","last_became_peered":"2024-09-13T18:46:41.330739+0000","last_unstale":"2024-09-13T18:48:11.490789+0000","last_undegraded":"2024-09-13T18:48:11.490789+0000","last_fullsized":"2024-09-13T18:48:11.490789+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:11.490538+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:11.490538+0000","last_clean_scrub_stamp":"2024-09-13T18:48:11.490538+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:35.858696+0000","scrub_duration":0.0038395500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:45.061803+0000","last_change":"2024-09-13T18:47:45.062044+0000","last_active":"2024-09-13T18:47:45.061803+0000","last_peered":"2024-09-13T18:47:45.061803+0000","last_clean":"2024-09-13T18:47:45.061803+0000","last_became_active":"2024-09-13T18:45:01.327811+0000","last_became_peered":"2024-09-13T18:45:01.327811+0000","last_unstale":"2024-09-13T18:47:45.061803+0000","last_undegraded":"2024-09-13T18:47:45.061803+0000","last_fullsized":"2024-09-13T18:47:45.061803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:45.061720+0000","last_clean_scrub_stamp":"2024-09-13T18:47:45.061720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:57.256752+0000","scrub_duration":0.0031242209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:14.418863+0000","last_change":"2024-09-13T18:48:14.419173+0000","last_active":"2024-09-13T18:48:14.418863+0000","last_peered":"2024-09-13T18:48:14.418863+0000","last_clean":"2024-09-13T18:48:14.418863+0000","last_became_active":"2024-09-13T18:45:01.338760+0000","last_became_peered":"2024-09-13T18:45:01.338760+0000","last_unstale":"2024-09-13T18:48:14.418863+0000","last_undegraded":"2024-09-13T18:48:14.418863+0000","last_fullsized":"2024-09-13T18:48:14.418863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:14.418765+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:14.418765+0000","last_clean_scrub_stamp":"2024-09-13T18:48:14.418765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:46.627229+0000","scrub_duration":0.0042173879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.337521+0000","last_change":"2024-09-13T18:48:12.337765+0000","last_active":"2024-09-13T18:48:12.337521+0000","last_peered":"2024-09-13T18:48:12.337521+0000","last_clean":"2024-09-13T18:48:12.337521+0000","last_became_active":"2024-09-13T18:45:01.334065+0000","last_became_peered":"2024-09-13T18:45:01.334065+0000","last_unstale":"2024-09-13T18:48:12.337521+0000","last_undegraded":"2024-09-13T18:48:12.337521+0000","last_fullsized":"2024-09-13T18:48:12.337521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:12.337472+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:12.337472+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.337472+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:41.399961+0000","scrub_duration":0.0036942479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.605617+0000","last_change":"2024-09-13T18:48:18.605993+0000","last_active":"2024-09-13T18:48:18.605617+0000","last_peered":"2024-09-13T18:48:18.605617+0000","last_clean":"2024-09-13T18:48:18.605617+0000","last_became_active":"2024-09-13T18:47:14.525534+0000","last_became_peered":"2024-09-13T18:47:14.525534+0000","last_unstale":"2024-09-13T18:48:18.605617+0000","last_undegraded":"2024-09-13T18:48:18.605617+0000","last_fullsized":"2024-09-13T18:48:18.605617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:18.605565+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:18.605565+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.605565+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:29.357925+0000","scrub_duration":0.003275994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:24.429759+0000","last_change":"2024-09-13T18:48:24.429759+0000","last_active":"2024-09-13T18:48:24.429759+0000","last_peered":"2024-09-13T18:48:24.429759+0000","last_clean":"2024-09-13T18:48:24.429759+0000","last_became_active":"2024-09-13T18:46:41.332315+0000","last_became_peered":"2024-09-13T18:46:41.332315+0000","last_unstale":"2024-09-13T18:48:24.429759+0000","last_undegraded":"2024-09-13T18:48:24.429759+0000","last_fullsized":"2024-09-13T18:48:24.429759+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:24.429529+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:24.429529+0000","last_clean_scrub_stamp":"2024-09-13T18:48:24.429529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:01.724113+0000","scrub_duration":0.0037295129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.271885+0000","last_change":"2024-09-13T18:48:08.272117+0000","last_active":"2024-09-13T18:48:08.271885+0000","last_peered":"2024-09-13T18:48:08.271885+0000","last_clean":"2024-09-13T18:48:08.271885+0000","last_became_active":"2024-09-13T18:45:01.329103+0000","last_became_peered":"2024-09-13T18:45:01.329103+0000","last_unstale":"2024-09-13T18:48:08.271885+0000","last_undegraded":"2024-09-13T18:48:08.271885+0000","last_fullsized":"2024-09-13T18:48:08.271885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:48:08.271828+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:48:08.271828+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.271828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:47.037826+0000","scrub_duration":0.0036946520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:40.755044+0000","last_change":"2024-09-13T18:48:40.755044+0000","last_active":"2024-09-13T18:48:40.755044+0000","last_peered":"2024-09-13T18:48:40.755044+0000","last_clean":"2024-09-13T18:48:40.755044+0000","last_became_active":"2024-09-13T18:46:41.334831+0000","last_became_peered":"2024-09-13T18:46:41.334831+0000","last_unstale":"2024-09-13T18:48:40.755044+0000","last_undegraded":"2024-09-13T18:48:40.755044+0000","last_fullsized":"2024-09-13T18:48:40.755044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:40.754784+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:40.754784+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.754784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:53.718152+0000","scrub_duration":0.0037398039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:47.562108+0000","last_change":"2024-09-13T18:47:47.562108+0000","last_active":"2024-09-13T18:47:47.562108+0000","last_peered":"2024-09-13T18:47:47.562108+0000","last_clean":"2024-09-13T18:47:47.562108+0000","last_became_active":"2024-09-13T18:46:41.342339+0000","last_became_peered":"2024-09-13T18:46:41.342339+0000","last_unstale":"2024-09-13T18:47:47.562108+0000","last_undegraded":"2024-09-13T18:47:47.562108+0000","last_fullsized":"2024-09-13T18:47:47.562108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:47:47.561735+0000","last_clean_scrub_stamp":"2024-09-13T18:47:47.561735+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:10.120901+0000","scrub_duration":0.0037975349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.286758+0000","last_change":"2024-09-13T18:48:08.287051+0000","last_active":"2024-09-13T18:48:08.286758+0000","last_peered":"2024-09-13T18:48:08.286758+0000","last_clean":"2024-09-13T18:48:08.286758+0000","last_became_active":"2024-09-13T18:45:01.337203+0000","last_became_peered":"2024-09-13T18:45:01.337203+0000","last_unstale":"2024-09-13T18:48:08.286758+0000","last_undegraded":"2024-09-13T18:48:08.286758+0000","last_fullsized":"2024-09-13T18:48:08.286758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:08.286639+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:08.286639+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.286639+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:11.439457+0000","scrub_duration":0.0035090690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:49.424537+0000","last_change":"2024-09-13T18:47:49.424537+0000","last_active":"2024-09-13T18:47:49.424537+0000","last_peered":"2024-09-13T18:47:49.424537+0000","last_clean":"2024-09-13T18:47:49.424537+0000","last_became_active":"2024-09-13T18:46:17.879063+0000","last_became_peered":"2024-09-13T18:46:17.879063+0000","last_unstale":"2024-09-13T18:47:49.424537+0000","last_undegraded":"2024-09-13T18:47:49.424537+0000","last_fullsized":"2024-09-13T18:47:49.424537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:49.424264+0000","last_clean_scrub_stamp":"2024-09-13T18:47:49.424264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:14.286009+0000","scrub_duration":0.00282059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:54.465116+0000","last_change":"2024-09-13T18:47:54.465116+0000","last_active":"2024-09-13T18:47:54.465116+0000","last_peered":"2024-09-13T18:47:54.465116+0000","last_clean":"2024-09-13T18:47:54.465116+0000","last_became_active":"2024-09-13T18:46:17.870171+0000","last_became_peered":"2024-09-13T18:46:17.870171+0000","last_unstale":"2024-09-13T18:47:54.465116+0000","last_undegraded":"2024-09-13T18:47:54.465116+0000","last_fullsized":"2024-09-13T18:47:54.465116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-13T18:47:54.464839+0000","last_clean_scrub_stamp":"2024-09-13T18:47:54.464839+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:40.461015+0000","scrub_duration":0.0036862280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:19.600237+0000","last_change":"2024-09-13T18:48:19.600433+0000","last_active":"2024-09-13T18:48:19.600237+0000","last_peered":"2024-09-13T18:48:19.600237+0000","last_clean":"2024-09-13T18:48:19.600237+0000","last_became_active":"2024-09-13T18:47:14.525226+0000","last_became_peered":"2024-09-13T18:47:14.525226+0000","last_unstale":"2024-09-13T18:48:19.600237+0000","last_undegraded":"2024-09-13T18:48:19.600237+0000","last_fullsized":"2024-09-13T18:48:19.600237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:19.600199+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:19.600199+0000","last_clean_scrub_stamp":"2024-09-13T18:48:19.600199+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.889071+0000","scrub_duration":0.0034096209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:13.707104+0000","last_change":"2024-09-13T18:48:13.707330+0000","last_active":"2024-09-13T18:48:13.707104+0000","last_peered":"2024-09-13T18:48:13.707104+0000","last_clean":"2024-09-13T18:48:13.707104+0000","last_became_active":"2024-09-13T18:47:14.654194+0000","last_became_peered":"2024-09-13T18:47:14.654194+0000","last_unstale":"2024-09-13T18:48:13.707104+0000","last_undegraded":"2024-09-13T18:48:13.707104+0000","last_fullsized":"2024-09-13T18:48:13.707104+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:48:13.707051+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:48:13.707051+0000","last_clean_scrub_stamp":"2024-09-13T18:48:13.707051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:38.728586+0000","scrub_duration":0.003750878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:08.569635+0000","last_change":"2024-09-13T18:48:08.569878+0000","last_active":"2024-09-13T18:48:08.569635+0000","last_peered":"2024-09-13T18:48:08.569635+0000","last_clean":"2024-09-13T18:48:08.569635+0000","last_became_active":"2024-09-13T18:47:14.520018+0000","last_became_peered":"2024-09-13T18:47:14.520018+0000","last_unstale":"2024-09-13T18:48:08.569635+0000","last_undegraded":"2024-09-13T18:48:08.569635+0000","last_fullsized":"2024-09-13T18:48:08.569635+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-13T18:48:08.569584+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-13T18:48:08.569584+0000","last_clean_scrub_stamp":"2024-09-13T18:48:08.569584+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:32.966173+0000","scrub_duration":0.0033504580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.382405+0000","last_change":"2024-09-13T18:48:17.382543+0000","last_active":"2024-09-13T18:48:17.382405+0000","last_peered":"2024-09-13T18:48:17.382405+0000","last_clean":"2024-09-13T18:48:17.382405+0000","last_became_active":"2024-09-13T18:46:41.326118+0000","last_became_peered":"2024-09-13T18:46:41.326118+0000","last_unstale":"2024-09-13T18:48:17.382405+0000","last_undegraded":"2024-09-13T18:48:17.382405+0000","last_fullsized":"2024-09-13T18:48:17.382405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-13T18:48:17.382376+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-13T18:48:17.382376+0000","last_clean_scrub_stamp":"2024-09-13T18:48:17.382376+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:50.307359+0000","scrub_duration":0.0021748319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:10.344070+0000","last_change":"2024-09-13T18:48:10.344274+0000","last_active":"2024-09-13T18:48:10.344070+0000","last_peered":"2024-09-13T18:48:10.344070+0000","last_clean":"2024-09-13T18:48:10.344070+0000","last_became_active":"2024-09-13T18:45:01.332178+0000","last_became_peered":"2024-09-13T18:45:01.332178+0000","last_unstale":"2024-09-13T18:48:10.344070+0000","last_undegraded":"2024-09-13T18:48:10.344070+0000","last_fullsized":"2024-09-13T18:48:10.344070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-13T18:48:10.344011+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-13T18:48:10.344011+0000","last_clean_scrub_stamp":"2024-09-13T18:48:10.344011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:10.725176+0000","scrub_duration":0.0038631820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:17.396898+0000","last_change":"2024-09-13T18:48:17.396898+0000","last_active":"2024-09-13T18:48:17.396898+0000","last_peered":"2024-09-13T18:48:17.396898+0000","last_clean":"2024-09-13T18:48:17.396898+0000","last_became_active":"2024-09-13T18:45:45.660655+0000","last_became_peered":"2024-09-13T18:45:45.660655+0000","last_unstale":"2024-09-13T18:48:17.396898+0000","last_undegraded":"2024-09-13T18:48:17.396898+0000","last_fullsized":"2024-09-13T18:48:17.396898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-13T18:48:17.396643+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-13T18:48:17.396643+0000","last_clean_scrub_stamp":"2024-09-13T18:48:17.396643+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:57.359618+0000","scrub_duration":0.0033315160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.122072+0000","last_change":"2024-09-13T18:47:53.122354+0000","last_active":"2024-09-13T18:47:53.122072+0000","last_peered":"2024-09-13T18:47:53.122072+0000","last_clean":"2024-09-13T18:47:53.122072+0000","last_became_active":"2024-09-13T18:45:01.332489+0000","last_became_peered":"2024-09-13T18:45:01.332489+0000","last_unstale":"2024-09-13T18:47:53.122072+0000","last_undegraded":"2024-09-13T18:47:53.122072+0000","last_fullsized":"2024-09-13T18:47:53.122072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-13T18:47:53.122017+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.122017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:58.006765+0000","scrub_duration":0.003838228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:53.591872+0000","last_change":"2024-09-13T18:47:53.592321+0000","last_active":"2024-09-13T18:47:53.591872+0000","last_peered":"2024-09-13T18:47:53.591872+0000","last_clean":"2024-09-13T18:47:53.591872+0000","last_became_active":"2024-09-13T18:47:14.521290+0000","last_became_peered":"2024-09-13T18:47:14.521290+0000","last_unstale":"2024-09-13T18:47:53.591872+0000","last_undegraded":"2024-09-13T18:47:53.591872+0000","last_fullsized":"2024-09-13T18:47:53.591872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:47:53.591804+0000","last_clean_scrub_stamp":"2024-09-13T18:47:53.591804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:03.584134+0000","scrub_duration":0.0026496750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:47:48.038206+0000","last_change":"2024-09-13T18:47:48.038206+0000","last_active":"2024-09-13T18:47:48.038206+0000","last_peered":"2024-09-13T18:47:48.038206+0000","last_clean":"2024-09-13T18:47:48.038206+0000","last_became_active":"2024-09-13T18:45:01.327662+0000","last_became_peered":"2024-09-13T18:45:01.327662+0000","last_unstale":"2024-09-13T18:47:48.038206+0000","last_undegraded":"2024-09-13T18:47:48.038206+0000","last_fullsized":"2024-09-13T18:47:48.038206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:47:48.037918+0000","last_clean_scrub_stamp":"2024-09-13T18:47:48.037918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:34.291038+0000","scrub_duration":0.0034905460000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.396738+0000","last_change":"2024-09-13T18:48:12.396935+0000","last_active":"2024-09-13T18:48:12.396738+0000","last_peered":"2024-09-13T18:48:12.396738+0000","last_clean":"2024-09-13T18:48:12.396738+0000","last_became_active":"2024-09-13T18:45:01.327526+0000","last_became_peered":"2024-09-13T18:45:01.327526+0000","last_unstale":"2024-09-13T18:48:12.396738+0000","last_undegraded":"2024-09-13T18:48:12.396738+0000","last_fullsized":"2024-09-13T18:48:12.396738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-13T18:48:12.396677+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-13T18:48:12.396677+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.396677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:12.749724+0000","scrub_duration":0.002876043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:18.355816+0000","last_change":"2024-09-13T18:48:18.355988+0000","last_active":"2024-09-13T18:48:18.355816+0000","last_peered":"2024-09-13T18:48:18.355816+0000","last_clean":"2024-09-13T18:48:18.355816+0000","last_became_active":"2024-09-13T18:46:17.891755+0000","last_became_peered":"2024-09-13T18:46:17.891755+0000","last_unstale":"2024-09-13T18:48:18.355816+0000","last_undegraded":"2024-09-13T18:48:18.355816+0000","last_fullsized":"2024-09-13T18:48:18.355816+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-13T18:48:18.355774+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-13T18:48:18.355774+0000","last_clean_scrub_stamp":"2024-09-13T18:48:18.355774+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:31.217712+0000","scrub_duration":0.0028712759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:48:12.670022+0000","last_change":"2024-09-13T18:48:12.670192+0000","last_active":"2024-09-13T18:48:12.670022+0000","last_peered":"2024-09-13T18:48:12.670022+0000","last_clean":"2024-09-13T18:48:12.670022+0000","last_became_active":"2024-09-13T18:47:14.654831+0000","last_became_peered":"2024-09-13T18:47:14.654831+0000","last_unstale":"2024-09-13T18:48:12.670022+0000","last_undegraded":"2024-09-13T18:48:12.670022+0000","last_fullsized":"2024-09-13T18:48:12.670022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-13T18:48:12.669968+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-13T18:48:12.669968+0000","last_clean_scrub_stamp":"2024-09-13T18:48:12.669968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:35.629738+0000","scrub_duration":0.0033964870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":87,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":950272,"data_stored":484594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.95499999999999996},"min":{"1min":0.59599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.244,"5min":2.585,"15min":2.585},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.95499999999999996,"15min":1.0209999999999999},"min":{"1min":0.63500000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.2669999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.1379999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98199999999999998,"15min":1.0369999999999999},"min":{"1min":0.70999999999999996,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3759999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.145,"15min":1.133},"min":{"1min":0.80500000000000005,"5min":0.38,"15min":0.38},"max":{"1min":1.627,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.27}]},{"osd":2,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1399999999999999,"15min":1.173},"min":{"1min":0.877,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5740000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.2170000000000001,"15min":1.2509999999999999},"min":{"1min":0.83799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.8700000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.538}]},{"osd":4,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1479999999999999,"15min":1.206},"min":{"1min":0.89000000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.579,"5min":1.665,"15min":1.665},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3200000000000001,"15min":1.339},"min":{"1min":1.1040000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.7490000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.21}]},{"osd":5,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.226,"15min":1.3120000000000001},"min":{"1min":0.95399999999999996,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5029999999999999,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.391},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.3600000000000001,"15min":1.3520000000000001},"min":{"1min":1.218,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.704,"5min":2.375,"15min":2.375},"last":1.4870000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.389,"15min":1.425},"min":{"1min":0.98599999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.7929999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.296,"15min":1.3420000000000001},"min":{"1min":1.0309999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.758,"5min":2.355,"15min":2.355},"last":1.4139999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3420000000000001,"15min":1.4139999999999999},"min":{"1min":1.0960000000000001,"5min":0.627,"15min":0.627},"max":{"1min":1.5660000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.357},{"interface":"front","average":{"1min":1.397,"5min":1.367,"15min":1.4750000000000001},"min":{"1min":1.147,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.0009999999999999,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3009999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":995328,"data_stored":521813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.72599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.518,"5min":4.3390000000000004,"15min":4.3390000000000004},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0860000000000001,"15min":1.1619999999999999},"min":{"1min":0.74199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.472,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.075,"15min":1.097},"min":{"1min":0.65400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4159999999999999,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.70799999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.528,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.89200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.2430000000000001,"15min":1.329},"min":{"1min":0.86099999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6799999999999999,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.2849999999999999,"15min":1.2869999999999999},"min":{"1min":0.61299999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.7170000000000001,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":1.149}]},{"osd":4,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.2849999999999999},"min":{"1min":0.89600000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.514,"5min":4.5869999999999997,"15min":4.5869999999999997},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.2889999999999999,"15min":1.319},"min":{"1min":0.99099999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.7609999999999999,"5min":3.028,"15min":3.028},"last":1.496}]},{"osd":5,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.353,"15min":1.4299999999999999},"min":{"1min":1.0129999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8080000000000001,"5min":3.052,"15min":3.052},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.298,"15min":1.3169999999999999},"min":{"1min":0.995,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.637,"5min":4.6269999999999998,"15min":4.6269999999999998},"last":1.2549999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.351,"15min":1.385},"min":{"1min":0.95399999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.742,"5min":4.7320000000000002,"15min":4.7320000000000002},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.381,"15min":1.417},"min":{"1min":0.99299999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.728,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":1.647}]},{"osd":7,"last update":"Fri Sep 13 18:48:54 2024","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.486,"15min":1.5720000000000001},"min":{"1min":1.1930000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.776,"5min":2.9750000000000001,"15min":2.9750000000000001},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.468,"15min":1.504},"min":{"1min":1.0649999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2999999999999998,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":1.454}]}]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1544192,"data_stored":1074450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":1.05},{"interface":"front","average":{"1min":1.038,"5min":1.1319999999999999,"15min":1.1759999999999999},"min":{"1min":0.627,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5209999999999999,"5min":4.4729999999999999,"15min":4.4729999999999999},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0249999999999999,"15min":1.044},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.194,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":1.117},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1799999999999999,"15min":1.147},"min":{"1min":0.69199999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.7769999999999999,"5min":4.7409999999999997,"15min":4.7409999999999997},"last":1.411}]},{"osd":3,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1619999999999999,"15min":1.2410000000000001},"min":{"1min":0.59199999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5489999999999999,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.165,"15min":1.2170000000000001},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.7549999999999999,"5min":5.1950000000000003,"15min":5.1950000000000003},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.298,"15min":1.3560000000000001},"min":{"1min":0.77300000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6180000000000001,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.371,"15min":1.427},"min":{"1min":0.90800000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.7949999999999999,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":1.514}]},{"osd":5,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.3520000000000001,"15min":1.466},"min":{"1min":0.74099999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.4350000000000001,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.327,"5min":1.431,"15min":1.5089999999999999},"min":{"1min":0.85899999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8999999999999999,"5min":4.7869999999999999,"15min":4.7869999999999999},"last":1.597}]},{"osd":6,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.383,"15min":1.4890000000000001},"min":{"1min":0.83899999999999997,"5min":0.624,"15min":0.624},"max":{"1min":1.7190000000000001,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.681},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.488,"15min":1.625},"min":{"1min":0.871,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.8169999999999999,"5min":4.9459999999999997,"15min":4.9459999999999997},"last":1.8129999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.5269999999999999,"15min":1.6479999999999999},"min":{"1min":0.98399999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.954,"5min":5.0380000000000003,"15min":5.0380000000000003},"last":1.9510000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.5529999999999999,"15min":1.637},"min":{"1min":0.95099999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.929,"5min":4.8600000000000003,"15min":4.8600000000000003},"last":1.867}]}]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":954368,"data_stored":484068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91800000000000004,"15min":0.95599999999999996},"min":{"1min":0.55800000000000005,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.159,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.95999999999999996,"15min":1.0249999999999999},"min":{"1min":0.68700000000000006,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.472,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1200000000000001,"15min":1.1459999999999999},"min":{"1min":0.67400000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6299999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.1319999999999999,"15min":1.1659999999999999},"min":{"1min":0.88800000000000001,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6679999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4830000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.091,"15min":1.032},"min":{"1min":0.59799999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.599,"5min":4.4630000000000001,"15min":4.4630000000000001},"last":1.508},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.218,"15min":1.29},"min":{"1min":0.90200000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.629,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.5900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2490000000000001,"15min":1.3260000000000001},"min":{"1min":0.96299999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4950000000000001,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.383},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.163,"15min":1.2390000000000001},"min":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.365,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.2390000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.97299999999999998,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.577,"5min":4.4089999999999998,"15min":4.4089999999999998},"last":1.21},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.321,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6910000000000001,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":1.4410000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.212,"15min":1.268},"min":{"1min":1.0209999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4299999999999999,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3879999999999999,"15min":1.427},"min":{"1min":1.1399999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.639,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.3100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:49:00 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.361,"15min":1.4510000000000001},"min":{"1min":1.0780000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.577,"5min":2.484,"15min":2.484},"last":1.425},{"interface":"front","average":{"1min":1.319,"5min":1.3029999999999999,"15min":1.367},"min":{"1min":1.099,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.462,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.544}]}]},{"osd":7,"up_from":14,"seq":60129542198,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":484447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.016,"15min":1.0720000000000001},"min":{"1min":0.78300000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1890000000000001,"5min":2.798,"15min":2.798},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.016,"5min":1.0389999999999999,"15min":1.0840000000000001},"min":{"1min":0.73199999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3109999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.052}]},{"osd":1,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0109999999999999,"15min":1.0449999999999999},"min":{"1min":0.79800000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3460000000000001,"5min":1.419,"15min":1.419},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.99299999999999999,"15min":1.0449999999999999},"min":{"1min":0.80300000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.181,"5min":1.923,"15min":1.923},"last":1.113}]},{"osd":2,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.044,"15min":1.073},"min":{"1min":0.58799999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.206,"5min":2.593,"15min":2.593},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.84199999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.4059999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.087}]},{"osd":3,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0640000000000001,"15min":1.121},"min":{"1min":0.72099999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1739999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.099,"15min":1.143},"min":{"1min":0.85599999999999998,"5min":0.63,"15min":0.63},"max":{"1min":1.391,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.151}]},{"osd":4,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.95999999999999996,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.97399999999999998,"15min":1.0269999999999999},"min":{"1min":0.63200000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0660000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0049999999999999,"15min":1.0289999999999999},"min":{"1min":0.627,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2569999999999999,"5min":1.573,"15min":1.573},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95899999999999996,"15min":0.95099999999999996},"min":{"1min":0.69099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2709999999999999,"5min":1.619,"15min":1.619},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:48:55 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0409999999999999,"15min":1.0309999999999999},"min":{"1min":0.80600000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.343,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0680000000000001,"15min":1.1060000000000001},"min":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.82099999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542199,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":484012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88900000000000001,"15min":0.92700000000000005},"min":{"1min":0.72799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.167,"5min":1.569,"15min":1.569},"last":1.542},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.91700000000000004,"15min":0.92500000000000004},"min":{"1min":0.82699999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1259999999999999,"5min":1.532,"15min":1.532},"last":1.095}]},{"osd":1,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.97599999999999998},"min":{"1min":0.77700000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1779999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.093,"5min":0.92000000000000004,"15min":0.86399999999999999},"min":{"1min":0.88800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.24,"5min":1.478,"15min":1.478},"last":1.169}]},{"osd":2,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.94499999999999995,"15min":0.92500000000000004},"min":{"1min":0.76200000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2470000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.92100000000000004,"15min":0.90500000000000003},"min":{"1min":0.73799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.085,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.05,"15min":1.093},"min":{"1min":0.80000000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.171,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.5},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.034,"15min":1.04},"min":{"1min":0.89600000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2230000000000001,"5min":1.659,"15min":1.659},"last":1.355}]},{"osd":4,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.88100000000000001},"min":{"1min":0.59099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.103,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.032},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.93999999999999995},"min":{"1min":0.67500000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.073,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.008,"15min":1.0680000000000001},"min":{"1min":0.65700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.248,"5min":1.76,"15min":1.76},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":1.004,"15min":1.032},"min":{"1min":0.65300000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.1899999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.448}]},{"osd":7,"last update":"Fri Sep 13 18:49:03 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.034,"15min":1.028},"min":{"1min":0.69499999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2849999999999999,"5min":1.677,"15min":1.677},"last":1.151},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.056,"15min":1.042},"min":{"1min":0.78400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.266,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.3080000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542198,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1552384,"data_stored":1074783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":1.119,"15min":1.006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.276,"5min":25.111999999999998,"15min":25.111999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.1659999999999999,"15min":1.0820000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5009999999999999,"5min":24.834,"15min":24.834},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.69099999999999995,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.304,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0720000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0589999999999999,"15min":1.109},"min":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.234,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.079,"15min":1.111},"min":{"1min":0.71599999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.999,"15min":1.036},"min":{"1min":0.65200000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4019999999999999,"5min":1.468,"15min":1.468},"last":1.212}]},{"osd":4,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.622,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.002},{"interface":"front","average":{"1min":1.036,"5min":1.0049999999999999,"15min":1.0209999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.95599999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.997,"15min":1.0429999999999999},"min":{"1min":0.58799999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1080000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0609999999999999,"15min":1.081},"min":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.137}]},{"osd":7,"last update":"Fri Sep 13 18:48:01 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.012},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3169999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1220000000000001,"15min":1.1519999999999999},"min":{"1min":0.67900000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2290000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":1003520,"data_stored":522485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.94299999999999995,"15min":0.98399999999999999},"min":{"1min":0.76100000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.482,"5min":1.76,"15min":1.76},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.94899999999999995,"15min":0.97299999999999998},"min":{"1min":0.76700000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.4530000000000001,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.88700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:49:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.01,"15min":1.04},"min":{"1min":0.73699999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5289999999999999,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.073,"5min":1.0629999999999999,"15min":1.0980000000000001},"min":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.78,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:49:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0860000000000001,"15min":1.1259999999999999},"min":{"1min":0.78500000000000003,"5min":0.621,"15min":0.621},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.236},{"interface":"front","average":{"1min":1.143,"5min":1.095,"15min":1.143},"min":{"1min":0.67900000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.669,"5min":2.032,"15min":2.032},"last":1.1559999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:49:01 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1990000000000001,"15min":1.421},"min":{"1min":0.79900000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.321,"5min":10.058999999999999,"15min":10.058999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.337,"15min":1.6000000000000001},"min":{"1min":0.78300000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.6160000000000001,"5min":10.223000000000001,"15min":10.223000000000001},"last":1.083}]},{"osd":5,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.88600000000000001,"15min":0.89000000000000001},"min":{"1min":0.60799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.93000000000000005,"15min":0.97399999999999998},"min":{"1min":0.65000000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0429999999999999,"5min":1.46,"15min":1.46},"last":0.82399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.99099999999999999,"15min":1.0249999999999999},"min":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1910000000000001,"5min":1.552,"15min":1.552},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0760000000000001,"15min":1.1419999999999999},"min":{"1min":0.624,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3089999999999999,"5min":1.597,"15min":1.597},"last":1.006}]},{"osd":7,"last update":"Fri Sep 13 18:48:56 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.101,"15min":1.133},"min":{"1min":0.77900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4950000000000001,"5min":1.694,"15min":1.694},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.042,"15min":1.0820000000000001},"min":{"1min":0.73099999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3839999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:49:06.964 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:49:07.174 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.167+0000 7f2bd8800700 1 Processor -- start 2024-09-13T18:49:07.175 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.167+0000 7f2bd8800700 1 -- start start 2024-09-13T18:49:07.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd8800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd00aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd8800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2bd00c75c0 0x7f2bd015a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd8800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00c8b40 con 0x7f2bd0072080 2024-09-13T18:49:07.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd8800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd015a990 con 0x7f2bd00c75c0 2024-09-13T18:49:07.177 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd8800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c9330 con 0x7f2bd0071ca0 2024-09-13T18:49:07.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd00aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f2bd00c75c0 0x7f2bd015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd00aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:55294/0 (socket says 172.21.15.32:55294) 2024-09-13T18:49:07.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5e00700 1 -- 172.21.15.32:0/2930266308 learned_addr learned my addr 172.21.15.32:0/2930266308 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:07.178 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd6800700 1 --1- 172.21.15.32:0/2930266308 >> v1:172.21.15.86:6789/0 conn(0x7f2bd0072080 0x7f2bd00c7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:47510/0 (socket says 172.21.15.32:47510) 2024-09-13T18:49:07.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5400700 1 -- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 msgr2=0x7f2bd00aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:07.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5400700 1 --2- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd00aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5400700 1 -- 172.21.15.32:0/2930266308 >> v1:172.21.15.86:6789/0 conn(0x7f2bd0072080 legacy=0x7f2bd00c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5400700 1 -- 172.21.15.32:0/2930266308 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00a9e90 con 0x7f2bd00c75c0 2024-09-13T18:49:07.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.171+0000 7f2bd5e00700 1 --2- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd00aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:07.179 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd5400700 1 --2- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd015a450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009850 tx=0x7f2bc0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2c738cb5fa9f605 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:07.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd4a00700 1 -- 172.21.15.32:0/2930266308 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011830 con 0x7f2bd00c75c0 2024-09-13T18:49:07.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd4a00700 1 -- 172.21.15.32:0/2930266308 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0011990 con 0x7f2bd00c75c0 2024-09-13T18:49:07.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd4a00700 1 -- 172.21.15.32:0/2930266308 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011d40 con 0x7f2bd00c75c0 2024-09-13T18:49:07.180 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 -- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 msgr2=0x7f2bd015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 --2- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd015a450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009850 tx=0x7f2bc0009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 -- 172.21.15.32:0/2930266308 shutdown_connections 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 --2- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd015a450 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 --2- 172.21.15.32:0/2930266308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd00aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 -- 172.21.15.32:0/2930266308 >> 172.21.15.32:0/2930266308 conn(0x7f2bd00cad40 msgr2=0x7f2bd00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 -- 172.21.15.32:0/2930266308 shutdown_connections 2024-09-13T18:49:07.181 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.175+0000 7f2bd8800700 1 -- 172.21.15.32:0/2930266308 wait complete. 2024-09-13T18:49:07.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 Processor -- start 2024-09-13T18:49:07.183 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 -- start start 2024-09-13T18:49:07.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd0153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bd0072080 0x7f2bd00bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c1cd0 con 0x7f2bd0072080 2024-09-13T18:49:07.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c2e40 con 0x7f2bd00c75c0 2024-09-13T18:49:07.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd8800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01506b0 con 0x7f2bd0071ca0 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bd0072080 0x7f2bd00bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd0153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd0153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:55310/0 (socket says 172.21.15.32:55310) 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd6800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5e00700 1 -- 172.21.15.32:0/3139474913 learned_addr learned my addr 172.21.15.32:0/3139474913 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 -- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 msgr2=0x7f2bd0153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.186 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd0153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 -- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 msgr2=0x7f2bd014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd014f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 -- 172.21.15.32:0/3139474913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4009570 con 0x7f2bd0072080 2024-09-13T18:49:07.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.179+0000 7f2bd5400700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bd0072080 0x7f2bd00bfd60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0016000 tx=0x7f2bc0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:07.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00036c0 con 0x7f2bd0072080 2024-09-13T18:49:07.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc00094b0 con 0x7f2bd0072080 2024-09-13T18:49:07.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0003840 con 0x7f2bd0072080 2024-09-13T18:49:07.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0003bf0 con 0x7f2bd0072080 2024-09-13T18:49:07.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd0150c70 con 0x7f2bd0072080 2024-09-13T18:49:07.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd014ef60 con 0x7f2bd0072080 2024-09-13T18:49:07.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.183+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2bc0003d50 con 0x7f2bd0072080 2024-09-13T18:49:07.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.187+0000 7f2bca000700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2bb4066760 0x7f2bb4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.187+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f2bc0021030 con 0x7f2bd0072080 2024-09-13T18:49:07.193 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.187+0000 7f2bd5e00700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2bb4066760 0x7f2bb4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.187+0000 7f2bd5e00700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2bb4066760 0x7f2bb4068c20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009da0 tx=0x7f2bc40092e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:07.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.195+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bd014ef60 con 0x7f2bd0072080 2024-09-13T18:49:07.390 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.383+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2bd014ef60 con 0x7f2bd0072080 2024-09-13T18:49:07.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.387+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2bc0052a60 con 0x7f2bd0072080 2024-09-13T18:49:07.395 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bca000700 1 -- 172.21.15.32:0/3139474913 <== mon.0 v2:172.21.15.32:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2bd014ef60 con 0x7f2bd0072080 2024-09-13T18:49:07.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2bb4066760 msgr2=0x7f2bb4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.398 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2bb4066760 0x7f2bb4068c20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009da0 tx=0x7f2bc40092e0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bd0072080 msgr2=0x7f2bd00bfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bd0072080 0x7f2bd00bfd60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0016000 tx=0x7f2bc0004770 comp rx=0 tx=0).stop 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 shutdown_connections 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2bb4066760 0x7f2bb4068c20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2bd00c75c0 0x7f2bd014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2bd0072080 0x7f2bd00bfd60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 --2- 172.21.15.32:0/3139474913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2bd0071ca0 0x7f2bd0153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 >> 172.21.15.32:0/3139474913 conn(0x7f2bd00cad40 msgr2=0x7f2bd0159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 shutdown_connections 2024-09-13T18:49:07.399 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.391+0000 7f2bd8800700 1 -- 172.21.15.32:0/3139474913 wait complete. 2024-09-13T18:49:07.419 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:49:07.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:07.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 Processor -- start 2024-09-13T18:49:07.595 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 -- start start 2024-09-13T18:49:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d01504f0 0x7fc5d006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.598 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc5d0071750 0x7fc5d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d00cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00c66f0 con 0x7fc5d0071750 2024-09-13T18:49:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00c5ab0 con 0x7fc5d01504f0 2024-09-13T18:49:07.599 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.591+0000 7fc5d6400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c60e0 con 0x7fc5d00c6c20 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5cfe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc5d0071750 0x7fc5d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d00cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d01504f0 0x7fc5d006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d00cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:55316/0 (socket says 172.21.15.32:55316) 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 -- 172.21.15.32:0/292518187 learned_addr learned my addr 172.21.15.32:0/292518187 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d01504f0 0x7fc5d006ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.32:49520/0 (socket says 172.21.15.32:49520) 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 -- 172.21.15.32:0/292518187 >> v2:172.21.15.86:3300/0 conn(0x7fc5d01504f0 msgr2=0x7fc5d006ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:07.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 --2- 172.21.15.32:0/292518187 >> v2:172.21.15.86:3300/0 conn(0x7fc5d01504f0 0x7fc5d006ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 -- 172.21.15.32:0/292518187 >> v2:172.21.15.32:3300/0 conn(0x7fc5d0071750 msgr2=0x7fc5d006e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:07.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 --2- 172.21.15.32:0/292518187 >> v2:172.21.15.32:3300/0 conn(0x7fc5d0071750 0x7fc5d006e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 -- 172.21.15.32:0/292518187 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00c54f0 con 0x7fc5d00c6c20 2024-09-13T18:49:07.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d5a00700 1 --2- 172.21.15.32:0/292518187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d00cb500 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00cc650 tx=0x7fc5c800d430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52e496ff6f59bffb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:07.601 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5cf400700 1 -- 172.21.15.32:0/292518187 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8010070 con 0x7fc5d00c6c20 2024-09-13T18:49:07.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5cf400700 1 -- 172.21.15.32:0/292518187 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5c800dce0 con 0x7fc5d00c6c20 2024-09-13T18:49:07.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5cf400700 1 -- 172.21.15.32:0/292518187 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800b330 con 0x7fc5d00c6c20 2024-09-13T18:49:07.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 -- 172.21.15.32:0/292518187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 msgr2=0x7fc5d00cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 --2- 172.21.15.32:0/292518187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d00cb500 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5d00cc650 tx=0x7fc5c800d430 comp rx=0 tx=0).stop 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 -- 172.21.15.32:0/292518187 shutdown_connections 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 --2- 172.21.15.32:0/292518187 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d00cb500 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 --2- 172.21.15.32:0/292518187 >> v2:172.21.15.32:3300/0 conn(0x7fc5d0071750 0x7fc5d006e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 --2- 172.21.15.32:0/292518187 >> v2:172.21.15.86:3300/0 conn(0x7fc5d01504f0 0x7fc5d006ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 -- 172.21.15.32:0/292518187 >> 172.21.15.32:0/292518187 conn(0x7fc5d0073720 msgr2=0x7fc5d0073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 -- 172.21.15.32:0/292518187 shutdown_connections 2024-09-13T18:49:07.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.595+0000 7fc5d6400700 1 -- 172.21.15.32:0/292518187 wait complete. 2024-09-13T18:49:07.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 Processor -- start 2024-09-13T18:49:07.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 -- start start 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d0071750 0x7fc5d01466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d01f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 0x7fc5d01f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0151eb0 con 0x7fc5d01504f0 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01515e0 con 0x7fc5d0071750 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d6400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0153700 con 0x7fc5d00c6c20 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d5a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 0x7fc5d01f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d5000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d0071750 0x7fc5d01466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d5a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 0x7fc5d01f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53662/0 (socket says 172.21.15.32:53662) 2024-09-13T18:49:07.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.599+0000 7fc5d5a00700 1 -- 172.21.15.32:0/864169008 learned_addr learned my addr 172.21.15.32:0/864169008 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:07.608 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5cfe00700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d01f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5a00700 1 -- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 msgr2=0x7fc5d01f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5a00700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d01f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5a00700 1 -- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d0071750 msgr2=0x7fc5d01466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5a00700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d0071750 0x7fc5d01466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5a00700 1 -- 172.21.15.32:0/864169008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c800bd40 con 0x7fc5d01504f0 2024-09-13T18:49:07.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5000700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d0071750 0x7fc5d01466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d5a00700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 0x7fc5d01f2b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800d780 tx=0x7fc5c8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8009a10 con 0x7fc5d01504f0 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5c8009b70 con 0x7fc5d01504f0 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d01539e0 con 0x7fc5d01504f0 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8003e60 con 0x7fc5d01504f0 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d0151b40 con 0x7fc5d01504f0 2024-09-13T18:49:07.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.603+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0152060 con 0x7fc5d01504f0 2024-09-13T18:49:07.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.607+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5c8004040 con 0x7fc5d01504f0 2024-09-13T18:49:07.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.607+0000 7fc5ccc00700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b0066730 0x7fc5b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:07.613 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.607+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fc5c8085790 con 0x7fc5d01504f0 2024-09-13T18:49:07.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.607+0000 7fc5d5000700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b0066730 0x7fc5b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:07.615 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.607+0000 7fc5d5000700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b0066730 0x7fc5b0068bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40112c0 tx=0x7fc5c4009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:07.620 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.615+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5d0152060 con 0x7fc5d01504f0 2024-09-13T18:49:07.863 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.859+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5d0152060 con 0x7fc5d01504f0 2024-09-13T18:49:07.864 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.859+0000 7fc5ccc00700 1 -- 172.21.15.32:0/864169008 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fc5d0152060 con 0x7fc5d01504f0 2024-09-13T18:49:07.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:49:07.865 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:25.505215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:49:07.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b0066730 msgr2=0x7fc5b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b0066730 0x7fc5b0068bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40112c0 tx=0x7fc5c4009240 comp rx=0 tx=0).stop 2024-09-13T18:49:07.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 msgr2=0x7fc5d01f2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:07.867 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 0x7fc5d01f2b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800d780 tx=0x7fc5c8004af0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 shutdown_connections 2024-09-13T18:49:07.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b0066730 0x7fc5b0068bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d01504f0 0x7fc5d01f2b90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.868 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d00c6c20 0x7fc5d01f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 --2- 172.21.15.32:0/864169008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d0071750 0x7fc5d01466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:07.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 >> 172.21.15.32:0/864169008 conn(0x7fc5d0073720 msgr2=0x7fc5d00c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:07.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 shutdown_connections 2024-09-13T18:49:07.869 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:07.863+0000 7fc5d6400700 1 -- 172.21.15.32:0/864169008 wait complete. 2024-09-13T18:49:07.870 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 10 2024-09-13T18:49:07.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:08.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.051+0000 7fc5dcc00700 1 Processor -- start 2024-09-13T18:49:08.058 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.051+0000 7fc5dcc00700 1 -- start start 2024-09-13T18:49:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5dcc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8070540 0x7fc5d8070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5dcc00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d8157d40 0x7fc5d8161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5dcc00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d80c84b0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5dcc00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d815b820 con 0x7fc5d8157d40 2024-09-13T18:49:08.062 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5dcc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d8070e60 con 0x7fc5d8070540 2024-09-13T18:49:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5d7400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8070540 0x7fc5d8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5d7e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fc5d8157d40 0x7fc5d8161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5cea00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc5d806d8e0 0x7fc5d8157630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45222/0 (socket says 172.21.15.32:45222) 2024-09-13T18:49:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.055+0000 7fc5cea00700 1 -- 172.21.15.32:0/2614336675 learned_addr learned my addr 172.21.15.32:0/2614336675 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d7e00700 1 -- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8070540 msgr2=0x7fc5d8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:08.063 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d7e00700 1 --2- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8070540 0x7fc5d8070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d7e00700 1 -- 172.21.15.32:0/2614336675 >> v1:172.21.15.32:6789/0 conn(0x7fc5d806d8e0 legacy=0x7fc5d8157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d7e00700 1 -- 172.21.15.32:0/2614336675 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d80c8770 con 0x7fc5d8157d40 2024-09-13T18:49:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d7400700 1 --2- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8070540 0x7fc5d8070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d6a00700 1 -- 172.21.15.32:0/2614336675 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593757799 0 0) 0x7fc5d80c84b0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.064 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d7e00700 1 --2- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8157d40 0x7fc5d8161ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009d90 tx=0x7fc5d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61c127c8196dc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d6a00700 1 -- 172.21.15.32:0/2614336675 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000e070 con 0x7fc5d8157d40 2024-09-13T18:49:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d6a00700 1 -- 172.21.15.32:0/2614336675 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5d000bb20 con 0x7fc5d8157d40 2024-09-13T18:49:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5d6a00700 1 -- 172.21.15.32:0/2614336675 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0012430 con 0x7fc5d8157d40 2024-09-13T18:49:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 -- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8157d40 msgr2=0x7fc5d8161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.065 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8157d40 0x7fc5d8161ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009d90 tx=0x7fc5d000b330 comp rx=0 tx=0).stop 2024-09-13T18:49:08.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 -- 172.21.15.32:0/2614336675 shutdown_connections 2024-09-13T18:49:08.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8157d40 0x7fc5d8161ed0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/2614336675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8070540 0x7fc5d8070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 -- 172.21.15.32:0/2614336675 >> 172.21.15.32:0/2614336675 conn(0x7fc5d8071080 msgr2=0x7fc5d8071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:08.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 -- 172.21.15.32:0/2614336675 shutdown_connections 2024-09-13T18:49:08.066 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.059+0000 7fc5dcc00700 1 -- 172.21.15.32:0/2614336675 wait complete. 2024-09-13T18:49:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 Processor -- start 2024-09-13T18:49:08.069 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 -- start start 2024-09-13T18:49:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 0x7fc5d80c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8070540 0x7fc5d8156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8157d40 0x7fc5d81f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d81f0fd0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80c3f80 con 0x7fc5d8070540 2024-09-13T18:49:08.071 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5dcc00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80c4260 con 0x7fc5d8157d40 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.063+0000 7fc5d7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 0x7fc5d80c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 0x7fc5d80c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53666/0 (socket says 172.21.15.32:53666) 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 -- 172.21.15.32:0/227708300 learned_addr learned my addr 172.21.15.32:0/227708300 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7e00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8157d40 0x7fc5d81f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5cea00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8070540 0x7fc5d8156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 -- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8157d40 msgr2=0x7fc5d81f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.072 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8157d40 0x7fc5d81f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 -- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8070540 msgr2=0x7fc5d8156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8070540 0x7fc5d8156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 -- 172.21.15.32:0/227708300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80094b0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.073 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5d7400700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 0x7fc5d80c4e30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800ebe0 tx=0x7fc5c800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800c850 con 0x7fc5d806d8e0 2024-09-13T18:49:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5c800c9b0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d0009a70 con 0x7fc5d806d8e0 2024-09-13T18:49:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800cd60 con 0x7fc5d806d8e0 2024-09-13T18:49:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d81f0c60 con 0x7fc5d806d8e0 2024-09-13T18:49:08.074 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.067+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d81f07e0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.075 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.071+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5c8013470 con 0x7fc5d806d8e0 2024-09-13T18:49:08.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.071+0000 7fc5cfe00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b4066730 0x7fc5b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.071+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fc5c80846d0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.077 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.071+0000 7fc5cea00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b4066730 0x7fc5b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.078 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.071+0000 7fc5cea00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b4066730 0x7fc5b4068bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc5d81f04a0 tx=0x7fc5c0007e90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.085 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.079+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5d81f07e0 con 0x7fc5d806d8e0 2024-09-13T18:49:08.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.323+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5d815b420 con 0x7fc5d806d8e0 2024-09-13T18:49:08.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.323+0000 7fc5cfe00700 1 -- 172.21.15.32:0/227708300 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6245 (secure 0 0 0) 0x7fc5d815b420 con 0x7fc5d806d8e0 2024-09-13T18:49:08.329 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:49:08.329 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6833/2941044093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2941044093},{"type":"v1","addr":"172.21.15.32:6833","nonce":2941044093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1937955380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1937955380},{"type":"v1","addr":"172.21.15.32:6836","nonce":1937955380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2331367033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2331367033},{"type":"v1","addr":"172.21.15.86:6837","nonce":2331367033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6838/2274522141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2274522141},{"type":"v1","addr":"172.21.15.86:6838","nonce":2274522141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/2715741968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2715741968},{"type":"v1","addr":"172.21.15.86:6839","nonce":2715741968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:01.303364+0000","modified":"2024-09-13T18:45:25.505215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4262":{"gid":4262,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.32:6837/1489168013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":1489168013},{"type":"v1","addr":"172.21.15.32:6837","nonce":1489168013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:49:08.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b4066730 msgr2=0x7fc5b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b4066730 0x7fc5b4068bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc5d81f04a0 tx=0x7fc5c0007e90 comp rx=0 tx=0).stop 2024-09-13T18:49:08.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 msgr2=0x7fc5d80c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 0x7fc5d80c4e30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800ebe0 tx=0x7fc5c800eef0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 shutdown_connections 2024-09-13T18:49:08.332 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fc5b4066730 0x7fc5b4068bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5d8157d40 0x7fc5d81f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5d8070540 0x7fc5d8156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 --2- 172.21.15.32:0/227708300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5d806d8e0 0x7fc5d80c4e30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 >> 172.21.15.32:0/227708300 conn(0x7fc5d8071080 msgr2=0x7fc5d8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 shutdown_connections 2024-09-13T18:49:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.327+0000 7fc5dcc00700 1 -- 172.21.15.32:0/227708300 wait complete. 2024-09-13T18:49:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 10 2024-09-13T18:49:08.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:49:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a1400700 1 Processor -- start 2024-09-13T18:49:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a1400700 1 -- start start 2024-09-13T18:49:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a1400700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb99c0c7280 0x7fb99c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a1400700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c06f5d0 con 0x7fb99c0c6ea0 2024-09-13T18:49:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a1400700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c06f890 con 0x7fb99c15d820 2024-09-13T18:49:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a1400700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c06fb70 con 0x7fb99c0c7280 2024-09-13T18:49:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99be00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb99c0c6ea0 0x7fb99c0c7870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45232/0 (socket says 172.21.15.32:45232) 2024-09-13T18:49:08.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99be00700 1 -- 172.21.15.32:0/2867330169 learned_addr learned my addr 172.21.15.32:0/2867330169 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb9a0a00700 1 --1- 172.21.15.32:0/2867330169 >> v1:172.21.15.86:6789/0 conn(0x7fb99c15d820 0x7fb99c06a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:47514/0 (socket says 172.21.15.32:47514) 2024-09-13T18:49:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99b400700 1 --2- 172.21.15.32:0/2867330169 >> v2:172.21.15.32:3300/0 conn(0x7fb99c0c7280 0x7fb99c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324038209 0 0) 0x7fb99c06f5d0 con 0x7fb99c0c6ea0 2024-09-13T18:49:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9800035d0 con 0x7fb99c0c6ea0 2024-09-13T18:49:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733944620 0 0) 0x7fb99c06f890 con 0x7fb99c15d820 2024-09-13T18:49:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb99c06f5d0 con 0x7fb99c15d820 2024-09-13T18:49:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99b400700 1 -- 172.21.15.32:0/2867330169 >> v1:172.21.15.86:6789/0 conn(0x7fb99c15d820 legacy=0x7fb99c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99b400700 1 -- 172.21.15.32:0/2867330169 >> v1:172.21.15.32:6789/0 conn(0x7fb99c0c6ea0 legacy=0x7fb99c0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.527+0000 7fb99b400700 1 -- 172.21.15.32:0/2867330169 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c06fe50 con 0x7fb99c0c7280 2024-09-13T18:49:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb99b400700 1 --2- 172.21.15.32:0/2867330169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c0c7280 0x7fb99c06c070 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb988009850 tx=0x7fb988009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab083e1c282d04b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011830 con 0x7fb99c0c7280 2024-09-13T18:49:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb988011990 con 0x7fb99c0c7280 2024-09-13T18:49:08.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb99aa00700 1 -- 172.21.15.32:0/2867330169 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988011d60 con 0x7fb99c0c7280 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 -- 172.21.15.32:0/2867330169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c0c7280 msgr2=0x7fb99c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 --2- 172.21.15.32:0/2867330169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c0c7280 0x7fb99c06c070 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb988009850 tx=0x7fb988009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 -- 172.21.15.32:0/2867330169 shutdown_connections 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 --2- 172.21.15.32:0/2867330169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c0c7280 0x7fb99c06c070 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 -- 172.21.15.32:0/2867330169 >> 172.21.15.32:0/2867330169 conn(0x7fb99c0ccf70 msgr2=0x7fb99c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 -- 172.21.15.32:0/2867330169 shutdown_connections 2024-09-13T18:49:08.537 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.531+0000 7fb9a1400700 1 -- 172.21.15.32:0/2867330169 wait complete. 2024-09-13T18:49:08.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 Processor -- start 2024-09-13T18:49:08.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 -- start start 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb99c0c6ea0 0x7fb99c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb99c0c7280 0x7fb99c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 0x7fb99c1ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c14fd70 con 0x7fb99c15d820 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1e4ef0 con 0x7fb99c0c6ea0 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a1400700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c14ffc0 con 0x7fb99c0c7280 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 0x7fb99c1ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a0a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 0x7fb99c1ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53684/0 (socket says 172.21.15.32:53684) 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb9a0a00700 1 -- 172.21.15.32:0/4123100129 learned_addr learned my addr 172.21.15.32:0/4123100129 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb99be00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb99c0c6ea0 0x7fb99c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.535+0000 7fb99b400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb99c0c7280 0x7fb99c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.544 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a0a00700 1 -- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb99c0c7280 msgr2=0x7fb99c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a0a00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb99c0c7280 0x7fb99c152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a0a00700 1 -- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb99c0c6ea0 msgr2=0x7fb99c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a0a00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb99c0c6ea0 0x7fb99c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a0a00700 1 -- 172.21.15.32:0/4123100129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880094b0 con 0x7fb99c15d820 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb99b400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb99c0c7280 0x7fb99c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a0a00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 0x7fb99c1ef390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb99400cbc0 tx=0x7fb99400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400a9e0 con 0x7fb99c15d820 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb99400ab40 con 0x7fb99c15d820 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c1502a0 con 0x7fb99c15d820 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994007070 con 0x7fb99c15d820 2024-09-13T18:49:08.545 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c1e4b80 con 0x7fb99c15d820 2024-09-13T18:49:08.546 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.539+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c15b820 con 0x7fb99c15d820 2024-09-13T18:49:08.547 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.543+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9940071d0 con 0x7fb99c15d820 2024-09-13T18:49:08.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.543+0000 7fb993e00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb97c066760 0x7fb97c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.543+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fb994084220 con 0x7fb99c15d820 2024-09-13T18:49:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.543+0000 7fb99be00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb97c066760 0x7fb97c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.550 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.543+0000 7fb99be00700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb97c066760 0x7fb97c068c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb98c007fd0 tx=0x7fb98c007de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.551+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb994051180 con 0x7fb99c15d820 2024-09-13T18:49:08.753 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.747+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb99c1e5060 con 0x7fb99c15d820 2024-09-13T18:49:08.755 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb993e00700 1 -- 172.21.15.32:0/4123100129 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18451 (secure 0 0 0) 0x7fb9940547a0 con 0x7fb99c15d820 2024-09-13T18:49:08.756 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-13T18:49:08.756 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":81,"fsid":"e3c44028-1b11-4958-a433-ecab24d0f05e","created":"2024-09-13T18:44:38.402959+0000","modified":"2024-09-13T18:47:27.647237+0000","last_up_change":"2024-09-13T18:44:49.741600+0000","last_in_change":"2024-09-13T18:46:40.269675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:44:50.146051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:44:59.596223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:00.330969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:45:03.385324+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"973dc52d-4a57-489e-b680-f484a091a77f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6813","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6815","nonce":3679908055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6818","nonce":3679908055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6823","nonce":3679908055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":3679908055},{"type":"v1","addr":"172.21.15.32:6821","nonce":3679908055}]},"public_addr":"172.21.15.32:6815/3679908055","cluster_addr":"172.21.15.32:6818/3679908055","heartbeat_back_addr":"172.21.15.32:6823/3679908055","heartbeat_front_addr":"172.21.15.32:6821/3679908055","state":["exists","up"]},{"osd":1,"uuid":"354ae97e-51cf-423c-b257-37bf8960729b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6801","nonce":1416437982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6803","nonce":1416437982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6807","nonce":1416437982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1416437982},{"type":"v1","addr":"172.21.15.32:6805","nonce":1416437982}]},"public_addr":"172.21.15.32:6801/1416437982","cluster_addr":"172.21.15.32:6803/1416437982","heartbeat_back_addr":"172.21.15.32:6807/1416437982","heartbeat_front_addr":"172.21.15.32:6805/1416437982","state":["exists","up"]},{"osd":2,"uuid":"b76494fe-9ae4-4444-8f25-15b7bb18dece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6809","nonce":1016396602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6811","nonce":1016396602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6817","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6819","nonce":1016396602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":1016396602},{"type":"v1","addr":"172.21.15.32:6814","nonce":1016396602}]},"public_addr":"172.21.15.32:6809/1016396602","cluster_addr":"172.21.15.32:6811/1016396602","heartbeat_back_addr":"172.21.15.32:6819/1016396602","heartbeat_front_addr":"172.21.15.32:6814/1016396602","state":["exists","up"]},{"osd":3,"uuid":"3b89a1fa-2088-4a23-b1e6-31644ebc6000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6825","nonce":2476570305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6827","nonce":2476570305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6831","nonce":2476570305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2476570305},{"type":"v1","addr":"172.21.15.32:6829","nonce":2476570305}]},"public_addr":"172.21.15.32:6825/2476570305","cluster_addr":"172.21.15.32:6827/2476570305","heartbeat_back_addr":"172.21.15.32:6831/2476570305","heartbeat_front_addr":"172.21.15.32:6829/2476570305","state":["exists","up"]},{"osd":4,"uuid":"63973273-0c32-404c-9eb2-943b451d3da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6811","nonce":838245911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6815","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6819","nonce":838245911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6829","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6831","nonce":838245911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":838245911},{"type":"v1","addr":"172.21.15.86:6825","nonce":838245911}]},"public_addr":"172.21.15.86:6811/838245911","cluster_addr":"172.21.15.86:6819/838245911","heartbeat_back_addr":"172.21.15.86:6831/838245911","heartbeat_front_addr":"172.21.15.86:6825/838245911","state":["exists","up"]},{"osd":5,"uuid":"2678edb8-ca2a-497a-8439-5f1dc709dbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6813","nonce":2187629356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6817","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6820","nonce":2187629356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6830","nonce":2187629356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":2187629356},{"type":"v1","addr":"172.21.15.86:6827","nonce":2187629356}]},"public_addr":"172.21.15.86:6813/2187629356","cluster_addr":"172.21.15.86:6820/2187629356","heartbeat_back_addr":"172.21.15.86:6830/2187629356","heartbeat_front_addr":"172.21.15.86:6827/2187629356","state":["exists","up"]},{"osd":6,"uuid":"8adaa119-857f-4d43-bf54-dcac614aba37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6801","nonce":4096931368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6803","nonce":4096931368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6807","nonce":4096931368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":4096931368},{"type":"v1","addr":"172.21.15.86:6805","nonce":4096931368}]},"public_addr":"172.21.15.86:6801/4096931368","cluster_addr":"172.21.15.86:6803/4096931368","heartbeat_back_addr":"172.21.15.86:6807/4096931368","heartbeat_front_addr":"172.21.15.86:6805/4096931368","state":["exists","up"]},{"osd":7,"uuid":"97880368-e206-4217-aeee-cf13756aa32b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6809","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6812","nonce":943661157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6816","nonce":943661157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6826","nonce":943661157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":943661157},{"type":"v1","addr":"172.21.15.86:6821","nonce":943661157}]},"public_addr":"172.21.15.86:6812/943661157","cluster_addr":"172.21.15.86:6816/943661157","heartbeat_back_addr":"172.21.15.86:6826/943661157","heartbeat_front_addr":"172.21.15.86:6821/943661157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.712403+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.585781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.661542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.680620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.198765+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.211743+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:46.007910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:44:45.769729+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.17","osds":[6,4,7,5]},{"pgid":"4.19","osds":[1,4,3,6]}],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.18","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb97c066760 msgr2=0x7fb97c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb97c066760 0x7fb97c068c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb98c007fd0 tx=0x7fb98c007de0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 msgr2=0x7fb99c1ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 0x7fb99c1ef390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb99400cbc0 tx=0x7fb99400ced0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 shutdown_connections 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb97c066760 0x7fb97c068c20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb99c15d820 0x7fb99c1ef390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb99c0c7280 0x7fb99c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 --2- 172.21.15.32:0/4123100129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb99c0c6ea0 0x7fb99c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 >> 172.21.15.32:0/4123100129 conn(0x7fb99c0ccf70 msgr2=0x7fb99c15ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:08.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.751+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 shutdown_connections 2024-09-13T18:49:08.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.755+0000 7fb9a1400700 1 -- 172.21.15.32:0/4123100129 wait complete. 2024-09-13T18:49:08.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:49:08.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.947+0000 7fbdab200700 1 Processor -- start 2024-09-13T18:49:08.955 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.951+0000 7fbdab200700 1 -- start start 2024-09-13T18:49:08.958 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.951+0000 7fbdab200700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbdac151370 0x7fbdac15b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.951+0000 7fbdab200700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac15ab80 con 0x7fbdac151750 2024-09-13T18:49:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.951+0000 7fbdab200700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac06a510 con 0x7fbdac0c5f40 2024-09-13T18:49:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbdab200700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac06a7b0 con 0x7fbdac151370 2024-09-13T18:49:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9e00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fbdac151370 0x7fbdac15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9400700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbdac151750 0x7fbdac0c4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49320/0 (socket says 172.21.15.32:49320) 2024-09-13T18:49:08.959 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9400700 1 -- 172.21.15.32:0/3035151538 learned_addr learned my addr 172.21.15.32:0/3035151538 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:08.960 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda8a00700 1 -- 172.21.15.32:0/3035151538 <== mon.1 v1:172.21.15.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389713928 0 0) 0x7fbdac06a510 con 0x7fbdac0c5f40 2024-09-13T18:49:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda8a00700 1 -- 172.21.15.32:0/3035151538 --> v1:172.21.15.86:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd900035d0 con 0x7fbdac0c5f40 2024-09-13T18:49:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda8a00700 1 -- 172.21.15.32:0/3035151538 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295006603 0 0) 0x7fbdac15ab80 con 0x7fbdac151750 2024-09-13T18:49:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9e00700 1 -- 172.21.15.32:0/3035151538 >> v1:172.21.15.86:6789/0 conn(0x7fbdac0c5f40 legacy=0x7fbdac161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9e00700 1 -- 172.21.15.32:0/3035151538 >> v1:172.21.15.32:6789/0 conn(0x7fbdac151750 legacy=0x7fbdac0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9e00700 1 -- 172.21.15.32:0/3035151538 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac06b0c0 con 0x7fbdac151370 2024-09-13T18:49:08.961 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda9e00700 1 --2- 172.21.15.32:0/3035151538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151370 0x7fbdac15b010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009850 tx=0x7fbd9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f43ed314c0dca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda8a00700 1 -- 172.21.15.32:0/3035151538 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c011830 con 0x7fbdac151370 2024-09-13T18:49:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda8a00700 1 -- 172.21.15.32:0/3035151538 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd9c011990 con 0x7fbdac151370 2024-09-13T18:49:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbda8a00700 1 -- 172.21.15.32:0/3035151538 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c011d60 con 0x7fbdac151370 2024-09-13T18:49:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbdab200700 1 -- 172.21.15.32:0/3035151538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151370 msgr2=0x7fbdac15b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.962 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbdab200700 1 --2- 172.21.15.32:0/3035151538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151370 0x7fbdac15b010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009850 tx=0x7fbd9c009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbdab200700 1 -- 172.21.15.32:0/3035151538 shutdown_connections 2024-09-13T18:49:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbdab200700 1 --2- 172.21.15.32:0/3035151538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151370 0x7fbdac15b010 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.955+0000 7fbdab200700 1 -- 172.21.15.32:0/3035151538 >> 172.21.15.32:0/3035151538 conn(0x7fbdac06f530 msgr2=0x7fbdac06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 -- 172.21.15.32:0/3035151538 shutdown_connections 2024-09-13T18:49:08.963 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 -- 172.21.15.32:0/3035151538 wait complete. 2024-09-13T18:49:08.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 Processor -- start 2024-09-13T18:49:08.965 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 -- start start 2024-09-13T18:49:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdac0c5f40 0x7fbdac14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 0x7fbdac0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151750 0x7fbdac1eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0c7b90 con 0x7fbdac151370 2024-09-13T18:49:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1efc40 con 0x7fbdac151750 2024-09-13T18:49:08.966 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdab200700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0c8560 con 0x7fbdac0c5f40 2024-09-13T18:49:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbda9400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 0x7fbdac0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbdaa800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151750 0x7fbdac1eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbda9400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 0x7fbdac0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49184/0 (socket says 172.21.15.32:49184) 2024-09-13T18:49:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbda9e00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdac0c5f40 0x7fbdac14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.967 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.959+0000 7fbda9400700 1 -- 172.21.15.32:0/960270518 learned_addr learned my addr 172.21.15.32:0/960270518 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda9400700 1 -- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdac0c5f40 msgr2=0x7fbdac14cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda9400700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdac0c5f40 0x7fbdac14cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda9400700 1 -- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151750 msgr2=0x7fbdac1eecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda9400700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151750 0x7fbdac1eecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda9400700 1 -- 172.21.15.32:0/960270518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0094b0 con 0x7fbdac151370 2024-09-13T18:49:08.968 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda9400700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 0x7fbdac0c8020 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800c520 tx=0x7fbd9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98004ca0 con 0x7fbdac151370 2024-09-13T18:49:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd98004e00 con 0x7fbdac151370 2024-09-13T18:49:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98007330 con 0x7fbdac151370 2024-09-13T18:49:08.969 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac1e4770 con 0x7fbdac151370 2024-09-13T18:49:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac0c7820 con 0x7fbdac151370 2024-09-13T18:49:08.970 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.963+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac0c5c30 con 0x7fbdac151370 2024-09-13T18:49:08.972 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.967+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd98007490 con 0x7fbdac151370 2024-09-13T18:49:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.967+0000 7fbda2000700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd8c066730 0x7fbd8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:08.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.967+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6624+0+0 (secure 0 0 0) 0x7fbd98084190 con 0x7fbdac151370 2024-09-13T18:49:08.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.967+0000 7fbda9e00700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd8c066730 0x7fbd8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:08.975 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.971+0000 7fbda9e00700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd8c066730 0x7fbd8c068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0090b0 tx=0x7fbd9c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:08.981 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:08.975+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd980510f0 con 0x7fbdac151370 2024-09-13T18:49:09.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.191+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbdac06ce60 con 0x7fbdac151370 2024-09-13T18:49:09.214 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.207+0000 7fbda2000700 1 -- 172.21.15.32:0/960270518 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbd98054710 con 0x7fbdac151370 2024-09-13T18:49:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd8c066730 msgr2=0x7fbd8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd8c066730 0x7fbd8c068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0090b0 tx=0x7fbd9c008030 comp rx=0 tx=0).stop 2024-09-13T18:49:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 msgr2=0x7fbdac0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 0x7fbdac0c8020 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800c520 tx=0x7fbd9800c830 comp rx=0 tx=0).stop 2024-09-13T18:49:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 shutdown_connections 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fbd8c066730 0x7fbd8c068bf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac151750 0x7fbdac1eecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac151370 0x7fbdac0c8020 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 --2- 172.21.15.32:0/960270518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbdac0c5f40 0x7fbdac14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 >> 172.21.15.32:0/960270518 conn(0x7fbdac06f530 msgr2=0x7fbdac06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 shutdown_connections 2024-09-13T18:49:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.211+0000 7fbdab200700 1 -- 172.21.15.32:0/960270518 wait complete. 2024-09-13T18:49:09.220 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:49:09.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:49:09.291 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2024-09-13T18:49:09.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.407+0000 7f830ea00700 1 Processor -- start 2024-09-13T18:49:09.414 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.407+0000 7f830ea00700 1 -- start start 2024-09-13T18:49:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080c9e90 0x7f83080ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830ea00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83080ca840 0x7f830806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830ea00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080c9440 con 0x7f830806ea50 2024-09-13T18:49:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830ea00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83080c9a70 con 0x7f83080ca840 2024-09-13T18:49:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830ea00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83080c7aa0 con 0x7f83080c9e90 2024-09-13T18:49:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830cc00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080c9e90 0x7f83080ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830e000700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f83080ca840 0x7f830806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830d600700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f830806ea50 0x7f830815aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49330/0 (socket says 172.21.15.32:49330) 2024-09-13T18:49:09.417 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830d600700 1 -- 172.21.15.32:0/1111816978 learned_addr learned my addr 172.21.15.32:0/1111816978 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830cc00700 1 -- 172.21.15.32:0/1111816978 >> v2:172.21.15.86:3300/0 conn(0x7f83080ca840 msgr2=0x7f830806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830cc00700 1 --2- 172.21.15.32:0/1111816978 >> v2:172.21.15.86:3300/0 conn(0x7f83080ca840 0x7f830806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830cc00700 1 -- 172.21.15.32:0/1111816978 >> v1:172.21.15.32:6789/0 conn(0x7f830806ea50 legacy=0x7f830815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830cc00700 1 -- 172.21.15.32:0/1111816978 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080c7d60 con 0x7f83080c9e90 2024-09-13T18:49:09.418 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f830cc00700 1 --2- 172.21.15.32:0/1111816978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080c9e90 0x7f83080ca300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009850 tx=0x7f82f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0cace5c423c734f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f8307e00700 1 -- 172.21.15.32:0/1111816978 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4011830 con 0x7f83080c9e90 2024-09-13T18:49:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.411+0000 7f8307e00700 1 -- 172.21.15.32:0/1111816978 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f82f4011990 con 0x7f83080c9e90 2024-09-13T18:49:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f8307e00700 1 -- 172.21.15.32:0/1111816978 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4011d60 con 0x7f83080c9e90 2024-09-13T18:49:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 -- 172.21.15.32:0/1111816978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080c9e90 msgr2=0x7f83080ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 --2- 172.21.15.32:0/1111816978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080c9e90 0x7f83080ca300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009850 tx=0x7f82f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 -- 172.21.15.32:0/1111816978 shutdown_connections 2024-09-13T18:49:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 --2- 172.21.15.32:0/1111816978 >> v2:172.21.15.86:3300/0 conn(0x7f83080ca840 0x7f830806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 --2- 172.21.15.32:0/1111816978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080c9e90 0x7f83080ca300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 -- 172.21.15.32:0/1111816978 >> 172.21.15.32:0/1111816978 conn(0x7f83080cac60 msgr2=0x7f83080cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 -- 172.21.15.32:0/1111816978 shutdown_connections 2024-09-13T18:49:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.415+0000 7f830ea00700 1 -- 172.21.15.32:0/1111816978 wait complete. 2024-09-13T18:49:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 Processor -- start 2024-09-13T18:49:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 -- start start 2024-09-13T18:49:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 0x7f830815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83080c9e90 0x7f8308157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080ca840 0x7f83080aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83080ac2d0 con 0x7f830806ea50 2024-09-13T18:49:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830815b5d0 con 0x7f83080c9e90 2024-09-13T18:49:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830ea00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83081efa70 con 0x7f83080ca840 2024-09-13T18:49:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 0x7f830815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 0x7f830815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49212/0 (socket says 172.21.15.32:49212) 2024-09-13T18:49:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 -- 172.21.15.32:0/2899030432 learned_addr learned my addr 172.21.15.32:0/2899030432 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830cc00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83080c9e90 0x7f8308157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830e000700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080ca840 0x7f83080aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 -- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080ca840 msgr2=0x7f83080aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080ca840 0x7f83080aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 -- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83080c9e90 msgr2=0x7f8308157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83080c9e90 0x7f8308157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 -- 172.21.15.32:0/2899030432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f40094b0 con 0x7f830806ea50 2024-09-13T18:49:09.429 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.419+0000 7f830d600700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 0x7f830815b090 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c700 tx=0x7f82fc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc005d90 con 0x7f830806ea50 2024-09-13T18:49:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f82fc0070d0 con 0x7f830806ea50 2024-09-13T18:49:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83080ac520 con 0x7f830806ea50 2024-09-13T18:49:09.430 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc007440 con 0x7f830806ea50 2024-09-13T18:49:09.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83080acae0 con 0x7f830806ea50 2024-09-13T18:49:09.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83080aa900 con 0x7f830806ea50 2024-09-13T18:49:09.431 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.423+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82fc0075a0 con 0x7f830806ea50 2024-09-13T18:49:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.427+0000 7f8305600700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f82e8066760 0x7f82e8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.427+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6710+0+0 (secure 0 0 0) 0x7f82fc083860 con 0x7f830806ea50 2024-09-13T18:49:09.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.427+0000 7f830cc00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f82e8066760 0x7f82e8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:09.433 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.427+0000 7f830cc00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f82e8066760 0x7f82e8068c20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009850 tx=0x7f82f4008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:09.436 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.431+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83080aa900 con 0x7f830806ea50 2024-09-13T18:49:09.657 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:09.651+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f83080aa900 con 0x7f830806ea50 2024-09-13T18:49:10.220 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.215+0000 7f8305600700 1 -- 172.21.15.32:0/2899030432 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f83080aa900 con 0x7f830806ea50 2024-09-13T18:49:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f82e8066760 msgr2=0x7f82e8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f82e8066760 0x7f82e8068c20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009850 tx=0x7f82f4008030 comp rx=0 tx=0).stop 2024-09-13T18:49:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 msgr2=0x7f830815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:10.225 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 0x7f830815b090 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c700 tx=0x7f82fc00ca10 comp rx=0 tx=0).stop 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 shutdown_connections 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f82e8066760 0x7f82e8068c20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f83080ca840 0x7f83080aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83080c9e90 0x7f8308157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 --2- 172.21.15.32:0/2899030432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f830806ea50 0x7f830815b090 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 >> 172.21.15.32:0/2899030432 conn(0x7f83080cac60 msgr2=0x7f830806ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 shutdown_connections 2024-09-13T18:49:10.226 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.219+0000 7f830ea00700 1 -- 172.21.15.32:0/2899030432 wait complete. 2024-09-13T18:49:10.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:49:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.439+0000 7f227fe00700 1 Processor -- start 2024-09-13T18:49:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227fe00700 1 -- start start 2024-09-13T18:49:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227fe00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22800cf500 0x7f228015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227fe00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f228015acb0 0x7f2280159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227fe00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228015dd00 con 0x7f22800cf8e0 2024-09-13T18:49:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227fe00700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22800ca740 con 0x7f22800cf500 2024-09-13T18:49:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227fe00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22800cad00 con 0x7f228015acb0 2024-09-13T18:49:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227ea00700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22800cf500 0x7f228015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227f400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f228015acb0 0x7f2280159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227e000700 1 --1- >> v1:172.21.15.86:6789/0 conn(0x7f22800cf8e0 0x7f22800cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.86:6789/0 says I am v1:172.21.15.32:48098/0 (socket says 172.21.15.32:48098) 2024-09-13T18:49:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.443+0000 7f227e000700 1 -- 172.21.15.32:0/2733770543 learned_addr learned my addr 172.21.15.32:0/2733770543 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227f400700 1 -- 172.21.15.32:0/2733770543 >> v2:172.21.15.32:3300/0 conn(0x7f22800cf500 msgr2=0x7f228015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227f400700 1 --2- 172.21.15.32:0/2733770543 >> v2:172.21.15.32:3300/0 conn(0x7f22800cf500 0x7f228015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227f400700 1 -- 172.21.15.32:0/2733770543 >> v1:172.21.15.86:6789/0 conn(0x7f22800cf8e0 legacy=0x7f22800cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227f400700 1 -- 172.21.15.32:0/2733770543 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228015a080 con 0x7f228015acb0 2024-09-13T18:49:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227f400700 1 --2- 172.21.15.32:0/2733770543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f228015acb0 0x7f2280159840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2278009d90 tx=0x7f227800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a2d3bf416c28337 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227d600700 1 -- 172.21.15.32:0/2733770543 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800e070 con 0x7f228015acb0 2024-09-13T18:49:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227d600700 1 -- 172.21.15.32:0/2733770543 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f227800bae0 con 0x7f228015acb0 2024-09-13T18:49:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227d600700 1 -- 172.21.15.32:0/2733770543 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278012430 con 0x7f228015acb0 2024-09-13T18:49:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 -- 172.21.15.32:0/2733770543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f228015acb0 msgr2=0x7f2280159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 --2- 172.21.15.32:0/2733770543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f228015acb0 0x7f2280159840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2278009d90 tx=0x7f227800b330 comp rx=0 tx=0).stop 2024-09-13T18:49:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 -- 172.21.15.32:0/2733770543 shutdown_connections 2024-09-13T18:49:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 --2- 172.21.15.32:0/2733770543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f228015acb0 0x7f2280159840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 --2- 172.21.15.32:0/2733770543 >> v2:172.21.15.32:3300/0 conn(0x7f22800cf500 0x7f228015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 -- 172.21.15.32:0/2733770543 >> 172.21.15.32:0/2733770543 conn(0x7f2280071dc0 msgr2=0x7f22800721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 -- 172.21.15.32:0/2733770543 shutdown_connections 2024-09-13T18:49:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.447+0000 7f227fe00700 1 -- 172.21.15.32:0/2733770543 wait complete. 2024-09-13T18:49:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 Processor -- start 2024-09-13T18:49:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 -- start start 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22800cf500 0x7f22801f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22800cf8e0 0x7f22801e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 0x7f22800c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2280157240 con 0x7f228015acb0 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22800c41f0 con 0x7f22800cf8e0 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.451+0000 7f227fe00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22801f3920 con 0x7f22800cf500 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 0x7f22800c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:10.460 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227ea00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22800cf500 0x7f22801f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:10.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227e000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22800cf8e0 0x7f22801e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:10.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 0x7f22800c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49242/0 (socket says 172.21.15.32:49242) 2024-09-13T18:49:10.461 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 -- 172.21.15.32:0/2260089436 learned_addr learned my addr 172.21.15.32:0/2260089436 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 -- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22800cf500 msgr2=0x7f22801f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22800cf500 0x7f22801f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 -- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22800cf8e0 msgr2=0x7f22801e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22800cf8e0 0x7f22801e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 -- 172.21.15.32:0/2260089436 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009a70 con 0x7f228015acb0 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227ea00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22800cf500 0x7f22801f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227f400700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 0x7f22800c4680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2278014040 tx=0x7f2278004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278012a70 con 0x7f228015acb0 2024-09-13T18:49:10.462 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2278020070 con 0x7f228015acb0 2024-09-13T18:49:10.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22801f3080 con 0x7f228015acb0 2024-09-13T18:49:10.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278012e70 con 0x7f228015acb0 2024-09-13T18:49:10.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22801f3640 con 0x7f228015acb0 2024-09-13T18:49:10.463 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.455+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22800c43a0 con 0x7f228015acb0 2024-09-13T18:49:10.465 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.459+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2278004040 con 0x7f228015acb0 2024-09-13T18:49:10.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.459+0000 7f2276a00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2260066730 0x7f2260068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:10.467 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.459+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6710+0+0 (secure 0 0 0) 0x7f2278022070 con 0x7f228015acb0 2024-09-13T18:49:10.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.463+0000 7f227ea00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2260066730 0x7f2260068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:10.468 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.463+0000 7f227ea00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2260066730 0x7f2260068bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2270009f40 tx=0x7f2270009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:10.473 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.467+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22800c43a0 con 0x7f228015acb0 2024-09-13T18:49:10.663 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:10.655+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22800ccd90 con 0x7f228015acb0 2024-09-13T18:49:11.542 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.535+0000 7f2276a00700 1 -- 172.21.15.32:0/2260089436 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2278057130 con 0x7f228015acb0 2024-09-13T18:49:11.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2260066730 msgr2=0x7f2260068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2260066730 0x7f2260068bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2270009f40 tx=0x7f2270009240 comp rx=0 tx=0).stop 2024-09-13T18:49:11.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 msgr2=0x7f22800c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.548 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 0x7f22800c4680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2278014040 tx=0x7f2278004af0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 shutdown_connections 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f2260066730 0x7f2260068bf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f228015acb0 0x7f22800c4680 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22800cf8e0 0x7f22801e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 --2- 172.21.15.32:0/2260089436 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22800cf500 0x7f22801f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 >> 172.21.15.32:0/2260089436 conn(0x7f2280071dc0 msgr2=0x7f2280153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 shutdown_connections 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.543+0000 7f227fe00700 1 -- 172.21.15.32:0/2260089436 wait complete. 2024-09-13T18:49:11.549 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:49:11.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:49:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.755+0000 7fb104a00700 1 Processor -- start 2024-09-13T18:49:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.755+0000 7fb104a00700 1 -- start start 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.755+0000 7fb104a00700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1001597a0 0x7fb1000c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.755+0000 7fb104a00700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb100153ed0 con 0x7fb100071390 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.755+0000 7fb104a00700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10015cfa0 con 0x7fb100153af0 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.755+0000 7fb104a00700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10015dc20 con 0x7fb1001597a0 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fe800700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb100071390 0x7fb1000ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49342/0 (socket says 172.21.15.32:49342) 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fd400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7fb1001597a0 0x7fb1000c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fe800700 1 -- 172.21.15.32:0/2174645907 learned_addr learned my addr 172.21.15.32:0/2174645907 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:11.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fd400700 1 -- 172.21.15.32:0/2174645907 >> v1:172.21.15.86:6789/0 conn(0x7fb100153af0 legacy=0x7fb1000cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fd400700 1 -- 172.21.15.32:0/2174645907 >> v1:172.21.15.32:6789/0 conn(0x7fb100071390 legacy=0x7fb1000ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fd400700 1 -- 172.21.15.32:0/2174645907 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10015d280 con 0x7fb1001597a0 2024-09-13T18:49:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fca00700 1 -- 172.21.15.32:0/2174645907 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901358493 0 0) 0x7fb100153ed0 con 0x7fb100071390 2024-09-13T18:49:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fd400700 1 --2- 172.21.15.32:0/2174645907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001597a0 0x7fb1000c9e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009850 tx=0x7fb0ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84785307dd49baa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fca00700 1 -- 172.21.15.32:0/2174645907 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec011830 con 0x7fb1001597a0 2024-09-13T18:49:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fca00700 1 -- 172.21.15.32:0/2174645907 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb0ec011990 con 0x7fb1001597a0 2024-09-13T18:49:11.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb0fca00700 1 -- 172.21.15.32:0/2174645907 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec011d40 con 0x7fb1001597a0 2024-09-13T18:49:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb104a00700 1 -- 172.21.15.32:0/2174645907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001597a0 msgr2=0x7fb1000c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb104a00700 1 --2- 172.21.15.32:0/2174645907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001597a0 0x7fb1000c9e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009850 tx=0x7fb0ec009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb104a00700 1 -- 172.21.15.32:0/2174645907 shutdown_connections 2024-09-13T18:49:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb104a00700 1 --2- 172.21.15.32:0/2174645907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1001597a0 0x7fb1000c9e80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb104a00700 1 -- 172.21.15.32:0/2174645907 >> 172.21.15.32:0/2174645907 conn(0x7fb100072540 msgr2=0x7fb100073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.759+0000 7fb104a00700 1 -- 172.21.15.32:0/2174645907 shutdown_connections 2024-09-13T18:49:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 -- 172.21.15.32:0/2174645907 wait complete. 2024-09-13T18:49:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 Processor -- start 2024-09-13T18:49:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 -- start start 2024-09-13T18:49:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 0x7fb10014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100153af0 0x7fb1001f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1001597a0 0x7fb1001f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10014d970 con 0x7fb100071390 2024-09-13T18:49:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001ef4c0 con 0x7fb100153af0 2024-09-13T18:49:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb104a00700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001efd20 con 0x7fb1001597a0 2024-09-13T18:49:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 0x7fb10014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 0x7fb10014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49258/0 (socket says 172.21.15.32:49258) 2024-09-13T18:49:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 -- 172.21.15.32:0/495129226 learned_addr learned my addr 172.21.15.32:0/495129226 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fd400700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100153af0 0x7fb1001f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fe800700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1001597a0 0x7fb1001f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 -- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1001597a0 msgr2=0x7fb1001f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1001597a0 0x7fb1001f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 -- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100153af0 msgr2=0x7fb1001f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100153af0 0x7fb1001f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fde00700 1 -- 172.21.15.32:0/495129226 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0094b0 con 0x7fb100071390 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.763+0000 7fb0fd400700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100153af0 0x7fb1001f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb0fde00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 0x7fb10014f3b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000c500 tx=0x7fb0f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00052d0 con 0x7fb100071390 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb0f0005430 con 0x7fb100071390 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10014d3b0 con 0x7fb100071390 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00055a0 con 0x7fb100071390 2024-09-13T18:49:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1001ef6d0 con 0x7fb100071390 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.767+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10015a7b0 con 0x7fb100071390 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.771+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0f0003900 con 0x7fb100071390 2024-09-13T18:49:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.771+0000 7fb0f6000700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb0e0066730 0x7fb0e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.771+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6272+0+0 (secure 0 0 0) 0x7fb0f0083980 con 0x7fb100071390 2024-09-13T18:49:11.778 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.771+0000 7fb0fd400700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb0e0066730 0x7fb0e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.779 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.771+0000 7fb0fd400700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb0e0066730 0x7fb0e0068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009850 tx=0x7fb0ec01c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.779+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0f00509a0 con 0x7fb100071390 2024-09-13T18:49:11.974 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:11.967+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb100067a00 con 0x7fb100071390 2024-09-13T18:49:12.553 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.547+0000 7fb0f6000700 1 -- 172.21.15.32:0/495129226 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb0f0017020 con 0x7fb100071390 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.551+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb0e0066730 msgr2=0x7fb0e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.551+0000 7fb104a00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb0e0066730 0x7fb0e0068bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009850 tx=0x7fb0ec01c040 comp rx=0 tx=0).stop 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.551+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 msgr2=0x7fb10014f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.551+0000 7fb104a00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 0x7fb10014f3b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000c500 tx=0x7fb0f000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 shutdown_connections 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7fb0e0066730 0x7fb0e0068bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.560 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1001597a0 0x7fb1001f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb100153af0 0x7fb1001f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 --2- 172.21.15.32:0/495129226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb100071390 0x7fb10014f3b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 >> 172.21.15.32:0/495129226 conn(0x7fb100072540 msgr2=0x7fb1000c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 shutdown_connections 2024-09-13T18:49:12.561 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.555+0000 7fb104a00700 1 -- 172.21.15.32:0/495129226 wait complete. 2024-09-13T18:49:12.564 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2024-09-13T18:49:12.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T18:49:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.755+0000 7f60a9800700 1 Processor -- start 2024-09-13T18:49:12.760 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.755+0000 7f60a9800700 1 -- start start 2024-09-13T18:49:12.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.755+0000 7f60a9800700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60a4072080 0x7f60a4162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.755+0000 7f60a9800700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a4158600 con 0x7f60a4154f90 2024-09-13T18:49:12.762 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.755+0000 7f60a9800700 1 -- --> v1:172.21.15.86:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a40aa310 con 0x7f60a4071b80 2024-09-13T18:49:12.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.755+0000 7f60a9800700 1 -- --> v2:172.21.15.86:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40ca620 con 0x7f60a4072080 2024-09-13T18:49:12.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a3400700 1 --2- >> v2:172.21.15.86:3300/0 conn(0x7f60a4072080 0x7f60a4162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a2a00700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f60a4154f90 0x7f60a4157ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49344/0 (socket says 172.21.15.32:49344) 2024-09-13T18:49:12.763 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a2a00700 1 -- 172.21.15.32:0/3476993514 learned_addr learned my addr 172.21.15.32:0/3476993514 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-09-13T18:49:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a3400700 1 -- 172.21.15.32:0/3476993514 >> v1:172.21.15.86:6789/0 conn(0x7f60a4071b80 legacy=0x7f60a40a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a3400700 1 -- 172.21.15.32:0/3476993514 >> v1:172.21.15.32:6789/0 conn(0x7f60a4154f90 legacy=0x7f60a4157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a3400700 1 -- 172.21.15.32:0/3476993514 --> v2:172.21.15.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40ca900 con 0x7f60a4072080 2024-09-13T18:49:12.764 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a3400700 1 --2- 172.21.15.32:0/3476993514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a4162f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f609c009d90 tx=0x7f609c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e72559faee3536 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a1600700 1 -- 172.21.15.32:0/3476993514 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00e070 con 0x7f60a4072080 2024-09-13T18:49:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a1600700 1 -- 172.21.15.32:0/3476993514 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f609c00bbd0 con 0x7f60a4072080 2024-09-13T18:49:12.765 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a1600700 1 -- 172.21.15.32:0/3476993514 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c012430 con 0x7f60a4072080 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 -- 172.21.15.32:0/3476993514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 msgr2=0x7f60a4162f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 --2- 172.21.15.32:0/3476993514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a4162f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f609c009d90 tx=0x7f609c00b330 comp rx=0 tx=0).stop 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 -- 172.21.15.32:0/3476993514 shutdown_connections 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 --2- 172.21.15.32:0/3476993514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a4162f70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 -- 172.21.15.32:0/3476993514 >> 172.21.15.32:0/3476993514 conn(0x7f60a40accb0 msgr2=0x7f60a40ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 -- 172.21.15.32:0/3476993514 shutdown_connections 2024-09-13T18:49:12.766 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.759+0000 7f60a9800700 1 -- 172.21.15.32:0/3476993514 wait complete. 2024-09-13T18:49:12.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 Processor -- start 2024-09-13T18:49:12.768 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 -- start start 2024-09-13T18:49:12.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60a4071b80 0x7f60a41e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a40c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 0x7f60a40c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a406cd50 con 0x7f60a4071b80 2024-09-13T18:49:12.769 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a406e810 con 0x7f60a4072080 2024-09-13T18:49:12.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a9800700 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c0af0 con 0x7f60a4154f90 2024-09-13T18:49:12.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a2a00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60a4071b80 0x7f60a41e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.770 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 0x7f60a40c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 0x7f60a40c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.32:35504/0 (socket says 172.21.15.32:35504) 2024-09-13T18:49:12.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 -- 172.21.15.32:0/2896411935 learned_addr learned my addr 172.21.15.32:0/2896411935 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-09-13T18:49:12.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a2000700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a40c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 -- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 msgr2=0x7f60a40c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a40c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.772 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 -- 172.21.15.32:0/2896411935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60a4071b80 msgr2=0x7f60a41e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60a4071b80 0x7f60a41e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 -- 172.21.15.32:0/2896411935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c009a70 con 0x7f60a4154f90 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a2000700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a40c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.763+0000 7f60a3400700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 0x7f60a40c14c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f60a40c7960 tx=0x7f609c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c012430 con 0x7f60a4154f90 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f609c020070 con 0x7f60a4154f90 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0042a0 con 0x7f60a4154f90 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a406c5c0 con 0x7f60a4154f90 2024-09-13T18:49:12.773 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a406df70 con 0x7f60a4154f90 2024-09-13T18:49:12.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a4067a40 con 0x7f60a4154f90 2024-09-13T18:49:12.774 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.767+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f609c004400 con 0x7f60a4154f90 2024-09-13T18:49:12.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.771+0000 7f609aa00700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6084066730 0x7f6084068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.776 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.771+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f609c022070 con 0x7f60a4154f90 2024-09-13T18:49:12.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.771+0000 7f60a2a00700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6084066730 0x7f6084068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.777 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.771+0000 7f60a2a00700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6084066730 0x7f6084068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6094005930 tx=0x7f6094009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.783+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f609c053670 con 0x7f60a4154f90 2024-09-13T18:49:12.985 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:12.979+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60a40a9f80 con 0x7f60a4154f90 2024-09-13T18:49:13.565 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.559+0000 7f609aa00700 1 -- 172.21.15.32:0/2896411935 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v85) v1 ==== 178+0+0 (secure 0 0 0) 0x7f609c056c90 con 0x7f60a4154f90 2024-09-13T18:49:13.570 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6084066730 msgr2=0x7f6084068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6084066730 0x7f6084068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6094005930 tx=0x7f6094009040 comp rx=0 tx=0).stop 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 msgr2=0x7f60a40c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 0x7f60a40c14c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f60a40c7960 tx=0x7f609c004af0 comp rx=0 tx=0).stop 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 shutdown_connections 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:6832/184658639,v1:172.21.15.86:6833/184658639] conn(0x7f6084066730 0x7f6084068bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f60a4154f90 0x7f60a40c14c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60a4072080 0x7f60a40c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 --2- 172.21.15.32:0/2896411935 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60a4071b80 0x7f60a41e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 >> 172.21.15.32:0/2896411935 conn(0x7f60a40accb0 msgr2=0x7f60a40a9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 shutdown_connections 2024-09-13T18:49:13.571 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-13T18:49:13.563+0000 7f60a9800700 1 -- 172.21.15.32:0/2896411935 wait complete. 2024-09-13T18:49:13.572 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data_ec' removed 2024-09-13T18:49:13.593 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:49:13.593 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:49:13.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:13.619 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:49:13.619 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:49:13.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:13.690 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:49:13.690 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-13T18:49:13.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:13.756 INFO:tasks.ceph.mds.e:Stopped 2024-09-13T18:49:13.756 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:49:13.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:13.772 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:49:13.772 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:49:13.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:13.836 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:49:13.836 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-13T18:49:13.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:13.849 INFO:tasks.ceph.mds.f:Stopped 2024-09-13T18:49:13.849 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:49:13.850 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:49:13.850 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:17.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T18:49:19.951 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:49:19.951 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:49:19.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:20.046 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:49:20.047 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:49:20.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:20.139 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:49:20.139 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:49:20.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:20.239 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:49:20.239 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:49:20.239 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:20.327 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:49:20.327 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:49:20.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:23.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T18:49:23.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T18:49:23.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:23.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:26.429 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:49:26.429 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:49:26.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.519 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:49:26.519 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:49:26.519 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.611 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:49:26.611 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:49:26.611 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:49:26.611 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.682 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:49:26.682 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:49:26.682 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.712 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:49:26.712 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:49:26.712 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:49:26.713 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.752 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:49:26.752 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:49:26.753 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.803 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:49:26.803 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:49:26.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:49:26.859 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:49:26.859 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:49:26.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2024-09-13T18:49:26.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:49:26.924 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:49:27.194 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:49:27.194 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:49:27.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:49:27.565 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:49:27.785 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:49:27.785 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:49:28.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:49:28.005 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:49:28.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:49:28.335 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:49:28.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T18:49:28.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:49:28.640 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:49:28.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:49:28.802 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:49:28.978 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:49:28.979 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/data/mon.a.tgz 2024-09-13T18:49:28.979 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-13T18:49:28.997 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.LXN2cM3bRa 2024-09-13T18:49:28.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LXN2cM3bRa 2024-09-13T18:49:29.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.LXN2cM3bRa 2024-09-13T18:49:29.269 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.LXN2cM3bRa is 363KB 2024-09-13T18:49:29.346 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.LXN2cM3bRa 2024-09-13T18:49:29.367 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/data/mon.b.tgz 2024-09-13T18:49:29.367 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-13T18:49:29.375 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.VKKWYw4rZb 2024-09-13T18:49:29.375 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VKKWYw4rZb 2024-09-13T18:49:29.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.VKKWYw4rZb 2024-09-13T18:49:29.569 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.VKKWYw4rZb is 502KB 2024-09-13T18:49:29.635 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.VKKWYw4rZb 2024-09-13T18:49:29.642 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/data/mon.c.tgz 2024-09-13T18:49:29.642 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-13T18:49:29.649 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.7rQG6dMsQB 2024-09-13T18:49:29.649 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7rQG6dMsQB 2024-09-13T18:49:29.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.7rQG6dMsQB 2024-09-13T18:49:29.842 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.7rQG6dMsQB is 502KB 2024-09-13T18:49:29.907 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.7rQG6dMsQB 2024-09-13T18:49:29.914 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:49:29.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:49:29.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:49:29.949 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:49:29.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:49:29.996 DEBUG:teuthology.orchestra.run.smithi086:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:49:30.022 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:49:30.045 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:49:30.061 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:49:30.062 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/remote/smithi032/crash 2024-09-13T18:49:30.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:49:30.096 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/remote/smithi086/crash 2024-09-13T18:49:30.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:49:30.113 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:49:30.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:30.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:30.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:30.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:30.249 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:49:30.250 DEBUG:teuthology.orchestra.run.smithi032:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:49:30.288 DEBUG:teuthology.orchestra.run.smithi086:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:49:35.370 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:49:35.371 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/remote/smithi032/log 2024-09-13T18:49:35.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:49:36.150 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/remote/smithi086/log 2024-09-13T18:49:36.150 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:49:36.692 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:49:36.703 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:49:36.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:49:36.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:49:36.805 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:49:36.813 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:49:36.814 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:49:36.819 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:49:36.844 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:49:36.844 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-13T18:49:36.844 INFO:teuthology.orchestra.run.smithi086.stdout:+hv01.front.sepi 67.205.162.81 3 u 24 64 377 0.096 0.230 2.710 2024-09-13T18:49:36.844 INFO:teuthology.orchestra.run.smithi086.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 377 0.097 -3.981 2.690 2024-09-13T18:49:36.844 INFO:teuthology.orchestra.run.smithi086.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.082 0.452 2.676 2024-09-13T18:49:36.844 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:49:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:49:36.855 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-13T18:49:36.855 INFO:teuthology.orchestra.run.smithi032.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.094 1.793 1.300 2024-09-13T18:49:36.855 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 27 64 377 0.110 -3.893 0.760 2024-09-13T18:49:36.856 INFO:teuthology.orchestra.run.smithi032.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.114 0.208 1.069 2024-09-13T18:49:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:49:36.857 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:49:36.866 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:49:36.867 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:49:37.047 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:49:37.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:49:37.067 INFO:teuthology.task.internal:Duration was 999.658664 seconds 2024-09-13T18:49:37.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:49:37.330 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:49:37.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:49:37.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:49:37.483 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:49:37.483 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-09-13T18:49:37.483 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:49:37.515 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-13T18:49:37.516 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:49:37.533 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:49:37.533 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:49:37.568 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:49:37.637 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:49:37.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:49:37.641 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:49:37.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:49:37.760 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:49:37.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:49:37.798 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:49:37.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:49:37.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:49:37.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:49:37.871 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-13T18:49:37.872 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-09-13T18:49:37.903 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:49:37.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:49:37.962 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:49:37.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:49:37.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:49:37.988 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:49:37.989 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/remote/smithi032 2024-09-13T18:49:37.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:49:38.053 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903998/remote/smithi086 2024-09-13T18:49:38.053 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:49:38.080 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:49:38.080 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:49:38.100 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:49:38.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:49:38.127 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:49:38.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:49:38.224 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:49:38.224 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:49:38.230 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:49:38.238 INFO:teuthology.orchestra.run.smithi086.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:49 /home/ubuntu/cephtest 2024-09-13T18:49:38.245 INFO:teuthology.orchestra.run.smithi032.stdout: 1181014 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:49 /home/ubuntu/cephtest 2024-09-13T18:49:38.251 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:49:38.445 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:49:38.962 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} duration: 999.6586635112762 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:49:38.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:49:39.053 INFO:teuthology.run:pass